[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:15:25.038964 21244 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.191.62:41215
I20260709 12:15:25.040547 21244 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:15:25.041673 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:25.058475 21253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:25.058532 21250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:25.058532 21251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:25.059926 21244 server_base.cc:1061] running on GCE node
I20260709 12:15:26.175748 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:26.176023 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:26.176213 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599326176193 us; error 0 us; skew 500 ppm
I20260709 12:15:26.177037 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:26.183220 21244 webserver.cc:533] Webserver started at http://127.20.191.62:34453/ using document root <none> and password file <none>
I20260709 12:15:26.184103 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:26.184329 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:26.184779 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:26.190603 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/master-0-root/instance:
uuid: "0714e974dc4c4da4bea88940fc8eb0d9"
format_stamp: "Formatted at 2026-07-09 12:15:26 on dist-test-slave-7c1h"
I20260709 12:15:26.199797 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:15:26.206647 21259 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:26.207939 21244 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:15:26.208292 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/master-0-root
uuid: "0714e974dc4c4da4bea88940fc8eb0d9"
format_stamp: "Formatted at 2026-07-09 12:15:26 on dist-test-slave-7c1h"
I20260709 12:15:26.208652 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:26.260980 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:26.262629 21244 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:15:26.263059 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:26.332605 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.62:41215
I20260709 12:15:26.332669 21310 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.62:41215 every 8 connection(s)
I20260709 12:15:26.340538 21311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.363257 21311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9: Bootstrap starting.
I20260709 12:15:26.369421 21311 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.371342 21311 log.cc:826] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9: Log is configured to *not* fsync() on all Append() calls
I20260709 12:15:26.376216 21311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9: No bootstrap required, opened a new log
I20260709 12:15:26.397473 21311 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0714e974dc4c4da4bea88940fc8eb0d9" member_type: VOTER }
I20260709 12:15:26.398135 21311 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.398350 21311 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0714e974dc4c4da4bea88940fc8eb0d9, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.399473 21311 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0714e974dc4c4da4bea88940fc8eb0d9" member_type: VOTER }
I20260709 12:15:26.400043 21311 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:26.400334 21311 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:26.400662 21311 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:26.405038 21311 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0714e974dc4c4da4bea88940fc8eb0d9" member_type: VOTER }
I20260709 12:15:26.405906 21311 leader_election.cc:304] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0714e974dc4c4da4bea88940fc8eb0d9; no voters: 
I20260709 12:15:26.407644 21311 leader_election.cc:290] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:26.407989 21314 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:26.410109 21314 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [term 1 LEADER]: Becoming Leader. State: Replica: 0714e974dc4c4da4bea88940fc8eb0d9, State: Running, Role: LEADER
I20260709 12:15:26.411058 21314 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0714e974dc4c4da4bea88940fc8eb0d9" member_type: VOTER }
I20260709 12:15:26.412189 21311 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:26.422523 21316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0714e974dc4c4da4bea88940fc8eb0d9. Latest consensus state: current_term: 1 leader_uuid: "0714e974dc4c4da4bea88940fc8eb0d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0714e974dc4c4da4bea88940fc8eb0d9" member_type: VOTER } }
I20260709 12:15:26.422533 21315 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0714e974dc4c4da4bea88940fc8eb0d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0714e974dc4c4da4bea88940fc8eb0d9" member_type: VOTER } }
I20260709 12:15:26.423372 21316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:26.423470 21315 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:26.426476 21324 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:26.437271 21324 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:26.439867 21244 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:26.456601 21324 catalog_manager.cc:1383] Generated new cluster ID: a1a3e3d5b9ef4907a9fc92bca0630e1f
I20260709 12:15:26.456943 21324 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:26.486796 21324 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:26.488982 21324 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:26.504405 21324 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9: Generated new TSK 0
I20260709 12:15:26.505652 21324 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:26.574086 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:26.582479 21333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:26.584954 21334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:26.586587 21336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:26.587679 21244 server_base.cc:1061] running on GCE node
I20260709 12:15:26.588610 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:26.588893 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:26.589099 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599326589079 us; error 0 us; skew 500 ppm
I20260709 12:15:26.589951 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:26.593994 21244 webserver.cc:533] Webserver started at http://127.20.191.1:38747/ using document root <none> and password file <none>
I20260709 12:15:26.594733 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:26.595010 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:26.595366 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:26.596949 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/ts-0-root/instance:
uuid: "51a448f6f27940929352af4a932e7b8c"
format_stamp: "Formatted at 2026-07-09 12:15:26 on dist-test-slave-7c1h"
I20260709 12:15:26.603912 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.009s	sys 0.000s
I20260709 12:15:26.609180 21341 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:26.610028 21244 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:15:26.610330 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/ts-0-root
uuid: "51a448f6f27940929352af4a932e7b8c"
format_stamp: "Formatted at 2026-07-09 12:15:26 on dist-test-slave-7c1h"
I20260709 12:15:26.610627 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:26.634732 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:26.636165 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:26.638816 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:26.643060 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:26.643325 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:26.643589 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:26.643765 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:26.739902 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.1:41619
I20260709 12:15:26.739969 21403 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.1:41619 every 8 connection(s)
I20260709 12:15:26.746862 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:26.761457 21408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:26.763797 21409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:26.767681 21411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:26.767930 21244 server_base.cc:1061] running on GCE node
I20260709 12:15:26.768962 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:26.769251 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:26.769444 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599326769427 us; error 0 us; skew 500 ppm
I20260709 12:15:26.770244 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:26.775847 21244 webserver.cc:533] Webserver started at http://127.20.191.2:37475/ using document root <none> and password file <none>
I20260709 12:15:26.776489 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:26.776764 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:26.777124 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:26.778623 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/ts-1-root/instance:
uuid: "84e01d71b0d1448d8c2b91f68282fa47"
format_stamp: "Formatted at 2026-07-09 12:15:26 on dist-test-slave-7c1h"
I20260709 12:15:26.780326 21404 heartbeater.cc:344] Connected to a master server at 127.20.191.62:41215
I20260709 12:15:26.780855 21404 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:26.782119 21404 heartbeater.cc:507] Master 127.20.191.62:41215 requested a full tablet report, sending...
I20260709 12:15:26.785373 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:15:26.786168 21276 ts_manager.cc:194] Registered new tserver with Master: 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619)
I20260709 12:15:26.789516 21276 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41718
I20260709 12:15:26.790138 21416 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:26.791051 21244 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:15:26.791440 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/ts-1-root
uuid: "84e01d71b0d1448d8c2b91f68282fa47"
format_stamp: "Formatted at 2026-07-09 12:15:26 on dist-test-slave-7c1h"
I20260709 12:15:26.791792 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:26.826303 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:26.827603 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:26.830006 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:26.833400 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:26.833632 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:26.833904 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:26.834085 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:26.926646 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.2:46135
I20260709 12:15:26.926743 21478 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.2:46135 every 8 connection(s)
I20260709 12:15:26.934806 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:26.943634 21482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:26.949330 21479 heartbeater.cc:344] Connected to a master server at 127.20.191.62:41215
I20260709 12:15:26.949818 21479 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:26.950834 21479 heartbeater.cc:507] Master 127.20.191.62:41215 requested a full tablet report, sending...
I20260709 12:15:26.953871 21276 ts_manager.cc:194] Registered new tserver with Master: 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135)
W20260709 12:15:26.954762 21483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:26.955317 21244 server_base.cc:1061] running on GCE node
W20260709 12:15:26.955435 21485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:26.955922 21276 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41722
I20260709 12:15:26.956524 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:26.956729 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:26.956919 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599326956900 us; error 0 us; skew 500 ppm
I20260709 12:15:26.957653 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:26.960522 21244 webserver.cc:533] Webserver started at http://127.20.191.3:41521/ using document root <none> and password file <none>
I20260709 12:15:26.961002 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:26.961194 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:26.961478 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:26.962637 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/ts-2-root/instance:
uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
format_stamp: "Formatted at 2026-07-09 12:15:26 on dist-test-slave-7c1h"
I20260709 12:15:26.967443 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:15:26.971027 21490 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:26.971958 21244 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:15:26.972276 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/ts-2-root
uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
format_stamp: "Formatted at 2026-07-09 12:15:26 on dist-test-slave-7c1h"
I20260709 12:15:26.972627 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599324869158-21244-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:26.987202 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:26.988847 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:26.991616 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:26.995028 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:26.995251 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:26.995507 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:26.995721 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:27.081244 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.3:33737
I20260709 12:15:27.081349 21552 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.3:33737 every 8 connection(s)
I20260709 12:15:27.099225 21553 heartbeater.cc:344] Connected to a master server at 127.20.191.62:41215
I20260709 12:15:27.099583 21553 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:27.100447 21553 heartbeater.cc:507] Master 127.20.191.62:41215 requested a full tablet report, sending...
I20260709 12:15:27.102753 21276 ts_manager.cc:194] Registered new tserver with Master: b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:27.102870 21244 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01356955s
I20260709 12:15:27.104622 21276 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41724
I20260709 12:15:27.159492 21276 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41726:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:27.163187 21276 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:27.264407 21517 tablet_service.cc:1511] Processing CreateTablet for tablet 085f9d2aa8b14024bf9a0ede6dfd793f (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:27.266223 21517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085f9d2aa8b14024bf9a0ede6dfd793f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.267750 21518 tablet_service.cc:1511] Processing CreateTablet for tablet 381f594f7b0d47cc96959e331c3d590d (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:27.265527 21516 tablet_service.cc:1511] Processing CreateTablet for tablet 718268da3eb54ad8b465d405d5fcd735 (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:27.270663 21518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381f594f7b0d47cc96959e331c3d590d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.267688 21515 tablet_service.cc:1511] Processing CreateTablet for tablet c9a921c7007f40bc934700567f0794ba (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:27.271952 21516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 718268da3eb54ad8b465d405d5fcd735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.275274 21515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a921c7007f40bc934700567f0794ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.277451 21514 tablet_service.cc:1511] Processing CreateTablet for tablet 8c7849f4e74a431a842e898c587b05cd (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:27.278906 21514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c7849f4e74a431a842e898c587b05cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.288080 21364 tablet_service.cc:1511] Processing CreateTablet for tablet 71c8fc47649e4defa79f85f626d3df0b (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:27.288482 21513 tablet_service.cc:1511] Processing CreateTablet for tablet 71c8fc47649e4defa79f85f626d3df0b (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:27.291452 21364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c8fc47649e4defa79f85f626d3df0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.296970 21513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c8fc47649e4defa79f85f626d3df0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.306035 21369 tablet_service.cc:1511] Processing CreateTablet for tablet 381f594f7b0d47cc96959e331c3d590d (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:27.307660 21369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381f594f7b0d47cc96959e331c3d590d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.313486 21368 tablet_service.cc:1511] Processing CreateTablet for tablet 085f9d2aa8b14024bf9a0ede6dfd793f (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:27.319895 21368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085f9d2aa8b14024bf9a0ede6dfd793f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.321555 21512 tablet_service.cc:1511] Processing CreateTablet for tablet f5438539aad6445ba4c38165117e192f (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:27.323328 21512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5438539aad6445ba4c38165117e192f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.324607 21365 tablet_service.cc:1511] Processing CreateTablet for tablet 8c7849f4e74a431a842e898c587b05cd (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:27.327425 21366 tablet_service.cc:1511] Processing CreateTablet for tablet c9a921c7007f40bc934700567f0794ba (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:27.329628 21363 tablet_service.cc:1511] Processing CreateTablet for tablet f5438539aad6445ba4c38165117e192f (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:27.326426 21367 tablet_service.cc:1511] Processing CreateTablet for tablet 718268da3eb54ad8b465d405d5fcd735 (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:27.333599 21365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c7849f4e74a431a842e898c587b05cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.334621 21367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 718268da3eb54ad8b465d405d5fcd735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.338073 21366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a921c7007f40bc934700567f0794ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.340500 21363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5438539aad6445ba4c38165117e192f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.355060 21362 tablet_service.cc:1511] Processing CreateTablet for tablet d119589772a243009b0526b813d6b272 (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:27.365178 21362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d119589772a243009b0526b813d6b272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.373957 21511 tablet_service.cc:1511] Processing CreateTablet for tablet d119589772a243009b0526b813d6b272 (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:27.385483 21440 tablet_service.cc:1511] Processing CreateTablet for tablet 8c7849f4e74a431a842e898c587b05cd (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:27.387044 21440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c7849f4e74a431a842e898c587b05cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.388926 21510 tablet_service.cc:1511] Processing CreateTablet for tablet ce6dde0da5d248dfb543e1986223fbd2 (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:27.390431 21510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6dde0da5d248dfb543e1986223fbd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.393122 21443 tablet_service.cc:1511] Processing CreateTablet for tablet 085f9d2aa8b14024bf9a0ede6dfd793f (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:27.394771 21443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085f9d2aa8b14024bf9a0ede6dfd793f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.377513 21444 tablet_service.cc:1511] Processing CreateTablet for tablet 381f594f7b0d47cc96959e331c3d590d (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:27.398188 21511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d119589772a243009b0526b813d6b272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.409543 21444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381f594f7b0d47cc96959e331c3d590d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.405962 21441 tablet_service.cc:1511] Processing CreateTablet for tablet c9a921c7007f40bc934700567f0794ba (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:27.405133 21442 tablet_service.cc:1511] Processing CreateTablet for tablet 718268da3eb54ad8b465d405d5fcd735 (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:27.436354 21442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 718268da3eb54ad8b465d405d5fcd735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.445851 21571 tablet_bootstrap.cc:492] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d: Bootstrap starting.
I20260709 12:15:27.426708 21438 tablet_service.cc:1511] Processing CreateTablet for tablet f5438539aad6445ba4c38165117e192f (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:27.445720 21436 tablet_service.cc:1511] Processing CreateTablet for tablet ce6dde0da5d248dfb543e1986223fbd2 (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:27.451898 21436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6dde0da5d248dfb543e1986223fbd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.442775 21361 tablet_service.cc:1511] Processing CreateTablet for tablet ce6dde0da5d248dfb543e1986223fbd2 (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:27.434212 21439 tablet_service.cc:1511] Processing CreateTablet for tablet 71c8fc47649e4defa79f85f626d3df0b (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:27.459489 21361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6dde0da5d248dfb543e1986223fbd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.464653 21439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c8fc47649e4defa79f85f626d3df0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.466940 21437 tablet_service.cc:1511] Processing CreateTablet for tablet d119589772a243009b0526b813d6b272 (DEFAULT_TABLE table=test-workload [id=afb69147a1b249118d4b3de9f547a89f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:27.469682 21438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5438539aad6445ba4c38165117e192f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:27.486817 21323 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:27.482739 21437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d119589772a243009b0526b813d6b272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.515093 21571 tablet_bootstrap.cc:654] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.529449 21441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a921c7007f40bc934700567f0794ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.571756 21572 tablet_bootstrap.cc:492] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c: Bootstrap starting.
I20260709 12:15:27.579082 21571 tablet_bootstrap.cc:492] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d: No bootstrap required, opened a new log
I20260709 12:15:27.579622 21571 ts_tablet_manager.cc:1403] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d: Time spent bootstrapping tablet: real 0.151s	user 0.010s	sys 0.014s
I20260709 12:15:27.586918 21573 tablet_bootstrap.cc:492] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47: Bootstrap starting.
I20260709 12:15:27.594595 21571 raft_consensus.cc:359] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.595463 21571 raft_consensus.cc:385] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.595762 21571 raft_consensus.cc:740] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.597681 21571 consensus_queue.cc:260] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.602017 21553 heartbeater.cc:499] Master 127.20.191.62:41215 was elected leader, sending a full tablet report...
I20260709 12:15:27.602895 21571 ts_tablet_manager.cc:1434] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.004s
I20260709 12:15:27.603917 21571 tablet_bootstrap.cc:492] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d: Bootstrap starting.
I20260709 12:15:27.600562 21572 tablet_bootstrap.cc:654] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.614506 21573 tablet_bootstrap.cc:654] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.620800 21571 tablet_bootstrap.cc:654] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.629654 21572 tablet_bootstrap.cc:492] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c: No bootstrap required, opened a new log
I20260709 12:15:27.630158 21572 ts_tablet_manager.cc:1403] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.004s
I20260709 12:15:27.631145 21573 tablet_bootstrap.cc:492] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47: No bootstrap required, opened a new log
I20260709 12:15:27.631596 21573 ts_tablet_manager.cc:1403] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.005s
I20260709 12:15:27.632833 21572 raft_consensus.cc:359] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.633569 21572 raft_consensus.cc:385] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.633886 21572 raft_consensus.cc:740] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.634764 21572 consensus_queue.cc:260] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.636960 21404 heartbeater.cc:499] Master 127.20.191.62:41215 was elected leader, sending a full tablet report...
I20260709 12:15:27.637446 21572 ts_tablet_manager.cc:1434] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:15:27.638476 21572 tablet_bootstrap.cc:492] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c: Bootstrap starting.
I20260709 12:15:27.639252 21573 raft_consensus.cc:359] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.641077 21573 raft_consensus.cc:385] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.641832 21573 raft_consensus.cc:740] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.643821 21573 consensus_queue.cc:260] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.646016 21572 tablet_bootstrap.cc:654] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.646708 21571 tablet_bootstrap.cc:492] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d: No bootstrap required, opened a new log
I20260709 12:15:27.650630 21571 ts_tablet_manager.cc:1403] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.007s
I20260709 12:15:27.653640 21571 raft_consensus.cc:359] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.654449 21571 raft_consensus.cc:385] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.654743 21571 raft_consensus.cc:740] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.655479 21571 consensus_queue.cc:260] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.659001 21479 heartbeater.cc:499] Master 127.20.191.62:41215 was elected leader, sending a full tablet report...
I20260709 12:15:27.660184 21573 ts_tablet_manager.cc:1434] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.012s
I20260709 12:15:27.661186 21573 tablet_bootstrap.cc:492] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47: Bootstrap starting.
I20260709 12:15:27.661252 21571 ts_tablet_manager.cc:1434] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:15:27.663096 21571 tablet_bootstrap.cc:492] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d: Bootstrap starting.
I20260709 12:15:27.668116 21573 tablet_bootstrap.cc:654] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.671809 21572 tablet_bootstrap.cc:492] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c: No bootstrap required, opened a new log
I20260709 12:15:27.672341 21572 ts_tablet_manager.cc:1403] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c: Time spent bootstrapping tablet: real 0.034s	user 0.004s	sys 0.008s
I20260709 12:15:27.675222 21572 raft_consensus.cc:359] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.676299 21572 raft_consensus.cc:385] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.676596 21572 raft_consensus.cc:740] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.677311 21572 consensus_queue.cc:260] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.679432 21572 ts_tablet_manager.cc:1434] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:15:27.680311 21572 tablet_bootstrap.cc:492] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c: Bootstrap starting.
I20260709 12:15:27.669391 21571 tablet_bootstrap.cc:654] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:27.687374 21480 tablet.cc:2406] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:15:27.690310 21572 tablet_bootstrap.cc:654] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.700286 21573 tablet_bootstrap.cc:492] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47: No bootstrap required, opened a new log
I20260709 12:15:27.700773 21573 ts_tablet_manager.cc:1403] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.003s
I20260709 12:15:27.708735 21573 raft_consensus.cc:359] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:27.709555 21573 raft_consensus.cc:385] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.710013 21573 raft_consensus.cc:740] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.710908 21571 tablet_bootstrap.cc:492] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d: No bootstrap required, opened a new log
I20260709 12:15:27.711185 21572 tablet_bootstrap.cc:492] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c: No bootstrap required, opened a new log
I20260709 12:15:27.711563 21571 ts_tablet_manager.cc:1403] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.016s
I20260709 12:15:27.711819 21572 ts_tablet_manager.cc:1403] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.003s
I20260709 12:15:27.710948 21573 consensus_queue.cc:260] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:27.714440 21572 raft_consensus.cc:359] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.715170 21572 raft_consensus.cc:385] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.715459 21572 raft_consensus.cc:740] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.716181 21572 consensus_queue.cc:260] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.723516 21573 ts_tablet_manager.cc:1434] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.003s
I20260709 12:15:27.724644 21573 tablet_bootstrap.cc:492] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47: Bootstrap starting.
I20260709 12:15:27.724274 21571 raft_consensus.cc:359] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.725222 21571 raft_consensus.cc:385] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.725596 21571 raft_consensus.cc:740] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.726629 21571 consensus_queue.cc:260] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.731922 21573 tablet_bootstrap.cc:654] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.733649 21572 ts_tablet_manager.cc:1434] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:15:27.734786 21572 tablet_bootstrap.cc:492] T 71c8fc47649e4defa79f85f626d3df0b P 51a448f6f27940929352af4a932e7b8c: Bootstrap starting.
I20260709 12:15:27.737993 21571 ts_tablet_manager.cc:1434] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:15:27.739148 21571 tablet_bootstrap.cc:492] T c9a921c7007f40bc934700567f0794ba P b7141e8c8cd04e61a34cd263fda83b3d: Bootstrap starting.
I20260709 12:15:27.743511 21573 tablet_bootstrap.cc:492] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47: No bootstrap required, opened a new log
I20260709 12:15:27.744057 21573 ts_tablet_manager.cc:1403] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 12:15:27.746182 21571 tablet_bootstrap.cc:654] T c9a921c7007f40bc934700567f0794ba P b7141e8c8cd04e61a34cd263fda83b3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.749493 21575 raft_consensus.cc:493] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.750033 21575 raft_consensus.cc:515] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.753137 21575 leader_election.cc:290] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135)
I20260709 12:15:27.748536 21573 raft_consensus.cc:359] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.753993 21573 raft_consensus.cc:385] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.754350 21573 raft_consensus.cc:740] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.755134 21573 consensus_queue.cc:260] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.757979 21573 ts_tablet_manager.cc:1434] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:15:27.758663 21572 tablet_bootstrap.cc:654] T 71c8fc47649e4defa79f85f626d3df0b P 51a448f6f27940929352af4a932e7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.759128 21573 tablet_bootstrap.cc:492] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47: Bootstrap starting.
I20260709 12:15:27.765053 21575 raft_consensus.cc:493] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.765585 21575 raft_consensus.cc:515] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.768038 21575 leader_election.cc:290] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135)
I20260709 12:15:27.770475 21573 tablet_bootstrap.cc:654] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.780522 21573 tablet_bootstrap.cc:492] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47: No bootstrap required, opened a new log
I20260709 12:15:27.781040 21573 ts_tablet_manager.cc:1403] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.007s
I20260709 12:15:27.781724 21571 tablet_bootstrap.cc:492] T c9a921c7007f40bc934700567f0794ba P b7141e8c8cd04e61a34cd263fda83b3d: No bootstrap required, opened a new log
I20260709 12:15:27.781669 21580 raft_consensus.cc:493] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.782394 21571 ts_tablet_manager.cc:1403] T c9a921c7007f40bc934700567f0794ba P b7141e8c8cd04e61a34cd263fda83b3d: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.007s
I20260709 12:15:27.782333 21580 raft_consensus.cc:515] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.784811 21379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718268da3eb54ad8b465d405d5fcd735" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51a448f6f27940929352af4a932e7b8c" is_pre_election: true
I20260709 12:15:27.785117 21580 leader_election.cc:290] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:27.785656 21379 raft_consensus.cc:2468] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7141e8c8cd04e61a34cd263fda83b3d in term 0.
I20260709 12:15:27.784953 21378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5438539aad6445ba4c38165117e192f" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51a448f6f27940929352af4a932e7b8c" is_pre_election: true
I20260709 12:15:27.789573 21572 tablet_bootstrap.cc:492] T 71c8fc47649e4defa79f85f626d3df0b P 51a448f6f27940929352af4a932e7b8c: No bootstrap required, opened a new log
I20260709 12:15:27.790072 21572 ts_tablet_manager.cc:1403] T 71c8fc47649e4defa79f85f626d3df0b P 51a448f6f27940929352af4a932e7b8c: Time spent bootstrapping tablet: real 0.056s	user 0.002s	sys 0.010s
I20260709 12:15:27.788517 21491 leader_election.cc:304] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:27.791667 21575 raft_consensus.cc:2804] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:27.792038 21575 raft_consensus.cc:493] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.792346 21575 raft_consensus.cc:3060] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:27.795193 21491 leader_election.cc:343] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.800139 21571 raft_consensus.cc:359] T c9a921c7007f40bc934700567f0794ba P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.802333 21579 raft_consensus.cc:493] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.804277 21573 raft_consensus.cc:359] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.806046 21573 raft_consensus.cc:385] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.801441 21575 raft_consensus.cc:515] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.806442 21573 raft_consensus.cc:740] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.805891 21579 raft_consensus.cc:515] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.807233 21573 consensus_queue.cc:260] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.808605 21575 leader_election.cc:290] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 election: Requested vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135)
I20260709 12:15:27.806355 21572 raft_consensus.cc:359] T 71c8fc47649e4defa79f85f626d3df0b P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.809758 21572 raft_consensus.cc:385] T 71c8fc47649e4defa79f85f626d3df0b P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.810114 21572 raft_consensus.cc:740] T 71c8fc47649e4defa79f85f626d3df0b P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.810904 21572 consensus_queue.cc:260] T 71c8fc47649e4defa79f85f626d3df0b P 51a448f6f27940929352af4a932e7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.813131 21579 leader_election.cc:290] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:27.816854 21573 ts_tablet_manager.cc:1434] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 12:15:27.818137 21573 tablet_bootstrap.cc:492] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47: Bootstrap starting.
I20260709 12:15:27.805900 21571 raft_consensus.cc:385] T c9a921c7007f40bc934700567f0794ba P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.843044 21378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718268da3eb54ad8b465d405d5fcd735" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51a448f6f27940929352af4a932e7b8c"
I20260709 12:15:27.843696 21378 raft_consensus.cc:3060] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.842245 21571 raft_consensus.cc:740] T c9a921c7007f40bc934700567f0794ba P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.846073 21571 consensus_queue.cc:260] T c9a921c7007f40bc934700567f0794ba P b7141e8c8cd04e61a34cd263fda83b3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.853978 21571 ts_tablet_manager.cc:1434] T c9a921c7007f40bc934700567f0794ba P b7141e8c8cd04e61a34cd263fda83b3d: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.002s
I20260709 12:15:27.855013 21571 tablet_bootstrap.cc:492] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d: Bootstrap starting.
I20260709 12:15:27.857285 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a921c7007f40bc934700567f0794ba" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47" is_pre_election: true
W20260709 12:15:27.868180 21345 leader_election.cc:343] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.872469 21573 tablet_bootstrap.cc:654] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.873325 21572 ts_tablet_manager.cc:1434] T 71c8fc47649e4defa79f85f626d3df0b P 51a448f6f27940929352af4a932e7b8c: Time spent starting tablet: real 0.083s	user 0.011s	sys 0.024s
I20260709 12:15:27.874455 21572 tablet_bootstrap.cc:492] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c: Bootstrap starting.
I20260709 12:15:27.884353 21571 tablet_bootstrap.cc:654] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.893172 21528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a921c7007f40bc934700567f0794ba" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" is_pre_election: true
I20260709 12:15:27.893991 21528 raft_consensus.cc:2468] T c9a921c7007f40bc934700567f0794ba P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 0.
I20260709 12:15:27.894832 21580 raft_consensus.cc:493] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.895323 21580 raft_consensus.cc:515] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:27.896080 21344 leader_election.cc:304] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 84e01d71b0d1448d8c2b91f68282fa47
I20260709 12:15:27.897432 21595 raft_consensus.cc:2804] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:27.897747 21580 leader_election.cc:290] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737), 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619)
I20260709 12:15:27.897960 21595 raft_consensus.cc:493] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.898620 21595 raft_consensus.cc:3060] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.899876 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718268da3eb54ad8b465d405d5fcd735" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47" is_pre_election: true
I20260709 12:15:27.901037 21454 raft_consensus.cc:2468] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7141e8c8cd04e61a34cd263fda83b3d in term 0.
I20260709 12:15:27.901324 21378 raft_consensus.cc:2468] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7141e8c8cd04e61a34cd263fda83b3d in term 1.
I20260709 12:15:27.903059 21572 tablet_bootstrap.cc:654] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.906039 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5438539aad6445ba4c38165117e192f" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47" is_pre_election: true
I20260709 12:15:27.907320 21491 leader_election.cc:304] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:27.908166 21575 raft_consensus.cc:2804] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:27.908792 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718268da3eb54ad8b465d405d5fcd735" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
I20260709 12:15:27.909747 21454 raft_consensus.cc:3060] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:27.918058 21494 leader_election.cc:343] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.918572 21494 leader_election.cc:304] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7141e8c8cd04e61a34cd263fda83b3d; no voters: 51a448f6f27940929352af4a932e7b8c, 84e01d71b0d1448d8c2b91f68282fa47
I20260709 12:15:27.928970 21575 raft_consensus.cc:697] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 1 LEADER]: Becoming Leader. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Running, Role: LEADER
I20260709 12:15:27.933002 21575 consensus_queue.cc:237] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.937739 21378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c8fc47649e4defa79f85f626d3df0b" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51a448f6f27940929352af4a932e7b8c" is_pre_election: true
I20260709 12:15:27.938628 21378 raft_consensus.cc:2468] T 71c8fc47649e4defa79f85f626d3df0b P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 0.
I20260709 12:15:27.940730 21378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51a448f6f27940929352af4a932e7b8c" is_pre_election: true
I20260709 12:15:27.942598 21417 leader_election.cc:304] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, 84e01d71b0d1448d8c2b91f68282fa47; no voters: 
I20260709 12:15:27.933030 21595 raft_consensus.cc:515] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.944208 21580 raft_consensus.cc:2804] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:27.946161 21580 raft_consensus.cc:493] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.946396 21454 raft_consensus.cc:2468] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7141e8c8cd04e61a34cd263fda83b3d in term 1.
I20260709 12:15:27.946532 21580 raft_consensus.cc:3060] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:27.944784 21417 leader_election.cc:343] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.944255 21599 raft_consensus.cc:2749] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:27.945886 21573 tablet_bootstrap.cc:492] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47: No bootstrap required, opened a new log
I20260709 12:15:27.949057 21573 ts_tablet_manager.cc:1403] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47: Time spent bootstrapping tablet: real 0.131s	user 0.016s	sys 0.000s
I20260709 12:15:27.955643 21595 leader_election.cc:290] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 election: Requested vote from peers 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:27.954510 21527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" is_pre_election: true
I20260709 12:15:27.957150 21528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c8fc47649e4defa79f85f626d3df0b" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" is_pre_election: true
I20260709 12:15:27.957686 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a921c7007f40bc934700567f0794ba" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
I20260709 12:15:27.963330 21573 raft_consensus.cc:359] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.958690 21528 raft_consensus.cc:2468] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 0.
I20260709 12:15:27.963667 21526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a921c7007f40bc934700567f0794ba" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
W20260709 12:15:27.964980 21494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46135, user_credentials={real_user=slave}} blocked reactor thread for 48315.4us
I20260709 12:15:27.968189 21526 raft_consensus.cc:3060] T c9a921c7007f40bc934700567f0794ba P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:27.968982 21419 leader_election.cc:343] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:27.969197 21345 leader_election.cc:343] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.967834 21573 raft_consensus.cc:385] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.970518 21571 tablet_bootstrap.cc:492] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d: No bootstrap required, opened a new log
I20260709 12:15:27.973251 21573 raft_consensus.cc:740] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.973572 21571 ts_tablet_manager.cc:1403] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d: Time spent bootstrapping tablet: real 0.119s	user 0.014s	sys 0.006s
I20260709 12:15:27.974053 21573 consensus_queue.cc:260] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.975795 21572 tablet_bootstrap.cc:492] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c: No bootstrap required, opened a new log
I20260709 12:15:27.976498 21572 ts_tablet_manager.cc:1403] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c: Time spent bootstrapping tablet: real 0.102s	user 0.006s	sys 0.024s
I20260709 12:15:27.976414 21571 raft_consensus.cc:359] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.977233 21571 raft_consensus.cc:385] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.977473 21571 raft_consensus.cc:740] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.977859 21419 leader_election.cc:304] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84e01d71b0d1448d8c2b91f68282fa47; no voters: 51a448f6f27940929352af4a932e7b8c, b7141e8c8cd04e61a34cd263fda83b3d
I20260709 12:15:27.978144 21571 consensus_queue.cc:260] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.979861 21573 ts_tablet_manager.cc:1434] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47: Time spent starting tablet: real 0.030s	user 0.011s	sys 0.000s
I20260709 12:15:27.980273 21571 ts_tablet_manager.cc:1434] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:15:27.979975 21580 raft_consensus.cc:515] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.980816 21573 tablet_bootstrap.cc:492] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47: Bootstrap starting.
I20260709 12:15:27.981217 21571 tablet_bootstrap.cc:492] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d: Bootstrap starting.
I20260709 12:15:27.982770 21378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c8fc47649e4defa79f85f626d3df0b" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51a448f6f27940929352af4a932e7b8c"
I20260709 12:15:27.983645 21378 raft_consensus.cc:3060] T 71c8fc47649e4defa79f85f626d3df0b P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.984218 21580 leader_election.cc:290] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 1 election: Requested vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:27.984916 21528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c8fc47649e4defa79f85f626d3df0b" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:27.986387 21528 raft_consensus.cc:3060] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.988572 21580 raft_consensus.cc:493] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.989039 21580 raft_consensus.cc:515] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.990578 21572 raft_consensus.cc:359] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:27.991372 21572 raft_consensus.cc:385] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.992520 21572 raft_consensus.cc:740] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.992871 21604 raft_consensus.cc:2749] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:27.993417 21378 raft_consensus.cc:2468] T 71c8fc47649e4defa79f85f626d3df0b P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 1.
I20260709 12:15:27.994738 21526 raft_consensus.cc:2468] T c9a921c7007f40bc934700567f0794ba P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 1.
I20260709 12:15:27.997053 21344 leader_election.cc:304] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 84e01d71b0d1448d8c2b91f68282fa47
I20260709 12:15:27.997892 21595 raft_consensus.cc:2804] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:27.997047 21417 leader_election.cc:304] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, 84e01d71b0d1448d8c2b91f68282fa47; no voters: 
I20260709 12:15:27.998752 21595 raft_consensus.cc:697] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Becoming Leader. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Running, Role: LEADER
I20260709 12:15:27.999210 21528 raft_consensus.cc:2468] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 1.
I20260709 12:15:27.999576 21595 consensus_queue.cc:237] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.000149 21604 raft_consensus.cc:2804] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:27.997893 21580 leader_election.cc:290] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:28.000397 21526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7849f4e74a431a842e898c587b05cd" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" is_pre_election: true
I20260709 12:15:28.001231 21378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7849f4e74a431a842e898c587b05cd" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51a448f6f27940929352af4a932e7b8c" is_pre_election: true
I20260709 12:15:28.000970 21572 consensus_queue.cc:260] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
W20260709 12:15:28.003904 21417 leader_election.cc:343] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:28.006026 21419 leader_election.cc:343] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.006670 21419 leader_election.cc:304] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84e01d71b0d1448d8c2b91f68282fa47; no voters: 51a448f6f27940929352af4a932e7b8c, b7141e8c8cd04e61a34cd263fda83b3d
I20260709 12:15:28.008414 21604 raft_consensus.cc:697] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 LEADER]: Becoming Leader. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Running, Role: LEADER
I20260709 12:15:28.008636 21580 raft_consensus.cc:2749] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:28.008911 21572 ts_tablet_manager.cc:1434] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:15:28.009446 21604 consensus_queue.cc:237] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.013741 21572 tablet_bootstrap.cc:492] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c: Bootstrap starting.
I20260709 12:15:28.014392 21573 tablet_bootstrap.cc:654] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.013509 21571 tablet_bootstrap.cc:654] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.031179 21573 tablet_bootstrap.cc:492] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47: No bootstrap required, opened a new log
I20260709 12:15:28.031737 21573 ts_tablet_manager.cc:1403] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.000s
I20260709 12:15:28.034950 21573 raft_consensus.cc:359] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.035815 21573 raft_consensus.cc:385] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.036178 21573 raft_consensus.cc:740] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.037178 21573 consensus_queue.cc:260] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.039148 21275 catalog_manager.cc:5697] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 51a448f6f27940929352af4a932e7b8c (127.20.191.1). New cstate: current_term: 1 leader_uuid: "51a448f6f27940929352af4a932e7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:28.042351 21572 tablet_bootstrap.cc:654] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.044543 21274 catalog_manager.cc:5697] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d reported cstate change: term changed from 0 to 1, leader changed from <none> to b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3). New cstate: current_term: 1 leader_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:28.048046 21571 tablet_bootstrap.cc:492] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d: No bootstrap required, opened a new log
I20260709 12:15:28.043412 21273 catalog_manager.cc:5697] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "84e01d71b0d1448d8c2b91f68282fa47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:28.048600 21571 ts_tablet_manager.cc:1403] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.009s
I20260709 12:15:28.052192 21573 ts_tablet_manager.cc:1434] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.006s
I20260709 12:15:28.051930 21571 raft_consensus.cc:359] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.052661 21571 raft_consensus.cc:385] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.052973 21571 raft_consensus.cc:740] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.053257 21573 tablet_bootstrap.cc:492] T ce6dde0da5d248dfb543e1986223fbd2 P 84e01d71b0d1448d8c2b91f68282fa47: Bootstrap starting.
I20260709 12:15:28.053731 21571 consensus_queue.cc:260] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.059986 21572 tablet_bootstrap.cc:492] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c: No bootstrap required, opened a new log
I20260709 12:15:28.060607 21572 ts_tablet_manager.cc:1403] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.009s
I20260709 12:15:28.060743 21573 tablet_bootstrap.cc:654] T ce6dde0da5d248dfb543e1986223fbd2 P 84e01d71b0d1448d8c2b91f68282fa47: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.063921 21572 raft_consensus.cc:359] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.064944 21572 raft_consensus.cc:385] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.065331 21572 raft_consensus.cc:740] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.066224 21572 consensus_queue.cc:260] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.069031 21572 ts_tablet_manager.cc:1434] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:15:28.070175 21572 tablet_bootstrap.cc:492] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c: Bootstrap starting.
I20260709 12:15:28.073859 21573 tablet_bootstrap.cc:492] T ce6dde0da5d248dfb543e1986223fbd2 P 84e01d71b0d1448d8c2b91f68282fa47: No bootstrap required, opened a new log
I20260709 12:15:28.074491 21573 ts_tablet_manager.cc:1403] T ce6dde0da5d248dfb543e1986223fbd2 P 84e01d71b0d1448d8c2b91f68282fa47: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 12:15:28.074824 21571 ts_tablet_manager.cc:1434] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d: Time spent starting tablet: real 0.026s	user 0.000s	sys 0.007s
I20260709 12:15:28.076116 21571 tablet_bootstrap.cc:492] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d: Bootstrap starting.
I20260709 12:15:28.077625 21572 tablet_bootstrap.cc:654] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.078265 21573 raft_consensus.cc:359] T ce6dde0da5d248dfb543e1986223fbd2 P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.079334 21573 raft_consensus.cc:385] T ce6dde0da5d248dfb543e1986223fbd2 P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.079669 21573 raft_consensus.cc:740] T ce6dde0da5d248dfb543e1986223fbd2 P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.080497 21573 consensus_queue.cc:260] T ce6dde0da5d248dfb543e1986223fbd2 P 84e01d71b0d1448d8c2b91f68282fa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.082991 21573 ts_tablet_manager.cc:1434] T ce6dde0da5d248dfb543e1986223fbd2 P 84e01d71b0d1448d8c2b91f68282fa47: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:28.084089 21573 tablet_bootstrap.cc:492] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47: Bootstrap starting.
I20260709 12:15:28.090394 21572 tablet_bootstrap.cc:492] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c: No bootstrap required, opened a new log
I20260709 12:15:28.091017 21572 ts_tablet_manager.cc:1403] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 12:15:28.091167 21573 tablet_bootstrap.cc:654] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.094797 21572 raft_consensus.cc:359] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.095674 21572 raft_consensus.cc:385] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.096019 21572 raft_consensus.cc:740] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.096897 21572 consensus_queue.cc:260] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.101115 21571 tablet_bootstrap.cc:654] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.103159 21595 raft_consensus.cc:493] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.103771 21573 tablet_bootstrap.cc:492] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47: No bootstrap required, opened a new log
I20260709 12:15:28.103657 21595 raft_consensus.cc:515] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.104231 21573 ts_tablet_manager.cc:1403] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:15:28.107286 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5438539aad6445ba4c38165117e192f" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47" is_pre_election: true
I20260709 12:15:28.107446 21573 raft_consensus.cc:359] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.108289 21573 raft_consensus.cc:385] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.108814 21595 leader_election.cc:290] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:28.110077 21526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5438539aad6445ba4c38165117e192f" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" is_pre_election: true
I20260709 12:15:28.110759 21526 raft_consensus.cc:2468] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 0.
I20260709 12:15:28.111065 21572 ts_tablet_manager.cc:1434] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:15:28.112119 21344 leader_election.cc:304] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:28.108600 21573 raft_consensus.cc:740] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.112922 21595 raft_consensus.cc:2804] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:28.113298 21595 raft_consensus.cc:493] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.113634 21595 raft_consensus.cc:3060] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.113576 21573 consensus_queue.cc:260] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.114593 21454 raft_consensus.cc:2468] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 0.
I20260709 12:15:28.115978 21573 ts_tablet_manager.cc:1434] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:15:28.116935 21573 tablet_bootstrap.cc:492] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47: Bootstrap starting.
I20260709 12:15:28.122738 21573 tablet_bootstrap.cc:654] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.127998 21579 raft_consensus.cc:493] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.128553 21579 raft_consensus.cc:515] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.130636 21579 leader_election.cc:290] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:28.132635 21526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085f9d2aa8b14024bf9a0ede6dfd793f" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" is_pre_election: true
I20260709 12:15:28.133093 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085f9d2aa8b14024bf9a0ede6dfd793f" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47" is_pre_election: true
I20260709 12:15:28.133351 21526 raft_consensus.cc:2468] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 0.
I20260709 12:15:28.133728 21454 raft_consensus.cc:2468] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 0.
I20260709 12:15:28.135160 21579 raft_consensus.cc:493] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.135041 21344 leader_election.cc:304] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:28.135658 21579 raft_consensus.cc:515] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.138006 21579 leader_election.cc:290] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:28.138528 21579 raft_consensus.cc:2804] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:28.138850 21579 raft_consensus.cc:493] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.139187 21579 raft_consensus.cc:3060] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.139804 21571 tablet_bootstrap.cc:492] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d: No bootstrap required, opened a new log
I20260709 12:15:28.140774 21571 ts_tablet_manager.cc:1403] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.002s
I20260709 12:15:28.142800 21572 tablet_bootstrap.cc:492] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c: Bootstrap starting.
I20260709 12:15:28.144073 21571 raft_consensus.cc:359] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:28.144831 21571 raft_consensus.cc:385] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.145143 21571 raft_consensus.cc:740] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.145184 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d119589772a243009b0526b813d6b272" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47" is_pre_election: true
I20260709 12:15:28.145884 21454 raft_consensus.cc:2468] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 0.
I20260709 12:15:28.147199 21345 leader_election.cc:304] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, 84e01d71b0d1448d8c2b91f68282fa47; no voters: 
I20260709 12:15:28.143615 21595 raft_consensus.cc:515] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.147727 21571 consensus_queue.cc:260] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:28.151345 21573 tablet_bootstrap.cc:492] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47: No bootstrap required, opened a new log
I20260709 12:15:28.151881 21573 ts_tablet_manager.cc:1403] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.004s
I20260709 12:15:28.154210 21571 ts_tablet_manager.cc:1434] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:15:28.154567 21595 leader_election.cc:290] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 election: Requested vote from peers 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:28.155162 21595 raft_consensus.cc:2804] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:28.155663 21595 raft_consensus.cc:493] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.157967 21595 raft_consensus.cc:3060] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.159144 21579 raft_consensus.cc:515] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.155225 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5438539aad6445ba4c38165117e192f" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
I20260709 12:15:28.161271 21579 leader_election.cc:290] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 election: Requested vote from peers 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:28.161324 21454 raft_consensus.cc:3060] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.155311 21571 tablet_bootstrap.cc:492] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d: Bootstrap starting.
I20260709 12:15:28.155501 21573 raft_consensus.cc:359] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.162551 21573 raft_consensus.cc:385] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.162777 21573 raft_consensus.cc:740] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.164121 21572 tablet_bootstrap.cc:654] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.165431 21573 consensus_queue.cc:260] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.173158 21595 raft_consensus.cc:515] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.169121 21453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085f9d2aa8b14024bf9a0ede6dfd793f" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
I20260709 12:15:28.175350 21453 raft_consensus.cc:3060] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.175666 21573 ts_tablet_manager.cc:1434] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 12:15:28.179190 21526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d119589772a243009b0526b813d6b272" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" is_pre_election: true
I20260709 12:15:28.181967 21528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5438539aad6445ba4c38165117e192f" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:28.182621 21528 raft_consensus.cc:3060] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.187101 21453 raft_consensus.cc:2468] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 1.
I20260709 12:15:28.188395 21345 leader_election.cc:304] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, 84e01d71b0d1448d8c2b91f68282fa47; no voters: 
I20260709 12:15:28.189270 21579 raft_consensus.cc:2804] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:28.189788 21579 raft_consensus.cc:697] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Becoming Leader. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Running, Role: LEADER
I20260709 12:15:28.190616 21579 consensus_queue.cc:237] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.191030 21595 leader_election.cc:290] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 election: Requested vote from peers 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:28.189556 21528 raft_consensus.cc:2468] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 1.
I20260709 12:15:28.194434 21454 raft_consensus.cc:2468] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 1.
I20260709 12:15:28.197152 21345 leader_election.cc:304] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, 84e01d71b0d1448d8c2b91f68282fa47; no voters: 
I20260709 12:15:28.198910 21526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085f9d2aa8b14024bf9a0ede6dfd793f" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:28.199509 21526 raft_consensus.cc:3060] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.200562 21572 tablet_bootstrap.cc:492] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c: No bootstrap required, opened a new log
I20260709 12:15:28.201328 21572 ts_tablet_manager.cc:1403] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.008s
I20260709 12:15:28.198251 21571 tablet_bootstrap.cc:654] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.206450 21620 raft_consensus.cc:2804] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:28.207115 21620 raft_consensus.cc:697] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Becoming Leader. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Running, Role: LEADER
I20260709 12:15:28.211174 21528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d119589772a243009b0526b813d6b272" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:28.211980 21572 raft_consensus.cc:359] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:28.213263 21572 raft_consensus.cc:385] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.213594 21572 raft_consensus.cc:740] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.214524 21572 consensus_queue.cc:260] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:28.214495 21276 catalog_manager.cc:5697] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 51a448f6f27940929352af4a932e7b8c (127.20.191.1). New cstate: current_term: 1 leader_uuid: "51a448f6f27940929352af4a932e7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:28.216672 21526 raft_consensus.cc:2468] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 1.
I20260709 12:15:28.216924 21572 ts_tablet_manager.cc:1434] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:15:28.208345 21620 consensus_queue.cc:237] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
W20260709 12:15:28.210911 21344 leader_election.cc:343] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.220522 21575 raft_consensus.cc:493] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.218418 21572 tablet_bootstrap.cc:492] T ce6dde0da5d248dfb543e1986223fbd2 P 51a448f6f27940929352af4a932e7b8c: Bootstrap starting.
I20260709 12:15:28.221006 21575 raft_consensus.cc:515] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.210454 21453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d119589772a243009b0526b813d6b272" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
I20260709 12:15:28.221896 21453 raft_consensus.cc:3060] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:28.223213 21344 leader_election.cc:343] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.225344 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6dde0da5d248dfb543e1986223fbd2" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47" is_pre_election: true
I20260709 12:15:28.226053 21454 raft_consensus.cc:2468] T ce6dde0da5d248dfb543e1986223fbd2 P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7141e8c8cd04e61a34cd263fda83b3d in term 0.
I20260709 12:15:28.229627 21572 tablet_bootstrap.cc:654] T ce6dde0da5d248dfb543e1986223fbd2 P 51a448f6f27940929352af4a932e7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.229908 21378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6dde0da5d248dfb543e1986223fbd2" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51a448f6f27940929352af4a932e7b8c" is_pre_election: true
I20260709 12:15:28.231468 21494 leader_election.cc:304] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e01d71b0d1448d8c2b91f68282fa47, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:28.232524 21601 raft_consensus.cc:2804] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:28.232957 21601 raft_consensus.cc:493] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.233309 21601 raft_consensus.cc:3060] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:28.235647 21491 leader_election.cc:343] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.239122 21453 raft_consensus.cc:2468] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 1.
I20260709 12:15:28.223237 21575 leader_election.cc:290] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135)
I20260709 12:15:28.240270 21345 leader_election.cc:304] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, 84e01d71b0d1448d8c2b91f68282fa47; no voters: b7141e8c8cd04e61a34cd263fda83b3d
I20260709 12:15:28.241102 21595 raft_consensus.cc:2804] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:28.241636 21595 raft_consensus.cc:697] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Becoming Leader. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Running, Role: LEADER
I20260709 12:15:28.242544 21595 consensus_queue.cc:237] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.246352 21601 raft_consensus.cc:515] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.240916 21572 tablet_bootstrap.cc:492] T ce6dde0da5d248dfb543e1986223fbd2 P 51a448f6f27940929352af4a932e7b8c: No bootstrap required, opened a new log
I20260709 12:15:28.247934 21572 ts_tablet_manager.cc:1403] T ce6dde0da5d248dfb543e1986223fbd2 P 51a448f6f27940929352af4a932e7b8c: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.006s
I20260709 12:15:28.249408 21378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6dde0da5d248dfb543e1986223fbd2" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51a448f6f27940929352af4a932e7b8c"
I20260709 12:15:28.252020 21453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6dde0da5d248dfb543e1986223fbd2" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
I20260709 12:15:28.252677 21453 raft_consensus.cc:3060] T ce6dde0da5d248dfb543e1986223fbd2 P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:28.253983 21491 leader_election.cc:343] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.255923 21571 tablet_bootstrap.cc:492] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d: No bootstrap required, opened a new log
I20260709 12:15:28.256388 21571 ts_tablet_manager.cc:1403] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d: Time spent bootstrapping tablet: real 0.101s	user 0.006s	sys 0.005s
I20260709 12:15:28.257009 21572 raft_consensus.cc:359] T ce6dde0da5d248dfb543e1986223fbd2 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.257809 21572 raft_consensus.cc:385] T ce6dde0da5d248dfb543e1986223fbd2 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.258107 21572 raft_consensus.cc:740] T ce6dde0da5d248dfb543e1986223fbd2 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.259336 21601 leader_election.cc:290] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 election: Requested vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135)
I20260709 12:15:28.259406 21453 raft_consensus.cc:2468] T ce6dde0da5d248dfb543e1986223fbd2 P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7141e8c8cd04e61a34cd263fda83b3d in term 1.
I20260709 12:15:28.259097 21571 raft_consensus.cc:359] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.260454 21571 raft_consensus.cc:385] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.260747 21571 raft_consensus.cc:740] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.260710 21494 leader_election.cc:304] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 84e01d71b0d1448d8c2b91f68282fa47, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 51a448f6f27940929352af4a932e7b8c
I20260709 12:15:28.261549 21601 raft_consensus.cc:2804] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:28.262257 21601 raft_consensus.cc:697] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [term 1 LEADER]: Becoming Leader. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Running, Role: LEADER
I20260709 12:15:28.263113 21601 consensus_queue.cc:237] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.259050 21572 consensus_queue.cc:260] T ce6dde0da5d248dfb543e1986223fbd2 P 51a448f6f27940929352af4a932e7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.267027 21571 consensus_queue.cc:260] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.267903 21572 ts_tablet_manager.cc:1434] T ce6dde0da5d248dfb543e1986223fbd2 P 51a448f6f27940929352af4a932e7b8c: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:15:28.269928 21571 ts_tablet_manager.cc:1434] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 12:15:28.270923 21571 tablet_bootstrap.cc:492] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d: Bootstrap starting.
I20260709 12:15:28.279546 21276 catalog_manager.cc:5697] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 51a448f6f27940929352af4a932e7b8c (127.20.191.1). New cstate: current_term: 1 leader_uuid: "51a448f6f27940929352af4a932e7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:28.282289 21571 tablet_bootstrap.cc:654] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.288304 21274 catalog_manager.cc:5697] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d reported cstate change: term changed from 0 to 1, leader changed from <none> to b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3). New cstate: current_term: 1 leader_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:28.292477 21571 tablet_bootstrap.cc:492] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d: No bootstrap required, opened a new log
I20260709 12:15:28.292994 21571 ts_tablet_manager.cc:1403] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
I20260709 12:15:28.295686 21571 raft_consensus.cc:359] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.296396 21571 raft_consensus.cc:385] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.296680 21571 raft_consensus.cc:740] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.297403 21571 consensus_queue.cc:260] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.299592 21571 ts_tablet_manager.cc:1434] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:28.299558 21273 catalog_manager.cc:5697] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 51a448f6f27940929352af4a932e7b8c (127.20.191.1). New cstate: current_term: 1 leader_uuid: "51a448f6f27940929352af4a932e7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:28.410941 21620 raft_consensus.cc:493] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.411500 21620 raft_consensus.cc:515] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.413795 21620 leader_election.cc:290] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:28.414698 21453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7849f4e74a431a842e898c587b05cd" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47" is_pre_election: true
I20260709 12:15:28.415386 21453 raft_consensus.cc:2468] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 0.
I20260709 12:15:28.415575 21526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7849f4e74a431a842e898c587b05cd" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" is_pre_election: true
I20260709 12:15:28.416224 21526 raft_consensus.cc:2468] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 0.
I20260709 12:15:28.417614 21344 leader_election.cc:304] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:28.418020 21601 consensus_queue.cc:1048] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:28.418429 21454 raft_consensus.cc:3060] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.419030 21620 raft_consensus.cc:2804] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:28.419395 21620 raft_consensus.cc:493] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.419778 21620 raft_consensus.cc:3060] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.427537 21620 raft_consensus.cc:515] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.428208 21595 consensus_queue.cc:1048] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:28.432303 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7849f4e74a431a842e898c587b05cd" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
I20260709 12:15:28.432976 21454 raft_consensus.cc:3060] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.433069 21526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7849f4e74a431a842e898c587b05cd" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:28.433705 21526 raft_consensus.cc:3060] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.442443 21454 raft_consensus.cc:2468] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 1.
I20260709 12:15:28.447901 21345 leader_election.cc:304] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, 84e01d71b0d1448d8c2b91f68282fa47; no voters: 
I20260709 12:15:28.449527 21595 raft_consensus.cc:2804] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:28.450126 21595 raft_consensus.cc:697] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Becoming Leader. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Running, Role: LEADER
I20260709 12:15:28.451025 21595 consensus_queue.cc:237] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.457888 21620 leader_election.cc:290] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 election: Requested vote from peers 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:28.459514 21599 consensus_queue.cc:1048] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:28.462423 21526 raft_consensus.cc:2468] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 1.
I20260709 12:15:28.470966 21604 consensus_queue.cc:1048] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:28.495715 21599 raft_consensus.cc:493] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.496254 21599 raft_consensus.cc:515] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
W20260709 12:15:28.497498 21323 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:28.498502 21599 leader_election.cc:290] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135)
I20260709 12:15:28.500169 21379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d119589772a243009b0526b813d6b272" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51a448f6f27940929352af4a932e7b8c" is_pre_election: true
I20260709 12:15:28.500705 21451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d119589772a243009b0526b813d6b272" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47" is_pre_election: true
I20260709 12:15:28.501493 21451 raft_consensus.cc:2393] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7141e8c8cd04e61a34cd263fda83b3d in current term 1: Already voted for candidate 51a448f6f27940929352af4a932e7b8c in this term.
I20260709 12:15:28.502719 21494 leader_election.cc:304] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7141e8c8cd04e61a34cd263fda83b3d; no voters: 51a448f6f27940929352af4a932e7b8c, 84e01d71b0d1448d8c2b91f68282fa47
I20260709 12:15:28.503901 21599 raft_consensus.cc:3060] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.511438 21599 raft_consensus.cc:2749] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:28.516794 21620 raft_consensus.cc:493] T ce6dde0da5d248dfb543e1986223fbd2 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.517472 21620 raft_consensus.cc:515] T ce6dde0da5d248dfb543e1986223fbd2 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.521428 21604 consensus_queue.cc:1048] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:28.521575 21528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6dde0da5d248dfb543e1986223fbd2" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" is_pre_election: true
I20260709 12:15:28.523701 21451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6dde0da5d248dfb543e1986223fbd2" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47" is_pre_election: true
I20260709 12:15:28.524645 21451 raft_consensus.cc:2393] T ce6dde0da5d248dfb543e1986223fbd2 P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51a448f6f27940929352af4a932e7b8c in current term 1: Already voted for candidate b7141e8c8cd04e61a34cd263fda83b3d in this term.
I20260709 12:15:28.526108 21345 leader_election.cc:304] T ce6dde0da5d248dfb543e1986223fbd2 P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c; no voters: 84e01d71b0d1448d8c2b91f68282fa47, b7141e8c8cd04e61a34cd263fda83b3d
I20260709 12:15:28.522178 21620 leader_election.cc:290] T ce6dde0da5d248dfb543e1986223fbd2 P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:28.528369 21638 raft_consensus.cc:3060] T ce6dde0da5d248dfb543e1986223fbd2 P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.540917 21595 consensus_queue.cc:1048] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:28.544693 21638 raft_consensus.cc:2749] T ce6dde0da5d248dfb543e1986223fbd2 P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:28.546452 21273 catalog_manager.cc:5697] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 51a448f6f27940929352af4a932e7b8c (127.20.191.1). New cstate: current_term: 1 leader_uuid: "51a448f6f27940929352af4a932e7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:28.599727 21638 consensus_queue.cc:1048] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:28.604293 21599 raft_consensus.cc:493] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.604840 21599 raft_consensus.cc:515] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:28.607208 21599 leader_election.cc:290] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135)
I20260709 12:15:28.609357 21451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47" is_pre_election: true
I20260709 12:15:28.610229 21451 raft_consensus.cc:2468] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7141e8c8cd04e61a34cd263fda83b3d in term 0.
I20260709 12:15:28.610528 21639 raft_consensus.cc:493] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.610581 21379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51a448f6f27940929352af4a932e7b8c" is_pre_election: true
I20260709 12:15:28.611016 21639 raft_consensus.cc:515] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:28.611443 21494 leader_election.cc:304] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e01d71b0d1448d8c2b91f68282fa47, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:28.612320 21599 raft_consensus.cc:2804] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:28.612676 21599 raft_consensus.cc:493] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.613054 21599 raft_consensus.cc:3060] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.616257 21379 raft_consensus.cc:2468] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7141e8c8cd04e61a34cd263fda83b3d in term 0.
I20260709 12:15:28.617929 21620 consensus_queue.cc:1048] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:28.624346 21526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" is_pre_election: true
I20260709 12:15:28.625339 21452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47" is_pre_election: true
I20260709 12:15:28.626046 21452 raft_consensus.cc:2468] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 0.
I20260709 12:15:28.628597 21599 raft_consensus.cc:515] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:28.629904 21526 raft_consensus.cc:2393] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51a448f6f27940929352af4a932e7b8c in current term 1: Already voted for candidate b7141e8c8cd04e61a34cd263fda83b3d in this term.
I20260709 12:15:28.630563 21345 leader_election.cc:304] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, 84e01d71b0d1448d8c2b91f68282fa47; no voters: 
I20260709 12:15:28.631450 21620 raft_consensus.cc:2804] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:28.633972 21620 raft_consensus.cc:493] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.634644 21620 raft_consensus.cc:3060] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.631829 21599 leader_election.cc:290] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 election: Requested vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135)
I20260709 12:15:28.622778 21639 leader_election.cc:290] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737), 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135)
I20260709 12:15:28.632141 21452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
I20260709 12:15:28.632861 21379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51a448f6f27940929352af4a932e7b8c"
I20260709 12:15:28.639654 21452 raft_consensus.cc:3060] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.641155 21639 consensus_queue.cc:1048] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:28.642760 21620 raft_consensus.cc:515] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:28.644054 21379 raft_consensus.cc:2393] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b7141e8c8cd04e61a34cd263fda83b3d in current term 1: Already voted for candidate 51a448f6f27940929352af4a932e7b8c in this term.
I20260709 12:15:28.648962 21620 leader_election.cc:290] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 election: Requested vote from peers b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737), 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135)
I20260709 12:15:28.650218 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
I20260709 12:15:28.651194 21528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:28.651979 21528 raft_consensus.cc:2393] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 51a448f6f27940929352af4a932e7b8c in current term 1: Already voted for candidate b7141e8c8cd04e61a34cd263fda83b3d in this term.
I20260709 12:15:28.652906 21344 leader_election.cc:304] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c; no voters: 84e01d71b0d1448d8c2b91f68282fa47, b7141e8c8cd04e61a34cd263fda83b3d
I20260709 12:15:28.654064 21620 raft_consensus.cc:2749] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:28.657905 21452 raft_consensus.cc:2468] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7141e8c8cd04e61a34cd263fda83b3d in term 1.
I20260709 12:15:28.659207 21494 leader_election.cc:304] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 84e01d71b0d1448d8c2b91f68282fa47, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 51a448f6f27940929352af4a932e7b8c
I20260709 12:15:28.660341 21599 raft_consensus.cc:2804] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:28.660818 21599 raft_consensus.cc:697] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 1 LEADER]: Becoming Leader. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Running, Role: LEADER
I20260709 12:15:28.661619 21599 consensus_queue.cc:237] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:28.668274 21620 consensus_queue.cc:1048] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:28.668244 21595 consensus_queue.cc:1048] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:28.688026 21274 catalog_manager.cc:5697] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d reported cstate change: term changed from 0 to 1, leader changed from <none> to b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3). New cstate: current_term: 1 leader_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:28.696467 21638 consensus_queue.cc:1048] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:28.717937 21599 consensus_queue.cc:1048] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:28.724099 21601 consensus_queue.cc:1048] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:28.789099 21528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d"
dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
mode: GRACEFUL
new_leader_uuid: "51a448f6f27940929352af4a932e7b8c"
 from {username='slave'} at 127.0.0.1:60330
I20260709 12:15:28.789932 21528 raft_consensus.cc:606] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 1 LEADER]: Received request to transfer leadership to TS 51a448f6f27940929352af4a932e7b8c
I20260709 12:15:28.799883 21528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "718268da3eb54ad8b465d405d5fcd735"
dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
mode: GRACEFUL
new_leader_uuid: "51a448f6f27940929352af4a932e7b8c"
 from {username='slave'} at 127.0.0.1:60330
I20260709 12:15:28.800519 21528 raft_consensus.cc:606] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 1 LEADER]: Received request to transfer leadership to TS 51a448f6f27940929352af4a932e7b8c
I20260709 12:15:28.819856 21379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c7849f4e74a431a842e898c587b05cd"
dest_uuid: "51a448f6f27940929352af4a932e7b8c"
mode: GRACEFUL
new_leader_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
 from {username='slave'} at 127.0.0.1:38578
I20260709 12:15:28.820385 21379 raft_consensus.cc:606] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Received request to transfer leadership to TS 84e01d71b0d1448d8c2b91f68282fa47
I20260709 12:15:28.828842 21379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5438539aad6445ba4c38165117e192f"
dest_uuid: "51a448f6f27940929352af4a932e7b8c"
mode: GRACEFUL
new_leader_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
 from {username='slave'} at 127.0.0.1:38578
I20260709 12:15:28.829366 21379 raft_consensus.cc:606] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Received request to transfer leadership to TS 84e01d71b0d1448d8c2b91f68282fa47
I20260709 12:15:28.834921 21379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d119589772a243009b0526b813d6b272"
dest_uuid: "51a448f6f27940929352af4a932e7b8c"
mode: GRACEFUL
new_leader_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
 from {username='slave'} at 127.0.0.1:38578
I20260709 12:15:28.835424 21379 raft_consensus.cc:606] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Received request to transfer leadership to TS 84e01d71b0d1448d8c2b91f68282fa47
I20260709 12:15:28.856776 21638 consensus_queue.cc:1048] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:28.867722 21639 consensus_queue.cc:1048] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:28.885111 21620 raft_consensus.cc:993] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c: : Instructing follower 84e01d71b0d1448d8c2b91f68282fa47 to start an election
I20260709 12:15:28.885633 21639 raft_consensus.cc:1081] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Signalling peer 84e01d71b0d1448d8c2b91f68282fa47 to start an election
I20260709 12:15:28.887641 21452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c7849f4e74a431a842e898c587b05cd"
dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
 from {username='slave'} at 127.0.0.1:50628
I20260709 12:15:28.888147 21452 raft_consensus.cc:493] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:28.888442 21452 raft_consensus.cc:3060] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:28.893193 21452 raft_consensus.cc:515] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.894922 21452 leader_election.cc:290] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 2 election: Requested vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:28.895892 21379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7849f4e74a431a842e898c587b05cd" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51a448f6f27940929352af4a932e7b8c"
I20260709 12:15:28.896030 21528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7849f4e74a431a842e898c587b05cd" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:28.896616 21528 raft_consensus.cc:3060] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:28.896590 21379 raft_consensus.cc:3055] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:28.897162 21379 raft_consensus.cc:740] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Running, Role: LEADER
I20260709 12:15:28.898059 21379 consensus_queue.cc:260] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.899472 21379 raft_consensus.cc:3060] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:28.901522 21528 raft_consensus.cc:2468] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 2.
I20260709 12:15:28.902671 21419 leader_election.cc:304] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e01d71b0d1448d8c2b91f68282fa47, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:28.903306 21604 raft_consensus.cc:2804] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:28.903689 21604 raft_consensus.cc:697] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Becoming Leader. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Running, Role: LEADER
I20260709 12:15:28.904500 21604 consensus_queue.cc:237] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.906411 21379 raft_consensus.cc:2468] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 2.
I20260709 12:15:28.911093 21274 catalog_manager.cc:5697] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 reported cstate change: term changed from 1 to 2, leader changed from 51a448f6f27940929352af4a932e7b8c (127.20.191.1) to 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "84e01d71b0d1448d8c2b91f68282fa47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:28.938362 21599 raft_consensus.cc:993] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d: : Instructing follower 51a448f6f27940929352af4a932e7b8c to start an election
I20260709 12:15:28.938840 21599 raft_consensus.cc:1081] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 1 LEADER]: Signalling peer 51a448f6f27940929352af4a932e7b8c to start an election
I20260709 12:15:28.940438 21379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "718268da3eb54ad8b465d405d5fcd735"
dest_uuid: "51a448f6f27940929352af4a932e7b8c"
 from {username='slave'} at 127.0.0.1:38550
I20260709 12:15:28.941007 21379 raft_consensus.cc:493] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:28.941378 21379 raft_consensus.cc:3060] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:28.946193 21379 raft_consensus.cc:515] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.947806 21379 leader_election.cc:290] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 2 election: Requested vote from peers 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:28.948902 21528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718268da3eb54ad8b465d405d5fcd735" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:28.948904 21452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718268da3eb54ad8b465d405d5fcd735" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
I20260709 12:15:28.949550 21528 raft_consensus.cc:3055] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:28.949674 21452 raft_consensus.cc:3060] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:28.949862 21528 raft_consensus.cc:740] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Running, Role: LEADER
I20260709 12:15:28.950595 21528 consensus_queue.cc:260] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.951463 21528 raft_consensus.cc:3060] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:28.955798 21528 raft_consensus.cc:2468] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 2.
I20260709 12:15:28.956459 21452 raft_consensus.cc:2468] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 2.
I20260709 12:15:28.956862 21344 leader_election.cc:304] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:28.957731 21639 raft_consensus.cc:2804] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:28.958222 21639 raft_consensus.cc:697] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 2 LEADER]: Becoming Leader. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Running, Role: LEADER
I20260709 12:15:28.959015 21639 consensus_queue.cc:237] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:28.965571 21274 catalog_manager.cc:5697] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c reported cstate change: term changed from 1 to 2, leader changed from b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3) to 51a448f6f27940929352af4a932e7b8c (127.20.191.1). New cstate: current_term: 2 leader_uuid: "51a448f6f27940929352af4a932e7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:28.995756 21620 raft_consensus.cc:993] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c: : Instructing follower 84e01d71b0d1448d8c2b91f68282fa47 to start an election
I20260709 12:15:28.996212 21639 raft_consensus.cc:1081] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Signalling peer 84e01d71b0d1448d8c2b91f68282fa47 to start an election
I20260709 12:15:28.997671 21452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5438539aad6445ba4c38165117e192f"
dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
 from {username='slave'} at 127.0.0.1:50628
I20260709 12:15:28.998265 21452 raft_consensus.cc:493] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:28.998618 21452 raft_consensus.cc:3060] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.005234 21452 raft_consensus.cc:515] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:29.007334 21452 leader_election.cc:290] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 2 election: Requested vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:29.008404 21379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5438539aad6445ba4c38165117e192f" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51a448f6f27940929352af4a932e7b8c"
I20260709 12:15:29.008590 21528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5438539aad6445ba4c38165117e192f" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:29.009126 21379 raft_consensus.cc:3055] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:29.009187 21528 raft_consensus.cc:3060] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.009501 21379 raft_consensus.cc:740] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Running, Role: LEADER
I20260709 12:15:29.010396 21379 consensus_queue.cc:260] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:29.011343 21379 raft_consensus.cc:3060] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.016716 21528 raft_consensus.cc:2468] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 2.
I20260709 12:15:29.017376 21379 raft_consensus.cc:2468] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 2.
I20260709 12:15:29.018023 21419 leader_election.cc:304] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e01d71b0d1448d8c2b91f68282fa47, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:29.018877 21604 raft_consensus.cc:2804] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:29.019275 21604 raft_consensus.cc:697] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Becoming Leader. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Running, Role: LEADER
I20260709 12:15:29.019977 21604 consensus_queue.cc:237] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:29.026855 21274 catalog_manager.cc:5697] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 reported cstate change: term changed from 1 to 2, leader changed from 51a448f6f27940929352af4a932e7b8c (127.20.191.1) to 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "84e01d71b0d1448d8c2b91f68282fa47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:29.089879 21599 consensus_queue.cc:1048] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:29.101305 21575 consensus_queue.cc:1048] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:29.111788 21659 raft_consensus.cc:993] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d: : Instructing follower 51a448f6f27940929352af4a932e7b8c to start an election
I20260709 12:15:29.112381 21575 raft_consensus.cc:1081] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 1 LEADER]: Signalling peer 51a448f6f27940929352af4a932e7b8c to start an election
I20260709 12:15:29.113901 21379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d"
dest_uuid: "51a448f6f27940929352af4a932e7b8c"
 from {username='slave'} at 127.0.0.1:38550
I20260709 12:15:29.114558 21379 raft_consensus.cc:493] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:29.114954 21379 raft_consensus.cc:3060] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.119791 21379 raft_consensus.cc:515] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:29.123090 21528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:29.123731 21528 raft_consensus.cc:3055] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:29.124047 21528 raft_consensus.cc:740] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Running, Role: LEADER
I20260709 12:15:29.124775 21528 consensus_queue.cc:260] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:29.126036 21528 raft_consensus.cc:3060] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.127228 21379 leader_election.cc:290] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 2 election: Requested vote from peers b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737), 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135)
I20260709 12:15:29.127497 21452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
I20260709 12:15:29.128067 21452 raft_consensus.cc:3060] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.133108 21452 raft_consensus.cc:2468] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 2.
I20260709 12:15:29.133117 21528 raft_consensus.cc:2468] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 2.
I20260709 12:15:29.134982 21345 leader_election.cc:304] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, 84e01d71b0d1448d8c2b91f68282fa47; no voters: 
I20260709 12:15:29.135968 21639 raft_consensus.cc:2804] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:29.136459 21639 raft_consensus.cc:697] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 2 LEADER]: Becoming Leader. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Running, Role: LEADER
I20260709 12:15:29.137188 21639 consensus_queue.cc:237] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:29.143178 21275 catalog_manager.cc:5697] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c reported cstate change: term changed from 1 to 2, leader changed from b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3) to 51a448f6f27940929352af4a932e7b8c (127.20.191.1). New cstate: current_term: 2 leader_uuid: "51a448f6f27940929352af4a932e7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:29.199772 21620 raft_consensus.cc:993] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c: : Instructing follower 84e01d71b0d1448d8c2b91f68282fa47 to start an election
I20260709 12:15:29.200244 21639 raft_consensus.cc:1081] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Signalling peer 84e01d71b0d1448d8c2b91f68282fa47 to start an election
I20260709 12:15:29.201869 21452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d119589772a243009b0526b813d6b272"
dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
 from {username='slave'} at 127.0.0.1:50628
I20260709 12:15:29.202379 21452 raft_consensus.cc:493] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:29.202697 21452 raft_consensus.cc:3060] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.207415 21452 raft_consensus.cc:515] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:29.209152 21452 leader_election.cc:290] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 2 election: Requested vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:29.210402 21379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d119589772a243009b0526b813d6b272" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51a448f6f27940929352af4a932e7b8c"
I20260709 12:15:29.210397 21528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d119589772a243009b0526b813d6b272" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:29.211138 21528 raft_consensus.cc:3060] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.212216 21379 raft_consensus.cc:3055] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:29.212610 21379 raft_consensus.cc:740] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Running, Role: LEADER
I20260709 12:15:29.213406 21379 consensus_queue.cc:260] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:29.214783 21379 raft_consensus.cc:3060] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.218215 21528 raft_consensus.cc:2468] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 2.
I20260709 12:15:29.219524 21419 leader_election.cc:304] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e01d71b0d1448d8c2b91f68282fa47, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:29.220454 21604 raft_consensus.cc:2804] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:29.220955 21604 raft_consensus.cc:697] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Becoming Leader. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Running, Role: LEADER
I20260709 12:15:29.221644 21379 raft_consensus.cc:2468] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 2.
I20260709 12:15:29.221743 21604 consensus_queue.cc:237] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:29.228503 21275 catalog_manager.cc:5697] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 reported cstate change: term changed from 1 to 2, leader changed from 51a448f6f27940929352af4a932e7b8c (127.20.191.1) to 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "84e01d71b0d1448d8c2b91f68282fa47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:29.308806 21528 raft_consensus.cc:1275] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Refusing update from remote peer 84e01d71b0d1448d8c2b91f68282fa47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:29.310086 21604 consensus_queue.cc:1048] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:29.319955 21379 raft_consensus.cc:1275] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Refusing update from remote peer 84e01d71b0d1448d8c2b91f68282fa47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:29.321313 21604 consensus_queue.cc:1048] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:29.435127 21528 raft_consensus.cc:1275] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Refusing update from remote peer 84e01d71b0d1448d8c2b91f68282fa47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:29.436503 21604 consensus_queue.cc:1048] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:29.445278 21379 raft_consensus.cc:1275] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Refusing update from remote peer 84e01d71b0d1448d8c2b91f68282fa47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:29.446902 21661 consensus_queue.cc:1048] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:29.547470 21528 raft_consensus.cc:1275] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Refusing update from remote peer 51a448f6f27940929352af4a932e7b8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:29.548559 21639 consensus_queue.cc:1048] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:29.556331 21452 raft_consensus.cc:1275] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Refusing update from remote peer 51a448f6f27940929352af4a932e7b8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:29.560400 21638 consensus_queue.cc:1048] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:29.578269 21528 raft_consensus.cc:1275] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Refusing update from remote peer 51a448f6f27940929352af4a932e7b8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:29.579514 21638 consensus_queue.cc:1048] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:29.586658 21452 raft_consensus.cc:1275] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Refusing update from remote peer 51a448f6f27940929352af4a932e7b8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:29.589028 21620 consensus_queue.cc:1048] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:29.600970 21528 raft_consensus.cc:1275] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Refusing update from remote peer 84e01d71b0d1448d8c2b91f68282fa47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:29.602192 21661 consensus_queue.cc:1048] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:29.609983 21379 raft_consensus.cc:1275] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Refusing update from remote peer 84e01d71b0d1448d8c2b91f68282fa47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:29.611644 21661 consensus_queue.cc:1048] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:31.870172 21244 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:15:31.871109 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:31.885758 21379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d"
dest_uuid: "51a448f6f27940929352af4a932e7b8c"
mode: GRACEFUL
new_leader_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
 from {username='slave'} at 127.0.0.1:60864
I20260709 12:15:31.886260 21379 raft_consensus.cc:606] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 2 LEADER]: Received request to transfer leadership to TS b7141e8c8cd04e61a34cd263fda83b3d
I20260709 12:15:31.896777 21452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5438539aad6445ba4c38165117e192f"
dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
mode: GRACEFUL
new_leader_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
 from {username='slave'} at 127.0.0.1:54896
I20260709 12:15:31.897293 21452 raft_consensus.cc:606] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Received request to transfer leadership to TS b7141e8c8cd04e61a34cd263fda83b3d
I20260709 12:15:31.898463 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:31.898931 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:31.907300 21661 raft_consensus.cc:993] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47: : Instructing follower b7141e8c8cd04e61a34cd263fda83b3d to start an election
I20260709 12:15:31.907725 21667 raft_consensus.cc:1081] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Signalling peer b7141e8c8cd04e61a34cd263fda83b3d to start an election
I20260709 12:15:31.909132 21528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5438539aad6445ba4c38165117e192f"
dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
 from {username='slave'} at 127.0.0.1:60308
I20260709 12:15:31.909565 21528 raft_consensus.cc:493] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:31.909853 21528 raft_consensus.cc:3060] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:31.913875 21528 raft_consensus.cc:515] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:31.915416 21528 leader_election.cc:290] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 3 election: Requested vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135)
I20260709 12:15:31.916224 21379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5438539aad6445ba4c38165117e192f" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "51a448f6f27940929352af4a932e7b8c"
I20260709 12:15:31.916463 21452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5438539aad6445ba4c38165117e192f" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
I20260709 12:15:31.916733 21379 raft_consensus.cc:3060] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:31.916917 21452 raft_consensus.cc:3055] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:31.917200 21452 raft_consensus.cc:740] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Running, Role: LEADER
I20260709 12:15:31.917855 21452 consensus_queue.cc:260] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:31.918709 21452 raft_consensus.cc:3060] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:31.921905 21379 raft_consensus.cc:2468] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7141e8c8cd04e61a34cd263fda83b3d in term 3.
I20260709 12:15:31.923451 21491 leader_election.cc:304] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:31.924185 21452 raft_consensus.cc:2468] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7141e8c8cd04e61a34cd263fda83b3d in term 3.
I20260709 12:15:31.924285 21575 raft_consensus.cc:2804] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:31.925385 21575 raft_consensus.cc:697] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 3 LEADER]: Becoming Leader. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Running, Role: LEADER
I20260709 12:15:31.926193 21575 consensus_queue.cc:237] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:31.933063 21274 catalog_manager.cc:5697] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d reported cstate change: term changed from 2 to 3, leader changed from 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2) to b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3). New cstate: current_term: 3 leader_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:32.300690 21674 raft_consensus.cc:993] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c: : Instructing follower b7141e8c8cd04e61a34cd263fda83b3d to start an election
I20260709 12:15:32.301113 21674 raft_consensus.cc:1081] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 2 LEADER]: Signalling peer b7141e8c8cd04e61a34cd263fda83b3d to start an election
I20260709 12:15:32.302642 21528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d"
dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
 from {username='slave'} at 127.0.0.1:60316
I20260709 12:15:32.303110 21528 raft_consensus.cc:493] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:32.303354 21528 raft_consensus.cc:3060] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:32.307300 21528 raft_consensus.cc:515] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:32.308790 21528 leader_election.cc:290] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 3 election: Requested vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135)
I20260709 12:15:32.309698 21379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "51a448f6f27940929352af4a932e7b8c"
I20260709 12:15:32.309831 21452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
I20260709 12:15:32.310428 21379 raft_consensus.cc:3055] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:32.310525 21452 raft_consensus.cc:3060] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:32.310724 21379 raft_consensus.cc:740] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Running, Role: LEADER
I20260709 12:15:32.311440 21379 consensus_queue.cc:260] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:32.312413 21379 raft_consensus.cc:3060] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:32.316278 21452 raft_consensus.cc:2468] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7141e8c8cd04e61a34cd263fda83b3d in term 3.
I20260709 12:15:32.317404 21494 leader_election.cc:304] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e01d71b0d1448d8c2b91f68282fa47, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:32.318305 21575 raft_consensus.cc:2804] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:32.318806 21575 raft_consensus.cc:697] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 3 LEADER]: Becoming Leader. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Running, Role: LEADER
I20260709 12:15:32.319425 21379 raft_consensus.cc:2468] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7141e8c8cd04e61a34cd263fda83b3d in term 3.
I20260709 12:15:32.319614 21575 consensus_queue.cc:237] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:32.330727 21274 catalog_manager.cc:5697] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d reported cstate change: term changed from 2 to 3, leader changed from 51a448f6f27940929352af4a932e7b8c (127.20.191.1) to b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3). New cstate: current_term: 3 leader_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:32.331959 21379 raft_consensus.cc:1275] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Refusing update from remote peer b7141e8c8cd04e61a34cd263fda83b3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:32.333882 21668 consensus_queue.cc:1048] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:32.346902 21452 raft_consensus.cc:1275] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Refusing update from remote peer b7141e8c8cd04e61a34cd263fda83b3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:32.348402 21668 consensus_queue.cc:1048] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:32.899865 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:32.905900 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:32.906306 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:32.927563 21452 raft_consensus.cc:1275] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Refusing update from remote peer b7141e8c8cd04e61a34cd263fda83b3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:32.929229 21668 consensus_queue.cc:1048] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:32.930449 21379 raft_consensus.cc:1275] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Refusing update from remote peer b7141e8c8cd04e61a34cd263fda83b3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:32.931700 21668 consensus_queue.cc:1048] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:33.907207 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:33.913458 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:33.914019 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:34.914986 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:34.919914 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:34.920341 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:35.921648 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:35.927168 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:35.927644 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:36.928825 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:36.935014 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:36.935515 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:37.936497 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:37.941757 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:37.942219 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:38.943260 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:38.948118 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:38.948500 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:39.949306 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:39.954433 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:39.954813 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:40.955687 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:40.961792 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:40.962352 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:42.304751 21244 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:15:42.309163 21526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d"
dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
mode: GRACEFUL
new_leader_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
 from {username='slave'} at 127.0.0.1:60330
I20260709 12:15:42.309885 21526 raft_consensus.cc:606] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 3 LEADER]: Received request to transfer leadership to TS 84e01d71b0d1448d8c2b91f68282fa47
I20260709 12:15:42.315479 21378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "085f9d2aa8b14024bf9a0ede6dfd793f"
dest_uuid: "51a448f6f27940929352af4a932e7b8c"
mode: GRACEFUL
new_leader_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
 from {username='slave'} at 127.0.0.1:38578
I20260709 12:15:42.315982 21378 raft_consensus.cc:606] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Received request to transfer leadership to TS 84e01d71b0d1448d8c2b91f68282fa47
I20260709 12:15:42.321384 21378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "718268da3eb54ad8b465d405d5fcd735"
dest_uuid: "51a448f6f27940929352af4a932e7b8c"
mode: GRACEFUL
new_leader_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
 from {username='slave'} at 127.0.0.1:38578
I20260709 12:15:42.321976 21378 raft_consensus.cc:606] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 2 LEADER]: Received request to transfer leadership to TS 84e01d71b0d1448d8c2b91f68282fa47
I20260709 12:15:42.326845 21378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9a921c7007f40bc934700567f0794ba"
dest_uuid: "51a448f6f27940929352af4a932e7b8c"
mode: GRACEFUL
new_leader_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
 from {username='slave'} at 127.0.0.1:38578
I20260709 12:15:42.327302 21378 raft_consensus.cc:606] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Received request to transfer leadership to TS 84e01d71b0d1448d8c2b91f68282fa47
I20260709 12:15:42.338088 21526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5438539aad6445ba4c38165117e192f"
dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
mode: GRACEFUL
new_leader_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
 from {username='slave'} at 127.0.0.1:60330
I20260709 12:15:42.338603 21526 raft_consensus.cc:606] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 3 LEADER]: Received request to transfer leadership to TS 84e01d71b0d1448d8c2b91f68282fa47
I20260709 12:15:42.423777 21674 raft_consensus.cc:993] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c: : Instructing follower 84e01d71b0d1448d8c2b91f68282fa47 to start an election
I20260709 12:15:42.424188 21674 raft_consensus.cc:1081] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 2 LEADER]: Signalling peer 84e01d71b0d1448d8c2b91f68282fa47 to start an election
I20260709 12:15:42.425650 21454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "718268da3eb54ad8b465d405d5fcd735"
dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
 from {username='slave'} at 127.0.0.1:50628
I20260709 12:15:42.426175 21454 raft_consensus.cc:493] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:42.426589 21454 raft_consensus.cc:3060] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.431524 21454 raft_consensus.cc:515] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:42.433405 21454 leader_election.cc:290] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 3 election: Requested vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:42.434491 21378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718268da3eb54ad8b465d405d5fcd735" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "51a448f6f27940929352af4a932e7b8c"
I20260709 12:15:42.434514 21526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718268da3eb54ad8b465d405d5fcd735" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:42.435652 21378 raft_consensus.cc:3055] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:42.435716 21526 raft_consensus.cc:3060] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.435998 21378 raft_consensus.cc:740] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Running, Role: LEADER
I20260709 12:15:42.436818 21378 consensus_queue.cc:260] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:42.437853 21378 raft_consensus.cc:3060] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.440722 21526 raft_consensus.cc:2468] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 3.
I20260709 12:15:42.442322 21419 leader_election.cc:304] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e01d71b0d1448d8c2b91f68282fa47, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:42.442704 21378 raft_consensus.cc:2468] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 3.
I20260709 12:15:42.443161 21693 raft_consensus.cc:2804] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:42.444265 21693 raft_consensus.cc:697] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 LEADER]: Becoming Leader. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Running, Role: LEADER
I20260709 12:15:42.445075 21693 consensus_queue.cc:237] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:42.455286 21275 catalog_manager.cc:5697] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 reported cstate change: term changed from 2 to 3, leader changed from 51a448f6f27940929352af4a932e7b8c (127.20.191.1) to 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2). New cstate: current_term: 3 leader_uuid: "84e01d71b0d1448d8c2b91f68282fa47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.554388 21695 raft_consensus.cc:993] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d: : Instructing follower 84e01d71b0d1448d8c2b91f68282fa47 to start an election
I20260709 12:15:42.554883 21691 raft_consensus.cc:1081] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 3 LEADER]: Signalling peer 84e01d71b0d1448d8c2b91f68282fa47 to start an election
I20260709 12:15:42.556301 21454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d"
dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
 from {username='slave'} at 127.0.0.1:50622
I20260709 12:15:42.556825 21454 raft_consensus.cc:493] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:42.557150 21454 raft_consensus.cc:3060] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:42.561034 21454 raft_consensus.cc:515] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:42.562403 21454 leader_election.cc:290] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 4 election: Requested vote from peers b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737), 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619)
I20260709 12:15:42.563280 21526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:42.563416 21378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "51a448f6f27940929352af4a932e7b8c"
I20260709 12:15:42.563706 21526 raft_consensus.cc:3055] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:42.563889 21378 raft_consensus.cc:3060] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:42.563985 21526 raft_consensus.cc:740] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Running, Role: LEADER
I20260709 12:15:42.564656 21526 consensus_queue.cc:260] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:42.565482 21526 raft_consensus.cc:3060] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:42.568539 21378 raft_consensus.cc:2468] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 4.
I20260709 12:15:42.569305 21526 raft_consensus.cc:2468] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 4.
I20260709 12:15:42.569576 21417 leader_election.cc:304] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, 84e01d71b0d1448d8c2b91f68282fa47; no voters: 
I20260709 12:15:42.570428 21693 raft_consensus.cc:2804] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:42.570941 21693 raft_consensus.cc:697] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 4 LEADER]: Becoming Leader. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Running, Role: LEADER
I20260709 12:15:42.571741 21693 consensus_queue.cc:237] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:42.578332 21275 catalog_manager.cc:5697] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 reported cstate change: term changed from 3 to 4, leader changed from b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3) to 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2). New cstate: current_term: 4 leader_uuid: "84e01d71b0d1448d8c2b91f68282fa47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:42.598027 21695 raft_consensus.cc:993] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d: : Instructing follower 84e01d71b0d1448d8c2b91f68282fa47 to start an election
I20260709 12:15:42.598474 21691 raft_consensus.cc:1081] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 3 LEADER]: Signalling peer 84e01d71b0d1448d8c2b91f68282fa47 to start an election
I20260709 12:15:42.599941 21454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5438539aad6445ba4c38165117e192f"
dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
 from {username='slave'} at 127.0.0.1:50622
I20260709 12:15:42.600371 21454 raft_consensus.cc:493] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:42.600626 21454 raft_consensus.cc:3060] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:42.604712 21454 raft_consensus.cc:515] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:42.606228 21454 leader_election.cc:290] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 4 election: Requested vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:42.607132 21378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5438539aad6445ba4c38165117e192f" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "51a448f6f27940929352af4a932e7b8c"
I20260709 12:15:42.607282 21526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5438539aad6445ba4c38165117e192f" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:42.607822 21378 raft_consensus.cc:3060] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:42.607897 21526 raft_consensus.cc:3055] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:42.608299 21526 raft_consensus.cc:740] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Running, Role: LEADER
I20260709 12:15:42.608840 21526 consensus_queue.cc:260] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:42.609855 21526 raft_consensus.cc:3060] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:42.613164 21378 raft_consensus.cc:2468] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 4.
I20260709 12:15:42.614046 21526 raft_consensus.cc:2468] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 4.
I20260709 12:15:42.614212 21417 leader_election.cc:304] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, 84e01d71b0d1448d8c2b91f68282fa47; no voters: 
I20260709 12:15:42.615036 21693 raft_consensus.cc:2804] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:42.615492 21693 raft_consensus.cc:697] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 4 LEADER]: Becoming Leader. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Running, Role: LEADER
I20260709 12:15:42.616168 21693 consensus_queue.cc:237] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:42.623236 21275 catalog_manager.cc:5697] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 reported cstate change: term changed from 3 to 4, leader changed from b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3) to 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2). New cstate: current_term: 4 leader_uuid: "84e01d71b0d1448d8c2b91f68282fa47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.628780 21696 raft_consensus.cc:993] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c: : Instructing follower 84e01d71b0d1448d8c2b91f68282fa47 to start an election
I20260709 12:15:42.629262 21674 raft_consensus.cc:1081] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Signalling peer 84e01d71b0d1448d8c2b91f68282fa47 to start an election
I20260709 12:15:42.630661 21454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "085f9d2aa8b14024bf9a0ede6dfd793f"
dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
 from {username='slave'} at 127.0.0.1:50628
I20260709 12:15:42.631119 21454 raft_consensus.cc:493] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:42.631376 21454 raft_consensus.cc:3060] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.635633 21454 raft_consensus.cc:515] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:42.637151 21454 leader_election.cc:290] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 2 election: Requested vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:42.638105 21378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085f9d2aa8b14024bf9a0ede6dfd793f" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51a448f6f27940929352af4a932e7b8c"
I20260709 12:15:42.638510 21526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085f9d2aa8b14024bf9a0ede6dfd793f" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:42.638681 21378 raft_consensus.cc:3055] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:42.639065 21378 raft_consensus.cc:740] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Running, Role: LEADER
I20260709 12:15:42.639055 21526 raft_consensus.cc:3060] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.639878 21378 consensus_queue.cc:260] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:42.640799 21378 raft_consensus.cc:3060] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.645144 21526 raft_consensus.cc:2468] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 2.
I20260709 12:15:42.645835 21378 raft_consensus.cc:2468] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 2.
I20260709 12:15:42.646409 21419 leader_election.cc:304] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e01d71b0d1448d8c2b91f68282fa47, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:42.647488 21693 raft_consensus.cc:2804] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.647955 21693 raft_consensus.cc:697] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Becoming Leader. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Running, Role: LEADER
I20260709 12:15:42.648814 21693 consensus_queue.cc:237] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:42.656451 21275 catalog_manager.cc:5697] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 reported cstate change: term changed from 1 to 2, leader changed from 51a448f6f27940929352af4a932e7b8c (127.20.191.1) to 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "84e01d71b0d1448d8c2b91f68282fa47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.696095 21696 raft_consensus.cc:993] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c: : Instructing follower 84e01d71b0d1448d8c2b91f68282fa47 to start an election
I20260709 12:15:42.696570 21674 raft_consensus.cc:1081] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Signalling peer 84e01d71b0d1448d8c2b91f68282fa47 to start an election
I20260709 12:15:42.697980 21454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9a921c7007f40bc934700567f0794ba"
dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
 from {username='slave'} at 127.0.0.1:50628
I20260709 12:15:42.698457 21454 raft_consensus.cc:493] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:42.698737 21454 raft_consensus.cc:3060] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.702673 21454 raft_consensus.cc:515] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:42.704078 21454 leader_election.cc:290] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 2 election: Requested vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:42.705044 21528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a921c7007f40bc934700567f0794ba" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:42.705082 21379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a921c7007f40bc934700567f0794ba" candidate_uuid: "84e01d71b0d1448d8c2b91f68282fa47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51a448f6f27940929352af4a932e7b8c"
I20260709 12:15:42.705560 21528 raft_consensus.cc:3060] T c9a921c7007f40bc934700567f0794ba P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.705610 21379 raft_consensus.cc:3055] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:42.705957 21379 raft_consensus.cc:740] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Running, Role: LEADER
I20260709 12:15:42.706480 21379 consensus_queue.cc:260] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:42.707348 21379 raft_consensus.cc:3060] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.710023 21528 raft_consensus.cc:2468] T c9a921c7007f40bc934700567f0794ba P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 2.
I20260709 12:15:42.711068 21419 leader_election.cc:304] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e01d71b0d1448d8c2b91f68282fa47, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:42.711867 21693 raft_consensus.cc:2804] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.711941 21379 raft_consensus.cc:2468] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e01d71b0d1448d8c2b91f68282fa47 in term 2.
I20260709 12:15:42.712322 21693 raft_consensus.cc:697] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Becoming Leader. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Running, Role: LEADER
I20260709 12:15:42.713212 21693 consensus_queue.cc:237] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:42.720036 21275 catalog_manager.cc:5697] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47 reported cstate change: term changed from 1 to 2, leader changed from 51a448f6f27940929352af4a932e7b8c (127.20.191.1) to 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "84e01d71b0d1448d8c2b91f68282fa47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.873152 21528 raft_consensus.cc:1275] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Refusing update from remote peer 84e01d71b0d1448d8c2b91f68282fa47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:42.874338 21693 consensus_queue.cc:1048] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:42.885371 21379 raft_consensus.cc:1275] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Refusing update from remote peer 84e01d71b0d1448d8c2b91f68282fa47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:42.887283 21710 consensus_queue.cc:1048] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:43.043200 21528 raft_consensus.cc:1275] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 4 FOLLOWER]: Refusing update from remote peer 84e01d71b0d1448d8c2b91f68282fa47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:15:43.043692 21400 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5060 after lost signal to thread 21247
W20260709 12:15:43.044409 21400 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5740 after lost signal to thread 21310
I20260709 12:15:43.044370 21710 consensus_queue.cc:1048] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:15:43.045265 21400 debug-util.cc:398] Leaking SignalData structure 0x7b08001f0740 after lost signal to thread 21403
W20260709 12:15:43.045982 21400 debug-util.cc:398] Leaking SignalData structure 0x7b08001f4d00 after lost signal to thread 21478
W20260709 12:15:43.046627 21400 debug-util.cc:398] Leaking SignalData structure 0x7b080019eac0 after lost signal to thread 21552
I20260709 12:15:43.054968 21379 raft_consensus.cc:1275] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 4 FOLLOWER]: Refusing update from remote peer 84e01d71b0d1448d8c2b91f68282fa47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:43.056579 21693 consensus_queue.cc:1048] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:43.094751 21379 raft_consensus.cc:1275] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Refusing update from remote peer 84e01d71b0d1448d8c2b91f68282fa47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.096344 21693 consensus_queue.cc:1048] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:43.107975 21528 raft_consensus.cc:1275] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Refusing update from remote peer 84e01d71b0d1448d8c2b91f68282fa47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.109483 21698 consensus_queue.cc:1048] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:43.154362 21379 raft_consensus.cc:1275] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 4 FOLLOWER]: Refusing update from remote peer 84e01d71b0d1448d8c2b91f68282fa47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:43.155774 21698 consensus_queue.cc:1048] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:43.165040 21528 raft_consensus.cc:1275] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 4 FOLLOWER]: Refusing update from remote peer 84e01d71b0d1448d8c2b91f68282fa47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:43.166679 21710 consensus_queue.cc:1048] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:43.188865 21379 raft_consensus.cc:1275] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Refusing update from remote peer 84e01d71b0d1448d8c2b91f68282fa47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.190166 21698 consensus_queue.cc:1048] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:43.199592 21528 raft_consensus.cc:1275] T c9a921c7007f40bc934700567f0794ba P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Refusing update from remote peer 84e01d71b0d1448d8c2b91f68282fa47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.203774 21698 consensus_queue.cc:1048] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:45.375761 21244 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:15:45.376564 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:45.384081 21454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "085f9d2aa8b14024bf9a0ede6dfd793f"
dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
mode: GRACEFUL
new_leader_uuid: "51a448f6f27940929352af4a932e7b8c"
 from {username='slave'} at 127.0.0.1:54896
I20260709 12:15:45.384727 21454 raft_consensus.cc:606] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Received request to transfer leadership to TS 51a448f6f27940929352af4a932e7b8c
I20260709 12:15:45.387523 21454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d"
dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
mode: GRACEFUL
new_leader_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
 from {username='slave'} at 127.0.0.1:54896
I20260709 12:15:45.387955 21454 raft_consensus.cc:606] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 4 LEADER]: Received request to transfer leadership to TS b7141e8c8cd04e61a34cd263fda83b3d
I20260709 12:15:45.390159 21454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71c8fc47649e4defa79f85f626d3df0b"
dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
mode: GRACEFUL
new_leader_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
 from {username='slave'} at 127.0.0.1:54896
I20260709 12:15:45.390612 21454 raft_consensus.cc:606] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 LEADER]: Received request to transfer leadership to TS b7141e8c8cd04e61a34cd263fda83b3d
I20260709 12:15:45.393085 21454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c7849f4e74a431a842e898c587b05cd"
dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
mode: GRACEFUL
new_leader_uuid: "51a448f6f27940929352af4a932e7b8c"
 from {username='slave'} at 127.0.0.1:54896
I20260709 12:15:45.393546 21454 raft_consensus.cc:606] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Received request to transfer leadership to TS 51a448f6f27940929352af4a932e7b8c
I20260709 12:15:45.396056 21454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d119589772a243009b0526b813d6b272"
dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
mode: GRACEFUL
new_leader_uuid: "51a448f6f27940929352af4a932e7b8c"
 from {username='slave'} at 127.0.0.1:54896
I20260709 12:15:45.396616 21454 raft_consensus.cc:606] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Received request to transfer leadership to TS 51a448f6f27940929352af4a932e7b8c
I20260709 12:15:45.397660 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:45.398142 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:45.612396 21710 raft_consensus.cc:993] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47: : Instructing follower b7141e8c8cd04e61a34cd263fda83b3d to start an election
I20260709 12:15:45.612800 21710 raft_consensus.cc:1081] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 LEADER]: Signalling peer b7141e8c8cd04e61a34cd263fda83b3d to start an election
I20260709 12:15:45.614317 21526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71c8fc47649e4defa79f85f626d3df0b"
dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
 from {username='slave'} at 127.0.0.1:60308
I20260709 12:15:45.614871 21526 raft_consensus.cc:493] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:45.615217 21526 raft_consensus.cc:3060] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.620800 21526 raft_consensus.cc:515] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:45.622859 21526 leader_election.cc:290] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 2 election: Requested vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135)
I20260709 12:15:45.623951 21379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c8fc47649e4defa79f85f626d3df0b" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51a448f6f27940929352af4a932e7b8c"
I20260709 12:15:45.624145 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c8fc47649e4defa79f85f626d3df0b" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
I20260709 12:15:45.624765 21379 raft_consensus.cc:3060] T 71c8fc47649e4defa79f85f626d3df0b P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.624797 21454 raft_consensus.cc:3055] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:45.625197 21454 raft_consensus.cc:740] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Running, Role: LEADER
I20260709 12:15:45.625990 21454 consensus_queue.cc:260] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:45.626971 21454 raft_consensus.cc:3060] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.629447 21379 raft_consensus.cc:2468] T 71c8fc47649e4defa79f85f626d3df0b P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7141e8c8cd04e61a34cd263fda83b3d in term 2.
I20260709 12:15:45.630645 21491 leader_election.cc:304] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:45.631384 21691 raft_consensus.cc:2804] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:45.631719 21454 raft_consensus.cc:2468] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7141e8c8cd04e61a34cd263fda83b3d in term 2.
I20260709 12:15:45.632341 21691 raft_consensus.cc:697] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [term 2 LEADER]: Becoming Leader. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Running, Role: LEADER
I20260709 12:15:45.633311 21691 consensus_queue.cc:237] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:45.640127 21274 catalog_manager.cc:5697] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d reported cstate change: term changed from 1 to 2, leader changed from 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2) to b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3). New cstate: current_term: 2 leader_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:45.675079 21710 raft_consensus.cc:993] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47: : Instructing follower 51a448f6f27940929352af4a932e7b8c to start an election
I20260709 12:15:45.675602 21710 raft_consensus.cc:1081] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Signalling peer 51a448f6f27940929352af4a932e7b8c to start an election
I20260709 12:15:45.677172 21378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "085f9d2aa8b14024bf9a0ede6dfd793f"
dest_uuid: "51a448f6f27940929352af4a932e7b8c"
 from {username='slave'} at 127.0.0.1:38562
I20260709 12:15:45.677620 21378 raft_consensus.cc:493] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:45.677889 21378 raft_consensus.cc:3060] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.683723 21378 raft_consensus.cc:515] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:45.686597 21378 leader_election.cc:290] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 3 election: Requested vote from peers 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:45.686785 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085f9d2aa8b14024bf9a0ede6dfd793f" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
I20260709 12:15:45.687263 21526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085f9d2aa8b14024bf9a0ede6dfd793f" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:45.687417 21454 raft_consensus.cc:3055] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:45.687767 21454 raft_consensus.cc:740] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Running, Role: LEADER
I20260709 12:15:45.687783 21526 raft_consensus.cc:3060] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.688570 21454 consensus_queue.cc:260] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:45.689740 21454 raft_consensus.cc:3060] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.694620 21526 raft_consensus.cc:2468] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 3.
I20260709 12:15:45.694712 21733 raft_consensus.cc:993] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47: : Instructing follower 51a448f6f27940929352af4a932e7b8c to start an election
I20260709 12:15:45.695240 21710 raft_consensus.cc:1081] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Signalling peer 51a448f6f27940929352af4a932e7b8c to start an election
I20260709 12:15:45.695577 21454 raft_consensus.cc:2468] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 3.
I20260709 12:15:45.696062 21344 leader_election.cc:304] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:45.697082 21378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c7849f4e74a431a842e898c587b05cd"
dest_uuid: "51a448f6f27940929352af4a932e7b8c"
 from {username='slave'} at 127.0.0.1:38562
I20260709 12:15:45.697541 21378 raft_consensus.cc:493] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:45.697856 21378 raft_consensus.cc:3060] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.698061 21734 raft_consensus.cc:2804] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:45.699270 21734 raft_consensus.cc:697] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 3 LEADER]: Becoming Leader. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Running, Role: LEADER
I20260709 12:15:45.700734 21734 consensus_queue.cc:237] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:45.702243 21733 raft_consensus.cc:993] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47: : Instructing follower b7141e8c8cd04e61a34cd263fda83b3d to start an election
I20260709 12:15:45.702719 21710 raft_consensus.cc:1081] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 4 LEADER]: Signalling peer b7141e8c8cd04e61a34cd263fda83b3d to start an election
I20260709 12:15:45.703650 21378 raft_consensus.cc:515] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:45.704579 21526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d"
dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
 from {username='slave'} at 127.0.0.1:60308
I20260709 12:15:45.705281 21526 raft_consensus.cc:493] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:45.705651 21526 raft_consensus.cc:3060] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:45.706683 21454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7849f4e74a431a842e898c587b05cd" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
I20260709 12:15:45.707170 21454 raft_consensus.cc:3055] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:45.707346 21454 raft_consensus.cc:740] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Running, Role: LEADER
I20260709 12:15:45.707994 21454 consensus_queue.cc:260] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:45.708812 21454 raft_consensus.cc:3060] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.710399 21378 leader_election.cc:290] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 3 election: Requested vote from peers 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:45.710122 21274 catalog_manager.cc:5697] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c reported cstate change: term changed from 2 to 3, leader changed from 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2) to 51a448f6f27940929352af4a932e7b8c (127.20.191.1). New cstate: current_term: 3 leader_uuid: "51a448f6f27940929352af4a932e7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.711752 21528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7849f4e74a431a842e898c587b05cd" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:45.712437 21528 raft_consensus.cc:3060] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.713349 21526 raft_consensus.cc:515] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:45.715571 21526 leader_election.cc:290] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 5 election: Requested vote from peers 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619), 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135)
I20260709 12:15:45.715801 21378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "51a448f6f27940929352af4a932e7b8c"
I20260709 12:15:45.716310 21378 raft_consensus.cc:3060] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:45.718556 21452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381f594f7b0d47cc96959e331c3d590d" candidate_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
I20260709 12:15:45.719002 21528 raft_consensus.cc:2468] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 3.
I20260709 12:15:45.719122 21452 raft_consensus.cc:3055] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:45.719489 21452 raft_consensus.cc:740] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Running, Role: LEADER
I20260709 12:15:45.720382 21454 raft_consensus.cc:2468] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 3.
I20260709 12:15:45.720293 21452 consensus_queue.cc:260] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:45.721508 21345 leader_election.cc:304] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, 84e01d71b0d1448d8c2b91f68282fa47; no voters: 
I20260709 12:15:45.721589 21452 raft_consensus.cc:3060] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:45.722189 21734 raft_consensus.cc:2804] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:45.722576 21734 raft_consensus.cc:697] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 3 LEADER]: Becoming Leader. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Running, Role: LEADER
I20260709 12:15:45.722790 21378 raft_consensus.cc:2468] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7141e8c8cd04e61a34cd263fda83b3d in term 5.
I20260709 12:15:45.723297 21734 consensus_queue.cc:237] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:45.723927 21491 leader_election.cc:304] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:45.724720 21691 raft_consensus.cc:2804] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:45.725170 21691 raft_consensus.cc:697] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 5 LEADER]: Becoming Leader. State: Replica: b7141e8c8cd04e61a34cd263fda83b3d, State: Running, Role: LEADER
I20260709 12:15:45.726089 21691 consensus_queue.cc:237] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } }
I20260709 12:15:45.732317 21452 raft_consensus.cc:2468] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7141e8c8cd04e61a34cd263fda83b3d in term 5.
I20260709 12:15:45.735185 21274 catalog_manager.cc:5697] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d reported cstate change: term changed from 4 to 5, leader changed from 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2) to b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3). New cstate: current_term: 5 leader_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.737309 21275 catalog_manager.cc:5697] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c reported cstate change: term changed from 2 to 3, leader changed from 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2) to 51a448f6f27940929352af4a932e7b8c (127.20.191.1). New cstate: current_term: 3 leader_uuid: "51a448f6f27940929352af4a932e7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.760668 21733 raft_consensus.cc:993] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47: : Instructing follower 51a448f6f27940929352af4a932e7b8c to start an election
I20260709 12:15:45.761174 21710 raft_consensus.cc:1081] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Signalling peer 51a448f6f27940929352af4a932e7b8c to start an election
I20260709 12:15:45.762794 21378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d119589772a243009b0526b813d6b272"
dest_uuid: "51a448f6f27940929352af4a932e7b8c"
 from {username='slave'} at 127.0.0.1:38562
I20260709 12:15:45.763290 21378 raft_consensus.cc:493] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:45.763594 21378 raft_consensus.cc:3060] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.768541 21378 raft_consensus.cc:515] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:45.770319 21378 leader_election.cc:290] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 3 election: Requested vote from peers 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135), b7141e8c8cd04e61a34cd263fda83b3d (127.20.191.3:33737)
I20260709 12:15:45.771176 21452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d119589772a243009b0526b813d6b272" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "84e01d71b0d1448d8c2b91f68282fa47"
I20260709 12:15:45.771272 21528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d119589772a243009b0526b813d6b272" candidate_uuid: "51a448f6f27940929352af4a932e7b8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7141e8c8cd04e61a34cd263fda83b3d"
I20260709 12:15:45.771731 21452 raft_consensus.cc:3055] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:45.771782 21528 raft_consensus.cc:3060] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.771988 21452 raft_consensus.cc:740] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 84e01d71b0d1448d8c2b91f68282fa47, State: Running, Role: LEADER
I20260709 12:15:45.772658 21452 consensus_queue.cc:260] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:45.773466 21452 raft_consensus.cc:3060] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.776567 21528 raft_consensus.cc:2468] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 3.
I20260709 12:15:45.777396 21452 raft_consensus.cc:2468] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a448f6f27940929352af4a932e7b8c in term 3.
I20260709 12:15:45.777496 21344 leader_election.cc:304] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a448f6f27940929352af4a932e7b8c, b7141e8c8cd04e61a34cd263fda83b3d; no voters: 
I20260709 12:15:45.778307 21734 raft_consensus.cc:2804] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:45.778757 21734 raft_consensus.cc:697] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 3 LEADER]: Becoming Leader. State: Replica: 51a448f6f27940929352af4a932e7b8c, State: Running, Role: LEADER
I20260709 12:15:45.779448 21734 consensus_queue.cc:237] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } }
I20260709 12:15:45.785836 21275 catalog_manager.cc:5697] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c reported cstate change: term changed from 2 to 3, leader changed from 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2) to 51a448f6f27940929352af4a932e7b8c (127.20.191.1). New cstate: current_term: 3 leader_uuid: "51a448f6f27940929352af4a932e7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:46.123730 21454 raft_consensus.cc:1275] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 5 FOLLOWER]: Refusing update from remote peer b7141e8c8cd04e61a34cd263fda83b3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:15:46.123749 21452 raft_consensus.cc:1275] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Refusing update from remote peer 51a448f6f27940929352af4a932e7b8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:46.125032 21691 consensus_queue.cc:1048] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:46.124997 21734 consensus_queue.cc:1048] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:46.142743 21379 raft_consensus.cc:1275] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 5 FOLLOWER]: Refusing update from remote peer b7141e8c8cd04e61a34cd263fda83b3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:15:46.146413 21453 raft_consensus.cc:1275] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Refusing update from remote peer 51a448f6f27940929352af4a932e7b8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:46.148120 21727 consensus_queue.cc:1048] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:15:46.148865 21734 consensus_queue.cc:1048] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:46.155831 21528 raft_consensus.cc:1275] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Refusing update from remote peer 51a448f6f27940929352af4a932e7b8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:46.160099 21734 consensus_queue.cc:1048] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:15:46.172549 21526 raft_consensus.cc:1275] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Refusing update from remote peer 51a448f6f27940929352af4a932e7b8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:46.175377 21734 consensus_queue.cc:1048] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:46.181880 21452 raft_consensus.cc:1275] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Refusing update from remote peer 51a448f6f27940929352af4a932e7b8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:46.184774 21735 consensus_queue.cc:1048] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:46.192092 21378 raft_consensus.cc:1275] T 71c8fc47649e4defa79f85f626d3df0b P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Refusing update from remote peer b7141e8c8cd04e61a34cd263fda83b3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:46.195137 21691 consensus_queue.cc:1048] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a448f6f27940929352af4a932e7b8c" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:46.209914 21450 raft_consensus.cc:1275] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Refusing update from remote peer b7141e8c8cd04e61a34cd263fda83b3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:46.214279 21727 consensus_queue.cc:1048] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e01d71b0d1448d8c2b91f68282fa47" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:46.220419 21528 raft_consensus.cc:1275] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Refusing update from remote peer 51a448f6f27940929352af4a932e7b8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:46.222193 21752 consensus_queue.cc:1048] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7141e8c8cd04e61a34cd263fda83b3d" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:46.399282 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:46.404017 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:46.404467 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:47.405441 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:47.411310 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:47.411861 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:48.413054 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:48.418241 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:48.418658 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:49.419734 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:49.425309 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:49.425740 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:50.426790 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:50.432957 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:50.433377 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:51.434659 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:51.440748 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:51.441267 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:52.442754 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:52.448462 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:52.448959 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:53.450035 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:53.456199 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:53.456632 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:54.457700 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:54.463799 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:54.464358 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:55.495484 21244 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:15:55.496035 21244 tablet_server.cc:179] TabletServer@127.20.191.1:0 shutting down...
W20260709 12:15:55.519043 21417 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:55.520466 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:55.521416 21244 tablet_replica.cc:333] T ce6dde0da5d248dfb543e1986223fbd2 P 51a448f6f27940929352af4a932e7b8c: stopping tablet replica
I20260709 12:15:55.522472 21244 raft_consensus.cc:2243] T ce6dde0da5d248dfb543e1986223fbd2 P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:55.522845 21417 consensus_peers.cc:597] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 -> Peer 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619): Couldn't send request to peer 51a448f6f27940929352af4a932e7b8c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:55.523285 21244 raft_consensus.cc:2272] T ce6dde0da5d248dfb543e1986223fbd2 P 51a448f6f27940929352af4a932e7b8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.525681 21244 tablet_replica.cc:333] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c: stopping tablet replica
I20260709 12:15:55.526243 21244 raft_consensus.cc:2243] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:55.526669 21244 raft_consensus.cc:2272] T 381f594f7b0d47cc96959e331c3d590d P 51a448f6f27940929352af4a932e7b8c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.528304 21244 tablet_replica.cc:333] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c: stopping tablet replica
I20260709 12:15:55.528853 21244 raft_consensus.cc:2243] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:55.529949 21244 raft_consensus.cc:2272] T 8c7849f4e74a431a842e898c587b05cd P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.532264 21244 tablet_replica.cc:333] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c: stopping tablet replica
I20260709 12:15:55.533146 21244 raft_consensus.cc:2243] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:55.533670 21244 raft_consensus.cc:2272] T f5438539aad6445ba4c38165117e192f P 51a448f6f27940929352af4a932e7b8c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.535539 21244 tablet_replica.cc:333] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c: stopping tablet replica
I20260709 12:15:55.536099 21244 raft_consensus.cc:2243] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:55.536968 21244 raft_consensus.cc:2272] T d119589772a243009b0526b813d6b272 P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.538892 21244 tablet_replica.cc:333] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c: stopping tablet replica
I20260709 12:15:55.539412 21244 raft_consensus.cc:2243] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:55.539884 21244 raft_consensus.cc:2272] T 718268da3eb54ad8b465d405d5fcd735 P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.541626 21244 tablet_replica.cc:333] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c: stopping tablet replica
I20260709 12:15:55.542146 21244 raft_consensus.cc:2243] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:55.542526 21244 raft_consensus.cc:2272] T c9a921c7007f40bc934700567f0794ba P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.544744 21244 tablet_replica.cc:333] T 71c8fc47649e4defa79f85f626d3df0b P 51a448f6f27940929352af4a932e7b8c: stopping tablet replica
I20260709 12:15:55.545382 21244 raft_consensus.cc:2243] T 71c8fc47649e4defa79f85f626d3df0b P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:55.545883 21244 raft_consensus.cc:2272] T 71c8fc47649e4defa79f85f626d3df0b P 51a448f6f27940929352af4a932e7b8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.547994 21244 tablet_replica.cc:333] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c: stopping tablet replica
I20260709 12:15:55.548442 21244 raft_consensus.cc:2243] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:55.549301 21244 raft_consensus.cc:2272] T 085f9d2aa8b14024bf9a0ede6dfd793f P 51a448f6f27940929352af4a932e7b8c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.651356 21244 tablet_server.cc:196] TabletServer@127.20.191.1:0 shutdown complete.
I20260709 12:15:55.668991 21244 tablet_server.cc:179] TabletServer@127.20.191.2:0 shutting down...
I20260709 12:15:55.699164 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:15:55.699265 21491 consensus_peers.cc:597] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d -> Peer 51a448f6f27940929352af4a932e7b8c (127.20.191.1:41619): Couldn't send request to peer 51a448f6f27940929352af4a932e7b8c. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:41619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:55.700066 21244 tablet_replica.cc:333] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47: stopping tablet replica
I20260709 12:15:55.701030 21244 raft_consensus.cc:2243] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:55.701929 21244 raft_consensus.cc:2272] T c9a921c7007f40bc934700567f0794ba P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.703709 21244 tablet_replica.cc:333] T ce6dde0da5d248dfb543e1986223fbd2 P 84e01d71b0d1448d8c2b91f68282fa47: stopping tablet replica
I20260709 12:15:55.704205 21244 raft_consensus.cc:2243] T ce6dde0da5d248dfb543e1986223fbd2 P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:55.704607 21244 raft_consensus.cc:2272] T ce6dde0da5d248dfb543e1986223fbd2 P 84e01d71b0d1448d8c2b91f68282fa47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.706211 21244 tablet_replica.cc:333] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47: stopping tablet replica
I20260709 12:15:55.706718 21244 raft_consensus.cc:2243] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:55.707123 21244 raft_consensus.cc:2272] T 085f9d2aa8b14024bf9a0ede6dfd793f P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.708732 21244 tablet_replica.cc:333] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47: stopping tablet replica
I20260709 12:15:55.709210 21244 raft_consensus.cc:2243] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:55.709614 21244 raft_consensus.cc:2272] T 71c8fc47649e4defa79f85f626d3df0b P 84e01d71b0d1448d8c2b91f68282fa47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.711194 21244 tablet_replica.cc:333] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47: stopping tablet replica
I20260709 12:15:55.711740 21244 raft_consensus.cc:2243] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:55.712141 21244 raft_consensus.cc:2272] T 381f594f7b0d47cc96959e331c3d590d P 84e01d71b0d1448d8c2b91f68282fa47 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.713650 21244 tablet_replica.cc:333] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47: stopping tablet replica
I20260709 12:15:55.714143 21244 raft_consensus.cc:2243] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:55.714834 21244 raft_consensus.cc:2272] T f5438539aad6445ba4c38165117e192f P 84e01d71b0d1448d8c2b91f68282fa47 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.716420 21244 tablet_replica.cc:333] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47: stopping tablet replica
I20260709 12:15:55.716866 21244 raft_consensus.cc:2243] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:55.717227 21244 raft_consensus.cc:2272] T d119589772a243009b0526b813d6b272 P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.718823 21244 tablet_replica.cc:333] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47: stopping tablet replica
I20260709 12:15:55.719256 21244 raft_consensus.cc:2243] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:55.719972 21244 raft_consensus.cc:2272] T 718268da3eb54ad8b465d405d5fcd735 P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.721570 21244 tablet_replica.cc:333] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47: stopping tablet replica
I20260709 12:15:55.722036 21244 raft_consensus.cc:2243] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:55.722411 21244 raft_consensus.cc:2272] T 8c7849f4e74a431a842e898c587b05cd P 84e01d71b0d1448d8c2b91f68282fa47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.749588 21244 tablet_server.cc:196] TabletServer@127.20.191.2:0 shutdown complete.
I20260709 12:15:55.771013 21244 tablet_server.cc:179] TabletServer@127.20.191.3:0 shutting down...
W20260709 12:15:55.796065 21494 consensus_peers.cc:597] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d -> Peer 84e01d71b0d1448d8c2b91f68282fa47 (127.20.191.2:46135): Couldn't send request to peer 84e01d71b0d1448d8c2b91f68282fa47. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:46135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:55.797227 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:55.797979 21244 tablet_replica.cc:333] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d: stopping tablet replica
I20260709 12:15:55.798707 21244 raft_consensus.cc:2243] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:55.799280 21244 raft_consensus.cc:2272] T 8c7849f4e74a431a842e898c587b05cd P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.801131 21244 tablet_replica.cc:333] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d: stopping tablet replica
I20260709 12:15:55.801641 21244 raft_consensus.cc:2243] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:15:55.802454 21244 raft_consensus.cc:2272] T 381f594f7b0d47cc96959e331c3d590d P b7141e8c8cd04e61a34cd263fda83b3d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.804301 21244 tablet_replica.cc:333] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d: stopping tablet replica
I20260709 12:15:55.804776 21244 raft_consensus.cc:2243] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:55.805518 21244 raft_consensus.cc:2272] T ce6dde0da5d248dfb543e1986223fbd2 P b7141e8c8cd04e61a34cd263fda83b3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.807220 21244 tablet_replica.cc:333] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d: stopping tablet replica
I20260709 12:15:55.807705 21244 raft_consensus.cc:2243] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:55.808089 21244 raft_consensus.cc:2272] T 085f9d2aa8b14024bf9a0ede6dfd793f P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.809894 21244 tablet_replica.cc:333] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d: stopping tablet replica
I20260709 12:15:55.810388 21244 raft_consensus.cc:2243] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:55.811131 21244 raft_consensus.cc:2272] T 71c8fc47649e4defa79f85f626d3df0b P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.812779 21244 tablet_replica.cc:333] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d: stopping tablet replica
I20260709 12:15:55.813282 21244 raft_consensus.cc:2243] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:55.813695 21244 raft_consensus.cc:2272] T d119589772a243009b0526b813d6b272 P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.815368 21244 tablet_replica.cc:333] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d: stopping tablet replica
I20260709 12:15:55.815841 21244 raft_consensus.cc:2243] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:55.816293 21244 raft_consensus.cc:2272] T 718268da3eb54ad8b465d405d5fcd735 P b7141e8c8cd04e61a34cd263fda83b3d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.818090 21244 tablet_replica.cc:333] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d: stopping tablet replica
I20260709 12:15:55.818542 21244 raft_consensus.cc:2243] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:55.818926 21244 raft_consensus.cc:2272] T f5438539aad6445ba4c38165117e192f P b7141e8c8cd04e61a34cd263fda83b3d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.820581 21244 tablet_replica.cc:333] T c9a921c7007f40bc934700567f0794ba P b7141e8c8cd04e61a34cd263fda83b3d: stopping tablet replica
I20260709 12:15:55.821036 21244 raft_consensus.cc:2243] T c9a921c7007f40bc934700567f0794ba P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:55.821504 21244 raft_consensus.cc:2272] T c9a921c7007f40bc934700567f0794ba P b7141e8c8cd04e61a34cd263fda83b3d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:55.848315 21244 tablet_server.cc:196] TabletServer@127.20.191.3:0 shutdown complete.
I20260709 12:15:55.865694 21244 master.cc:562] Master@127.20.191.62:41215 shutting down...
I20260709 12:15:56.014083 21244 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:56.014683 21244 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.015012 21244 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0714e974dc4c4da4bea88940fc8eb0d9: stopping tablet replica
I20260709 12:15:56.033756 21244 master.cc:584] Master@127.20.191.62:41215 shutdown complete.
51a448f6f27940929352af4a932e7b8c  4
84e01d71b0d1448d8c2b91f68282fa47  4
b7141e8c8cd04e61a34cd263fda83b3d  1
51a448f6f27940929352af4a932e7b8c  3
84e01d71b0d1448d8c2b91f68282fa47  3
b7141e8c8cd04e61a34cd263fda83b3d  3
51a448f6f27940929352af4a932e7b8c  0
84e01d71b0d1448d8c2b91f68282fa47  8
b7141e8c8cd04e61a34cd263fda83b3d  1
51a448f6f27940929352af4a932e7b8c  3
84e01d71b0d1448d8c2b91f68282fa47  3
b7141e8c8cd04e61a34cd263fda83b3d  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31040 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:15:56.075991 21244 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.191.62:36641
I20260709 12:15:56.077121 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:56.082836 21767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:56.083132 21768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:56.083741 21770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:56.084412 21244 server_base.cc:1061] running on GCE node
I20260709 12:15:56.085333 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:56.085523 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:56.085636 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599356085626 us; error 0 us; skew 500 ppm
I20260709 12:15:56.086124 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:56.088464 21244 webserver.cc:533] Webserver started at http://127.20.191.62:38031/ using document root <none> and password file <none>
I20260709 12:15:56.088912 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:56.089066 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:56.089274 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:56.090427 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/master-0-root/instance:
uuid: "58456430ff2648aea9fae88921051de3"
format_stamp: "Formatted at 2026-07-09 12:15:56 on dist-test-slave-7c1h"
I20260709 12:15:56.095005 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:15:56.098326 21775 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:56.099102 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 12:15:56.099383 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/master-0-root
uuid: "58456430ff2648aea9fae88921051de3"
format_stamp: "Formatted at 2026-07-09 12:15:56 on dist-test-slave-7c1h"
I20260709 12:15:56.099653 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:56.119019 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:56.120265 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:56.157960 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.62:36641
I20260709 12:15:56.158038 21826 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.62:36641 every 8 connection(s)
I20260709 12:15:56.161834 21827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.171916 21827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3: Bootstrap starting.
I20260709 12:15:56.176522 21827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:56.180872 21827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3: No bootstrap required, opened a new log
I20260709 12:15:56.183204 21827 raft_consensus.cc:359] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58456430ff2648aea9fae88921051de3" member_type: VOTER }
I20260709 12:15:56.183696 21827 raft_consensus.cc:385] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:56.183902 21827 raft_consensus.cc:740] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58456430ff2648aea9fae88921051de3, State: Initialized, Role: FOLLOWER
I20260709 12:15:56.184448 21827 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58456430ff2648aea9fae88921051de3" member_type: VOTER }
I20260709 12:15:56.184909 21827 raft_consensus.cc:399] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:56.185107 21827 raft_consensus.cc:493] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:56.185308 21827 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:56.189167 21827 raft_consensus.cc:515] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58456430ff2648aea9fae88921051de3" member_type: VOTER }
I20260709 12:15:56.189667 21827 leader_election.cc:304] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58456430ff2648aea9fae88921051de3; no voters: 
I20260709 12:15:56.190696 21827 leader_election.cc:290] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:56.191076 21830 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:56.192379 21830 raft_consensus.cc:697] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [term 1 LEADER]: Becoming Leader. State: Replica: 58456430ff2648aea9fae88921051de3, State: Running, Role: LEADER
I20260709 12:15:56.193039 21830 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58456430ff2648aea9fae88921051de3" member_type: VOTER }
I20260709 12:15:56.193548 21827 sys_catalog.cc:565] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:56.200853 21832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58456430ff2648aea9fae88921051de3. Latest consensus state: current_term: 1 leader_uuid: "58456430ff2648aea9fae88921051de3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58456430ff2648aea9fae88921051de3" member_type: VOTER } }
I20260709 12:15:56.201606 21832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:56.205154 21831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58456430ff2648aea9fae88921051de3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58456430ff2648aea9fae88921051de3" member_type: VOTER } }
I20260709 12:15:56.205968 21831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:56.207731 21837 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:56.213833 21837 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:56.216986 21244 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:56.224076 21837 catalog_manager.cc:1383] Generated new cluster ID: f00a05bd816c4b48870d63370f0e10fd
I20260709 12:15:56.224325 21837 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:56.238978 21837 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:56.240592 21837 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:56.257666 21837 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3: Generated new TSK 0
I20260709 12:15:56.258280 21837 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:56.283671 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:56.289363 21848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:56.290279 21849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:56.292725 21244 server_base.cc:1061] running on GCE node
W20260709 12:15:56.292778 21851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:56.293887 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:56.294117 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:56.294269 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599356294252 us; error 0 us; skew 500 ppm
I20260709 12:15:56.294765 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:56.297163 21244 webserver.cc:533] Webserver started at http://127.20.191.1:36965/ using document root <none> and password file <none>
I20260709 12:15:56.297657 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:56.297875 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:56.298182 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:56.299230 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/ts-0-root/instance:
uuid: "d00d75d8e50e4383abd5f04c72c73071"
format_stamp: "Formatted at 2026-07-09 12:15:56 on dist-test-slave-7c1h"
I20260709 12:15:56.303887 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:15:56.307193 21856 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:56.308046 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:15:56.308343 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/ts-0-root
uuid: "d00d75d8e50e4383abd5f04c72c73071"
format_stamp: "Formatted at 2026-07-09 12:15:56 on dist-test-slave-7c1h"
I20260709 12:15:56.308646 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:56.324795 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:56.326102 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:56.327594 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:56.329962 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:56.330173 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:56.330600 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:56.330817 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:56.371980 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.1:34199
I20260709 12:15:56.372098 21918 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.1:34199 every 8 connection(s)
I20260709 12:15:56.377240 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:56.383816 21923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:56.386292 21924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:56.388536 21926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:56.389458 21919 heartbeater.cc:344] Connected to a master server at 127.20.191.62:36641
I20260709 12:15:56.389737 21244 server_base.cc:1061] running on GCE node
I20260709 12:15:56.389866 21919 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:56.390690 21919 heartbeater.cc:507] Master 127.20.191.62:36641 requested a full tablet report, sending...
I20260709 12:15:56.390776 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:56.391038 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:56.391191 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599356391175 us; error 0 us; skew 500 ppm
I20260709 12:15:56.391752 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:56.393078 21792 ts_manager.cc:194] Registered new tserver with Master: d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199)
I20260709 12:15:56.394585 21244 webserver.cc:533] Webserver started at http://127.20.191.2:45203/ using document root <none> and password file <none>
I20260709 12:15:56.395224 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:56.395443 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:56.395569 21792 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39230
I20260709 12:15:56.395766 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:56.397128 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/ts-1-root/instance:
uuid: "532d8c016b334c18b3ec09578fa596f9"
format_stamp: "Formatted at 2026-07-09 12:15:56 on dist-test-slave-7c1h"
I20260709 12:15:56.401444 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:15:56.404819 21931 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:56.405547 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:15:56.405848 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/ts-1-root
uuid: "532d8c016b334c18b3ec09578fa596f9"
format_stamp: "Formatted at 2026-07-09 12:15:56 on dist-test-slave-7c1h"
I20260709 12:15:56.406116 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:56.431054 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:56.432227 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:56.433684 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:56.435843 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:56.436050 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:56.436273 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:56.436427 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:56.483685 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.2:37455
I20260709 12:15:56.483780 21993 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.2:37455 every 8 connection(s)
I20260709 12:15:56.488165 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:56.495878 21997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:56.497453 21998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:56.498133 22000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:56.498521 21244 server_base.cc:1061] running on GCE node
I20260709 12:15:56.499652 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:56.499899 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:56.500082 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599356500066 us; error 0 us; skew 500 ppm
I20260709 12:15:56.500741 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:56.502588 21994 heartbeater.cc:344] Connected to a master server at 127.20.191.62:36641
I20260709 12:15:56.503010 21994 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:56.503819 21244 webserver.cc:533] Webserver started at http://127.20.191.3:35315/ using document root <none> and password file <none>
I20260709 12:15:56.503898 21994 heartbeater.cc:507] Master 127.20.191.62:36641 requested a full tablet report, sending...
I20260709 12:15:56.504511 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:56.504768 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:56.505081 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:56.506644 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/ts-2-root/instance:
uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
format_stamp: "Formatted at 2026-07-09 12:15:56 on dist-test-slave-7c1h"
I20260709 12:15:56.507050 21792 ts_manager.cc:194] Registered new tserver with Master: 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455)
I20260709 12:15:56.508836 21792 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39240
I20260709 12:15:56.511907 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:15:56.515915 22005 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:56.516964 21244 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:15:56.517360 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/ts-2-root
uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
format_stamp: "Formatted at 2026-07-09 12:15:56 on dist-test-slave-7c1h"
I20260709 12:15:56.517663 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599324869158-21244-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:56.537818 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:56.539098 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:56.540550 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:56.543071 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:56.543303 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:56.543540 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:56.543694 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:56.583976 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.3:39713
I20260709 12:15:56.584079 22067 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.3:39713 every 8 connection(s)
I20260709 12:15:56.597478 22068 heartbeater.cc:344] Connected to a master server at 127.20.191.62:36641
I20260709 12:15:56.597961 22068 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:56.598681 22068 heartbeater.cc:507] Master 127.20.191.62:36641 requested a full tablet report, sending...
I20260709 12:15:56.600566 21792 ts_manager.cc:194] Registered new tserver with Master: 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:56.601452 21244 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014436942s
I20260709 12:15:56.602262 21792 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39256
I20260709 12:15:56.632071 21792 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39264:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:56.635114 21792 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:56.706434 22033 tablet_service.cc:1511] Processing CreateTablet for tablet 13511bd75f3f414381563741fec19933 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:15:56.709056 22033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13511bd75f3f414381563741fec19933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.711937 22032 tablet_service.cc:1511] Processing CreateTablet for tablet fdf9a5b30c9d4da7a9544632c3407a97 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:15:56.713483 22032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdf9a5b30c9d4da7a9544632c3407a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.719612 22031 tablet_service.cc:1511] Processing CreateTablet for tablet 1bc1ca7a20764dc887bffaa896850ec3 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:15:56.721024 22031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bc1ca7a20764dc887bffaa896850ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.730973 22030 tablet_service.cc:1511] Processing CreateTablet for tablet cd75751852944d3fa27116f7ce00f75a (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:15:56.732411 22030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd75751852944d3fa27116f7ce00f75a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.734561 22083 tablet_bootstrap.cc:492] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Bootstrap starting.
I20260709 12:15:56.741258 22083 tablet_bootstrap.cc:654] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:56.746822 22033 tablet_service.cc:1511] Processing CreateTablet for tablet d62f5fd00783452596eb3c11b706bfc4 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:15:56.748240 22033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d62f5fd00783452596eb3c11b706bfc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.750929 22029 tablet_service.cc:1511] Processing CreateTablet for tablet 616f1cc48bc74cc2acc1759c32206441 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:15:56.752522 22029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616f1cc48bc74cc2acc1759c32206441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.753626 21959 tablet_service.cc:1511] Processing CreateTablet for tablet 13511bd75f3f414381563741fec19933 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:15:56.755168 21959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13511bd75f3f414381563741fec19933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.755602 22026 tablet_service.cc:1511] Processing CreateTablet for tablet 27141291d310492caf09007c5d6be37e (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:15:56.756877 22026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27141291d310492caf09007c5d6be37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.759023 21957 tablet_service.cc:1511] Processing CreateTablet for tablet 1bc1ca7a20764dc887bffaa896850ec3 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:15:56.760385 21957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bc1ca7a20764dc887bffaa896850ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.758921 22025 tablet_service.cc:1511] Processing CreateTablet for tablet 30c9f76486cd4360bf84de37b8ebc53f (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:15:56.767252 21956 tablet_service.cc:1511] Processing CreateTablet for tablet cd75751852944d3fa27116f7ce00f75a (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:15:56.769101 21956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd75751852944d3fa27116f7ce00f75a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.771157 21955 tablet_service.cc:1511] Processing CreateTablet for tablet d62f5fd00783452596eb3c11b706bfc4 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:15:56.772570 21955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d62f5fd00783452596eb3c11b706bfc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.775056 21954 tablet_service.cc:1511] Processing CreateTablet for tablet 616f1cc48bc74cc2acc1759c32206441 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:15:56.776494 21954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616f1cc48bc74cc2acc1759c32206441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.776341 21950 tablet_service.cc:1511] Processing CreateTablet for tablet 30c9f76486cd4360bf84de37b8ebc53f (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:15:56.777704 21950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c9f76486cd4360bf84de37b8ebc53f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.778160 21953 tablet_service.cc:1511] Processing CreateTablet for tablet fc892a3158e4480f87c2b4524b0c9907 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:15:56.779444 21953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc892a3158e4480f87c2b4524b0c9907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.782409 21952 tablet_service.cc:1511] Processing CreateTablet for tablet 0f746cb0c05245509f72f0ef07c16ba2 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:15:56.783856 21952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f746cb0c05245509f72f0ef07c16ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.787062 21951 tablet_service.cc:1511] Processing CreateTablet for tablet 27141291d310492caf09007c5d6be37e (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:15:56.788484 21951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27141291d310492caf09007c5d6be37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.790917 22028 tablet_service.cc:1511] Processing CreateTablet for tablet fc892a3158e4480f87c2b4524b0c9907 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:15:56.758925 21958 tablet_service.cc:1511] Processing CreateTablet for tablet fdf9a5b30c9d4da7a9544632c3407a97 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:15:56.793987 21958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdf9a5b30c9d4da7a9544632c3407a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.764904 22027 tablet_service.cc:1511] Processing CreateTablet for tablet 0f746cb0c05245509f72f0ef07c16ba2 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:15:56.767336 22025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c9f76486cd4360bf84de37b8ebc53f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.798434 22028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc892a3158e4480f87c2b4524b0c9907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.801822 22027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f746cb0c05245509f72f0ef07c16ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.827026 21884 tablet_service.cc:1511] Processing CreateTablet for tablet 13511bd75f3f414381563741fec19933 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:15:56.828481 21884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13511bd75f3f414381563741fec19933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.839507 21883 tablet_service.cc:1511] Processing CreateTablet for tablet fdf9a5b30c9d4da7a9544632c3407a97 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:15:56.840951 21883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdf9a5b30c9d4da7a9544632c3407a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.849629 22085 tablet_bootstrap.cc:492] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9: Bootstrap starting.
I20260709 12:15:56.850458 21882 tablet_service.cc:1511] Processing CreateTablet for tablet 1bc1ca7a20764dc887bffaa896850ec3 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:15:56.866000 21882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bc1ca7a20764dc887bffaa896850ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.850884 21881 tablet_service.cc:1511] Processing CreateTablet for tablet cd75751852944d3fa27116f7ce00f75a (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:15:56.853135 21880 tablet_service.cc:1511] Processing CreateTablet for tablet d62f5fd00783452596eb3c11b706bfc4 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:15:56.854526 21876 tablet_service.cc:1511] Processing CreateTablet for tablet 27141291d310492caf09007c5d6be37e (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:15:56.869050 21881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd75751852944d3fa27116f7ce00f75a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.870689 21876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27141291d310492caf09007c5d6be37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.871429 22085 tablet_bootstrap.cc:654] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:56.854924 21879 tablet_service.cc:1511] Processing CreateTablet for tablet 616f1cc48bc74cc2acc1759c32206441 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:15:56.878712 21879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616f1cc48bc74cc2acc1759c32206441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.856624 21878 tablet_service.cc:1511] Processing CreateTablet for tablet fc892a3158e4480f87c2b4524b0c9907 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:15:56.858932 21875 tablet_service.cc:1511] Processing CreateTablet for tablet 30c9f76486cd4360bf84de37b8ebc53f (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:15:56.860028 21877 tablet_service.cc:1511] Processing CreateTablet for tablet 0f746cb0c05245509f72f0ef07c16ba2 (DEFAULT_TABLE table=test-workload [id=e8c1f5bdeca94266abb93567ed19f5ca]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:15:56.860459 22083 tablet_bootstrap.cc:492] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0: No bootstrap required, opened a new log
I20260709 12:15:56.881723 21875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c9f76486cd4360bf84de37b8ebc53f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.882637 22083 ts_tablet_manager.cc:1403] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent bootstrapping tablet: real 0.149s	user 0.015s	sys 0.009s
I20260709 12:15:56.888438 21878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc892a3158e4480f87c2b4524b0c9907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.889989 21880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d62f5fd00783452596eb3c11b706bfc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.891193 21877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f746cb0c05245509f72f0ef07c16ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:56.922950 22083 raft_consensus.cc:359] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } } peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } }
I20260709 12:15:56.923930 22083 raft_consensus.cc:385] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:56.924413 22083 raft_consensus.cc:740] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Initialized, Role: FOLLOWER
I20260709 12:15:56.925403 22083 consensus_queue.cc:260] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } } peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } }
I20260709 12:15:56.954429 22086 tablet_bootstrap.cc:492] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071: Bootstrap starting.
I20260709 12:15:56.960683 22086 tablet_bootstrap.cc:654] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:56.963109 22085 tablet_bootstrap.cc:492] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9: No bootstrap required, opened a new log
I20260709 12:15:56.964299 22068 heartbeater.cc:499] Master 127.20.191.62:36641 was elected leader, sending a full tablet report...
I20260709 12:15:56.964448 22085 ts_tablet_manager.cc:1403] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9: Time spent bootstrapping tablet: real 0.115s	user 0.043s	sys 0.046s
I20260709 12:15:56.964767 22083 ts_tablet_manager.cc:1434] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent starting tablet: real 0.079s	user 0.025s	sys 0.009s
I20260709 12:15:56.965808 22083 tablet_bootstrap.cc:492] T d62f5fd00783452596eb3c11b706bfc4 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Bootstrap starting.
I20260709 12:15:56.967398 22085 raft_consensus.cc:359] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:56.968149 22085 raft_consensus.cc:385] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:56.968438 22085 raft_consensus.cc:740] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Initialized, Role: FOLLOWER
I20260709 12:15:56.971961 22083 tablet_bootstrap.cc:654] T d62f5fd00783452596eb3c11b706bfc4 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:56.971808 22085 consensus_queue.cc:260] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:56.980373 22086 tablet_bootstrap.cc:492] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071: No bootstrap required, opened a new log
I20260709 12:15:56.980858 22086 ts_tablet_manager.cc:1403] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.006s
I20260709 12:15:56.983436 22085 ts_tablet_manager.cc:1434] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.008s
I20260709 12:15:56.984303 21994 heartbeater.cc:499] Master 127.20.191.62:36641 was elected leader, sending a full tablet report...
I20260709 12:15:56.984616 22085 tablet_bootstrap.cc:492] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9: Bootstrap starting.
I20260709 12:15:57.000270 22083 tablet_bootstrap.cc:492] T d62f5fd00783452596eb3c11b706bfc4 P 85e8e1fc05f24abe9523c5c55b9ab7d0: No bootstrap required, opened a new log
I20260709 12:15:57.000872 22083 ts_tablet_manager.cc:1403] T d62f5fd00783452596eb3c11b706bfc4 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.017s
I20260709 12:15:56.998075 22086 raft_consensus.cc:359] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.001972 22086 raft_consensus.cc:385] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.002350 22086 raft_consensus.cc:740] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.003125 22086 consensus_queue.cc:260] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.004067 22085 tablet_bootstrap.cc:654] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.003901 22083 raft_consensus.cc:359] T d62f5fd00783452596eb3c11b706bfc4 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.004612 22083 raft_consensus.cc:385] T d62f5fd00783452596eb3c11b706bfc4 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.004916 22083 raft_consensus.cc:740] T d62f5fd00783452596eb3c11b706bfc4 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.005725 22090 raft_consensus.cc:493] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.005832 22083 consensus_queue.cc:260] T d62f5fd00783452596eb3c11b706bfc4 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.008087 22090 raft_consensus.cc:515] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.017405 22083 ts_tablet_manager.cc:1434] T d62f5fd00783452596eb3c11b706bfc4 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.005s
I20260709 12:15:57.022665 22083 tablet_bootstrap.cc:492] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Bootstrap starting.
I20260709 12:15:57.029377 22083 tablet_bootstrap.cc:654] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.032941 22090 leader_election.cc:290] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:57.035049 22085 tablet_bootstrap.cc:492] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9: No bootstrap required, opened a new log
I20260709 12:15:57.035575 22085 ts_tablet_manager.cc:1403] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9: Time spent bootstrapping tablet: real 0.051s	user 0.028s	sys 0.020s
I20260709 12:15:57.038574 22085 raft_consensus.cc:359] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.039561 22085 raft_consensus.cc:385] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.040047 22085 raft_consensus.cc:740] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.040869 22085 consensus_queue.cc:260] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.042977 22085 ts_tablet_manager.cc:1434] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:57.043973 22085 tablet_bootstrap.cc:492] T 13511bd75f3f414381563741fec19933 P 532d8c016b334c18b3ec09578fa596f9: Bootstrap starting.
I20260709 12:15:57.050746 22085 tablet_bootstrap.cc:654] T 13511bd75f3f414381563741fec19933 P 532d8c016b334c18b3ec09578fa596f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.052155 22083 tablet_bootstrap.cc:492] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0: No bootstrap required, opened a new log
I20260709 12:15:57.052677 22083 ts_tablet_manager.cc:1403] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.000s
I20260709 12:15:57.055637 22083 raft_consensus.cc:359] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.056362 22083 raft_consensus.cc:385] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.056670 22083 raft_consensus.cc:740] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.057657 22083 consensus_queue.cc:260] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.058300 22043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc1ca7a20764dc887bffaa896850ec3" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" is_pre_election: true
I20260709 12:15:57.059072 22043 raft_consensus.cc:2468] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 532d8c016b334c18b3ec09578fa596f9 in term 0.
I20260709 12:15:57.059816 21919 heartbeater.cc:499] Master 127.20.191.62:36641 was elected leader, sending a full tablet report...
I20260709 12:15:57.058302 21894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc1ca7a20764dc887bffaa896850ec3" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00d75d8e50e4383abd5f04c72c73071" is_pre_election: true
I20260709 12:15:57.060456 22083 ts_tablet_manager.cc:1434] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:15:57.061494 22083 tablet_bootstrap.cc:492] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0: Bootstrap starting.
I20260709 12:15:57.061910 21934 leader_election.cc:304] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, 85e8e1fc05f24abe9523c5c55b9ab7d0; no voters: 
W20260709 12:15:57.063035 21933 leader_election.cc:343] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:57.064476 22090 raft_consensus.cc:2804] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:57.064637 22086 ts_tablet_manager.cc:1434] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071: Time spent starting tablet: real 0.084s	user 0.016s	sys 0.034s
I20260709 12:15:57.064896 22090 raft_consensus.cc:493] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.065246 22090 raft_consensus.cc:3060] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.065568 22086 tablet_bootstrap.cc:492] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071: Bootstrap starting.
I20260709 12:15:57.070052 22085 tablet_bootstrap.cc:492] T 13511bd75f3f414381563741fec19933 P 532d8c016b334c18b3ec09578fa596f9: No bootstrap required, opened a new log
I20260709 12:15:57.070668 22085 ts_tablet_manager.cc:1403] T 13511bd75f3f414381563741fec19933 P 532d8c016b334c18b3ec09578fa596f9: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.011s
I20260709 12:15:57.072331 22086 tablet_bootstrap.cc:654] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.072557 22090 raft_consensus.cc:515] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.073824 22085 raft_consensus.cc:359] T 13511bd75f3f414381563741fec19933 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } } peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } }
I20260709 12:15:57.074640 22085 raft_consensus.cc:385] T 13511bd75f3f414381563741fec19933 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.075001 22085 raft_consensus.cc:740] T 13511bd75f3f414381563741fec19933 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.075548 21894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc1ca7a20764dc887bffaa896850ec3" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
I20260709 12:15:57.075875 22085 consensus_queue.cc:260] T 13511bd75f3f414381563741fec19933 P 532d8c016b334c18b3ec09578fa596f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } } peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } }
W20260709 12:15:57.076977 21933 leader_election.cc:343] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:57.079715 22083 tablet_bootstrap.cc:654] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.082813 22043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc1ca7a20764dc887bffaa896850ec3" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:15:57.083483 22043 raft_consensus.cc:3060] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.088884 22086 tablet_bootstrap.cc:492] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071: No bootstrap required, opened a new log
I20260709 12:15:57.090431 22043 raft_consensus.cc:2468] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 532d8c016b334c18b3ec09578fa596f9 in term 1.
I20260709 12:15:57.090891 22090 leader_election.cc:290] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 1 election: Requested vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:57.091735 21934 leader_election.cc:304] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, 85e8e1fc05f24abe9523c5c55b9ab7d0; no voters: d00d75d8e50e4383abd5f04c72c73071
I20260709 12:15:57.092378 22083 tablet_bootstrap.cc:492] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0: No bootstrap required, opened a new log
I20260709 12:15:57.092859 22083 ts_tablet_manager.cc:1403] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.000s
I20260709 12:15:57.092994 22099 raft_consensus.cc:2804] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:57.093804 22085 ts_tablet_manager.cc:1434] T 13511bd75f3f414381563741fec19933 P 532d8c016b334c18b3ec09578fa596f9: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.016s
I20260709 12:15:57.089430 22086 ts_tablet_manager.cc:1403] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.001s
I20260709 12:15:57.095017 22085 tablet_bootstrap.cc:492] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9: Bootstrap starting.
I20260709 12:15:57.095863 22083 raft_consensus.cc:359] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.096642 22083 raft_consensus.cc:385] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.096952 22083 raft_consensus.cc:740] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.097579 22086 raft_consensus.cc:359] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.097748 22083 consensus_queue.cc:260] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.098363 22086 raft_consensus.cc:385] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.098706 22086 raft_consensus.cc:740] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.099438 22086 consensus_queue.cc:260] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.093725 22099 raft_consensus.cc:697] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 1 LEADER]: Becoming Leader. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Running, Role: LEADER
I20260709 12:15:57.101598 22086 ts_tablet_manager.cc:1434] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.006s
I20260709 12:15:57.102378 22085 tablet_bootstrap.cc:654] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.101898 22099 consensus_queue.cc:237] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.102589 22086 tablet_bootstrap.cc:492] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071: Bootstrap starting.
I20260709 12:15:57.107102 22083 ts_tablet_manager.cc:1434] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 12:15:57.108372 22083 tablet_bootstrap.cc:492] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Bootstrap starting.
I20260709 12:15:57.109258 22086 tablet_bootstrap.cc:654] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.126907 22083 tablet_bootstrap.cc:654] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.132477 22085 tablet_bootstrap.cc:492] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9: No bootstrap required, opened a new log
I20260709 12:15:57.133065 22085 ts_tablet_manager.cc:1403] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9: Time spent bootstrapping tablet: real 0.038s	user 0.028s	sys 0.006s
I20260709 12:15:57.136557 22083 tablet_bootstrap.cc:492] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0: No bootstrap required, opened a new log
I20260709 12:15:57.136833 22086 tablet_bootstrap.cc:492] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071: No bootstrap required, opened a new log
I20260709 12:15:57.136533 22085 raft_consensus.cc:359] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.137346 22086 ts_tablet_manager.cc:1403] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.022s
I20260709 12:15:57.137251 22083 ts_tablet_manager.cc:1403] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.005s
I20260709 12:15:57.137920 22085 raft_consensus.cc:385] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.138594 22085 raft_consensus.cc:740] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.138080 21792 catalog_manager.cc:5697] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "532d8c016b334c18b3ec09578fa596f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:57.139668 22085 consensus_queue.cc:260] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.140395 22083 raft_consensus.cc:359] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.140648 22086 raft_consensus.cc:359] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.141088 22083 raft_consensus.cc:385] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.141361 22086 raft_consensus.cc:385] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.141417 22083 raft_consensus.cc:740] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.141948 22086 raft_consensus.cc:740] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.142725 22085 ts_tablet_manager.cc:1434] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 12:15:57.142453 22083 consensus_queue.cc:260] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.143858 22085 tablet_bootstrap.cc:492] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9: Bootstrap starting.
I20260709 12:15:57.144711 22083 ts_tablet_manager.cc:1434] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 12:15:57.145717 22083 tablet_bootstrap.cc:492] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Bootstrap starting.
I20260709 12:15:57.142963 22086 consensus_queue.cc:260] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.150930 22085 tablet_bootstrap.cc:654] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.151829 22083 tablet_bootstrap.cc:654] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.155485 22086 ts_tablet_manager.cc:1434] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:15:57.160060 22086 tablet_bootstrap.cc:492] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071: Bootstrap starting.
I20260709 12:15:57.168323 22086 tablet_bootstrap.cc:654] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.173224 22088 raft_consensus.cc:493] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.173789 22088 raft_consensus.cc:515] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.174335 22085 tablet_bootstrap.cc:492] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9: No bootstrap required, opened a new log
I20260709 12:15:57.175004 22085 ts_tablet_manager.cc:1403] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.009s
I20260709 12:15:57.175769 22083 tablet_bootstrap.cc:492] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0: No bootstrap required, opened a new log
I20260709 12:15:57.176211 22086 tablet_bootstrap.cc:492] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071: No bootstrap required, opened a new log
I20260709 12:15:57.176265 22083 ts_tablet_manager.cc:1403] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.008s
I20260709 12:15:57.176818 22086 ts_tablet_manager.cc:1403] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.008s
I20260709 12:15:57.178323 22085 raft_consensus.cc:359] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.179174 22085 raft_consensus.cc:385] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.179566 22085 raft_consensus.cc:740] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.179435 22083 raft_consensus.cc:359] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.180554 22085 consensus_queue.cc:260] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.180976 22088 leader_election.cc:290] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455)
I20260709 12:15:57.179689 22086 raft_consensus.cc:359] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } } peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } }
I20260709 12:15:57.182317 22086 raft_consensus.cc:385] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.182618 22086 raft_consensus.cc:740] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.183491 22085 ts_tablet_manager.cc:1434] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.006s
I20260709 12:15:57.183372 22086 consensus_queue.cc:260] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } } peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } }
I20260709 12:15:57.184317 22083 raft_consensus.cc:385] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.184728 22085 tablet_bootstrap.cc:492] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9: Bootstrap starting.
I20260709 12:15:57.189169 22086 ts_tablet_manager.cc:1434] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:15:57.184657 22083 raft_consensus.cc:740] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.190219 22086 tablet_bootstrap.cc:492] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071: Bootstrap starting.
I20260709 12:15:57.190133 22083 consensus_queue.cc:260] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.192585 22083 ts_tablet_manager.cc:1434] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:15:57.193629 22083 tablet_bootstrap.cc:492] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0: Bootstrap starting.
I20260709 12:15:57.196746 22086 tablet_bootstrap.cc:654] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.199760 21969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9" is_pre_election: true
W20260709 12:15:57.201392 22008 leader_election.cc:343] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:57.202400 22083 tablet_bootstrap.cc:654] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.196918 22085 tablet_bootstrap.cc:654] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:57.212604 21840 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:57.227319 21894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00d75d8e50e4383abd5f04c72c73071" is_pre_election: true
I20260709 12:15:57.228087 21894 raft_consensus.cc:2468] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 0.
I20260709 12:15:57.229313 22007 leader_election.cc:304] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071; no voters: 532d8c016b334c18b3ec09578fa596f9
I20260709 12:15:57.230702 22088 raft_consensus.cc:2804] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:57.231086 22088 raft_consensus.cc:493] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.231070 22083 tablet_bootstrap.cc:492] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0: No bootstrap required, opened a new log
I20260709 12:15:57.231070 22086 tablet_bootstrap.cc:492] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071: No bootstrap required, opened a new log
I20260709 12:15:57.231246 22085 tablet_bootstrap.cc:492] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9: No bootstrap required, opened a new log
I20260709 12:15:57.231528 22088 raft_consensus.cc:3060] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.231959 22086 ts_tablet_manager.cc:1403] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071: Time spent bootstrapping tablet: real 0.042s	user 0.024s	sys 0.013s
I20260709 12:15:57.231935 22083 ts_tablet_manager.cc:1403] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.017s
I20260709 12:15:57.232220 22085 ts_tablet_manager.cc:1403] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9: Time spent bootstrapping tablet: real 0.048s	user 0.005s	sys 0.025s
I20260709 12:15:57.235198 22083 raft_consensus.cc:359] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.235337 22086 raft_consensus.cc:359] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.235759 22085 raft_consensus.cc:359] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.236163 22086 raft_consensus.cc:385] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.236163 22083 raft_consensus.cc:385] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.236521 22085 raft_consensus.cc:385] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.236681 22086 raft_consensus.cc:740] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.236748 22083 raft_consensus.cc:740] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.236915 22085 raft_consensus.cc:740] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.237857 22086 consensus_queue.cc:260] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.238001 22085 consensus_queue.cc:260] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.239924 22085 ts_tablet_manager.cc:1434] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:15:57.239741 22088 raft_consensus.cc:515] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.237857 22083 consensus_queue.cc:260] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.242933 21894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
I20260709 12:15:57.243583 21894 raft_consensus.cc:3060] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.245644 22085 tablet_bootstrap.cc:492] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9: Bootstrap starting.
I20260709 12:15:57.249076 22086 ts_tablet_manager.cc:1434] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:15:57.250341 22086 tablet_bootstrap.cc:492] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071: Bootstrap starting.
I20260709 12:15:57.251202 22092 raft_consensus.cc:493] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.251832 22092 raft_consensus.cc:515] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.255797 22092 leader_election.cc:290] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:57.259146 22113 raft_consensus.cc:493] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.260031 21894 raft_consensus.cc:2468] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 1.
I20260709 12:15:57.261719 22088 leader_election.cc:290] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 election: Requested vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455)
I20260709 12:15:57.258723 22085 tablet_bootstrap.cc:654] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.262207 22113 raft_consensus.cc:515] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } } peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } }
I20260709 12:15:57.262857 22007 leader_election.cc:304] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:15:57.262281 22088 raft_consensus.cc:493] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.261554 22083 ts_tablet_manager.cc:1434] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.007s
I20260709 12:15:57.265697 22113 leader_election.cc:290] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455)
I20260709 12:15:57.266021 22083 tablet_bootstrap.cc:492] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Bootstrap starting.
I20260709 12:15:57.266448 21894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13511bd75f3f414381563741fec19933" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00d75d8e50e4383abd5f04c72c73071" is_pre_election: true
I20260709 12:15:57.266790 22086 tablet_bootstrap.cc:654] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.267099 21894 raft_consensus.cc:2468] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 0.
I20260709 12:15:57.268254 22007 leader_election.cc:304] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:15:57.265051 22088 raft_consensus.cc:515] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.270319 22113 raft_consensus.cc:2804] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:57.270871 22113 raft_consensus.cc:697] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Becoming Leader. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Running, Role: LEADER
I20260709 12:15:57.271729 22113 consensus_queue.cc:237] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.273099 22083 tablet_bootstrap.cc:654] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.273201 21894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27141291d310492caf09007c5d6be37e" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00d75d8e50e4383abd5f04c72c73071" is_pre_election: true
I20260709 12:15:57.276737 22088 leader_election.cc:290] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455)
I20260709 12:15:57.277390 22088 raft_consensus.cc:2804] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:57.277740 22088 raft_consensus.cc:493] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:57.277920 22007 leader_election.cc:343] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:57.278172 22088 raft_consensus.cc:3060] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.278824 22085 tablet_bootstrap.cc:492] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9: No bootstrap required, opened a new log
I20260709 12:15:57.279362 22085 ts_tablet_manager.cc:1403] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.000s
I20260709 12:15:57.282516 22085 raft_consensus.cc:359] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.283409 22085 raft_consensus.cc:385] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.283761 22085 raft_consensus.cc:740] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.284571 22085 consensus_queue.cc:260] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.287184 22085 ts_tablet_manager.cc:1434] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:15:57.288376 22085 tablet_bootstrap.cc:492] T d62f5fd00783452596eb3c11b706bfc4 P 532d8c016b334c18b3ec09578fa596f9: Bootstrap starting.
I20260709 12:15:57.289304 21969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:15:57.290799 22092 raft_consensus.cc:493] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.291337 22092 raft_consensus.cc:515] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.293548 22092 leader_election.cc:290] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:57.295791 22085 tablet_bootstrap.cc:654] T d62f5fd00783452596eb3c11b706bfc4 P 532d8c016b334c18b3ec09578fa596f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.295759 21969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13511bd75f3f414381563741fec19933" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9" is_pre_election: true
I20260709 12:15:57.296710 21969 raft_consensus.cc:2468] T 13511bd75f3f414381563741fec19933 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 0.
I20260709 12:15:57.299011 21969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27141291d310492caf09007c5d6be37e" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9" is_pre_election: true
I20260709 12:15:57.299750 21969 raft_consensus.cc:2468] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 0.
W20260709 12:15:57.301343 22008 leader_election.cc:343] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:57.302977 22008 leader_election.cc:304] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, 85e8e1fc05f24abe9523c5c55b9ab7d0; no voters: d00d75d8e50e4383abd5f04c72c73071
I20260709 12:15:57.305101 22116 raft_consensus.cc:2804] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:57.306232 22116 raft_consensus.cc:493] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.306715 22116 raft_consensus.cc:3060] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.314905 22116 raft_consensus.cc:515] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.317675 21791 catalog_manager.cc:5697] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:57.318463 21894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27141291d310492caf09007c5d6be37e" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
W20260709 12:15:57.320163 22007 leader_election.cc:343] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:57.321986 22086 tablet_bootstrap.cc:492] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071: No bootstrap required, opened a new log
I20260709 12:15:57.322508 22086 ts_tablet_manager.cc:1403] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071: Time spent bootstrapping tablet: real 0.072s	user 0.017s	sys 0.006s
I20260709 12:15:57.322364 21969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27141291d310492caf09007c5d6be37e" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:15:57.322966 21969 raft_consensus.cc:3060] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.327330 22088 raft_consensus.cc:515] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } } peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } }
I20260709 12:15:57.330677 21894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13511bd75f3f414381563741fec19933" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
I20260709 12:15:57.330756 21968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13511bd75f3f414381563741fec19933" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:15:57.331518 21894 raft_consensus.cc:3060] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.331549 21968 raft_consensus.cc:3060] T 13511bd75f3f414381563741fec19933 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.332010 21967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d62f5fd00783452596eb3c11b706bfc4" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9" is_pre_election: true
I20260709 12:15:57.333640 21966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616f1cc48bc74cc2acc1759c32206441" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9" is_pre_election: true
I20260709 12:15:57.334403 21966 raft_consensus.cc:2468] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 0.
W20260709 12:15:57.335163 21859 leader_election.cc:343] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:57.336017 21859 leader_election.cc:304] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:15:57.332752 22116 leader_election.cc:290] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 election: Requested vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455)
I20260709 12:15:57.336948 22092 raft_consensus.cc:2804] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:57.333004 22088 leader_election.cc:290] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 election: Requested vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455)
I20260709 12:15:57.337384 22086 raft_consensus.cc:359] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.338780 22092 raft_consensus.cc:493] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.339417 22092 raft_consensus.cc:3060] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.342069 22086 raft_consensus.cc:385] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.342504 22086 raft_consensus.cc:740] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.343246 22086 consensus_queue.cc:260] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.344791 22043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d62f5fd00783452596eb3c11b706bfc4" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" is_pre_election: true
I20260709 12:15:57.345340 22043 raft_consensus.cc:2468] T d62f5fd00783452596eb3c11b706bfc4 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 0.
I20260709 12:15:57.346204 22116 raft_consensus.cc:493] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.346642 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616f1cc48bc74cc2acc1759c32206441" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" is_pre_election: true
I20260709 12:15:57.346791 22116 raft_consensus.cc:515] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.348510 21859 leader_election.cc:304] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071; no voters: 532d8c016b334c18b3ec09578fa596f9
I20260709 12:15:57.352102 21893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd75751852944d3fa27116f7ce00f75a" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00d75d8e50e4383abd5f04c72c73071" is_pre_election: true
I20260709 12:15:57.352856 21893 raft_consensus.cc:2468] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 0.
I20260709 12:15:57.352955 21894 raft_consensus.cc:2468] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 1.
I20260709 12:15:57.352253 21966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd75751852944d3fa27116f7ce00f75a" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9" is_pre_election: true
I20260709 12:15:57.349084 21968 raft_consensus.cc:2468] T 13511bd75f3f414381563741fec19933 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 1.
I20260709 12:15:57.350358 22116 leader_election.cc:290] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455)
I20260709 12:15:57.358664 22007 leader_election.cc:304] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:15:57.360245 22116 raft_consensus.cc:2804] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:57.360778 22116 raft_consensus.cc:493] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.361269 22116 raft_consensus.cc:3060] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:57.361645 22008 leader_election.cc:343] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:57.365814 22088 raft_consensus.cc:493] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.360582 22007 leader_election.cc:304] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:15:57.366460 22088 raft_consensus.cc:515] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.366880 22113 raft_consensus.cc:2804] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:57.367501 22113 raft_consensus.cc:697] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Becoming Leader. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Running, Role: LEADER
I20260709 12:15:57.368643 22088 leader_election.cc:290] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455)
I20260709 12:15:57.368463 22113 consensus_queue.cc:237] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } } peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } }
I20260709 12:15:57.365816 22099 raft_consensus.cc:493] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.369320 22116 raft_consensus.cc:515] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.369722 22099 raft_consensus.cc:515] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.370700 21894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc892a3158e4480f87c2b4524b0c9907" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00d75d8e50e4383abd5f04c72c73071" is_pre_election: true
I20260709 12:15:57.371457 21894 raft_consensus.cc:2468] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 0.
I20260709 12:15:57.371673 22116 leader_election.cc:290] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 election: Requested vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455)
I20260709 12:15:57.373435 22007 leader_election.cc:304] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:15:57.373941 21893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd75751852944d3fa27116f7ce00f75a" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
I20260709 12:15:57.374539 21893 raft_consensus.cc:3060] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.375792 22085 tablet_bootstrap.cc:492] T d62f5fd00783452596eb3c11b706bfc4 P 532d8c016b334c18b3ec09578fa596f9: No bootstrap required, opened a new log
I20260709 12:15:57.376000 21967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd75751852944d3fa27116f7ce00f75a" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:15:57.376221 22085 ts_tablet_manager.cc:1403] T d62f5fd00783452596eb3c11b706bfc4 P 532d8c016b334c18b3ec09578fa596f9: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.004s
I20260709 12:15:57.374459 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f746cb0c05245509f72f0ef07c16ba2" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" is_pre_election: true
I20260709 12:15:57.371840 22099 leader_election.cc:290] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
W20260709 12:15:57.379704 21934 leader_election.cc:343] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:57.379784 21966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc892a3158e4480f87c2b4524b0c9907" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9" is_pre_election: true
I20260709 12:15:57.350117 21969 raft_consensus.cc:2468] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 1.
I20260709 12:15:57.380760 21966 raft_consensus.cc:2468] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 0.
W20260709 12:15:57.381219 22008 leader_election.cc:343] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:57.382041 22008 leader_election.cc:304] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, 85e8e1fc05f24abe9523c5c55b9ab7d0; no voters: d00d75d8e50e4383abd5f04c72c73071
I20260709 12:15:57.382318 21894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f746cb0c05245509f72f0ef07c16ba2" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00d75d8e50e4383abd5f04c72c73071" is_pre_election: true
I20260709 12:15:57.382957 22088 raft_consensus.cc:2804] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:57.383462 22088 raft_consensus.cc:697] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Becoming Leader. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Running, Role: LEADER
W20260709 12:15:57.384001 21933 leader_election.cc:343] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:57.384459 21933 leader_election.cc:304] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9; no voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071
I20260709 12:15:57.384353 22088 consensus_queue.cc:237] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.385638 22099 raft_consensus.cc:2749] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:57.386291 22085 raft_consensus.cc:359] T d62f5fd00783452596eb3c11b706bfc4 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.386960 22085 raft_consensus.cc:385] T d62f5fd00783452596eb3c11b706bfc4 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.387238 22085 raft_consensus.cc:740] T d62f5fd00783452596eb3c11b706bfc4 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.387917 22085 consensus_queue.cc:260] T d62f5fd00783452596eb3c11b706bfc4 P 532d8c016b334c18b3ec09578fa596f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.389173 22116 raft_consensus.cc:2804] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:57.389603 22116 raft_consensus.cc:493] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.390033 22116 raft_consensus.cc:3060] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.394375 21893 raft_consensus.cc:2468] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 1.
I20260709 12:15:57.395913 22007 leader_election.cc:304] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071; no voters: 532d8c016b334c18b3ec09578fa596f9
I20260709 12:15:57.396999 22114 raft_consensus.cc:2804] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:57.397826 22085 ts_tablet_manager.cc:1434] T d62f5fd00783452596eb3c11b706bfc4 P 532d8c016b334c18b3ec09578fa596f9: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:15:57.399679 22092 raft_consensus.cc:515] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.402731 22085 tablet_bootstrap.cc:492] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9: Bootstrap starting.
I20260709 12:15:57.410219 22086 ts_tablet_manager.cc:1434] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071: Time spent starting tablet: real 0.087s	user 0.032s	sys 0.025s
I20260709 12:15:57.411609 22083 tablet_bootstrap.cc:492] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0: No bootstrap required, opened a new log
I20260709 12:15:57.412147 22083 ts_tablet_manager.cc:1403] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent bootstrapping tablet: real 0.146s	user 0.035s	sys 0.018s
I20260709 12:15:57.413098 22086 tablet_bootstrap.cc:492] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071: Bootstrap starting.
I20260709 12:15:57.413956 22124 raft_consensus.cc:2804] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:57.414341 22124 raft_consensus.cc:493] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.414659 22124 raft_consensus.cc:3060] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.420336 22086 tablet_bootstrap.cc:654] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:57.423063 21859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:39713, user_credentials={real_user=slave}} blocked reactor thread for 74670.6us
I20260709 12:15:57.423910 22092 leader_election.cc:290] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 election: Requested vote from peers 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:57.426616 22124 raft_consensus.cc:515] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.426928 22116 raft_consensus.cc:515] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
W20260709 12:15:57.427693 21859 leader_election.cc:343] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:57.432406 22124 leader_election.cc:290] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 election: Requested vote from peers 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:57.435549 22085 tablet_bootstrap.cc:654] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.428550 22114 raft_consensus.cc:697] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Becoming Leader. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Running, Role: LEADER
I20260709 12:15:57.438225 21966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d62f5fd00783452596eb3c11b706bfc4" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:15:57.439374 21966 raft_consensus.cc:3060] T d62f5fd00783452596eb3c11b706bfc4 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.440834 22043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d62f5fd00783452596eb3c11b706bfc4" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:15:57.444473 22086 tablet_bootstrap.cc:492] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071: No bootstrap required, opened a new log
I20260709 12:15:57.444960 22086 ts_tablet_manager.cc:1403] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.013s
I20260709 12:15:57.446557 22085 tablet_bootstrap.cc:492] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9: No bootstrap required, opened a new log
I20260709 12:15:57.441951 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616f1cc48bc74cc2acc1759c32206441" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:15:57.447093 22085 ts_tablet_manager.cc:1403] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.002s
I20260709 12:15:57.447371 22043 raft_consensus.cc:3060] T d62f5fd00783452596eb3c11b706bfc4 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.448055 22086 raft_consensus.cc:359] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.448789 22086 raft_consensus.cc:385] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.448216 21792 catalog_manager.cc:5697] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:57.449111 22086 raft_consensus.cc:740] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.449828 22085 raft_consensus.cc:359] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.450201 21968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616f1cc48bc74cc2acc1759c32206441" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:15:57.449972 22086 consensus_queue.cc:260] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.450717 22085 raft_consensus.cc:385] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.451383 22085 raft_consensus.cc:740] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.452476 22085 consensus_queue.cc:260] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.453943 22099 raft_consensus.cc:493] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.454425 22099 raft_consensus.cc:515] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.452365 22086 ts_tablet_manager.cc:1434] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:57.450798 21968 raft_consensus.cc:3060] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.458364 22086 tablet_bootstrap.cc:492] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071: Bootstrap starting.
I20260709 12:15:57.460676 22099 leader_election.cc:290] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
W20260709 12:15:57.462834 21859 leader_election.cc:343] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:57.465679 22086 tablet_bootstrap.cc:654] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.453586 22116 leader_election.cc:290] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 election: Requested vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455)
I20260709 12:15:57.466730 22085 ts_tablet_manager.cc:1434] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:15:57.467725 22085 tablet_bootstrap.cc:492] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9: Bootstrap starting.
I20260709 12:15:57.471570 22043 raft_consensus.cc:2468] T d62f5fd00783452596eb3c11b706bfc4 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 1.
I20260709 12:15:57.473688 22085 tablet_bootstrap.cc:654] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.475831 21966 raft_consensus.cc:2468] T d62f5fd00783452596eb3c11b706bfc4 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 1.
I20260709 12:15:57.476830 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd75751852944d3fa27116f7ce00f75a" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" is_pre_election: true
I20260709 12:15:57.477684 21969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc892a3158e4480f87c2b4524b0c9907" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:15:57.483486 21969 raft_consensus.cc:3060] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.478538 21894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc892a3158e4480f87c2b4524b0c9907" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
I20260709 12:15:57.483716 21859 leader_election.cc:304] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:15:57.484056 21894 raft_consensus.cc:3060] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.484808 22124 raft_consensus.cc:2804] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:57.485365 22124 raft_consensus.cc:697] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [term 1 LEADER]: Becoming Leader. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:15:57.486266 22124 consensus_queue.cc:237] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.481361 22083 raft_consensus.cc:359] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.493623 22083 raft_consensus.cc:385] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.494266 22083 raft_consensus.cc:740] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.495916 22083 consensus_queue.cc:260] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.497854 22086 tablet_bootstrap.cc:492] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071: No bootstrap required, opened a new log
I20260709 12:15:57.480901 21968 raft_consensus.cc:2468] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 1.
I20260709 12:15:57.481251 21893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd75751852944d3fa27116f7ce00f75a" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00d75d8e50e4383abd5f04c72c73071" is_pre_election: true
I20260709 12:15:57.438654 22114 consensus_queue.cc:237] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
W20260709 12:15:57.505939 21933 consensus_peers.cc:597] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 -> Peer d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199): Couldn't send request to peer d00d75d8e50e4383abd5f04c72c73071. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:57.499516 22083 ts_tablet_manager.cc:1434] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 12:15:57.512979 22083 tablet_bootstrap.cc:492] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Bootstrap starting.
I20260709 12:15:57.514873 21893 raft_consensus.cc:2393] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 532d8c016b334c18b3ec09578fa596f9 in current term 1: Already voted for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in this term.
I20260709 12:15:57.514402 21791 catalog_manager.cc:5697] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 reported cstate change: term changed from 0 to 1, leader changed from <none> to d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "d00d75d8e50e4383abd5f04c72c73071" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:57.515625 22085 tablet_bootstrap.cc:492] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9: No bootstrap required, opened a new log
I20260709 12:15:57.516072 21933 leader_election.cc:304] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9; no voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071
I20260709 12:15:57.516911 22099 raft_consensus.cc:3060] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.502836 21894 raft_consensus.cc:2468] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 1.
I20260709 12:15:57.518366 22007 leader_election.cc:304] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:15:57.519251 22116 raft_consensus.cc:2804] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:57.519747 22116 raft_consensus.cc:697] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Becoming Leader. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Running, Role: LEADER
I20260709 12:15:57.520717 22116 consensus_queue.cc:237] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.498391 21969 raft_consensus.cc:2468] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 1.
I20260709 12:15:57.524413 22099 raft_consensus.cc:2749] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:57.516094 22085 ts_tablet_manager.cc:1403] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.011s
I20260709 12:15:57.498337 22086 ts_tablet_manager.cc:1403] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071: Time spent bootstrapping tablet: real 0.040s	user 0.026s	sys 0.011s
I20260709 12:15:57.525033 21859 leader_election.cc:304] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, d00d75d8e50e4383abd5f04c72c73071; no voters: 85e8e1fc05f24abe9523c5c55b9ab7d0
I20260709 12:15:57.526345 22124 raft_consensus.cc:2804] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:57.526860 22124 raft_consensus.cc:697] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 1 LEADER]: Becoming Leader. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:15:57.527446 22085 raft_consensus.cc:359] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.527997 22085 raft_consensus.cc:385] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.527684 22124 consensus_queue.cc:237] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.528216 22085 raft_consensus.cc:740] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.529011 22086 raft_consensus.cc:359] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.529080 22085 consensus_queue.cc:260] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.529868 22086 raft_consensus.cc:385] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.530234 22086 raft_consensus.cc:740] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.532327 22085 ts_tablet_manager.cc:1434] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:15:57.530922 22086 consensus_queue.cc:260] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.534950 22086 ts_tablet_manager.cc:1434] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:15:57.536087 22086 tablet_bootstrap.cc:492] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071: Bootstrap starting.
I20260709 12:15:57.536427 22099 consensus_queue.cc:1048] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:57.536998 22090 raft_consensus.cc:493] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.537529 22090 raft_consensus.cc:515] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.539772 22090 leader_election.cc:290] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:57.540102 22083 tablet_bootstrap.cc:654] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.541030 21893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9f76486cd4360bf84de37b8ebc53f" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00d75d8e50e4383abd5f04c72c73071" is_pre_election: true
I20260709 12:15:57.541352 22043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9f76486cd4360bf84de37b8ebc53f" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" is_pre_election: true
W20260709 12:15:57.542776 21933 leader_election.cc:343] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:57.544620 21934 leader_election.cc:343] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:57.545092 21934 leader_election.cc:304] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9; no voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071
I20260709 12:15:57.546227 22099 raft_consensus.cc:2749] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:57.567799 21791 catalog_manager.cc:5697] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:57.569327 22086 tablet_bootstrap.cc:654] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.569659 21791 catalog_manager.cc:5697] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:57.569904 21792 catalog_manager.cc:5697] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 reported cstate change: term changed from 0 to 1, leader changed from <none> to d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "d00d75d8e50e4383abd5f04c72c73071" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:57.575848 21791 catalog_manager.cc:5697] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:57.589362 22086 tablet_bootstrap.cc:492] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071: No bootstrap required, opened a new log
I20260709 12:15:57.589471 22083 tablet_bootstrap.cc:492] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0: No bootstrap required, opened a new log
I20260709 12:15:57.589984 22086 ts_tablet_manager.cc:1403] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.002s
I20260709 12:15:57.590303 22083 ts_tablet_manager.cc:1403] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent bootstrapping tablet: real 0.078s	user 0.000s	sys 0.018s
I20260709 12:15:57.592696 22086 raft_consensus.cc:359] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.595690 22086 raft_consensus.cc:385] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.595269 22083 raft_consensus.cc:359] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.596019 22086 raft_consensus.cc:740] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.596768 22086 consensus_queue.cc:260] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.596122 22083 raft_consensus.cc:385] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.597934 22083 raft_consensus.cc:740] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.598703 22086 ts_tablet_manager.cc:1434] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:15:57.598559 22083 consensus_queue.cc:260] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.599648 22086 tablet_bootstrap.cc:492] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071: Bootstrap starting.
I20260709 12:15:57.602147 22083 ts_tablet_manager.cc:1434] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 12:15:57.603035 22083 tablet_bootstrap.cc:492] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0: Bootstrap starting.
I20260709 12:15:57.605348 22086 tablet_bootstrap.cc:654] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.608826 22090 raft_consensus.cc:493] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.610237 22086 tablet_bootstrap.cc:492] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071: No bootstrap required, opened a new log
I20260709 12:15:57.610670 22086 ts_tablet_manager.cc:1403] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:15:57.612337 22083 tablet_bootstrap.cc:654] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:57.612640 22086 raft_consensus.cc:359] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.613137 22086 raft_consensus.cc:385] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.613394 22086 raft_consensus.cc:740] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.613754 22090 raft_consensus.cc:515] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.614007 22086 consensus_queue.cc:260] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.615665 22086 ts_tablet_manager.cc:1434] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:15:57.616354 22090 leader_election.cc:290] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:57.616602 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" is_pre_election: true
I20260709 12:15:57.617100 21893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00d75d8e50e4383abd5f04c72c73071" is_pre_election: true
I20260709 12:15:57.617892 21893 raft_consensus.cc:2393] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 532d8c016b334c18b3ec09578fa596f9 in current term 1: Already voted for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in this term.
I20260709 12:15:57.618942 21933 leader_election.cc:304] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9; no voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071
I20260709 12:15:57.620122 22090 raft_consensus.cc:3060] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.620393 22083 tablet_bootstrap.cc:492] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0: No bootstrap required, opened a new log
I20260709 12:15:57.620836 22083 ts_tablet_manager.cc:1403] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.004s
I20260709 12:15:57.623445 22083 raft_consensus.cc:359] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.624107 22083 raft_consensus.cc:385] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:57.624358 22083 raft_consensus.cc:740] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.624481 22124 raft_consensus.cc:493] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.624948 22124 raft_consensus.cc:515] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.625015 22083 consensus_queue.cc:260] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.627182 22124 leader_election.cc:290] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:57.627388 22083 ts_tablet_manager.cc:1434] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:15:57.628758 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9f76486cd4360bf84de37b8ebc53f" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" is_pre_election: true
I20260709 12:15:57.628715 21969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9f76486cd4360bf84de37b8ebc53f" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9" is_pre_election: true
I20260709 12:15:57.629423 22042 raft_consensus.cc:2468] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 0.
I20260709 12:15:57.629462 21969 raft_consensus.cc:2468] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 0.
I20260709 12:15:57.629952 22090 raft_consensus.cc:2749] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:57.630703 21859 leader_election.cc:304] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:15:57.631796 22124 raft_consensus.cc:2804] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:57.632072 22124 raft_consensus.cc:493] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.632387 22124 raft_consensus.cc:3060] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.637614 22124 raft_consensus.cc:515] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.639192 22124 leader_election.cc:290] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 election: Requested vote from peers 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:57.640003 21969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9f76486cd4360bf84de37b8ebc53f" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:15:57.640246 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9f76486cd4360bf84de37b8ebc53f" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:15:57.640514 21969 raft_consensus.cc:3060] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.640695 22042 raft_consensus.cc:3060] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.645378 22042 raft_consensus.cc:2468] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 1.
I20260709 12:15:57.645380 21969 raft_consensus.cc:2468] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 1.
I20260709 12:15:57.646596 21859 leader_election.cc:304] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:15:57.647249 22124 raft_consensus.cc:2804] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:57.647600 22124 raft_consensus.cc:697] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 1 LEADER]: Becoming Leader. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:15:57.648319 22124 consensus_queue.cc:237] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.655797 21791 catalog_manager.cc:5697] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 reported cstate change: term changed from 0 to 1, leader changed from <none> to d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "d00d75d8e50e4383abd5f04c72c73071" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:57.673074 22124 raft_consensus.cc:493] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.673523 22124 raft_consensus.cc:515] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.675491 22124 leader_election.cc:290] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:57.676391 21969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc1ca7a20764dc887bffaa896850ec3" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9" is_pre_election: true
I20260709 12:15:57.676497 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc1ca7a20764dc887bffaa896850ec3" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" is_pre_election: true
I20260709 12:15:57.677925 21859 leader_election.cc:304] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d00d75d8e50e4383abd5f04c72c73071; no voters: 532d8c016b334c18b3ec09578fa596f9, 85e8e1fc05f24abe9523c5c55b9ab7d0
I20260709 12:15:57.678567 22124 raft_consensus.cc:2749] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:57.686235 22116 consensus_queue.cc:1048] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:57.698385 22116 consensus_queue.cc:1048] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:57.719157 22116 raft_consensus.cc:493] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.719622 22116 raft_consensus.cc:515] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.721275 22116 leader_election.cc:290] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455)
I20260709 12:15:57.722090 21893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616f1cc48bc74cc2acc1759c32206441" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00d75d8e50e4383abd5f04c72c73071" is_pre_election: true
I20260709 12:15:57.722268 21969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616f1cc48bc74cc2acc1759c32206441" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9" is_pre_election: true
I20260709 12:15:57.722904 21969 raft_consensus.cc:2393] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in current term 1: Already voted for candidate d00d75d8e50e4383abd5f04c72c73071 in this term.
I20260709 12:15:57.723771 22008 leader_election.cc:304] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85e8e1fc05f24abe9523c5c55b9ab7d0; no voters: 532d8c016b334c18b3ec09578fa596f9, d00d75d8e50e4383abd5f04c72c73071
I20260709 12:15:57.724381 22116 raft_consensus.cc:3060] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.728983 22116 raft_consensus.cc:2749] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:57.749920 22124 raft_consensus.cc:493] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.750509 22124 raft_consensus.cc:515] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.752825 22124 leader_election.cc:290] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:57.753489 21969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27141291d310492caf09007c5d6be37e" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9" is_pre_election: true
I20260709 12:15:57.753742 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27141291d310492caf09007c5d6be37e" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" is_pre_election: true
I20260709 12:15:57.754191 21969 raft_consensus.cc:2393] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d00d75d8e50e4383abd5f04c72c73071 in current term 1: Already voted for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in this term.
I20260709 12:15:57.755204 21859 leader_election.cc:304] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d00d75d8e50e4383abd5f04c72c73071; no voters: 532d8c016b334c18b3ec09578fa596f9, 85e8e1fc05f24abe9523c5c55b9ab7d0
I20260709 12:15:57.755854 22124 raft_consensus.cc:3060] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.760380 22124 raft_consensus.cc:2749] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:57.804858 22116 consensus_queue.cc:1048] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:57.815922 22127 consensus_queue.cc:1048] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:57.841573 22127 consensus_queue.cc:1048] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:57.845466 22069 tablet.cc:2406] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:15:57.852298 22116 consensus_queue.cc:1048] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:57.856855 22124 raft_consensus.cc:493] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.857482 22124 raft_consensus.cc:515] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.859628 22124 leader_election.cc:290] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:57.861099 21969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f746cb0c05245509f72f0ef07c16ba2" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9" is_pre_election: true
I20260709 12:15:57.861363 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f746cb0c05245509f72f0ef07c16ba2" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" is_pre_election: true
I20260709 12:15:57.861744 21969 raft_consensus.cc:2468] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 0.
I20260709 12:15:57.861955 22042 raft_consensus.cc:2468] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 0.
I20260709 12:15:57.862900 21859 leader_election.cc:304] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:15:57.863832 22124 raft_consensus.cc:2804] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:57.864137 22124 raft_consensus.cc:493] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.864605 22124 raft_consensus.cc:3060] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.870380 22124 raft_consensus.cc:515] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.872272 22124 leader_election.cc:290] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 election: Requested vote from peers 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:57.873085 21969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f746cb0c05245509f72f0ef07c16ba2" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:15:57.873400 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f746cb0c05245509f72f0ef07c16ba2" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:15:57.873556 21969 raft_consensus.cc:3060] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.873965 22042 raft_consensus.cc:3060] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.878762 21969 raft_consensus.cc:2468] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 1.
I20260709 12:15:57.878978 22042 raft_consensus.cc:2468] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 1.
I20260709 12:15:57.880059 21859 leader_election.cc:304] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:15:57.880702 22124 raft_consensus.cc:2804] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:57.881054 22124 raft_consensus.cc:697] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 1 LEADER]: Becoming Leader. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:15:57.881811 22124 consensus_queue.cc:237] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:57.888535 21790 catalog_manager.cc:5697] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 reported cstate change: term changed from 0 to 1, leader changed from <none> to d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "d00d75d8e50e4383abd5f04c72c73071" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:57.918923 22116 consensus_queue.cc:1048] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:57.929286 22088 consensus_queue.cc:1048] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:57.972771 22124 consensus_queue.cc:1048] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:57.978163 21893 raft_consensus.cc:3060] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:57.987636 22092 consensus_queue.cc:1048] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:57.994580 22092 consensus_queue.cc:1048] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:58.011541 22124 consensus_queue.cc:1048] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:58.065438 22088 consensus_queue.cc:1048] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:58.069422 22088 consensus_queue.cc:1048] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:58.120597 22124 consensus_queue.cc:1048] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:58.131425 22092 consensus_queue.cc:1048] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:58.155812 22042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13511bd75f3f414381563741fec19933"
dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
mode: GRACEFUL
new_leader_uuid: "d00d75d8e50e4383abd5f04c72c73071"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:15:58.156373 22042 raft_consensus.cc:606] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Received request to transfer leadership to TS d00d75d8e50e4383abd5f04c72c73071
I20260709 12:15:58.161681 22042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97"
dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
mode: GRACEFUL
new_leader_uuid: "d00d75d8e50e4383abd5f04c72c73071"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:15:58.162354 22042 raft_consensus.cc:606] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Received request to transfer leadership to TS d00d75d8e50e4383abd5f04c72c73071
I20260709 12:15:58.175504 21969 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bc1ca7a20764dc887bffaa896850ec3"
dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
mode: GRACEFUL
new_leader_uuid: "d00d75d8e50e4383abd5f04c72c73071"
 from {username='slave'} at 127.0.0.1:59296
I20260709 12:15:58.176011 21969 raft_consensus.cc:606] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 1 LEADER]: Received request to transfer leadership to TS d00d75d8e50e4383abd5f04c72c73071
I20260709 12:15:58.180877 22042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd75751852944d3fa27116f7ce00f75a"
dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
mode: GRACEFUL
new_leader_uuid: "d00d75d8e50e4383abd5f04c72c73071"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:15:58.181392 22042 raft_consensus.cc:606] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Received request to transfer leadership to TS d00d75d8e50e4383abd5f04c72c73071
I20260709 12:15:58.197672 21893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "616f1cc48bc74cc2acc1759c32206441"
dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
mode: GRACEFUL
new_leader_uuid: "532d8c016b334c18b3ec09578fa596f9"
 from {username='slave'} at 127.0.0.1:47224
I20260709 12:15:58.198191 21893 raft_consensus.cc:606] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 1 LEADER]: Received request to transfer leadership to TS 532d8c016b334c18b3ec09578fa596f9
I20260709 12:15:58.203136 22042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc892a3158e4480f87c2b4524b0c9907"
dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
mode: GRACEFUL
new_leader_uuid: "532d8c016b334c18b3ec09578fa596f9"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:15:58.203632 22042 raft_consensus.cc:606] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Received request to transfer leadership to TS 532d8c016b334c18b3ec09578fa596f9
I20260709 12:15:58.208220 21893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f746cb0c05245509f72f0ef07c16ba2"
dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
mode: GRACEFUL
new_leader_uuid: "532d8c016b334c18b3ec09578fa596f9"
 from {username='slave'} at 127.0.0.1:47224
I20260709 12:15:58.208717 21893 raft_consensus.cc:606] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 1 LEADER]: Received request to transfer leadership to TS 532d8c016b334c18b3ec09578fa596f9
I20260709 12:15:58.213608 22042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27141291d310492caf09007c5d6be37e"
dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
mode: GRACEFUL
new_leader_uuid: "532d8c016b334c18b3ec09578fa596f9"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:15:58.214157 22042 raft_consensus.cc:606] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Received request to transfer leadership to TS 532d8c016b334c18b3ec09578fa596f9
I20260709 12:15:58.219880 21893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30c9f76486cd4360bf84de37b8ebc53f"
dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
mode: GRACEFUL
new_leader_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
 from {username='slave'} at 127.0.0.1:47224
I20260709 12:15:58.220423 21893 raft_consensus.cc:606] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 1 LEADER]: Received request to transfer leadership to TS 85e8e1fc05f24abe9523c5c55b9ab7d0
I20260709 12:15:58.341741 22092 consensus_queue.cc:1048] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:58.348101 22155 raft_consensus.cc:993] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071: : Instructing follower 532d8c016b334c18b3ec09578fa596f9 to start an election
I20260709 12:15:58.348527 22124 raft_consensus.cc:1081] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 1 LEADER]: Signalling peer 532d8c016b334c18b3ec09578fa596f9 to start an election
I20260709 12:15:58.350065 21968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f746cb0c05245509f72f0ef07c16ba2"
dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
 from {username='slave'} at 127.0.0.1:59282
I20260709 12:15:58.351570 21968 raft_consensus.cc:493] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:58.351931 21968 raft_consensus.cc:3060] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.353142 22155 consensus_queue.cc:1048] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:58.361179 21968 raft_consensus.cc:515] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.365825 21893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f746cb0c05245509f72f0ef07c16ba2" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
I20260709 12:15:58.366417 21893 raft_consensus.cc:3055] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:58.366750 21893 raft_consensus.cc:740] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:15:58.366986 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f746cb0c05245509f72f0ef07c16ba2" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:15:58.367484 22042 raft_consensus.cc:3060] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.367524 21893 consensus_queue.cc:260] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.368661 21893 raft_consensus.cc:3060] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.371378 21968 leader_election.cc:290] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 2 election: Requested vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:58.374286 22042 raft_consensus.cc:2468] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 532d8c016b334c18b3ec09578fa596f9 in term 2.
I20260709 12:15:58.375257 21893 raft_consensus.cc:2468] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 532d8c016b334c18b3ec09578fa596f9 in term 2.
I20260709 12:15:58.375515 21934 leader_election.cc:304] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, 85e8e1fc05f24abe9523c5c55b9ab7d0; no voters: 
I20260709 12:15:58.376277 22090 raft_consensus.cc:2804] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:58.376715 22090 raft_consensus.cc:697] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 2 LEADER]: Becoming Leader. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Running, Role: LEADER
I20260709 12:15:58.377502 22090 consensus_queue.cc:237] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.378072 22114 raft_consensus.cc:993] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0: : Instructing follower d00d75d8e50e4383abd5f04c72c73071 to start an election
I20260709 12:15:58.378458 22116 raft_consensus.cc:1081] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Signalling peer d00d75d8e50e4383abd5f04c72c73071 to start an election
I20260709 12:15:58.379758 21893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd75751852944d3fa27116f7ce00f75a"
dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
 from {username='slave'} at 127.0.0.1:47214
I20260709 12:15:58.380185 21893 raft_consensus.cc:493] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:58.380537 21893 raft_consensus.cc:3060] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.384919 21790 catalog_manager.cc:5697] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 reported cstate change: term changed from 1 to 2, leader changed from d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1) to 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "532d8c016b334c18b3ec09578fa596f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:58.386726 21893 raft_consensus.cc:515] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.388691 21893 leader_election.cc:290] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 2 election: Requested vote from peers 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:58.389362 21968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd75751852944d3fa27116f7ce00f75a" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:15:58.389925 21968 raft_consensus.cc:3060] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.389921 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd75751852944d3fa27116f7ce00f75a" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:15:58.390476 22042 raft_consensus.cc:3055] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:58.390681 22042 raft_consensus.cc:740] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Running, Role: LEADER
I20260709 12:15:58.391414 22042 consensus_queue.cc:260] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.395212 22042 raft_consensus.cc:3060] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.396479 21968 raft_consensus.cc:2468] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 2.
I20260709 12:15:58.397526 21859 leader_election.cc:304] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:15:58.398185 22155 raft_consensus.cc:2804] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:58.398548 22155 raft_consensus.cc:697] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 2 LEADER]: Becoming Leader. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:15:58.399224 22155 consensus_queue.cc:237] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.400296 22042 raft_consensus.cc:2468] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 2.
I20260709 12:15:58.405706 21790 catalog_manager.cc:5697] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 reported cstate change: term changed from 1 to 2, leader changed from 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3) to d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "d00d75d8e50e4383abd5f04c72c73071" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:58.420504 22113 raft_consensus.cc:993] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0: : Instructing follower 532d8c016b334c18b3ec09578fa596f9 to start an election
I20260709 12:15:58.420922 22116 raft_consensus.cc:1081] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Signalling peer 532d8c016b334c18b3ec09578fa596f9 to start an election
I20260709 12:15:58.422333 21968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27141291d310492caf09007c5d6be37e"
dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
 from {username='slave'} at 127.0.0.1:59280
I20260709 12:15:58.422962 21968 raft_consensus.cc:493] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:58.423341 21968 raft_consensus.cc:3060] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.428611 21968 raft_consensus.cc:515] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.430335 21968 leader_election.cc:290] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 2 election: Requested vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:58.431396 21893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27141291d310492caf09007c5d6be37e" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
I20260709 12:15:58.431396 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27141291d310492caf09007c5d6be37e" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:15:58.432169 21893 raft_consensus.cc:3060] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.432214 22042 raft_consensus.cc:3055] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:58.432662 22042 raft_consensus.cc:740] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Running, Role: LEADER
I20260709 12:15:58.433498 22042 consensus_queue.cc:260] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.434798 22042 raft_consensus.cc:3060] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.439527 21893 raft_consensus.cc:2468] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 532d8c016b334c18b3ec09578fa596f9 in term 2.
I20260709 12:15:58.440882 21933 leader_election.cc:304] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:15:58.441254 22042 raft_consensus.cc:2468] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 532d8c016b334c18b3ec09578fa596f9 in term 2.
I20260709 12:15:58.441586 22090 raft_consensus.cc:2804] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:58.442070 22090 raft_consensus.cc:697] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [term 2 LEADER]: Becoming Leader. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Running, Role: LEADER
I20260709 12:15:58.442823 22090 consensus_queue.cc:237] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.449111 21790 catalog_manager.cc:5697] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 reported cstate change: term changed from 1 to 2, leader changed from 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3) to 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "532d8c016b334c18b3ec09578fa596f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:58.465332 22113 raft_consensus.cc:993] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0: : Instructing follower d00d75d8e50e4383abd5f04c72c73071 to start an election
I20260709 12:15:58.465788 22116 raft_consensus.cc:1081] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Signalling peer d00d75d8e50e4383abd5f04c72c73071 to start an election
I20260709 12:15:58.467191 21893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13511bd75f3f414381563741fec19933"
dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
 from {username='slave'} at 127.0.0.1:47214
I20260709 12:15:58.467650 21893 raft_consensus.cc:493] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:58.467922 21893 raft_consensus.cc:3060] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.472512 21893 raft_consensus.cc:515] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } } peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } }
I20260709 12:15:58.474306 21893 leader_election.cc:290] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 2 election: Requested vote from peers 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713), 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455)
I20260709 12:15:58.476007 21968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13511bd75f3f414381563741fec19933" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:15:58.476621 21968 raft_consensus.cc:3060] T 13511bd75f3f414381563741fec19933 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.478048 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13511bd75f3f414381563741fec19933" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:15:58.478726 22042 raft_consensus.cc:3055] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:58.479081 22042 raft_consensus.cc:740] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Running, Role: LEADER
I20260709 12:15:58.479909 22042 consensus_queue.cc:260] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } } peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } }
I20260709 12:15:58.481215 22042 raft_consensus.cc:3060] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.484304 21968 raft_consensus.cc:2468] T 13511bd75f3f414381563741fec19933 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 2.
I20260709 12:15:58.484659 22099 raft_consensus.cc:993] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9: : Instructing follower d00d75d8e50e4383abd5f04c72c73071 to start an election
I20260709 12:15:58.485124 22170 raft_consensus.cc:1081] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 1 LEADER]: Signalling peer d00d75d8e50e4383abd5f04c72c73071 to start an election
I20260709 12:15:58.485486 21859 leader_election.cc:304] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:15:58.486326 22155 raft_consensus.cc:2804] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:58.486790 22155 raft_consensus.cc:697] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [term 2 LEADER]: Becoming Leader. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:15:58.486876 21893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bc1ca7a20764dc887bffaa896850ec3"
dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
 from {username='slave'} at 127.0.0.1:47204
I20260709 12:15:58.487458 21893 raft_consensus.cc:493] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:58.487821 21893 raft_consensus.cc:3060] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.487672 22155 consensus_queue.cc:237] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } } peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } }
I20260709 12:15:58.488922 22042 raft_consensus.cc:2468] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 2.
I20260709 12:15:58.493810 21893 raft_consensus.cc:515] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.495510 21893 leader_election.cc:290] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 2 election: Requested vote from peers 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:58.496321 21968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc1ca7a20764dc887bffaa896850ec3" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:15:58.495610 21790 catalog_manager.cc:5697] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 reported cstate change: term changed from 1 to 2, leader changed from 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3) to d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "d00d75d8e50e4383abd5f04c72c73071" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:58.496717 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc1ca7a20764dc887bffaa896850ec3" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:15:58.496981 21968 raft_consensus.cc:3055] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:58.497298 22042 raft_consensus.cc:3060] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.497308 21968 raft_consensus.cc:740] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Running, Role: LEADER
I20260709 12:15:58.498265 21968 consensus_queue.cc:260] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.499437 21968 raft_consensus.cc:3060] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.504472 22042 raft_consensus.cc:2468] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 2.
I20260709 12:15:58.505688 21859 leader_election.cc:304] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:15:58.506297 21968 raft_consensus.cc:2468] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 2.
I20260709 12:15:58.506522 22155 raft_consensus.cc:2804] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:58.506978 22155 raft_consensus.cc:697] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 2 LEADER]: Becoming Leader. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:15:58.507848 22155 consensus_queue.cc:237] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.515697 21790 catalog_manager.cc:5697] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 reported cstate change: term changed from 1 to 2, leader changed from 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2) to d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "d00d75d8e50e4383abd5f04c72c73071" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:58.521562 22124 raft_consensus.cc:993] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071: : Instructing follower 532d8c016b334c18b3ec09578fa596f9 to start an election
I20260709 12:15:58.522015 22155 raft_consensus.cc:1081] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 1 LEADER]: Signalling peer 532d8c016b334c18b3ec09578fa596f9 to start an election
I20260709 12:15:58.523480 21968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "616f1cc48bc74cc2acc1759c32206441"
dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
 from {username='slave'} at 127.0.0.1:59282
I20260709 12:15:58.523973 21968 raft_consensus.cc:493] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:58.524327 21968 raft_consensus.cc:3060] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.530019 21968 raft_consensus.cc:515] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.531814 21968 leader_election.cc:290] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 2 election: Requested vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:58.532486 21893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616f1cc48bc74cc2acc1759c32206441" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
I20260709 12:15:58.532810 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616f1cc48bc74cc2acc1759c32206441" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:15:58.533039 21893 raft_consensus.cc:3055] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:58.533293 22042 raft_consensus.cc:3060] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.533334 21893 raft_consensus.cc:740] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:15:58.534170 21893 consensus_queue.cc:260] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.535092 21893 raft_consensus.cc:3060] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.538364 22042 raft_consensus.cc:2468] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 532d8c016b334c18b3ec09578fa596f9 in term 2.
I20260709 12:15:58.539397 21934 leader_election.cc:304] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, 85e8e1fc05f24abe9523c5c55b9ab7d0; no voters: 
I20260709 12:15:58.539697 21893 raft_consensus.cc:2468] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 532d8c016b334c18b3ec09578fa596f9 in term 2.
I20260709 12:15:58.540236 22170 raft_consensus.cc:2804] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:58.540728 22170 raft_consensus.cc:697] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 2 LEADER]: Becoming Leader. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Running, Role: LEADER
I20260709 12:15:58.541456 22170 consensus_queue.cc:237] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.547317 21790 catalog_manager.cc:5697] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 reported cstate change: term changed from 1 to 2, leader changed from d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1) to 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "532d8c016b334c18b3ec09578fa596f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:58.555797 22124 raft_consensus.cc:993] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071: : Instructing follower 85e8e1fc05f24abe9523c5c55b9ab7d0 to start an election
I20260709 12:15:58.556209 22155 raft_consensus.cc:1081] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 1 LEADER]: Signalling peer 85e8e1fc05f24abe9523c5c55b9ab7d0 to start an election
I20260709 12:15:58.557626 22042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30c9f76486cd4360bf84de37b8ebc53f"
dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
 from {username='slave'} at 127.0.0.1:33604
I20260709 12:15:58.558216 22042 raft_consensus.cc:493] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:58.558511 22042 raft_consensus.cc:3060] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.563628 22042 raft_consensus.cc:515] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.565447 22042 leader_election.cc:290] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 2 election: Requested vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455)
I20260709 12:15:58.566519 21893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9f76486cd4360bf84de37b8ebc53f" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
I20260709 12:15:58.566511 21968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9f76486cd4360bf84de37b8ebc53f" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:15:58.567081 21893 raft_consensus.cc:3055] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:58.567124 21968 raft_consensus.cc:3060] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.567386 21893 raft_consensus.cc:740] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:15:58.568027 21893 consensus_queue.cc:260] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.568874 21893 raft_consensus.cc:3060] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.572010 21968 raft_consensus.cc:2468] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 2.
I20260709 12:15:58.573057 22008 leader_election.cc:304] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, 85e8e1fc05f24abe9523c5c55b9ab7d0; no voters: 
I20260709 12:15:58.573489 21893 raft_consensus.cc:2468] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 2.
I20260709 12:15:58.573894 22116 raft_consensus.cc:2804] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:58.574373 22116 raft_consensus.cc:697] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 LEADER]: Becoming Leader. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Running, Role: LEADER
I20260709 12:15:58.575125 22116 consensus_queue.cc:237] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.581090 21790 catalog_manager.cc:5697] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 reported cstate change: term changed from 1 to 2, leader changed from d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1) to 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3). New cstate: current_term: 2 leader_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:58.688710 22113 raft_consensus.cc:993] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0: : Instructing follower 532d8c016b334c18b3ec09578fa596f9 to start an election
I20260709 12:15:58.689194 22116 raft_consensus.cc:1081] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Signalling peer 532d8c016b334c18b3ec09578fa596f9 to start an election
I20260709 12:15:58.690644 21968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc892a3158e4480f87c2b4524b0c9907"
dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
 from {username='slave'} at 127.0.0.1:59280
I20260709 12:15:58.691071 21968 raft_consensus.cc:493] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:58.691336 21968 raft_consensus.cc:3060] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.696448 21968 raft_consensus.cc:515] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.700433 21968 leader_election.cc:290] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 2 election: Requested vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:58.700402 21893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc892a3158e4480f87c2b4524b0c9907" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
I20260709 12:15:58.701179 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc892a3158e4480f87c2b4524b0c9907" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:15:58.701310 21893 raft_consensus.cc:3060] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.701745 22042 raft_consensus.cc:3055] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:58.702061 22042 raft_consensus.cc:740] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Running, Role: LEADER
I20260709 12:15:58.702693 22042 consensus_queue.cc:260] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.704074 22042 raft_consensus.cc:3060] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.706830 21893 raft_consensus.cc:2468] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 532d8c016b334c18b3ec09578fa596f9 in term 2.
I20260709 12:15:58.707896 21933 leader_election.cc:304] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:15:58.708561 22170 raft_consensus.cc:2804] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:58.708940 22170 raft_consensus.cc:697] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 2 LEADER]: Becoming Leader. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Running, Role: LEADER
I20260709 12:15:58.709168 22042 raft_consensus.cc:2468] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 532d8c016b334c18b3ec09578fa596f9 in term 2.
I20260709 12:15:58.709668 22170 consensus_queue.cc:237] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.715775 21790 catalog_manager.cc:5697] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 reported cstate change: term changed from 1 to 2, leader changed from 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3) to 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "532d8c016b334c18b3ec09578fa596f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:58.759997 22113 raft_consensus.cc:993] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0: : Instructing follower d00d75d8e50e4383abd5f04c72c73071 to start an election
I20260709 12:15:58.760394 22113 raft_consensus.cc:1081] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Signalling peer d00d75d8e50e4383abd5f04c72c73071 to start an election
I20260709 12:15:58.761739 21893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97"
dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
 from {username='slave'} at 127.0.0.1:47214
I20260709 12:15:58.762228 21893 raft_consensus.cc:493] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:58.762499 21893 raft_consensus.cc:3060] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.767468 21893 raft_consensus.cc:515] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.769119 21893 leader_election.cc:290] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 2 election: Requested vote from peers 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:15:58.770120 21968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:15:58.770337 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:15:58.770646 21968 raft_consensus.cc:3060] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.770839 22042 raft_consensus.cc:3055] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:58.771152 22042 raft_consensus.cc:740] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Running, Role: LEADER
I20260709 12:15:58.771786 22042 consensus_queue.cc:260] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.772676 22042 raft_consensus.cc:3060] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:58.776091 21968 raft_consensus.cc:2468] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 2.
I20260709 12:15:58.776788 21893 raft_consensus.cc:1275] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Refusing update from remote peer 532d8c016b334c18b3ec09578fa596f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:58.777158 21859 leader_election.cc:304] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:15:58.777840 22155 raft_consensus.cc:2804] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:58.778239 22155 raft_consensus.cc:697] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 2 LEADER]: Becoming Leader. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:15:58.778154 22170 consensus_queue.cc:1048] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:58.778440 22042 raft_consensus.cc:2468] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 2.
I20260709 12:15:58.779084 22155 consensus_queue.cc:237] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:15:58.785499 22042 raft_consensus.cc:1275] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Refusing update from remote peer 532d8c016b334c18b3ec09578fa596f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:58.787364 22099 consensus_queue.cc:1048] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:58.787087 21790 catalog_manager.cc:5697] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 reported cstate change: term changed from 1 to 2, leader changed from 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3) to d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "d00d75d8e50e4383abd5f04c72c73071" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:58.811508 22042 raft_consensus.cc:1275] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Refusing update from remote peer d00d75d8e50e4383abd5f04c72c73071: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:58.812652 22155 consensus_queue.cc:1048] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:58.819520 21968 raft_consensus.cc:1275] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Refusing update from remote peer d00d75d8e50e4383abd5f04c72c73071: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:58.821053 22155 consensus_queue.cc:1048] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:58.942687 21893 raft_consensus.cc:1275] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Refusing update from remote peer 532d8c016b334c18b3ec09578fa596f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:58.944061 22099 consensus_queue.cc:1048] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:58.951596 22042 raft_consensus.cc:1275] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Refusing update from remote peer 532d8c016b334c18b3ec09578fa596f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:58.953961 22099 consensus_queue.cc:1048] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:58.968566 22042 raft_consensus.cc:1275] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Refusing update from remote peer d00d75d8e50e4383abd5f04c72c73071: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:58.969671 22155 consensus_queue.cc:1048] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:58.970497 21893 raft_consensus.cc:1275] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Refusing update from remote peer 532d8c016b334c18b3ec09578fa596f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:58.971616 22099 consensus_queue.cc:1048] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:58.978379 21968 raft_consensus.cc:1275] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Refusing update from remote peer d00d75d8e50e4383abd5f04c72c73071: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:58.980624 22124 consensus_queue.cc:1048] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:58.981386 22042 raft_consensus.cc:1275] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Refusing update from remote peer 532d8c016b334c18b3ec09578fa596f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:58.983296 22099 consensus_queue.cc:1048] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:58.994995 21968 raft_consensus.cc:1275] T 13511bd75f3f414381563741fec19933 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Refusing update from remote peer d00d75d8e50e4383abd5f04c72c73071: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:58.996527 22155 consensus_queue.cc:1048] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:59.002410 21893 raft_consensus.cc:1275] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Refusing update from remote peer 85e8e1fc05f24abe9523c5c55b9ab7d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:59.003963 22113 consensus_queue.cc:1048] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:59.006973 22043 raft_consensus.cc:1275] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Refusing update from remote peer d00d75d8e50e4383abd5f04c72c73071: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:59.009116 22175 consensus_queue.cc:1048] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:59.014904 21968 raft_consensus.cc:1275] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Refusing update from remote peer 85e8e1fc05f24abe9523c5c55b9ab7d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:59.017716 22116 consensus_queue.cc:1048] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:59.145727 22043 raft_consensus.cc:1275] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Refusing update from remote peer 532d8c016b334c18b3ec09578fa596f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:59.147081 22170 consensus_queue.cc:1048] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:59.155550 21893 raft_consensus.cc:1275] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Refusing update from remote peer 532d8c016b334c18b3ec09578fa596f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:59.157532 22099 consensus_queue.cc:1048] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:59.385232 22043 raft_consensus.cc:1275] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Refusing update from remote peer d00d75d8e50e4383abd5f04c72c73071: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:59.386561 22155 consensus_queue.cc:1048] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:59.395248 21968 raft_consensus.cc:1275] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Refusing update from remote peer d00d75d8e50e4383abd5f04c72c73071: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:59.397223 22155 consensus_queue.cc:1048] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:01.253053 21244 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:16:01.254079 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:01.277652 21893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd75751852944d3fa27116f7ce00f75a"
dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
mode: GRACEFUL
new_leader_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
 from {username='slave'} at 127.0.0.1:36434
I20260709 12:16:01.278138 21893 raft_consensus.cc:606] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 2 LEADER]: Received request to transfer leadership to TS 85e8e1fc05f24abe9523c5c55b9ab7d0
I20260709 12:16:01.280207 21893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97"
dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
mode: GRACEFUL
new_leader_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
 from {username='slave'} at 127.0.0.1:36434
I20260709 12:16:01.280650 21893 raft_consensus.cc:606] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 2 LEADER]: Received request to transfer leadership to TS 85e8e1fc05f24abe9523c5c55b9ab7d0
I20260709 12:16:01.281639 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:16:01.282109 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:01.449517 22188 raft_consensus.cc:993] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071: : Instructing follower 85e8e1fc05f24abe9523c5c55b9ab7d0 to start an election
I20260709 12:16:01.449993 22155 raft_consensus.cc:1081] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 2 LEADER]: Signalling peer 85e8e1fc05f24abe9523c5c55b9ab7d0 to start an election
I20260709 12:16:01.451565 22042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97"
dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
 from {username='slave'} at 127.0.0.1:33604
I20260709 12:16:01.452095 22042 raft_consensus.cc:493] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:01.452366 22042 raft_consensus.cc:3060] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.456523 22042 raft_consensus.cc:515] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:01.457942 22042 leader_election.cc:290] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 3 election: Requested vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455)
I20260709 12:16:01.458822 21893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
I20260709 12:16:01.458891 21968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:16:01.459446 21893 raft_consensus.cc:3055] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:01.459518 21968 raft_consensus.cc:3060] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.459703 21893 raft_consensus.cc:740] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:16:01.460284 21893 consensus_queue.cc:260] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:01.461061 21893 raft_consensus.cc:3060] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.463774 21968 raft_consensus.cc:2468] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 3.
I20260709 12:16:01.464883 22008 leader_election.cc:304] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, 85e8e1fc05f24abe9523c5c55b9ab7d0; no voters: 
I20260709 12:16:01.465396 21893 raft_consensus.cc:2468] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 3.
I20260709 12:16:01.465536 22185 raft_consensus.cc:2804] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:01.466547 22185 raft_consensus.cc:697] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 LEADER]: Becoming Leader. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Running, Role: LEADER
I20260709 12:16:01.467253 22185 consensus_queue.cc:237] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:01.473217 21790 catalog_manager.cc:5697] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 reported cstate change: term changed from 2 to 3, leader changed from d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1) to 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3). New cstate: current_term: 3 leader_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:01.618872 22155 raft_consensus.cc:993] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071: : Instructing follower 85e8e1fc05f24abe9523c5c55b9ab7d0 to start an election
I20260709 12:16:01.619333 22188 raft_consensus.cc:1081] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 2 LEADER]: Signalling peer 85e8e1fc05f24abe9523c5c55b9ab7d0 to start an election
I20260709 12:16:01.620828 22042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd75751852944d3fa27116f7ce00f75a"
dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
 from {username='slave'} at 127.0.0.1:33604
I20260709 12:16:01.621310 22042 raft_consensus.cc:493] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:01.621569 22042 raft_consensus.cc:3060] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.625702 22042 raft_consensus.cc:515] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:01.627118 22042 leader_election.cc:290] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 3 election: Requested vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455)
I20260709 12:16:01.627969 21893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd75751852944d3fa27116f7ce00f75a" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
I20260709 12:16:01.628175 21968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd75751852944d3fa27116f7ce00f75a" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:16:01.628413 21893 raft_consensus.cc:3055] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:01.628628 21968 raft_consensus.cc:3060] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.628693 21893 raft_consensus.cc:740] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:16:01.629329 21893 consensus_queue.cc:260] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:01.630142 21893 raft_consensus.cc:3060] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.633096 21968 raft_consensus.cc:2468] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 3.
I20260709 12:16:01.634250 21893 raft_consensus.cc:2468] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 3.
I20260709 12:16:01.634161 22008 leader_election.cc:304] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, 85e8e1fc05f24abe9523c5c55b9ab7d0; no voters: 
I20260709 12:16:01.635085 22185 raft_consensus.cc:2804] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:01.635493 22185 raft_consensus.cc:697] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 LEADER]: Becoming Leader. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Running, Role: LEADER
I20260709 12:16:01.636169 22185 consensus_queue.cc:237] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:01.646215 21792 catalog_manager.cc:5697] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 reported cstate change: term changed from 2 to 3, leader changed from d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1) to 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3). New cstate: current_term: 3 leader_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:01.962464 21968 raft_consensus.cc:1275] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Refusing update from remote peer 85e8e1fc05f24abe9523c5c55b9ab7d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:01.963728 22185 consensus_queue.cc:1048] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:01.975257 21893 raft_consensus.cc:1275] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Refusing update from remote peer 85e8e1fc05f24abe9523c5c55b9ab7d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:01.976540 22185 consensus_queue.cc:1048] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:02.160835 21893 raft_consensus.cc:1275] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Refusing update from remote peer 85e8e1fc05f24abe9523c5c55b9ab7d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:02.162220 22185 consensus_queue.cc:1048] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:02.169252 21968 raft_consensus.cc:1275] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Refusing update from remote peer 85e8e1fc05f24abe9523c5c55b9ab7d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:02.170972 22185 consensus_queue.cc:1048] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:02.283187 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:02.288836 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:02.289273 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:03.290313 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:03.296800 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:03.297223 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:04.298403 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:04.309425 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:04.310987 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:05.312592 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:05.322194 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:05.322750 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:06.324249 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:06.334424 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:06.335008 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:07.336220 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:07.341842 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:07.342473 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:08.343703 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:08.352119 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:08.352582 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:09.353540 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:09.358649 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:09.359069 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:10.360005 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:10.365206 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:10.365623 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:11.399529 21244 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:16:11.407164 22042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97"
dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
mode: GRACEFUL
new_leader_uuid: "d00d75d8e50e4383abd5f04c72c73071"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:16:11.407861 22042 raft_consensus.cc:606] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 LEADER]: Received request to transfer leadership to TS d00d75d8e50e4383abd5f04c72c73071
I20260709 12:16:11.415892 22042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd75751852944d3fa27116f7ce00f75a"
dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
mode: GRACEFUL
new_leader_uuid: "d00d75d8e50e4383abd5f04c72c73071"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:16:11.416337 22042 raft_consensus.cc:606] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 LEADER]: Received request to transfer leadership to TS d00d75d8e50e4383abd5f04c72c73071
I20260709 12:16:11.424297 21968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "616f1cc48bc74cc2acc1759c32206441"
dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
mode: GRACEFUL
new_leader_uuid: "d00d75d8e50e4383abd5f04c72c73071"
 from {username='slave'} at 127.0.0.1:59296
I20260709 12:16:11.424762 21968 raft_consensus.cc:606] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 2 LEADER]: Received request to transfer leadership to TS d00d75d8e50e4383abd5f04c72c73071
I20260709 12:16:11.429952 21968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc892a3158e4480f87c2b4524b0c9907"
dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
mode: GRACEFUL
new_leader_uuid: "d00d75d8e50e4383abd5f04c72c73071"
 from {username='slave'} at 127.0.0.1:59296
I20260709 12:16:11.430445 21968 raft_consensus.cc:606] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 2 LEADER]: Received request to transfer leadership to TS d00d75d8e50e4383abd5f04c72c73071
I20260709 12:16:11.431329 22208 raft_consensus.cc:993] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0: : Instructing follower d00d75d8e50e4383abd5f04c72c73071 to start an election
I20260709 12:16:11.431903 22206 raft_consensus.cc:1081] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 LEADER]: Signalling peer d00d75d8e50e4383abd5f04c72c73071 to start an election
I20260709 12:16:11.433310 21893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd75751852944d3fa27116f7ce00f75a"
dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
 from {username='slave'} at 127.0.0.1:47214
I20260709 12:16:11.433876 21893 raft_consensus.cc:493] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:11.434244 21893 raft_consensus.cc:3060] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:11.435554 21968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f746cb0c05245509f72f0ef07c16ba2"
dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
mode: GRACEFUL
new_leader_uuid: "d00d75d8e50e4383abd5f04c72c73071"
 from {username='slave'} at 127.0.0.1:59296
I20260709 12:16:11.436110 21968 raft_consensus.cc:606] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 2 LEADER]: Received request to transfer leadership to TS d00d75d8e50e4383abd5f04c72c73071
I20260709 12:16:11.442575 22090 raft_consensus.cc:993] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9: : Instructing follower d00d75d8e50e4383abd5f04c72c73071 to start an election
I20260709 12:16:11.441984 21893 raft_consensus.cc:515] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:11.443183 22209 raft_consensus.cc:1081] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 2 LEADER]: Signalling peer d00d75d8e50e4383abd5f04c72c73071 to start an election
I20260709 12:16:11.444736 21893 leader_election.cc:290] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 4 election: Requested vote from peers 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:16:11.444912 21894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f746cb0c05245509f72f0ef07c16ba2"
dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
 from {username='slave'} at 127.0.0.1:47204
I20260709 12:16:11.445528 21894 raft_consensus.cc:493] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:11.445922 21894 raft_consensus.cc:3060] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:11.450279 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd75751852944d3fa27116f7ce00f75a" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:16:11.450924 22042 raft_consensus.cc:3055] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:11.451169 22042 raft_consensus.cc:740] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Running, Role: LEADER
I20260709 12:16:11.451673 21968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd75751852944d3fa27116f7ce00f75a" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:16:11.451903 21894 raft_consensus.cc:515] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:11.452230 21968 raft_consensus.cc:3060] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:11.451993 22042 consensus_queue.cc:260] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:11.453214 22042 raft_consensus.cc:3060] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:11.454986 21969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f746cb0c05245509f72f0ef07c16ba2" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:16:11.455677 21969 raft_consensus.cc:3055] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:11.456028 21969 raft_consensus.cc:740] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Running, Role: LEADER
I20260709 12:16:11.456255 22043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f746cb0c05245509f72f0ef07c16ba2" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:16:11.457086 22043 raft_consensus.cc:3060] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:11.457187 21969 consensus_queue.cc:260] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:11.458739 21969 raft_consensus.cc:3060] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:11.460223 21968 raft_consensus.cc:2468] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 4.
I20260709 12:16:11.462307 22042 raft_consensus.cc:2468] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 4.
I20260709 12:16:11.463698 21894 leader_election.cc:290] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 3 election: Requested vote from peers 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:16:11.463792 21859 leader_election.cc:304] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:16:11.464620 22043 raft_consensus.cc:2468] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 3.
I20260709 12:16:11.465332 22188 raft_consensus.cc:2804] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:11.466004 21859 leader_election.cc:304] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:16:11.466287 21969 raft_consensus.cc:2468] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 3.
I20260709 12:16:11.467542 22188 raft_consensus.cc:697] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 4 LEADER]: Becoming Leader. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:16:11.468540 22188 consensus_queue.cc:237] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:11.469089 22211 raft_consensus.cc:2804] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:11.469616 22211 raft_consensus.cc:697] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 3 LEADER]: Becoming Leader. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:16:11.470678 22211 consensus_queue.cc:237] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:11.476925 21790 catalog_manager.cc:5697] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 reported cstate change: term changed from 3 to 4, leader changed from 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3) to d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1). New cstate: current_term: 4 leader_uuid: "d00d75d8e50e4383abd5f04c72c73071" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:11.493681 21790 catalog_manager.cc:5697] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 reported cstate change: term changed from 2 to 3, leader changed from 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2) to d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1). New cstate: current_term: 3 leader_uuid: "d00d75d8e50e4383abd5f04c72c73071" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:11.737049 22090 raft_consensus.cc:993] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9: : Instructing follower d00d75d8e50e4383abd5f04c72c73071 to start an election
I20260709 12:16:11.737437 22090 raft_consensus.cc:1081] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 2 LEADER]: Signalling peer d00d75d8e50e4383abd5f04c72c73071 to start an election
I20260709 12:16:11.738803 21894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "616f1cc48bc74cc2acc1759c32206441"
dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
 from {username='slave'} at 127.0.0.1:47204
I20260709 12:16:11.739298 21894 raft_consensus.cc:493] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:11.739599 21894 raft_consensus.cc:3060] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:11.744743 21894 raft_consensus.cc:515] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:11.746419 21894 leader_election.cc:290] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 3 election: Requested vote from peers 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:16:11.747725 21969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616f1cc48bc74cc2acc1759c32206441" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:16:11.748063 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616f1cc48bc74cc2acc1759c32206441" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:16:11.748345 21969 raft_consensus.cc:3055] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:11.748589 22042 raft_consensus.cc:3060] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:11.748682 21969 raft_consensus.cc:740] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Running, Role: LEADER
I20260709 12:16:11.749460 21969 consensus_queue.cc:260] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:11.750479 21969 raft_consensus.cc:3060] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:11.753618 22042 raft_consensus.cc:2468] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 3.
I20260709 12:16:11.754689 21859 leader_election.cc:304] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:16:11.755349 22211 raft_consensus.cc:2804] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:11.755719 22211 raft_consensus.cc:697] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 3 LEADER]: Becoming Leader. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:16:11.755713 21969 raft_consensus.cc:2468] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 3.
I20260709 12:16:11.756516 22211 consensus_queue.cc:237] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:11.763319 21790 catalog_manager.cc:5697] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 reported cstate change: term changed from 2 to 3, leader changed from 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2) to d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1). New cstate: current_term: 3 leader_uuid: "d00d75d8e50e4383abd5f04c72c73071" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:11.881093 22209 raft_consensus.cc:993] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9: : Instructing follower d00d75d8e50e4383abd5f04c72c73071 to start an election
I20260709 12:16:11.881494 22090 raft_consensus.cc:1081] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 2 LEADER]: Signalling peer d00d75d8e50e4383abd5f04c72c73071 to start an election
I20260709 12:16:11.883109 21894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc892a3158e4480f87c2b4524b0c9907"
dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
 from {username='slave'} at 127.0.0.1:47204
I20260709 12:16:11.883611 21894 raft_consensus.cc:493] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:11.883893 21894 raft_consensus.cc:3060] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:11.888597 21894 raft_consensus.cc:515] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:11.890261 21894 leader_election.cc:290] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 3 election: Requested vote from peers 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:16:11.891366 21969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc892a3158e4480f87c2b4524b0c9907" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:16:11.891680 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc892a3158e4480f87c2b4524b0c9907" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:16:11.891960 21969 raft_consensus.cc:3055] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:11.892252 21969 raft_consensus.cc:740] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Running, Role: LEADER
I20260709 12:16:11.892287 22042 raft_consensus.cc:3060] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:11.893029 21969 consensus_queue.cc:260] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:11.894142 21969 raft_consensus.cc:3060] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:11.897150 22042 raft_consensus.cc:2468] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 3.
I20260709 12:16:11.898272 21859 leader_election.cc:304] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85e8e1fc05f24abe9523c5c55b9ab7d0, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:16:11.898972 22211 raft_consensus.cc:2804] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:11.898967 21969 raft_consensus.cc:2468] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 3.
I20260709 12:16:11.899850 22211 raft_consensus.cc:697] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 3 LEADER]: Becoming Leader. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:16:11.900887 22211 consensus_queue.cc:237] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:11.906548 22042 raft_consensus.cc:1275] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 4 FOLLOWER]: Refusing update from remote peer d00d75d8e50e4383abd5f04c72c73071: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:11.907665 22211 consensus_queue.cc:1048] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:11.908457 21790 catalog_manager.cc:5697] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 reported cstate change: term changed from 2 to 3, leader changed from 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2) to d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1). New cstate: current_term: 3 leader_uuid: "d00d75d8e50e4383abd5f04c72c73071" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:11.913172 22208 raft_consensus.cc:993] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0: : Instructing follower d00d75d8e50e4383abd5f04c72c73071 to start an election
I20260709 12:16:11.913720 22206 raft_consensus.cc:1081] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 LEADER]: Signalling peer d00d75d8e50e4383abd5f04c72c73071 to start an election
I20260709 12:16:11.915771 21894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97"
dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
 from {username='slave'} at 127.0.0.1:47214
I20260709 12:16:11.916356 21894 raft_consensus.cc:493] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:11.916729 21894 raft_consensus.cc:3060] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:11.925364 21968 raft_consensus.cc:1275] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [term 4 FOLLOWER]: Refusing update from remote peer d00d75d8e50e4383abd5f04c72c73071: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:11.927170 22210 consensus_queue.cc:1048] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:11.931715 21894 raft_consensus.cc:515] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:11.934795 21969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:16:11.935395 21969 raft_consensus.cc:3060] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:11.935672 22043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97" candidate_uuid: "d00d75d8e50e4383abd5f04c72c73071" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:16:11.936326 22043 raft_consensus.cc:3055] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:11.936685 22043 raft_consensus.cc:740] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Running, Role: LEADER
I20260709 12:16:11.937654 22043 consensus_queue.cc:260] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:11.938925 22043 raft_consensus.cc:3060] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:11.941399 21969 raft_consensus.cc:2468] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 4.
I20260709 12:16:11.942466 21859 leader_election.cc:304] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, d00d75d8e50e4383abd5f04c72c73071; no voters: 
I20260709 12:16:11.945119 22211 raft_consensus.cc:2804] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:11.945629 22211 raft_consensus.cc:697] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 4 LEADER]: Becoming Leader. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:16:11.946568 22211 consensus_queue.cc:237] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:11.948957 22043 raft_consensus.cc:2468] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00d75d8e50e4383abd5f04c72c73071 in term 4.
I20260709 12:16:11.949628 21894 leader_election.cc:290] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [CANDIDATE]: Term 4 election: Requested vote from peers 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:16:11.956023 21790 catalog_manager.cc:5697] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 reported cstate change: term changed from 3 to 4, leader changed from 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3) to d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1). New cstate: current_term: 4 leader_uuid: "d00d75d8e50e4383abd5f04c72c73071" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:11.973882 22043 raft_consensus.cc:1275] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Refusing update from remote peer d00d75d8e50e4383abd5f04c72c73071: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:11.975317 22211 consensus_queue.cc:1048] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:11.990998 21968 raft_consensus.cc:1275] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Refusing update from remote peer d00d75d8e50e4383abd5f04c72c73071: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:11.992660 22210 consensus_queue.cc:1048] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:12.165920 21968 raft_consensus.cc:1275] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Refusing update from remote peer d00d75d8e50e4383abd5f04c72c73071: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:12.167019 22210 consensus_queue.cc:1048] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:12.175525 22043 raft_consensus.cc:1275] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Refusing update from remote peer d00d75d8e50e4383abd5f04c72c73071: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:12.177419 22210 consensus_queue.cc:1048] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:12.342274 21968 raft_consensus.cc:1275] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 4 FOLLOWER]: Refusing update from remote peer d00d75d8e50e4383abd5f04c72c73071: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:12.343605 22210 consensus_queue.cc:1048] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:12.354321 22042 raft_consensus.cc:1275] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 4 FOLLOWER]: Refusing update from remote peer d00d75d8e50e4383abd5f04c72c73071: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:12.356178 22210 consensus_queue.cc:1048] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:12.363943 22042 raft_consensus.cc:1275] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Refusing update from remote peer d00d75d8e50e4383abd5f04c72c73071: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:12.365027 22210 consensus_queue.cc:1048] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:12.376626 21968 raft_consensus.cc:1275] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Refusing update from remote peer d00d75d8e50e4383abd5f04c72c73071: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:12.378451 22211 consensus_queue.cc:1048] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:14.474674 21244 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:16:14.475370 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:14.482506 21894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bc1ca7a20764dc887bffaa896850ec3"
dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
mode: GRACEFUL
new_leader_uuid: "532d8c016b334c18b3ec09578fa596f9"
 from {username='slave'} at 127.0.0.1:36434
I20260709 12:16:14.483026 21894 raft_consensus.cc:606] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 2 LEADER]: Received request to transfer leadership to TS 532d8c016b334c18b3ec09578fa596f9
I20260709 12:16:14.485453 21894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "616f1cc48bc74cc2acc1759c32206441"
dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
mode: GRACEFUL
new_leader_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
 from {username='slave'} at 127.0.0.1:36434
I20260709 12:16:14.485967 21894 raft_consensus.cc:606] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 3 LEADER]: Received request to transfer leadership to TS 85e8e1fc05f24abe9523c5c55b9ab7d0
I20260709 12:16:14.488127 21894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc892a3158e4480f87c2b4524b0c9907"
dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
mode: GRACEFUL
new_leader_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
 from {username='slave'} at 127.0.0.1:36434
I20260709 12:16:14.488682 21894 raft_consensus.cc:606] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 3 LEADER]: Received request to transfer leadership to TS 85e8e1fc05f24abe9523c5c55b9ab7d0
I20260709 12:16:14.490949 21894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97"
dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
mode: GRACEFUL
new_leader_uuid: "532d8c016b334c18b3ec09578fa596f9"
 from {username='slave'} at 127.0.0.1:36434
I20260709 12:16:14.491418 21894 raft_consensus.cc:606] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 4 LEADER]: Received request to transfer leadership to TS 532d8c016b334c18b3ec09578fa596f9
I20260709 12:16:14.492394 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:16:14.492844 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:14.696775 22236 raft_consensus.cc:993] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071: : Instructing follower 85e8e1fc05f24abe9523c5c55b9ab7d0 to start an election
I20260709 12:16:14.697227 22236 raft_consensus.cc:1081] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 3 LEADER]: Signalling peer 85e8e1fc05f24abe9523c5c55b9ab7d0 to start an election
I20260709 12:16:14.698602 22042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "616f1cc48bc74cc2acc1759c32206441"
dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
 from {username='slave'} at 127.0.0.1:33604
I20260709 12:16:14.699026 22042 raft_consensus.cc:493] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:14.699275 22042 raft_consensus.cc:3060] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:14.703635 22042 raft_consensus.cc:515] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:14.705458 22042 leader_election.cc:290] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 4 election: Requested vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455)
I20260709 12:16:14.706482 21968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616f1cc48bc74cc2acc1759c32206441" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:16:14.706403 21894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616f1cc48bc74cc2acc1759c32206441" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
I20260709 12:16:14.707083 21968 raft_consensus.cc:3060] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:14.707139 21894 raft_consensus.cc:3055] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:14.707525 21894 raft_consensus.cc:740] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:16:14.708298 21894 consensus_queue.cc:260] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:14.709481 21894 raft_consensus.cc:3060] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:14.713845 21968 raft_consensus.cc:2468] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 4.
I20260709 12:16:14.715006 22008 leader_election.cc:304] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, 85e8e1fc05f24abe9523c5c55b9ab7d0; no voters: 
I20260709 12:16:14.715993 22206 raft_consensus.cc:2804] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:14.716475 22206 raft_consensus.cc:697] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 4 LEADER]: Becoming Leader. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Running, Role: LEADER
I20260709 12:16:14.717213 21894 raft_consensus.cc:2468] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 4.
I20260709 12:16:14.717319 22206 consensus_queue.cc:237] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:14.724483 21792 catalog_manager.cc:5697] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 reported cstate change: term changed from 3 to 4, leader changed from d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1) to 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3). New cstate: current_term: 4 leader_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:14.785307 22236 raft_consensus.cc:993] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071: : Instructing follower 85e8e1fc05f24abe9523c5c55b9ab7d0 to start an election
I20260709 12:16:14.785820 22235 raft_consensus.cc:1081] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 3 LEADER]: Signalling peer 85e8e1fc05f24abe9523c5c55b9ab7d0 to start an election
I20260709 12:16:14.787616 22042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc892a3158e4480f87c2b4524b0c9907"
dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
 from {username='slave'} at 127.0.0.1:33604
I20260709 12:16:14.788077 22042 raft_consensus.cc:493] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:14.788332 22042 raft_consensus.cc:3060] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:14.792613 22042 raft_consensus.cc:515] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:14.794072 22042 leader_election.cc:290] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 4 election: Requested vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455)
I20260709 12:16:14.794950 21894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc892a3158e4480f87c2b4524b0c9907" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
I20260709 12:16:14.795120 21968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc892a3158e4480f87c2b4524b0c9907" candidate_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
I20260709 12:16:14.795478 21894 raft_consensus.cc:3055] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:14.795548 21968 raft_consensus.cc:3060] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:14.795794 21894 raft_consensus.cc:740] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:16:14.796492 21894 consensus_queue.cc:260] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:14.797375 21894 raft_consensus.cc:3060] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:14.799894 21968 raft_consensus.cc:2468] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 4.
I20260709 12:16:14.800858 22008 leader_election.cc:304] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, 85e8e1fc05f24abe9523c5c55b9ab7d0; no voters: 
I20260709 12:16:14.801522 22206 raft_consensus.cc:2804] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:14.802013 22206 raft_consensus.cc:697] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 4 LEADER]: Becoming Leader. State: Replica: 85e8e1fc05f24abe9523c5c55b9ab7d0, State: Running, Role: LEADER
I20260709 12:16:14.802920 21894 raft_consensus.cc:2468] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e8e1fc05f24abe9523c5c55b9ab7d0 in term 4.
I20260709 12:16:14.802809 22206 consensus_queue.cc:237] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:14.810182 21792 catalog_manager.cc:5697] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 reported cstate change: term changed from 3 to 4, leader changed from d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1) to 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3). New cstate: current_term: 4 leader_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:14.864279 22236 raft_consensus.cc:993] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071: : Instructing follower 532d8c016b334c18b3ec09578fa596f9 to start an election
I20260709 12:16:14.864709 22235 raft_consensus.cc:1081] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 2 LEADER]: Signalling peer 532d8c016b334c18b3ec09578fa596f9 to start an election
I20260709 12:16:14.865959 21968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bc1ca7a20764dc887bffaa896850ec3"
dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
 from {username='slave'} at 127.0.0.1:59282
I20260709 12:16:14.866356 21968 raft_consensus.cc:493] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:14.866597 21968 raft_consensus.cc:3060] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:14.870595 21968 raft_consensus.cc:515] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:14.872411 21968 leader_election.cc:290] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 3 election: Requested vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:16:14.873248 21894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc1ca7a20764dc887bffaa896850ec3" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
I20260709 12:16:14.873397 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc1ca7a20764dc887bffaa896850ec3" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:16:14.873790 21894 raft_consensus.cc:3055] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:14.873907 22042 raft_consensus.cc:3060] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:14.874101 21894 raft_consensus.cc:740] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:16:14.874889 21894 consensus_queue.cc:260] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:14.875825 21894 raft_consensus.cc:3060] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:14.878429 22042 raft_consensus.cc:2468] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 532d8c016b334c18b3ec09578fa596f9 in term 3.
I20260709 12:16:14.879566 21934 leader_election.cc:304] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, 85e8e1fc05f24abe9523c5c55b9ab7d0; no voters: 
I20260709 12:16:14.880335 22090 raft_consensus.cc:2804] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:14.880548 21894 raft_consensus.cc:2468] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 532d8c016b334c18b3ec09578fa596f9 in term 3.
I20260709 12:16:14.881506 22090 raft_consensus.cc:697] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 3 LEADER]: Becoming Leader. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Running, Role: LEADER
I20260709 12:16:14.882211 22090 consensus_queue.cc:237] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:14.889742 21792 catalog_manager.cc:5697] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 reported cstate change: term changed from 2 to 3, leader changed from d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1) to 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2). New cstate: current_term: 3 leader_uuid: "532d8c016b334c18b3ec09578fa596f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:15.084837 22236 raft_consensus.cc:993] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071: : Instructing follower 532d8c016b334c18b3ec09578fa596f9 to start an election
I20260709 12:16:15.085259 22235 raft_consensus.cc:1081] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 4 LEADER]: Signalling peer 532d8c016b334c18b3ec09578fa596f9 to start an election
I20260709 12:16:15.086577 21968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97"
dest_uuid: "532d8c016b334c18b3ec09578fa596f9"
 from {username='slave'} at 127.0.0.1:59282
I20260709 12:16:15.087011 21968 raft_consensus.cc:493] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:15.087263 21968 raft_consensus.cc:3060] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:15.091593 21968 raft_consensus.cc:515] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:15.093044 21968 leader_election.cc:290] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 5 election: Requested vote from peers d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199), 85e8e1fc05f24abe9523c5c55b9ab7d0 (127.20.191.3:39713)
I20260709 12:16:15.093890 21894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d00d75d8e50e4383abd5f04c72c73071"
I20260709 12:16:15.093958 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf9a5b30c9d4da7a9544632c3407a97" candidate_uuid: "532d8c016b334c18b3ec09578fa596f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0"
I20260709 12:16:15.094376 21894 raft_consensus.cc:3055] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:15.094434 22042 raft_consensus.cc:3060] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:15.094630 21894 raft_consensus.cc:740] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d00d75d8e50e4383abd5f04c72c73071, State: Running, Role: LEADER
I20260709 12:16:15.095338 21894 consensus_queue.cc:260] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:15.096135 21894 raft_consensus.cc:3060] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:15.098711 22042 raft_consensus.cc:2468] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 532d8c016b334c18b3ec09578fa596f9 in term 5.
I20260709 12:16:15.099541 21934 leader_election.cc:304] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532d8c016b334c18b3ec09578fa596f9, 85e8e1fc05f24abe9523c5c55b9ab7d0; no voters: 
I20260709 12:16:15.100127 22090 raft_consensus.cc:2804] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:15.100258 21894 raft_consensus.cc:2468] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 532d8c016b334c18b3ec09578fa596f9 in term 5.
I20260709 12:16:15.100577 22090 raft_consensus.cc:697] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 5 LEADER]: Becoming Leader. State: Replica: 532d8c016b334c18b3ec09578fa596f9, State: Running, Role: LEADER
I20260709 12:16:15.101495 22090 consensus_queue.cc:237] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } }
I20260709 12:16:15.107359 21894 raft_consensus.cc:1275] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 4 FOLLOWER]: Refusing update from remote peer 85e8e1fc05f24abe9523c5c55b9ab7d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:15.107649 21792 catalog_manager.cc:5697] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 reported cstate change: term changed from 4 to 5, leader changed from d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1) to 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2). New cstate: current_term: 5 leader_uuid: "532d8c016b334c18b3ec09578fa596f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:15.108505 22206 consensus_queue.cc:1048] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:15.119948 21968 raft_consensus.cc:1275] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 4 FOLLOWER]: Refusing update from remote peer 85e8e1fc05f24abe9523c5c55b9ab7d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:15.121928 22249 consensus_queue.cc:1048] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:15.238716 21894 raft_consensus.cc:1275] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 4 FOLLOWER]: Refusing update from remote peer 85e8e1fc05f24abe9523c5c55b9ab7d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:15.240134 22249 consensus_queue.cc:1048] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:15.253845 21968 raft_consensus.cc:1275] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 4 FOLLOWER]: Refusing update from remote peer 85e8e1fc05f24abe9523c5c55b9ab7d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:15.255322 22249 consensus_queue.cc:1048] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d8c016b334c18b3ec09578fa596f9" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:15.269502 22043 raft_consensus.cc:1275] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Refusing update from remote peer 532d8c016b334c18b3ec09578fa596f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:15.270913 22090 consensus_queue.cc:1048] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:15.283429 21894 raft_consensus.cc:1275] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Refusing update from remote peer 532d8c016b334c18b3ec09578fa596f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:15.285161 22090 consensus_queue.cc:1048] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:15.494210 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:15.500069 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:15.500555 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:15.554817 22043 raft_consensus.cc:1275] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 5 FOLLOWER]: Refusing update from remote peer 532d8c016b334c18b3ec09578fa596f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:15.556144 22257 consensus_queue.cc:1048] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85e8e1fc05f24abe9523c5c55b9ab7d0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:15.569330 21894 raft_consensus.cc:1275] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 5 FOLLOWER]: Refusing update from remote peer 532d8c016b334c18b3ec09578fa596f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:15.570794 22244 consensus_queue.cc:1048] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00d75d8e50e4383abd5f04c72c73071" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:16.501695 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:16.508073 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:16.508498 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:17.509595 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:17.515324 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:17.515772 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:18.516674 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:18.522043 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:18.522466 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:19.523427 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:19.529367 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:19.529886 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:20.530838 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:20.537179 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:20.537575 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:21.538478 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:21.545380 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:21.545960 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:22.547088 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:22.553619 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:22.554102 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:23.555027 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:23.560192 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:23.560611 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:24.592299 21244 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:16:24.592798 21244 tablet_server.cc:179] TabletServer@127.20.191.1:0 shutting down...
I20260709 12:16:24.617151 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:24.617921 21244 tablet_replica.cc:333] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071: stopping tablet replica
I20260709 12:16:24.618673 21244 raft_consensus.cc:2243] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.619122 21244 raft_consensus.cc:2272] T 30c9f76486cd4360bf84de37b8ebc53f P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.621043 21244 tablet_replica.cc:333] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071: stopping tablet replica
I20260709 12:16:24.621580 21244 raft_consensus.cc:2243] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.622044 21244 raft_consensus.cc:2272] T 1bc1ca7a20764dc887bffaa896850ec3 P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.623672 21244 tablet_replica.cc:333] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071: stopping tablet replica
I20260709 12:16:24.624161 21244 raft_consensus.cc:2243] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.624900 21244 raft_consensus.cc:2272] T 0f746cb0c05245509f72f0ef07c16ba2 P d00d75d8e50e4383abd5f04c72c73071 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.626632 21244 tablet_replica.cc:333] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071: stopping tablet replica
I20260709 12:16:24.627115 21244 raft_consensus.cc:2243] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.627530 21244 raft_consensus.cc:2272] T fc892a3158e4480f87c2b4524b0c9907 P d00d75d8e50e4383abd5f04c72c73071 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.629169 21244 tablet_replica.cc:333] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071: stopping tablet replica
I20260709 12:16:24.629670 21244 raft_consensus.cc:2243] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.630162 21244 raft_consensus.cc:2272] T 616f1cc48bc74cc2acc1759c32206441 P d00d75d8e50e4383abd5f04c72c73071 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.631907 21244 tablet_replica.cc:333] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071: stopping tablet replica
I20260709 12:16:24.632741 21244 raft_consensus.cc:2243] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.633221 21244 raft_consensus.cc:2272] T 27141291d310492caf09007c5d6be37e P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.635309 21244 tablet_replica.cc:333] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071: stopping tablet replica
I20260709 12:16:24.635813 21244 raft_consensus.cc:2243] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.636606 21244 raft_consensus.cc:2272] T d62f5fd00783452596eb3c11b706bfc4 P d00d75d8e50e4383abd5f04c72c73071 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.638463 21244 tablet_replica.cc:333] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071: stopping tablet replica
I20260709 12:16:24.638957 21244 raft_consensus.cc:2243] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.640202 21244 raft_consensus.cc:2272] T cd75751852944d3fa27116f7ce00f75a P d00d75d8e50e4383abd5f04c72c73071 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.642235 21244 tablet_replica.cc:333] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071: stopping tablet replica
I20260709 12:16:24.642884 21244 raft_consensus.cc:2243] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.643666 21244 raft_consensus.cc:2272] T 13511bd75f3f414381563741fec19933 P d00d75d8e50e4383abd5f04c72c73071 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.645427 21244 tablet_replica.cc:333] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071: stopping tablet replica
I20260709 12:16:24.645936 21244 raft_consensus.cc:2243] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.646347 21244 raft_consensus.cc:2272] T fdf9a5b30c9d4da7a9544632c3407a97 P d00d75d8e50e4383abd5f04c72c73071 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:24.654206 22007 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 12:16:24.657413 22007 consensus_peers.cc:597] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 -> Peer d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199): Couldn't send request to peer d00d75d8e50e4383abd5f04c72c73071. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.676608 21933 consensus_peers.cc:597] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 -> Peer d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199): Couldn't send request to peer d00d75d8e50e4383abd5f04c72c73071. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:34199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:24.678861 21244 tablet_server.cc:196] TabletServer@127.20.191.1:0 shutdown complete.
W20260709 12:16:24.694425 21933 consensus_peers.cc:597] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 -> Peer d00d75d8e50e4383abd5f04c72c73071 (127.20.191.1:34199): Couldn't send request to peer d00d75d8e50e4383abd5f04c72c73071. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:34199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:24.700140 21244 tablet_server.cc:179] TabletServer@127.20.191.2:0 shutting down...
I20260709 12:16:24.723718 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:24.724397 21244 tablet_replica.cc:333] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9: stopping tablet replica
I20260709 12:16:24.724988 21244 raft_consensus.cc:2243] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.725445 21244 raft_consensus.cc:2272] T cd75751852944d3fa27116f7ce00f75a P 532d8c016b334c18b3ec09578fa596f9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.727370 21244 tablet_replica.cc:333] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9: stopping tablet replica
I20260709 12:16:24.728093 21244 raft_consensus.cc:2243] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.728609 21244 raft_consensus.cc:2272] T 0f746cb0c05245509f72f0ef07c16ba2 P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:24.731268 22008 consensus_peers.cc:597] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 -> Peer 532d8c016b334c18b3ec09578fa596f9 (127.20.191.2:37455): Couldn't send request to peer 532d8c016b334c18b3ec09578fa596f9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:24.731366 21244 tablet_replica.cc:333] T d62f5fd00783452596eb3c11b706bfc4 P 532d8c016b334c18b3ec09578fa596f9: stopping tablet replica
I20260709 12:16:24.731931 21244 raft_consensus.cc:2243] T d62f5fd00783452596eb3c11b706bfc4 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.732381 21244 raft_consensus.cc:2272] T d62f5fd00783452596eb3c11b706bfc4 P 532d8c016b334c18b3ec09578fa596f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.734169 21244 tablet_replica.cc:333] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9: stopping tablet replica
I20260709 12:16:24.734830 21244 raft_consensus.cc:2243] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.735580 21244 raft_consensus.cc:2272] T 27141291d310492caf09007c5d6be37e P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.737282 21244 tablet_replica.cc:333] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9: stopping tablet replica
I20260709 12:16:24.737951 21244 raft_consensus.cc:2243] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.738777 21244 raft_consensus.cc:2272] T fc892a3158e4480f87c2b4524b0c9907 P 532d8c016b334c18b3ec09578fa596f9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.740613 21244 tablet_replica.cc:333] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9: stopping tablet replica
I20260709 12:16:24.741154 21244 raft_consensus.cc:2243] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.741602 21244 raft_consensus.cc:2272] T 616f1cc48bc74cc2acc1759c32206441 P 532d8c016b334c18b3ec09578fa596f9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.743319 21244 tablet_replica.cc:333] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9: stopping tablet replica
I20260709 12:16:24.743815 21244 raft_consensus.cc:2243] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.744248 21244 raft_consensus.cc:2272] T 30c9f76486cd4360bf84de37b8ebc53f P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.746045 21244 tablet_replica.cc:333] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9: stopping tablet replica
I20260709 12:16:24.746543 21244 raft_consensus.cc:2243] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.747303 21244 raft_consensus.cc:2272] T fdf9a5b30c9d4da7a9544632c3407a97 P 532d8c016b334c18b3ec09578fa596f9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.748996 21244 tablet_replica.cc:333] T 13511bd75f3f414381563741fec19933 P 532d8c016b334c18b3ec09578fa596f9: stopping tablet replica
I20260709 12:16:24.749462 21244 raft_consensus.cc:2243] T 13511bd75f3f414381563741fec19933 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.749895 21244 raft_consensus.cc:2272] T 13511bd75f3f414381563741fec19933 P 532d8c016b334c18b3ec09578fa596f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.751582 21244 tablet_replica.cc:333] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9: stopping tablet replica
I20260709 12:16:24.752018 21244 raft_consensus.cc:2243] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.752707 21244 raft_consensus.cc:2272] T 1bc1ca7a20764dc887bffaa896850ec3 P 532d8c016b334c18b3ec09578fa596f9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.781715 21244 tablet_server.cc:196] TabletServer@127.20.191.2:0 shutdown complete.
I20260709 12:16:24.800957 21244 tablet_server.cc:179] TabletServer@127.20.191.3:0 shutting down...
I20260709 12:16:24.824847 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:24.825560 21244 tablet_replica.cc:333] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0: stopping tablet replica
I20260709 12:16:24.826164 21244 raft_consensus.cc:2243] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.826937 21244 raft_consensus.cc:2272] T 30c9f76486cd4360bf84de37b8ebc53f P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.828687 21244 tablet_replica.cc:333] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0: stopping tablet replica
I20260709 12:16:24.829185 21244 raft_consensus.cc:2243] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.829907 21244 raft_consensus.cc:2272] T 616f1cc48bc74cc2acc1759c32206441 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.831555 21244 tablet_replica.cc:333] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0: stopping tablet replica
I20260709 12:16:24.832041 21244 raft_consensus.cc:2243] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.832437 21244 raft_consensus.cc:2272] T 0f746cb0c05245509f72f0ef07c16ba2 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.834131 21244 tablet_replica.cc:333] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0: stopping tablet replica
I20260709 12:16:24.834642 21244 raft_consensus.cc:2243] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.835356 21244 raft_consensus.cc:2272] T fc892a3158e4480f87c2b4524b0c9907 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.837144 21244 tablet_replica.cc:333] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0: stopping tablet replica
I20260709 12:16:24.837663 21244 raft_consensus.cc:2243] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.838153 21244 raft_consensus.cc:2272] T cd75751852944d3fa27116f7ce00f75a P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.839861 21244 tablet_replica.cc:333] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0: stopping tablet replica
I20260709 12:16:24.840348 21244 raft_consensus.cc:2243] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.840739 21244 raft_consensus.cc:2272] T 27141291d310492caf09007c5d6be37e P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.842413 21244 tablet_replica.cc:333] T d62f5fd00783452596eb3c11b706bfc4 P 85e8e1fc05f24abe9523c5c55b9ab7d0: stopping tablet replica
I20260709 12:16:24.842870 21244 raft_consensus.cc:2243] T d62f5fd00783452596eb3c11b706bfc4 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.843236 21244 raft_consensus.cc:2272] T d62f5fd00783452596eb3c11b706bfc4 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.844807 21244 tablet_replica.cc:333] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0: stopping tablet replica
I20260709 12:16:24.845255 21244 raft_consensus.cc:2243] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.845623 21244 raft_consensus.cc:2272] T 13511bd75f3f414381563741fec19933 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.847242 21244 tablet_replica.cc:333] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0: stopping tablet replica
I20260709 12:16:24.847683 21244 raft_consensus.cc:2243] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.848055 21244 raft_consensus.cc:2272] T fdf9a5b30c9d4da7a9544632c3407a97 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.849540 21244 tablet_replica.cc:333] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0: stopping tablet replica
I20260709 12:16:24.849969 21244 raft_consensus.cc:2243] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.850340 21244 raft_consensus.cc:2272] T 1bc1ca7a20764dc887bffaa896850ec3 P 85e8e1fc05f24abe9523c5c55b9ab7d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.877671 21244 tablet_server.cc:196] TabletServer@127.20.191.3:0 shutdown complete.
I20260709 12:16:24.895991 21244 master.cc:562] Master@127.20.191.62:36641 shutting down...
I20260709 12:16:24.915776 21244 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.916285 21244 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.916572 21244 tablet_replica.cc:333] T 00000000000000000000000000000000 P 58456430ff2648aea9fae88921051de3: stopping tablet replica
I20260709 12:16:24.935830 21244 master.cc:584] Master@127.20.191.62:36641 shutdown complete.
532d8c016b334c18b3ec09578fa596f9  4
85e8e1fc05f24abe9523c5c55b9ab7d0  1
d00d75d8e50e4383abd5f04c72c73071  5
532d8c016b334c18b3ec09578fa596f9  4
85e8e1fc05f24abe9523c5c55b9ab7d0  3
d00d75d8e50e4383abd5f04c72c73071  3
532d8c016b334c18b3ec09578fa596f9  1
85e8e1fc05f24abe9523c5c55b9ab7d0  1
d00d75d8e50e4383abd5f04c72c73071  8
532d8c016b334c18b3ec09578fa596f9  3
85e8e1fc05f24abe9523c5c55b9ab7d0  3
d00d75d8e50e4383abd5f04c72c73071  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28898 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:16:24.974562 21244 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.191.62:37293
I20260709 12:16:24.975665 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:24.981510 22275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:24.981743 22277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:24.981582 22274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:24.982684 21244 server_base.cc:1061] running on GCE node
I20260709 12:16:24.983603 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:24.983798 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:24.983937 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599384983919 us; error 0 us; skew 500 ppm
I20260709 12:16:24.984467 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:24.986814 21244 webserver.cc:533] Webserver started at http://127.20.191.62:37469/ using document root <none> and password file <none>
I20260709 12:16:24.987283 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:24.987463 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:24.987741 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:24.988866 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/master-0-root/instance:
uuid: "fd30aaad5b9140cf904466d9eb78783a"
format_stamp: "Formatted at 2026-07-09 12:16:24 on dist-test-slave-7c1h"
I20260709 12:16:24.993412 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:16:24.996930 22282 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:24.997733 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:16:24.998060 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/master-0-root
uuid: "fd30aaad5b9140cf904466d9eb78783a"
format_stamp: "Formatted at 2026-07-09 12:16:24 on dist-test-slave-7c1h"
I20260709 12:16:24.998340 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:25.035385 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:25.036602 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:25.077075 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.62:37293
I20260709 12:16:25.077175 22333 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.62:37293 every 8 connection(s)
I20260709 12:16:25.080952 22334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.090752 22334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Bootstrap starting.
I20260709 12:16:25.095351 22334 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.099731 22334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: No bootstrap required, opened a new log
I20260709 12:16:25.102375 22334 raft_consensus.cc:359] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd30aaad5b9140cf904466d9eb78783a" member_type: VOTER }
I20260709 12:16:25.102820 22334 raft_consensus.cc:385] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.103061 22334 raft_consensus.cc:740] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd30aaad5b9140cf904466d9eb78783a, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.103639 22334 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd30aaad5b9140cf904466d9eb78783a" member_type: VOTER }
I20260709 12:16:25.104099 22334 raft_consensus.cc:399] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:25.104311 22334 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:25.104555 22334 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.109022 22334 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd30aaad5b9140cf904466d9eb78783a" member_type: VOTER }
I20260709 12:16:25.109591 22334 leader_election.cc:304] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd30aaad5b9140cf904466d9eb78783a; no voters: 
I20260709 12:16:25.110710 22334 leader_election.cc:290] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:25.111029 22337 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:25.112246 22337 raft_consensus.cc:697] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [term 1 LEADER]: Becoming Leader. State: Replica: fd30aaad5b9140cf904466d9eb78783a, State: Running, Role: LEADER
I20260709 12:16:25.112951 22337 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd30aaad5b9140cf904466d9eb78783a" member_type: VOTER }
I20260709 12:16:25.113449 22334 sys_catalog.cc:565] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:25.115911 22338 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd30aaad5b9140cf904466d9eb78783a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd30aaad5b9140cf904466d9eb78783a" member_type: VOTER } }
I20260709 12:16:25.115996 22339 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd30aaad5b9140cf904466d9eb78783a. Latest consensus state: current_term: 1 leader_uuid: "fd30aaad5b9140cf904466d9eb78783a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd30aaad5b9140cf904466d9eb78783a" member_type: VOTER } }
I20260709 12:16:25.116796 22338 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:25.116791 22339 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:25.119755 22343 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:25.124830 22343 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:25.127588 21244 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:25.133596 22343 catalog_manager.cc:1383] Generated new cluster ID: 82343d685ccd49cdbea7376534dd0830
I20260709 12:16:25.133877 22343 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:25.146020 22343 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:25.147184 22343 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:25.159981 22343 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Generated new TSK 0
I20260709 12:16:25.160526 22343 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:25.194738 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:25.200842 22355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:25.201704 22356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:25.204336 22358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:25.205055 21244 server_base.cc:1061] running on GCE node
I20260709 12:16:25.206033 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:25.206221 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:25.206393 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599385206379 us; error 0 us; skew 500 ppm
I20260709 12:16:25.206979 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:25.209288 21244 webserver.cc:533] Webserver started at http://127.20.191.1:33101/ using document root <none> and password file <none>
I20260709 12:16:25.209808 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:25.210001 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:25.210275 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:25.211369 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-0-root/instance:
uuid: "b8621fa34be04d3fa2d68a300f858cd1"
format_stamp: "Formatted at 2026-07-09 12:16:25 on dist-test-slave-7c1h"
I20260709 12:16:25.216382 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:16:25.219933 22363 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:25.220634 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:16:25.220934 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-0-root
uuid: "b8621fa34be04d3fa2d68a300f858cd1"
format_stamp: "Formatted at 2026-07-09 12:16:25 on dist-test-slave-7c1h"
I20260709 12:16:25.221230 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:25.266105 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:25.267788 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:25.269438 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:25.272145 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:25.272363 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:25.272657 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:25.272820 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:25.314795 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.1:37927
I20260709 12:16:25.314967 22426 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.1:37927 every 8 connection(s)
I20260709 12:16:25.320649 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:25.328043 22431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:25.328470 22432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:25.332163 21244 server_base.cc:1061] running on GCE node
W20260709 12:16:25.332333 22434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:25.333463 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:25.333739 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:25.334005 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599385333985 us; error 0 us; skew 500 ppm
I20260709 12:16:25.334692 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:25.336560 22427 heartbeater.cc:344] Connected to a master server at 127.20.191.62:37293
I20260709 12:16:25.337064 22427 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:25.337922 22427 heartbeater.cc:507] Master 127.20.191.62:37293 requested a full tablet report, sending...
I20260709 12:16:25.338467 21244 webserver.cc:533] Webserver started at http://127.20.191.2:44059/ using document root <none> and password file <none>
I20260709 12:16:25.338972 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:25.339182 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:25.339493 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:25.340572 22299 ts_manager.cc:194] Registered new tserver with Master: b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:16:25.341473 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-1-root/instance:
uuid: "25ebf14868c042dca42f54b3e251e1b2"
format_stamp: "Formatted at 2026-07-09 12:16:25 on dist-test-slave-7c1h"
I20260709 12:16:25.343403 22299 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50158
I20260709 12:16:25.347291 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:16:25.351089 22439 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:25.351943 21244 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:16:25.352262 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-1-root
uuid: "25ebf14868c042dca42f54b3e251e1b2"
format_stamp: "Formatted at 2026-07-09 12:16:25 on dist-test-slave-7c1h"
I20260709 12:16:25.352559 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:25.367048 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:25.368286 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:25.369750 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:25.372043 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:25.372242 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:25.372473 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:25.372622 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:25.412729 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.2:46187
I20260709 12:16:25.412817 22501 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.2:46187 every 8 connection(s)
I20260709 12:16:25.417400 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:25.424808 22505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:25.427037 22506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:25.430399 22502 heartbeater.cc:344] Connected to a master server at 127.20.191.62:37293
I20260709 12:16:25.430912 22502 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:25.431593 21244 server_base.cc:1061] running on GCE node
W20260709 12:16:25.431689 22508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:25.431945 22502 heartbeater.cc:507] Master 127.20.191.62:37293 requested a full tablet report, sending...
I20260709 12:16:25.433000 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:25.433408 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:25.433596 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599385433575 us; error 0 us; skew 500 ppm
I20260709 12:16:25.434262 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:25.434216 22299 ts_manager.cc:194] Registered new tserver with Master: 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:25.435961 22299 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50166
I20260709 12:16:25.437569 21244 webserver.cc:533] Webserver started at http://127.20.191.3:38765/ using document root <none> and password file <none>
I20260709 12:16:25.438093 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:25.438280 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:25.438653 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:25.439803 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-2-root/instance:
uuid: "8c3bcfa13ca74a24ab8999a408532932"
format_stamp: "Formatted at 2026-07-09 12:16:25 on dist-test-slave-7c1h"
I20260709 12:16:25.444329 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:16:25.447854 22513 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:25.448724 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:16:25.449046 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-2-root
uuid: "8c3bcfa13ca74a24ab8999a408532932"
format_stamp: "Formatted at 2026-07-09 12:16:25 on dist-test-slave-7c1h"
I20260709 12:16:25.449344 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:25.494297 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:25.496235 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:25.497732 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:25.499986 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:25.500190 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:25.500535 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:25.500689 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:25.543954 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.3:38645
I20260709 12:16:25.544044 22575 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.3:38645 every 8 connection(s)
I20260709 12:16:25.557675 22576 heartbeater.cc:344] Connected to a master server at 127.20.191.62:37293
I20260709 12:16:25.558053 22576 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:25.558723 22576 heartbeater.cc:507] Master 127.20.191.62:37293 requested a full tablet report, sending...
I20260709 12:16:25.560541 22299 ts_manager.cc:194] Registered new tserver with Master: 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:25.561213 21244 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014231963s
I20260709 12:16:25.561939 22299 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50176
I20260709 12:16:25.588493 22299 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50178:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:25.594807 22299 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:25.788813 22541 tablet_service.cc:1511] Processing CreateTablet for tablet a60334567abd4be7b4e9f6f2e754d015 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:25.789192 22540 tablet_service.cc:1511] Processing CreateTablet for tablet 12b0076739944e0099d6937fbaa402f5 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:25.790446 22541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a60334567abd4be7b4e9f6f2e754d015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.791069 22392 tablet_service.cc:1511] Processing CreateTablet for tablet a60334567abd4be7b4e9f6f2e754d015 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:25.792423 22392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a60334567abd4be7b4e9f6f2e754d015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.794135 22538 tablet_service.cc:1511] Processing CreateTablet for tablet 14fbfde86a044b028b2032a062d189e9 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:25.794981 22539 tablet_service.cc:1511] Processing CreateTablet for tablet 3c5498b1e8b04b8caba1d9a87889d60d (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:25.796547 22538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14fbfde86a044b028b2032a062d189e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.797464 22539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5498b1e8b04b8caba1d9a87889d60d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.798182 22540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b0076739944e0099d6937fbaa402f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.801205 22537 tablet_service.cc:1511] Processing CreateTablet for tablet cbdd827fb2d34627bbd307872debd3d3 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:25.802613 22537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbdd827fb2d34627bbd307872debd3d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.806118 22536 tablet_service.cc:1511] Processing CreateTablet for tablet 2d5abbd8a2264ab6ac3b4face1caa842 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:25.808758 22389 tablet_service.cc:1511] Processing CreateTablet for tablet 14fbfde86a044b028b2032a062d189e9 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:25.809193 22388 tablet_service.cc:1511] Processing CreateTablet for tablet cbdd827fb2d34627bbd307872debd3d3 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:25.810328 22389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14fbfde86a044b028b2032a062d189e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.814199 22388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbdd827fb2d34627bbd307872debd3d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.814934 22391 tablet_service.cc:1511] Processing CreateTablet for tablet 12b0076739944e0099d6937fbaa402f5 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:25.816354 22391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b0076739944e0099d6937fbaa402f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.818923 22390 tablet_service.cc:1511] Processing CreateTablet for tablet 3c5498b1e8b04b8caba1d9a87889d60d (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:25.820348 22390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5498b1e8b04b8caba1d9a87889d60d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.824676 22535 tablet_service.cc:1511] Processing CreateTablet for tablet 3781b48054df42c08e2bf775312a3699 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:25.825878 22536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d5abbd8a2264ab6ac3b4face1caa842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.828655 22532 tablet_service.cc:1511] Processing CreateTablet for tablet e8e9f45e270942459d8aa926ed037bec (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:25.830946 22533 tablet_service.cc:1511] Processing CreateTablet for tablet b59a53e40d134aaa9cfbc682ee81be3e (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:25.826970 22534 tablet_service.cc:1511] Processing CreateTablet for tablet ec9af5639dd5418baaabd871ac6515f0 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:25.833331 22532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8e9f45e270942459d8aa926ed037bec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.834365 22535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3781b48054df42c08e2bf775312a3699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.834935 22534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec9af5639dd5418baaabd871ac6515f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.837543 22533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59a53e40d134aaa9cfbc682ee81be3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.840543 22387 tablet_service.cc:1511] Processing CreateTablet for tablet 2d5abbd8a2264ab6ac3b4face1caa842 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:25.842325 22387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d5abbd8a2264ab6ac3b4face1caa842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.856761 22386 tablet_service.cc:1511] Processing CreateTablet for tablet 3781b48054df42c08e2bf775312a3699 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:25.858170 22386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3781b48054df42c08e2bf775312a3699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.869553 22385 tablet_service.cc:1511] Processing CreateTablet for tablet ec9af5639dd5418baaabd871ac6515f0 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:25.870456 22539 tablet_service.cc:1511] Processing CreateTablet for tablet c7c8d517a42b486fab919998ad1e7e07 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:25.870986 22385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec9af5639dd5418baaabd871ac6515f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.871660 22539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c8d517a42b486fab919998ad1e7e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.874984 22384 tablet_service.cc:1511] Processing CreateTablet for tablet b59a53e40d134aaa9cfbc682ee81be3e (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:25.875936 22383 tablet_service.cc:1511] Processing CreateTablet for tablet e8e9f45e270942459d8aa926ed037bec (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:25.876360 22384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59a53e40d134aaa9cfbc682ee81be3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.881729 22541 tablet_service.cc:1511] Processing CreateTablet for tablet c23bd5666c81480f8ce12f767a245571 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:25.883064 22541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23bd5666c81480f8ce12f767a245571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.886890 22383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8e9f45e270942459d8aa926ed037bec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.894914 22392 tablet_service.cc:1511] Processing CreateTablet for tablet b1433e47e33649a3a8e6313d2ec4e289 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:25.896421 22392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1433e47e33649a3a8e6313d2ec4e289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.905403 22591 tablet_bootstrap.cc:492] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:25.907524 22532 tablet_service.cc:1511] Processing CreateTablet for tablet 453901cb626f4358bcfa980bf0d03ea4 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:25.908947 22532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 453901cb626f4358bcfa980bf0d03ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.912222 22591 tablet_bootstrap.cc:654] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.916417 22391 tablet_service.cc:1511] Processing CreateTablet for tablet c7c8d517a42b486fab919998ad1e7e07 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:25.919529 22391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c8d517a42b486fab919998ad1e7e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.931303 22467 tablet_service.cc:1511] Processing CreateTablet for tablet a60334567abd4be7b4e9f6f2e754d015 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:25.932094 22466 tablet_service.cc:1511] Processing CreateTablet for tablet 12b0076739944e0099d6937fbaa402f5 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:25.932672 22467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a60334567abd4be7b4e9f6f2e754d015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.933739 22465 tablet_service.cc:1511] Processing CreateTablet for tablet 3c5498b1e8b04b8caba1d9a87889d60d (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:25.934520 22459 tablet_service.cc:1511] Processing CreateTablet for tablet b59a53e40d134aaa9cfbc682ee81be3e (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:25.935109 22465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5498b1e8b04b8caba1d9a87889d60d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.934909 22463 tablet_service.cc:1511] Processing CreateTablet for tablet cbdd827fb2d34627bbd307872debd3d3 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:25.935858 22459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59a53e40d134aaa9cfbc682ee81be3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.937039 22464 tablet_service.cc:1511] Processing CreateTablet for tablet 14fbfde86a044b028b2032a062d189e9 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:25.938361 22464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14fbfde86a044b028b2032a062d189e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.938185 22461 tablet_service.cc:1511] Processing CreateTablet for tablet 3781b48054df42c08e2bf775312a3699 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:25.940418 22460 tablet_service.cc:1511] Processing CreateTablet for tablet ec9af5639dd5418baaabd871ac6515f0 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:25.941946 22461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3781b48054df42c08e2bf775312a3699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.943020 22458 tablet_service.cc:1511] Processing CreateTablet for tablet e8e9f45e270942459d8aa926ed037bec (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:25.944406 22458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8e9f45e270942459d8aa926ed037bec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.933084 22536 tablet_service.cc:1511] Processing CreateTablet for tablet b1433e47e33649a3a8e6313d2ec4e289 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:25.946113 22463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbdd827fb2d34627bbd307872debd3d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.937052 22462 tablet_service.cc:1511] Processing CreateTablet for tablet 2d5abbd8a2264ab6ac3b4face1caa842 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:25.952339 22460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec9af5639dd5418baaabd871ac6515f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.953034 22462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d5abbd8a2264ab6ac3b4face1caa842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.955312 22466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b0076739944e0099d6937fbaa402f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.972733 22532 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff00cc49b3d446797f2e5ddc5bdfcdf (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:25.984392 22537 tablet_service.cc:1511] Processing CreateTablet for tablet ff6628c2d6a44791975f2350758cb3db (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:25.984583 22459 tablet_service.cc:1511] Processing CreateTablet for tablet ff6628c2d6a44791975f2350758cb3db (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:25.973595 22536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1433e47e33649a3a8e6313d2ec4e289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.986045 22459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff6628c2d6a44791975f2350758cb3db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.000154 22388 tablet_service.cc:1511] Processing CreateTablet for tablet c23bd5666c81480f8ce12f767a245571 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:26.004734 22388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23bd5666c81480f8ce12f767a245571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.000813 22389 tablet_service.cc:1511] Processing CreateTablet for tablet ff6628c2d6a44791975f2350758cb3db (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:26.006259 22389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff6628c2d6a44791975f2350758cb3db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.009182 22540 tablet_service.cc:1511] Processing CreateTablet for tablet b2b016c5c65e474393776e2a5db3cfe2 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:26.005225 22462 tablet_service.cc:1511] Processing CreateTablet for tablet c7c8d517a42b486fab919998ad1e7e07 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:26.014356 22462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c8d517a42b486fab919998ad1e7e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.021715 22539 tablet_service.cc:1511] Processing CreateTablet for tablet 367745908a334997957e47f869d9fb14 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:26.022917 22390 tablet_service.cc:1511] Processing CreateTablet for tablet 453901cb626f4358bcfa980bf0d03ea4 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:26.025192 22390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 453901cb626f4358bcfa980bf0d03ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.031322 22467 tablet_service.cc:1511] Processing CreateTablet for tablet b1433e47e33649a3a8e6313d2ec4e289 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:26.032758 22384 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff00cc49b3d446797f2e5ddc5bdfcdf (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:26.035885 22387 tablet_service.cc:1511] Processing CreateTablet for tablet b2b016c5c65e474393776e2a5db3cfe2 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:26.037305 22535 tablet_service.cc:1511] Processing CreateTablet for tablet a0d5063dbb1a45fdb6db1177b40d5c72 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:26.032752 22467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1433e47e33649a3a8e6313d2ec4e289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.027521 22533 tablet_service.cc:1511] Processing CreateTablet for tablet 5b2850432f3942ddadf16c096755b5b5 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:26.050146 22592 tablet_bootstrap.cc:492] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:26.055527 22594 tablet_bootstrap.cc:492] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:26.011924 22532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff00cc49b3d446797f2e5ddc5bdfcdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.050146 22384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff00cc49b3d446797f2e5ddc5bdfcdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.058399 22591 tablet_bootstrap.cc:492] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:26.060181 22540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b016c5c65e474393776e2a5db3cfe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.061177 22591 ts_tablet_manager.cc:1403] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.156s	user 0.010s	sys 0.020s
I20260709 12:16:26.061425 22537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff6628c2d6a44791975f2350758cb3db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.066087 22539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 367745908a334997957e47f869d9fb14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.068627 22462 tablet_service.cc:1511] Processing CreateTablet for tablet 453901cb626f4358bcfa980bf0d03ea4 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:26.070036 22462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 453901cb626f4358bcfa980bf0d03ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.074131 22535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d5063dbb1a45fdb6db1177b40d5c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.077044 22458 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff00cc49b3d446797f2e5ddc5bdfcdf (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:26.070583 22591 raft_consensus.cc:359] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:26.082891 22533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2850432f3942ddadf16c096755b5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.084621 22464 tablet_service.cc:1511] Processing CreateTablet for tablet c23bd5666c81480f8ce12f767a245571 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:26.082404 22458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff00cc49b3d446797f2e5ddc5bdfcdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.079380 22591 raft_consensus.cc:385] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.090811 22591 raft_consensus.cc:740] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.057682 22383 tablet_service.cc:1511] Processing CreateTablet for tablet 367745908a334997957e47f869d9fb14 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:26.089999 22538 tablet_service.cc:1511] Processing CreateTablet for tablet 5a1d549b197d46b29284e9fda8131aa2 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:26.092077 22591 consensus_queue.cc:260] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:26.094197 22534 tablet_service.cc:1511] Processing CreateTablet for tablet eed3b8d7432b461c802823d02d952440 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:26.096733 22541 tablet_service.cc:1511] Processing CreateTablet for tablet 621dbb467a3b47c7b0f2d1e85c7eba84 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:26.093657 22538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1d549b197d46b29284e9fda8131aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.113443 22386 tablet_service.cc:1511] Processing CreateTablet for tablet 5b2850432f3942ddadf16c096755b5b5 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:26.117955 22387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b016c5c65e474393776e2a5db3cfe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.117972 22464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23bd5666c81480f8ce12f767a245571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.119956 22385 tablet_service.cc:1511] Processing CreateTablet for tablet a0d5063dbb1a45fdb6db1177b40d5c72 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:26.121563 22534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed3b8d7432b461c802823d02d952440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.122793 22541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 621dbb467a3b47c7b0f2d1e85c7eba84. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:26.131709 22347 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:26.129631 22384 tablet_service.cc:1511] Processing CreateTablet for tablet 5a1d549b197d46b29284e9fda8131aa2 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:26.125785 22460 tablet_service.cc:1511] Processing CreateTablet for tablet 367745908a334997957e47f869d9fb14 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:26.143096 22460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 367745908a334997957e47f869d9fb14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.146440 22466 tablet_service.cc:1511] Processing CreateTablet for tablet b2b016c5c65e474393776e2a5db3cfe2 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:26.147940 22466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b016c5c65e474393776e2a5db3cfe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.151477 22461 tablet_service.cc:1511] Processing CreateTablet for tablet 5b2850432f3942ddadf16c096755b5b5 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:26.152733 22461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2850432f3942ddadf16c096755b5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.153394 22537 tablet_service.cc:1511] Processing CreateTablet for tablet 9a6a426ef4624f2cb84081714ee42138 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:26.156051 22537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a6a426ef4624f2cb84081714ee42138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.156769 22389 tablet_service.cc:1511] Processing CreateTablet for tablet eed3b8d7432b461c802823d02d952440 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:26.157307 22463 tablet_service.cc:1511] Processing CreateTablet for tablet 5a1d549b197d46b29284e9fda8131aa2 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:26.158066 22576 heartbeater.cc:499] Master 127.20.191.62:37293 was elected leader, sending a full tablet report...
I20260709 12:16:26.158546 22463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1d549b197d46b29284e9fda8131aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.171506 22536 tablet_service.cc:1511] Processing CreateTablet for tablet 277d262725804effb16ede64e81d19c8 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:26.174817 22463 tablet_service.cc:1511] Processing CreateTablet for tablet eed3b8d7432b461c802823d02d952440 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:26.177069 22385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d5063dbb1a45fdb6db1177b40d5c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.186822 22532 tablet_service.cc:1511] Processing CreateTablet for tablet 3367203e404b4201ac57986dc36a032e (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:26.194675 22532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3367203e404b4201ac57986dc36a032e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.195078 22383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 367745908a334997957e47f869d9fb14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.190912 22462 tablet_service.cc:1511] Processing CreateTablet for tablet 621dbb467a3b47c7b0f2d1e85c7eba84 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:26.197685 22594 tablet_bootstrap.cc:654] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.199811 22389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed3b8d7432b461c802823d02d952440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.192840 22392 tablet_service.cc:1511] Processing CreateTablet for tablet 621dbb467a3b47c7b0f2d1e85c7eba84 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:26.202064 22386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2850432f3942ddadf16c096755b5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.203190 22465 tablet_service.cc:1511] Processing CreateTablet for tablet a0d5063dbb1a45fdb6db1177b40d5c72 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:26.206187 22384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1d549b197d46b29284e9fda8131aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.210490 22392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 621dbb467a3b47c7b0f2d1e85c7eba84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.214200 22591 ts_tablet_manager.cc:1434] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.153s	user 0.013s	sys 0.017s
I20260709 12:16:26.215312 22591 tablet_bootstrap.cc:492] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:26.218611 22391 tablet_service.cc:1511] Processing CreateTablet for tablet 277d262725804effb16ede64e81d19c8 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:26.226979 22384 tablet_service.cc:1511] Processing CreateTablet for tablet 3367203e404b4201ac57986dc36a032e (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:26.229447 22592 tablet_bootstrap.cc:654] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.234926 22384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3367203e404b4201ac57986dc36a032e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.244879 22392 tablet_service.cc:1511] Processing CreateTablet for tablet 2974af5009474d6590a8e35ea1dc6b83 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:26.246371 22392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2974af5009474d6590a8e35ea1dc6b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.230938 22388 tablet_service.cc:1511] Processing CreateTablet for tablet beb931ddd9ec4606a06a5fd9dbc6322e (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:26.248785 22388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beb931ddd9ec4606a06a5fd9dbc6322e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.253206 22536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277d262725804effb16ede64e81d19c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.254998 22391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277d262725804effb16ede64e81d19c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.260686 22592 tablet_bootstrap.cc:492] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:26.261296 22592 ts_tablet_manager.cc:1403] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.249s	user 0.017s	sys 0.000s
I20260709 12:16:26.263653 22539 tablet_service.cc:1511] Processing CreateTablet for tablet beb931ddd9ec4606a06a5fd9dbc6322e (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:26.264636 22592 raft_consensus.cc:359] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:16:26.265370 22592 raft_consensus.cc:385] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.265661 22592 raft_consensus.cc:740] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.268810 22392 tablet_service.cc:1511] Processing CreateTablet for tablet c4e53d64761746008e02335e67f74c08 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:26.269344 22592 consensus_queue.cc:260] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:16:26.270110 22392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e53d64761746008e02335e67f74c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.271494 22459 tablet_service.cc:1511] Processing CreateTablet for tablet 9a6a426ef4624f2cb84081714ee42138 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:26.272680 22463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed3b8d7432b461c802823d02d952440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.286573 22462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 621dbb467a3b47c7b0f2d1e85c7eba84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.273736 22466 tablet_service.cc:1511] Processing CreateTablet for tablet 277d262725804effb16ede64e81d19c8 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:26.287801 22466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277d262725804effb16ede64e81d19c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.275174 22594 tablet_bootstrap.cc:492] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:26.275653 22460 tablet_service.cc:1511] Processing CreateTablet for tablet 3367203e404b4201ac57986dc36a032e (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:26.292459 22594 ts_tablet_manager.cc:1403] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.237s	user 0.016s	sys 0.000s
I20260709 12:16:26.293303 22460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3367203e404b4201ac57986dc36a032e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.279229 22467 tablet_service.cc:1511] Processing CreateTablet for tablet beb931ddd9ec4606a06a5fd9dbc6322e (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:26.295483 22467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beb931ddd9ec4606a06a5fd9dbc6322e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.282550 22458 tablet_service.cc:1511] Processing CreateTablet for tablet 2974af5009474d6590a8e35ea1dc6b83 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:26.284215 22537 tablet_service.cc:1511] Processing CreateTablet for tablet 2974af5009474d6590a8e35ea1dc6b83 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:26.289944 22464 tablet_service.cc:1511] Processing CreateTablet for tablet c4e53d64761746008e02335e67f74c08 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:26.293491 22389 tablet_service.cc:1511] Processing CreateTablet for tablet c837f3ed639d47cc8258ce902cca0154 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:26.338168 22385 tablet_service.cc:1511] Processing CreateTablet for tablet 31ce456c700b43db9bef6c8297fe973c (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:26.338591 22389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c837f3ed639d47cc8258ce902cca0154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.339303 22541 tablet_service.cc:1511] Processing CreateTablet for tablet c4e53d64761746008e02335e67f74c08 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:26.340054 22385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ce456c700b43db9bef6c8297fe973c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.339453 22465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d5063dbb1a45fdb6db1177b40d5c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.346462 22427 heartbeater.cc:499] Master 127.20.191.62:37293 was elected leader, sending a full tablet report...
I20260709 12:16:26.348495 22390 tablet_service.cc:1511] Processing CreateTablet for tablet 9a6a426ef4624f2cb84081714ee42138 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:26.349913 22390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a6a426ef4624f2cb84081714ee42138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.336539 22539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beb931ddd9ec4606a06a5fd9dbc6322e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.351783 22537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2974af5009474d6590a8e35ea1dc6b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.353850 22541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e53d64761746008e02335e67f74c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.366093 22458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2974af5009474d6590a8e35ea1dc6b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.373967 22591 tablet_bootstrap.cc:654] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.374385 22459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a6a426ef4624f2cb84081714ee42138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.379609 22464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e53d64761746008e02335e67f74c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.382099 22595 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.382654 22595 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:26.385075 22595 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:26.348521 22533 tablet_service.cc:1511] Processing CreateTablet for tablet c837f3ed639d47cc8258ce902cca0154 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:26.406842 22533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c837f3ed639d47cc8258ce902cca0154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.423043 22594 raft_consensus.cc:359] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:16:26.423812 22594 raft_consensus.cc:385] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.424094 22594 raft_consensus.cc:740] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.424829 22594 consensus_queue.cc:260] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:16:26.426780 22460 tablet_service.cc:1511] Processing CreateTablet for tablet c837f3ed639d47cc8258ce902cca0154 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:26.428092 22460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c837f3ed639d47cc8258ce902cca0154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.428134 22598 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.428719 22598 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:16:26.437455 22598 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:26.438584 22502 heartbeater.cc:499] Master 127.20.191.62:37293 was elected leader, sending a full tablet report...
I20260709 12:16:26.468500 22391 tablet_service.cc:1511] Processing CreateTablet for tablet db333e4f6a9549d88edc232a61e2fc65 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:26.490350 22391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db333e4f6a9549d88edc232a61e2fc65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.495797 22592 ts_tablet_manager.cc:1434] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.234s	user 0.016s	sys 0.007s
I20260709 12:16:26.512126 22383 tablet_service.cc:1511] Processing CreateTablet for tablet c3bf88f0980e49afb7b7f1dabfbb3815 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:26.513578 22383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3bf88f0980e49afb7b7f1dabfbb3815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.518309 22467 tablet_service.cc:1511] Processing CreateTablet for tablet 31ce456c700b43db9bef6c8297fe973c (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:26.519702 22467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ce456c700b43db9bef6c8297fe973c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.524745 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:26.526743 22366 leader_election.cc:343] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.531414 22384 tablet_service.cc:1511] Processing CreateTablet for tablet abad5d59b4bd455ab855711fa092b038 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:26.532831 22384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abad5d59b4bd455ab855711fa092b038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.545548 22592 tablet_bootstrap.cc:492] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:26.564729 22459 tablet_service.cc:1511] Processing CreateTablet for tablet db333e4f6a9549d88edc232a61e2fc65 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:26.565650 22535 tablet_service.cc:1511] Processing CreateTablet for tablet 31ce456c700b43db9bef6c8297fe973c (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:26.567013 22535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ce456c700b43db9bef6c8297fe973c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.569060 22594 ts_tablet_manager.cc:1434] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.276s	user 0.022s	sys 0.033s
I20260709 12:16:26.571599 22592 tablet_bootstrap.cc:654] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.574558 22591 tablet_bootstrap.cc:492] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:26.575024 22591 ts_tablet_manager.cc:1403] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.360s	user 0.026s	sys 0.023s
I20260709 12:16:26.579968 22539 tablet_service.cc:1511] Processing CreateTablet for tablet abad5d59b4bd455ab855711fa092b038 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:26.581336 22539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abad5d59b4bd455ab855711fa092b038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.587179 22594 tablet_bootstrap.cc:492] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:26.591701 22459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db333e4f6a9549d88edc232a61e2fc65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.595294 22458 tablet_service.cc:1511] Processing CreateTablet for tablet f65bed92f9e64bb9955b9ba82a1645c8 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:26.595794 22594 tablet_bootstrap.cc:654] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.596655 22458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f65bed92f9e64bb9955b9ba82a1645c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.596864 22609 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.597348 22609 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:16:26.606420 22461 tablet_service.cc:1511] Processing CreateTablet for tablet abad5d59b4bd455ab855711fa092b038 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:26.607758 22461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abad5d59b4bd455ab855711fa092b038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.577925 22591 raft_consensus.cc:359] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:26.610318 22591 raft_consensus.cc:385] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.610636 22591 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.611399 22591 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:26.613706 22591 ts_tablet_manager.cc:1434] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 12:16:26.614666 22591 tablet_bootstrap.cc:492] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:26.621093 22537 tablet_service.cc:1511] Processing CreateTablet for tablet db333e4f6a9549d88edc232a61e2fc65 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:26.622485 22537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db333e4f6a9549d88edc232a61e2fc65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.585122 22462 tablet_service.cc:1511] Processing CreateTablet for tablet c3bf88f0980e49afb7b7f1dabfbb3815 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:26.631367 22462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3bf88f0980e49afb7b7f1dabfbb3815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.649839 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:26.650632 22477 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:26.636423 22609 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:16:26.641523 22388 tablet_service.cc:1511] Processing CreateTablet for tablet f65bed92f9e64bb9955b9ba82a1645c8 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:26.656431 22367 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:26.657533 22388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f65bed92f9e64bb9955b9ba82a1645c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.662073 22599 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.662501 22599 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.663619 22599 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.657541 22533 tablet_service.cc:1511] Processing CreateTablet for tablet f65bed92f9e64bb9955b9ba82a1645c8 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:26.671725 22533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f65bed92f9e64bb9955b9ba82a1645c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.673048 22541 tablet_service.cc:1511] Processing CreateTablet for tablet cc602501d91d4eff9464e488c0b6704d (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:26.674468 22541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc602501d91d4eff9464e488c0b6704d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.677686 22538 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9c94c2c7014c7b97357727b65ecdcd (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:26.679236 22538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9c94c2c7014c7b97357727b65ecdcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.679486 22460 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9c94c2c7014c7b97357727b65ecdcd (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:26.680719 22460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9c94c2c7014c7b97357727b65ecdcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.682814 22467 tablet_service.cc:1511] Processing CreateTablet for tablet cc602501d91d4eff9464e488c0b6704d (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:26.684172 22467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc602501d91d4eff9464e488c0b6704d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.684958 22464 tablet_service.cc:1511] Processing CreateTablet for tablet 3b0059ced3574627a342d9de0f02a487 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:26.686280 22464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b0059ced3574627a342d9de0f02a487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.684978 22465 tablet_service.cc:1511] Processing CreateTablet for tablet e4931c1eea6843949b1447b3e6106340 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:26.687623 22532 tablet_service.cc:1511] Processing CreateTablet for tablet e4931c1eea6843949b1447b3e6106340 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:26.688802 22465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4931c1eea6843949b1447b3e6106340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.689972 22540 tablet_service.cc:1511] Processing CreateTablet for tablet 3b0059ced3574627a342d9de0f02a487 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:26.695456 22534 tablet_service.cc:1511] Processing CreateTablet for tablet 7f7fcc060e2443ad87cf29161f3ea079 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:26.688876 22532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4931c1eea6843949b1447b3e6106340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.698040 22534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7fcc060e2443ad87cf29161f3ea079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.699872 22463 tablet_service.cc:1511] Processing CreateTablet for tablet 7f7fcc060e2443ad87cf29161f3ea079 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:26.701133 22463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7fcc060e2443ad87cf29161f3ea079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.702243 22540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b0059ced3574627a342d9de0f02a487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.710158 22536 tablet_service.cc:1511] Processing CreateTablet for tablet c3bf88f0980e49afb7b7f1dabfbb3815 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:26.711516 22536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3bf88f0980e49afb7b7f1dabfbb3815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.720593 22594 tablet_bootstrap.cc:492] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:26.721113 22594 ts_tablet_manager.cc:1403] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.134s	user 0.030s	sys 0.038s
I20260709 12:16:26.723186 22466 tablet_service.cc:1511] Processing CreateTablet for tablet 906ffc7e978c43a2841f212271a02a94 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:26.724059 22594 raft_consensus.cc:359] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:26.724820 22594 raft_consensus.cc:385] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.725231 22594 raft_consensus.cc:740] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.726114 22594 consensus_queue.cc:260] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:26.728498 22594 ts_tablet_manager.cc:1434] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:16:26.729562 22594 tablet_bootstrap.cc:492] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:26.724537 22466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906ffc7e978c43a2841f212271a02a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.742251 22599 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:16:26.745270 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:16:26.746716 22366 leader_election.cc:343] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.746611 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:26.748430 22441 leader_election.cc:343] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.750496 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:26.751070 22477 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.749437 22599 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:26.792973 22539 tablet_service.cc:1511] Processing CreateTablet for tablet 272f66365eb84231bc71d7c51137bbfb (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:26.796294 22594 tablet_bootstrap.cc:654] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.801698 22384 tablet_service.cc:1511] Processing CreateTablet for tablet cc602501d91d4eff9464e488c0b6704d (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:26.803169 22384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc602501d91d4eff9464e488c0b6704d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.810392 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:26.812489 22383 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9c94c2c7014c7b97357727b65ecdcd (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:26.814042 22383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9c94c2c7014c7b97357727b65ecdcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.815138 22458 tablet_service.cc:1511] Processing CreateTablet for tablet 0723691b01e2413baf71cbc73a551fdc (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:26.816788 22458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0723691b01e2413baf71cbc73a551fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.820010 22461 tablet_service.cc:1511] Processing CreateTablet for tablet 272f66365eb84231bc71d7c51137bbfb (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 12:16:26.822431 22516 leader_election.cc:343] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.824749 22390 tablet_service.cc:1511] Processing CreateTablet for tablet e4931c1eea6843949b1447b3e6106340 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:26.825076 22387 tablet_service.cc:1511] Processing CreateTablet for tablet 3b0059ced3574627a342d9de0f02a487 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:26.826293 22390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4931c1eea6843949b1447b3e6106340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.827272 22460 tablet_service.cc:1511] Processing CreateTablet for tablet 67ad5236324342d48e6d762f265e4a3a (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:26.829459 22385 tablet_service.cc:1511] Processing CreateTablet for tablet 7f7fcc060e2443ad87cf29161f3ea079 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:26.830443 22387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b0059ced3574627a342d9de0f02a487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.839643 22385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7fcc060e2443ad87cf29161f3ea079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.840147 22537 tablet_service.cc:1511] Processing CreateTablet for tablet 0723691b01e2413baf71cbc73a551fdc (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:26.840291 22389 tablet_service.cc:1511] Processing CreateTablet for tablet 0723691b01e2413baf71cbc73a551fdc (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:26.841372 22537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0723691b01e2413baf71cbc73a551fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.841533 22389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0723691b01e2413baf71cbc73a551fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.842788 22459 tablet_service.cc:1511] Processing CreateTablet for tablet 1a201b290044481b8c4e67ad9f11ed89 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:26.845041 22477 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:26.847188 22367 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:26.849097 22539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272f66365eb84231bc71d7c51137bbfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.851017 22599 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.852236 22599 raft_consensus.cc:697] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:26.855370 22591 tablet_bootstrap.cc:654] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.855605 22467 tablet_service.cc:1511] Processing CreateTablet for tablet 009e461415d44f48aed3f751e8855a5d (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:26.853140 22599 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:16:26.876322 22533 tablet_service.cc:1511] Processing CreateTablet for tablet 67ad5236324342d48e6d762f265e4a3a (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:26.879271 22386 tablet_service.cc:1511] Processing CreateTablet for tablet 906ffc7e978c43a2841f212271a02a94 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:26.880520 22386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906ffc7e978c43a2841f212271a02a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.882050 22541 tablet_service.cc:1511] Processing CreateTablet for tablet 1a201b290044481b8c4e67ad9f11ed89 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:26.887220 22392 tablet_service.cc:1511] Processing CreateTablet for tablet 67ad5236324342d48e6d762f265e4a3a (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:26.888511 22392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ad5236324342d48e6d762f265e4a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.894030 22592 tablet_bootstrap.cc:492] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:26.894542 22592 ts_tablet_manager.cc:1403] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.379s	user 0.030s	sys 0.058s
I20260709 12:16:26.877610 22533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ad5236324342d48e6d762f265e4a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.897413 22464 tablet_service.cc:1511] Processing CreateTablet for tablet d7dee89f230e46e8a6f8e492cd0ca0d4 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:26.899797 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:26.900664 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:26.900806 22385 tablet_service.cc:1511] Processing CreateTablet for tablet 272f66365eb84231bc71d7c51137bbfb (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 12:16:26.902985 22516 leader_election.cc:343] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.903365 22442 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:26.906100 22613 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.903506 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:26.907253 22595 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.909147 22462 tablet_service.cc:1511] Processing CreateTablet for tablet 9c37e03879a64c308ad32ed0e1da75e9 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:26.903034 22385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272f66365eb84231bc71d7c51137bbfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.907450 22594 tablet_bootstrap.cc:492] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:26.899150 22461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272f66365eb84231bc71d7c51137bbfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.912011 22594 ts_tablet_manager.cc:1403] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.183s	user 0.012s	sys 0.008s
I20260709 12:16:26.897399 22592 raft_consensus.cc:359] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:26.912665 22592 raft_consensus.cc:385] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.921460 22592 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.922371 22592 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:26.860826 22535 tablet_service.cc:1511] Processing CreateTablet for tablet 906ffc7e978c43a2841f212271a02a94 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:26.926626 22388 tablet_service.cc:1511] Processing CreateTablet for tablet 1a201b290044481b8c4e67ad9f11ed89 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:26.927891 22388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a201b290044481b8c4e67ad9f11ed89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.931891 22466 tablet_service.cc:1511] Processing CreateTablet for tablet 444001888258449e8c4f5fd4ad540389 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:26.914093 22459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a201b290044481b8c4e67ad9f11ed89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.914902 22594 raft_consensus.cc:359] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:26.915715 22534 tablet_service.cc:1511] Processing CreateTablet for tablet 009e461415d44f48aed3f751e8855a5d (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:26.919464 22595 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.937261 22595 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:26.934957 22594 raft_consensus.cc:385] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.938110 22594 raft_consensus.cc:740] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.938895 22594 consensus_queue.cc:260] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:26.939424 22595 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:26.941061 22594 ts_tablet_manager.cc:1434] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.000s
I20260709 12:16:26.941188 22532 tablet_service.cc:1511] Processing CreateTablet for tablet 2dae2730adf94f9da39f2dffbb692494 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:26.941808 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:26.963966 22463 tablet_service.cc:1511] Processing CreateTablet for tablet 2dae2730adf94f9da39f2dffbb692494 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 12:16:26.964780 22516 leader_election.cc:343] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.942427 22460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ad5236324342d48e6d762f265e4a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.949062 22389 tablet_service.cc:1511] Processing CreateTablet for tablet 009e461415d44f48aed3f751e8855a5d (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:26.966125 22389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 009e461415d44f48aed3f751e8855a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.966387 22467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 009e461415d44f48aed3f751e8855a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.955183 22541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a201b290044481b8c4e67ad9f11ed89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.955396 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:26.956719 22591 tablet_bootstrap.cc:492] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:26.967691 22591 ts_tablet_manager.cc:1403] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.353s	user 0.026s	sys 0.019s
I20260709 12:16:26.970672 22591 raft_consensus.cc:359] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:16:26.971539 22591 raft_consensus.cc:385] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.971890 22591 raft_consensus.cc:740] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.924877 22592 ts_tablet_manager.cc:1434] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:16:26.951749 22540 tablet_service.cc:1511] Processing CreateTablet for tablet 444001888258449e8c4f5fd4ad540389 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:26.974326 22540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 444001888258449e8c4f5fd4ad540389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.975268 22592 tablet_bootstrap.cc:492] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:26.967680 22462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c37e03879a64c308ad32ed0e1da75e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.979131 22466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 444001888258449e8c4f5fd4ad540389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.969348 22390 tablet_service.cc:1511] Processing CreateTablet for tablet d7dee89f230e46e8a6f8e492cd0ca0d4 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 12:16:26.979100 22516 leader_election.cc:343] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.986212 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:26.987349 22595 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.988291 22594 tablet_bootstrap.cc:492] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:26.989094 22390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7dee89f230e46e8a6f8e492cd0ca0d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.977069 22383 tablet_service.cc:1511] Processing CreateTablet for tablet 444001888258449e8c4f5fd4ad540389 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:26.991171 22535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906ffc7e978c43a2841f212271a02a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.000797 22538 tablet_service.cc:1511] Processing CreateTablet for tablet d7dee89f230e46e8a6f8e492cd0ca0d4 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:27.002213 22538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7dee89f230e46e8a6f8e492cd0ca0d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.991108 22463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dae2730adf94f9da39f2dffbb692494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.006271 22534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 009e461415d44f48aed3f751e8855a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.995921 22299 catalog_manager.cc:5697] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.010277 22387 tablet_service.cc:1511] Processing CreateTablet for tablet 2dae2730adf94f9da39f2dffbb692494 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:27.014127 22532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dae2730adf94f9da39f2dffbb692494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.018046 22538 tablet_service.cc:1511] Processing CreateTablet for tablet 5f6bd9e32472432889b9795a2e3653d6 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:27.019379 22538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f6bd9e32472432889b9795a2e3653d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.032191 22461 tablet_service.cc:1511] Processing CreateTablet for tablet 5f6bd9e32472432889b9795a2e3653d6 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:27.024569 22458 tablet_service.cc:1511] Processing CreateTablet for tablet b42c69680a57493c942307ff09185b72 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:27.039112 22464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7dee89f230e46e8a6f8e492cd0ca0d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.049065 22392 tablet_service.cc:1511] Processing CreateTablet for tablet 5f6bd9e32472432889b9795a2e3653d6 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:27.049510 22386 tablet_service.cc:1511] Processing CreateTablet for tablet fcf4dc17810b42c6bf0fc46fd69d0fd9 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:27.051486 22458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42c69680a57493c942307ff09185b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.086798 22460 tablet_service.cc:1511] Processing CreateTablet for tablet 41ad743163ad40dba602eb017e958a78 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:27.025205 22465 tablet_service.cc:1511] Processing CreateTablet for tablet fcf4dc17810b42c6bf0fc46fd69d0fd9 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:27.086781 22532 tablet_service.cc:1511] Processing CreateTablet for tablet f8462358d27c41a9a8e75c2021a10a4a (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:27.090636 22532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8462358d27c41a9a8e75c2021a10a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.091132 22389 tablet_service.cc:1511] Processing CreateTablet for tablet c98e38137cdf48ddae2d7d3311ccb425 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:27.088925 22388 tablet_service.cc:1511] Processing CreateTablet for tablet 41ad743163ad40dba602eb017e958a78 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:27.099452 22536 tablet_service.cc:1511] Processing CreateTablet for tablet 9c37e03879a64c308ad32ed0e1da75e9 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:27.100771 22536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c37e03879a64c308ad32ed0e1da75e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.054538 22391 tablet_service.cc:1511] Processing CreateTablet for tablet b42c69680a57493c942307ff09185b72 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:27.054864 22533 tablet_service.cc:1511] Processing CreateTablet for tablet fcf4dc17810b42c6bf0fc46fd69d0fd9 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:27.055795 22592 tablet_bootstrap.cc:654] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.058629 22594 tablet_bootstrap.cc:654] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.972689 22591 consensus_queue.cc:260] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:16:27.062492 22387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dae2730adf94f9da39f2dffbb692494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.071419 22540 tablet_service.cc:1511] Processing CreateTablet for tablet c98e38137cdf48ddae2d7d3311ccb425 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:27.072896 22537 tablet_service.cc:1511] Processing CreateTablet for tablet 41ad743163ad40dba602eb017e958a78 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:27.110327 22595 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.115334 22595 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:16:27.118283 22595 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:27.119702 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:27.120512 22477 raft_consensus.cc:2393] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 1: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:16:27.118979 22541 tablet_service.cc:1511] Processing CreateTablet for tablet f1115558d9fe452f8e6c19d821f08bfd (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:27.127287 22538 tablet_service.cc:1511] Processing CreateTablet for tablet dd445b6ff12a48a9a51097b364e1da2e (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:27.129253 22591 ts_tablet_manager.cc:1434] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.161s	user 0.004s	sys 0.004s
I20260709 12:16:27.086917 22459 tablet_service.cc:1511] Processing CreateTablet for tablet f8462358d27c41a9a8e75c2021a10a4a (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:27.087890 22461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f6bd9e32472432889b9795a2e3653d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.088263 22534 tablet_service.cc:1511] Processing CreateTablet for tablet d71e68d38beb49d496914180d9606c26 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:27.088464 22463 tablet_service.cc:1511] Processing CreateTablet for tablet c98e38137cdf48ddae2d7d3311ccb425 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:27.051980 22539 tablet_service.cc:1511] Processing CreateTablet for tablet b42c69680a57493c942307ff09185b72 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:27.102849 22533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf4dc17810b42c6bf0fc46fd69d0fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.111675 22386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf4dc17810b42c6bf0fc46fd69d0fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.072827 22384 tablet_service.cc:1511] Processing CreateTablet for tablet 9c37e03879a64c308ad32ed0e1da75e9 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:27.134330 22591 tablet_bootstrap.cc:492] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:27.141279 22540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98e38137cdf48ddae2d7d3311ccb425. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:27.144654 22347 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:27.145648 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:27.146093 22534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d71e68d38beb49d496914180d9606c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.147502 22516 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:27.148814 22539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42c69680a57493c942307ff09185b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.137285 22460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ad743163ad40dba602eb017e958a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.149863 22537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ad743163ad40dba602eb017e958a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.151638 22389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98e38137cdf48ddae2d7d3311ccb425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.154119 22459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8462358d27c41a9a8e75c2021a10a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.154299 22388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ad743163ad40dba602eb017e958a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.159768 22465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf4dc17810b42c6bf0fc46fd69d0fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.160691 22466 tablet_service.cc:1511] Processing CreateTablet for tablet d71e68d38beb49d496914180d9606c26 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:27.163172 22384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c37e03879a64c308ad32ed0e1da75e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.165977 22391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42c69680a57493c942307ff09185b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.169849 22595 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.170120 22392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f6bd9e32472432889b9795a2e3653d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.174834 22591 tablet_bootstrap.cc:654] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.176213 22464 tablet_service.cc:1511] Processing CreateTablet for tablet dd445b6ff12a48a9a51097b364e1da2e (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:27.177408 22464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd445b6ff12a48a9a51097b364e1da2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.178049 22466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d71e68d38beb49d496914180d9606c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.179517 22383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 444001888258449e8c4f5fd4ad540389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.182132 22463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98e38137cdf48ddae2d7d3311ccb425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.186589 22538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd445b6ff12a48a9a51097b364e1da2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.199990 22385 tablet_service.cc:1511] Processing CreateTablet for tablet d71e68d38beb49d496914180d9606c26 (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:27.201575 22385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d71e68d38beb49d496914180d9606c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.208750 22613 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.209882 22613 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.212927 22613 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.215037 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:27.215221 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:27.216410 22442 leader_election.cc:343] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:27.216953 22441 leader_election.cc:343] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.217378 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:27.217535 22458 tablet_service.cc:1511] Processing CreateTablet for tablet f1115558d9fe452f8e6c19d821f08bfd (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:27.220917 22541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1115558d9fe452f8e6c19d821f08bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.218544 22613 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:27.230278 22458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1115558d9fe452f8e6c19d821f08bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.242611 22592 tablet_bootstrap.cc:492] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:27.248628 22591 tablet_bootstrap.cc:492] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:27.249236 22591 ts_tablet_manager.cc:1403] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.115s	user 0.008s	sys 0.006s
I20260709 12:16:27.249953 22592 ts_tablet_manager.cc:1403] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.275s	user 0.009s	sys 0.006s
I20260709 12:16:27.253073 22592 raft_consensus.cc:359] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.254487 22595 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:27.255352 22383 tablet_service.cc:1511] Processing CreateTablet for tablet f8462358d27c41a9a8e75c2021a10a4a (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:27.256637 22383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8462358d27c41a9a8e75c2021a10a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.265264 22594 tablet_bootstrap.cc:492] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:27.260182 22592 raft_consensus.cc:385] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.265947 22594 ts_tablet_manager.cc:1403] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.278s	user 0.013s	sys 0.011s
I20260709 12:16:27.267279 22592 raft_consensus.cc:740] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.269395 22592 consensus_queue.cc:260] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.271836 22592 ts_tablet_manager.cc:1434] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:16:27.271453 22594 raft_consensus.cc:359] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.272249 22594 raft_consensus.cc:385] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.272666 22592 tablet_bootstrap.cc:492] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:27.272564 22594 raft_consensus.cc:740] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.277307 22594 consensus_queue.cc:260] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.279450 22594 ts_tablet_manager.cc:1434] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:16:27.282317 22592 tablet_bootstrap.cc:654] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.285523 22594 tablet_bootstrap.cc:492] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:27.281920 22387 tablet_service.cc:1511] Processing CreateTablet for tablet f1115558d9fe452f8e6c19d821f08bfd (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:27.325978 22387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1115558d9fe452f8e6c19d821f08bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.328887 22591 raft_consensus.cc:359] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.329887 22591 raft_consensus.cc:385] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.330209 22591 raft_consensus.cc:740] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.332000 22386 tablet_service.cc:1511] Processing CreateTablet for tablet dd445b6ff12a48a9a51097b364e1da2e (DEFAULT_TABLE table=test-workload [id=186854d74fe443938d812c3623d2cc63]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:27.333354 22386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd445b6ff12a48a9a51097b364e1da2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:27.340206 22594 tablet_bootstrap.cc:654] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.342203 22591 consensus_queue.cc:260] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.344516 22591 ts_tablet_manager.cc:1434] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.001s
I20260709 12:16:27.345579 22591 tablet_bootstrap.cc:492] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:27.346630 22613 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.359515 22613 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.363409 22613 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.364151 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:27.364699 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:27.365684 22442 leader_election.cc:343] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:27.366782 22441 leader_election.cc:343] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.367179 22441 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:27.367774 22613 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:27.374679 22594 tablet_bootstrap.cc:492] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:27.375262 22594 ts_tablet_manager.cc:1403] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.000s
I20260709 12:16:27.378240 22594 raft_consensus.cc:359] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.380466 22592 tablet_bootstrap.cc:492] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:27.380877 22594 raft_consensus.cc:385] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.381088 22592 ts_tablet_manager.cc:1403] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.109s	user 0.027s	sys 0.035s
I20260709 12:16:27.381264 22594 raft_consensus.cc:740] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.382275 22594 consensus_queue.cc:260] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.384001 22592 raft_consensus.cc:359] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.384687 22592 raft_consensus.cc:385] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.384956 22592 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.385689 22592 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.387653 22594 ts_tablet_manager.cc:1434] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:16:27.387928 22592 ts_tablet_manager.cc:1434] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:27.388837 22594 tablet_bootstrap.cc:492] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:27.388931 22592 tablet_bootstrap.cc:492] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:27.396106 22591 tablet_bootstrap.cc:654] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.396368 22594 tablet_bootstrap.cc:654] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.398625 22599 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.399127 22599 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.401382 22599 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.402307 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:27.402508 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:27.403955 22367 leader_election.cc:343] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:27.404583 22366 leader_election.cc:343] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.405036 22366 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:27.407110 22598 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.407600 22598 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.412729 22598 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.406656 22599 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:27.414673 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:27.414912 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:27.415405 22477 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
W20260709 12:16:27.416460 22366 leader_election.cc:343] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.417002 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:27.429646 22599 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.430089 22599 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.430436 22599 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.436928 22592 tablet_bootstrap.cc:654] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.444168 22594 tablet_bootstrap.cc:492] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:27.444828 22591 tablet_bootstrap.cc:492] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:27.447173 22594 ts_tablet_manager.cc:1403] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.000s
I20260709 12:16:27.447319 22591 ts_tablet_manager.cc:1403] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.102s	user 0.034s	sys 0.009s
I20260709 12:16:27.447525 22599 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.449358 22592 tablet_bootstrap.cc:492] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:27.449877 22592 ts_tablet_manager.cc:1403] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.009s
I20260709 12:16:27.450492 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:27.450425 22591 raft_consensus.cc:359] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.451238 22477 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.451375 22591 raft_consensus.cc:385] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.450937 22594 raft_consensus.cc:359] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.451766 22591 raft_consensus.cc:740] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.451970 22594 raft_consensus.cc:385] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.452414 22594 raft_consensus.cc:740] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.452589 22591 consensus_queue.cc:260] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.452875 22592 raft_consensus.cc:359] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.453534 22592 raft_consensus.cc:385] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.453186 22594 consensus_queue.cc:260] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.453867 22592 raft_consensus.cc:740] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.454936 22591 ts_tablet_manager.cc:1434] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:16:27.454718 22592 consensus_queue.cc:260] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.455909 22594 ts_tablet_manager.cc:1434] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:27.455992 22591 tablet_bootstrap.cc:492] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:27.457191 22594 tablet_bootstrap.cc:492] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:27.459570 22592 ts_tablet_manager.cc:1434] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:16:27.460567 22592 tablet_bootstrap.cc:492] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:27.463207 22591 tablet_bootstrap.cc:654] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.463471 22594 tablet_bootstrap.cc:654] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.467114 22592 tablet_bootstrap.cc:654] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.475819 22594 tablet_bootstrap.cc:492] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:27.476387 22594 ts_tablet_manager.cc:1403] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.007s
I20260709 12:16:27.476980 22598 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.477443 22598 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.479354 22594 raft_consensus.cc:359] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.480129 22594 raft_consensus.cc:385] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.480429 22594 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.480800 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:27.481516 22550 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:27.481225 22594 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.481942 22592 tablet_bootstrap.cc:492] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:27.482450 22592 ts_tablet_manager.cc:1403] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.005s
I20260709 12:16:27.483618 22594 ts_tablet_manager.cc:1434] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:27.484757 22594 tablet_bootstrap.cc:492] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:27.484921 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:27.485543 22476 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:27.485435 22592 raft_consensus.cc:359] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.486333 22592 raft_consensus.cc:385] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.486641 22592 raft_consensus.cc:740] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.483548 22366 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:27.487357 22592 consensus_queue.cc:260] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.491459 22598 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.493854 22598 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.486663 22591 tablet_bootstrap.cc:492] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:27.498620 22591 ts_tablet_manager.cc:1403] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.004s
I20260709 12:16:27.501935 22591 raft_consensus.cc:359] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.502799 22591 raft_consensus.cc:385] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.503140 22591 raft_consensus.cc:740] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.504103 22591 consensus_queue.cc:260] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.494189 22594 tablet_bootstrap.cc:654] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.509608 22635 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.510191 22635 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.510571 22635 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.503175 22477 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:27.515482 22591 ts_tablet_manager.cc:1434] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:16:27.516711 22591 tablet_bootstrap.cc:492] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:27.520120 22367 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:27.523792 22598 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:27.524374 22598 raft_consensus.cc:697] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:27.525219 22598 consensus_queue.cc:237] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.514678 22599 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:27.534349 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 50894.6us
I20260709 12:16:27.542963 22592 ts_tablet_manager.cc:1434] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.060s	user 0.013s	sys 0.046s
I20260709 12:16:27.543146 22594 tablet_bootstrap.cc:492] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:27.543641 22594 ts_tablet_manager.cc:1403] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.008s
I20260709 12:16:27.543992 22592 tablet_bootstrap.cc:492] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:27.546167 22594 raft_consensus.cc:359] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.529429 22635 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.546361 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:16:27.548554 22366 leader_election.cc:343] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.546849 22594 raft_consensus.cc:385] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.549412 22635 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.535851 22591 tablet_bootstrap.cc:654] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.550223 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:27.552071 22476 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.550751 22592 tablet_bootstrap.cc:654] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.550858 22598 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.551524 22594 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.555645 22594 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.546367 22297 catalog_manager.cc:5697] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.559818 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:27.561844 22592 tablet_bootstrap.cc:492] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:27.563352 22550 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.563544 22592 ts_tablet_manager.cc:1403] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.003s
I20260709 12:16:27.564628 22591 tablet_bootstrap.cc:492] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:27.565099 22591 ts_tablet_manager.cc:1403] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.000s
I20260709 12:16:27.566730 22592 raft_consensus.cc:359] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.567543 22592 raft_consensus.cc:385] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.567842 22592 raft_consensus.cc:740] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.568595 22592 consensus_queue.cc:260] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.562280 22476 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:27.570992 22592 ts_tablet_manager.cc:1434] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:27.571943 22367 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:27.573027 22637 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:27.573523 22637 raft_consensus.cc:697] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:27.573885 22613 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.574404 22613 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.574460 22637 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.576658 22613 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.570942 22591 raft_consensus.cc:359] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.577903 22591 raft_consensus.cc:385] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.578239 22591 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.578804 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:27.579082 22591 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:27.580811 22441 leader_election.cc:343] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.581589 22594 ts_tablet_manager.cc:1434] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 12:16:27.571969 22592 tablet_bootstrap.cc:492] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:27.583073 22594 tablet_bootstrap.cc:492] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:27.582818 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:27.584854 22442 leader_election.cc:343] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.585332 22442 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:27.581897 22591 ts_tablet_manager.cc:1434] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 12:16:27.586699 22591 tablet_bootstrap.cc:492] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:27.590134 22613 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:27.589897 22592 tablet_bootstrap.cc:654] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.590793 22594 tablet_bootstrap.cc:654] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.594789 22613 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.595350 22613 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.598299 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:27.598888 22591 tablet_bootstrap.cc:654] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:27.600010 22442 leader_election.cc:343] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.602141 22298 catalog_manager.cc:5697] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.604117 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:27.604887 22549 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:27.608259 22441 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:27.609135 22591 tablet_bootstrap.cc:492] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:27.609611 22591 ts_tablet_manager.cc:1403] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.002s
I20260709 12:16:27.609740 22650 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.610244 22650 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.610596 22650 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.612231 22591 raft_consensus.cc:359] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.613075 22591 raft_consensus.cc:385] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.613384 22591 raft_consensus.cc:740] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.613987 22613 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.621484 22592 tablet_bootstrap.cc:492] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:27.622013 22592 ts_tablet_manager.cc:1403] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.006s
I20260709 12:16:27.619779 22591 consensus_queue.cc:260] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.623909 22591 ts_tablet_manager.cc:1434] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:16:27.624845 22591 tablet_bootstrap.cc:492] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:27.625375 22592 raft_consensus.cc:359] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.626092 22592 raft_consensus.cc:385] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.626358 22592 raft_consensus.cc:740] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.627105 22592 consensus_queue.cc:260] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.627794 22594 tablet_bootstrap.cc:492] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:27.628247 22594 ts_tablet_manager.cc:1403] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.045s	user 0.025s	sys 0.009s
I20260709 12:16:27.631237 22591 tablet_bootstrap.cc:654] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.630885 22594 raft_consensus.cc:359] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.632390 22592 ts_tablet_manager.cc:1434] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:16:27.633337 22592 tablet_bootstrap.cc:492] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:27.635092 22550 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:27.639878 22592 tablet_bootstrap.cc:654] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.642096 22650 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.631768 22594 raft_consensus.cc:385] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.644539 22594 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.645031 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:27.645627 22401 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.645332 22594 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.649597 22594 ts_tablet_manager.cc:1434] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 12:16:27.650661 22594 tablet_bootstrap.cc:492] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:27.651678 22592 tablet_bootstrap.cc:492] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:27.652253 22592 ts_tablet_manager.cc:1403] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 12:16:27.655432 22592 raft_consensus.cc:359] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.656225 22592 raft_consensus.cc:385] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.656514 22592 raft_consensus.cc:740] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.656847 22594 tablet_bootstrap.cc:654] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.657522 22592 consensus_queue.cc:260] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.663967 22592 ts_tablet_manager.cc:1434] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:16:27.664351 22401 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:27.665141 22592 tablet_bootstrap.cc:492] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:27.665545 22442 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:27.668836 22591 tablet_bootstrap.cc:492] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:27.669413 22591 ts_tablet_manager.cc:1403] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.019s
I20260709 12:16:27.669998 22613 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:27.671397 22592 tablet_bootstrap.cc:654] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.676412 22591 raft_consensus.cc:359] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.677328 22591 raft_consensus.cc:385] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.677665 22591 raft_consensus.cc:740] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.678939 22613 raft_consensus.cc:697] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:27.678622 22591 consensus_queue.cc:260] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.681373 22591 ts_tablet_manager.cc:1434] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:16:27.684566 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:27.685210 22550 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.685609 22591 tablet_bootstrap.cc:492] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:27.692145 22591 tablet_bootstrap.cc:654] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.695748 22592 tablet_bootstrap.cc:492] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:27.682196 22613 consensus_queue.cc:237] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.700575 22592 ts_tablet_manager.cc:1403] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.016s
I20260709 12:16:27.703732 22592 raft_consensus.cc:359] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.704514 22592 raft_consensus.cc:385] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.704838 22592 raft_consensus.cc:740] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.705839 22591 tablet_bootstrap.cc:492] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:27.705580 22592 consensus_queue.cc:260] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.706306 22591 ts_tablet_manager.cc:1403] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 12:16:27.708940 22550 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:27.709638 22591 raft_consensus.cc:359] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.710362 22591 raft_consensus.cc:385] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.709759 22650 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.710675 22591 raft_consensus.cc:740] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.711493 22592 ts_tablet_manager.cc:1434] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:16:27.711391 22591 consensus_queue.cc:260] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.712872 22592 tablet_bootstrap.cc:492] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:27.713469 22591 ts_tablet_manager.cc:1434] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.003s
I20260709 12:16:27.715598 22594 tablet_bootstrap.cc:492] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:27.716316 22594 ts_tablet_manager.cc:1403] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.019s
I20260709 12:16:27.718844 22594 raft_consensus.cc:359] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.719487 22592 tablet_bootstrap.cc:654] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.719924 22591 tablet_bootstrap.cc:492] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:27.719460 22594 raft_consensus.cc:385] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.720247 22594 raft_consensus.cc:740] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.722688 22594 consensus_queue.cc:260] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.722306 22297 catalog_manager.cc:5697] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.725039 22594 ts_tablet_manager.cc:1434] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:16:27.726001 22594 tablet_bootstrap.cc:492] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:27.726781 22591 tablet_bootstrap.cc:654] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.731572 22594 tablet_bootstrap.cc:654] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.751762 22595 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.752390 22595 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.754652 22595 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:27.757443 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:27.758286 22401 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:27.759473 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:27.760445 22477 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:27.762534 22516 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:27.763407 22595 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.763831 22595 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.764223 22595 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.765580 22591 tablet_bootstrap.cc:492] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:27.765714 22594 tablet_bootstrap.cc:492] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:27.766119 22591 ts_tablet_manager.cc:1403] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.028s
I20260709 12:16:27.766311 22594 ts_tablet_manager.cc:1403] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.041s	user 0.023s	sys 0.015s
I20260709 12:16:27.767360 22592 tablet_bootstrap.cc:492] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:27.767795 22592 ts_tablet_manager.cc:1403] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.026s
I20260709 12:16:27.768807 22591 raft_consensus.cc:359] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.768997 22594 raft_consensus.cc:359] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.769475 22591 raft_consensus.cc:385] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.769662 22594 raft_consensus.cc:385] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.769810 22591 raft_consensus.cc:740] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.770040 22594 raft_consensus.cc:740] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.770321 22592 raft_consensus.cc:359] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.770553 22591 consensus_queue.cc:260] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.770952 22592 raft_consensus.cc:385] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.771070 22613 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.770897 22594 consensus_queue.cc:260] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.771334 22592 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.771575 22613 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.772957 22594 ts_tablet_manager.cc:1434] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:27.775058 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:27.775317 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:27.775700 22550 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:27.776027 22401 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:27.777024 22441 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:27.777688 22613 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.777951 22650 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.778501 22650 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.778918 22650 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.779699 22592 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.781790 22592 ts_tablet_manager.cc:1434] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.005s
I20260709 12:16:27.782755 22592 tablet_bootstrap.cc:492] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:27.787500 22594 tablet_bootstrap.cc:492] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:27.788547 22592 tablet_bootstrap.cc:654] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.793860 22594 tablet_bootstrap.cc:654] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.802561 22613 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.803315 22613 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.808620 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:27.809473 22401 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:27.810976 22442 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:27.812165 22656 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.812639 22656 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.812983 22656 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.815133 22592 tablet_bootstrap.cc:492] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:27.816201 22592 ts_tablet_manager.cc:1403] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.009s
I20260709 12:16:27.820514 22592 raft_consensus.cc:359] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.821376 22592 raft_consensus.cc:385] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.824250 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:27.825073 22550 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:27.826942 22613 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.831844 22666 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.832530 22666 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.835225 22666 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:27.835817 22666 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.836361 22666 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.835567 22595 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.831665 22650 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.840117 22666 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:27.840546 22594 tablet_bootstrap.cc:492] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:27.821672 22592 raft_consensus.cc:740] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.841027 22594 ts_tablet_manager.cc:1403] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.033s
I20260709 12:16:27.840899 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:27.841593 22401 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.841365 22592 consensus_queue.cc:260] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.843554 22592 ts_tablet_manager.cc:1434] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 12:16:27.843920 22594 raft_consensus.cc:359] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.844511 22592 tablet_bootstrap.cc:492] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:27.844587 22594 raft_consensus.cc:385] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.844923 22594 raft_consensus.cc:740] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.845610 22594 consensus_queue.cc:260] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.847692 22594 ts_tablet_manager.cc:1434] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:16:27.848649 22594 tablet_bootstrap.cc:492] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
W20260709 12:16:27.849129 22577 tablet.cc:2406] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:16:27.854962 22594 tablet_bootstrap.cc:654] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.855603 22592 tablet_bootstrap.cc:654] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.866545 22637 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.867151 22637 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.870402 22592 tablet_bootstrap.cc:492] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:27.870954 22592 ts_tablet_manager.cc:1403] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.005s
I20260709 12:16:27.870992 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:27.871728 22550 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:27.873339 22594 tablet_bootstrap.cc:492] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:27.873229 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:27.873972 22594 ts_tablet_manager.cc:1403] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.016s
I20260709 12:16:27.874024 22477 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:27.874161 22637 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.875475 22367 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:27.874063 22592 raft_consensus.cc:359] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.876998 22592 raft_consensus.cc:385] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.877262 22592 raft_consensus.cc:740] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.877164 22594 raft_consensus.cc:359] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.877880 22594 raft_consensus.cc:385] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.878173 22594 raft_consensus.cc:740] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.877993 22592 consensus_queue.cc:260] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.879109 22636 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.878921 22594 consensus_queue.cc:260] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.879492 22636 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.879841 22636 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.879958 22654 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.880404 22654 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.882675 22654 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.884817 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:27.886466 22441 leader_election.cc:343] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.887795 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:27.888501 22402 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:27.888931 22594 ts_tablet_manager.cc:1434] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.004s
I20260709 12:16:27.889889 22594 tablet_bootstrap.cc:492] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:27.889842 22442 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:27.891079 22654 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.891436 22654 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.891762 22654 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.896163 22594 tablet_bootstrap.cc:654] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.899232 22654 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.900483 22636 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.903604 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:27.904160 22592 ts_tablet_manager.cc:1434] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:16:27.904209 22477 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.836445 22656 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.906940 22656 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.908008 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:27.907392 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:27.908636 22550 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.908865 22402 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.907900 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:27.910044 22400 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.913295 22595 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:27.914881 22650 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.915126 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:27.916033 22401 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:27.917738 22595 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.919147 22551 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.919289 22595 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.920693 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:27.916324 22402 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:27.918713 22592 tablet_bootstrap.cc:492] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
W20260709 12:16:27.923440 22441 leader_election.cc:343] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.925278 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:27.927451 22591 ts_tablet_manager.cc:1434] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.161s	user 0.040s	sys 0.054s
I20260709 12:16:27.928225 22591 tablet_bootstrap.cc:492] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:27.926666 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:27.922631 22654 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.930325 22476 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:27.932058 22442 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:27.933022 22650 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:27.933553 22650 raft_consensus.cc:697] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:27.934473 22650 consensus_queue.cc:237] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.937213 22637 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.929018 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:27.937633 22637 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.938387 22475 raft_consensus.cc:2393] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 1: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:16:27.935245 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:27.941108 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:27.942481 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:16:27.945281 22516 leader_election.cc:343] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.943531 22636 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.943710 22476 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.947252 22549 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.947365 22442 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:27.952899 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:27.954434 22654 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:27.955171 22548 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:27.955451 22654 raft_consensus.cc:697] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:27.951500 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:27.956411 22475 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:27.956429 22366 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:27.957324 22636 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.957650 22636 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.959059 22636 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.958907 22654 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.963721 22549 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:27.965201 22366 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:27.949095 22637 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.966368 22637 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:27.967984 22634 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.968122 22637 raft_consensus.cc:697] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:27.968521 22634 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.968816 22637 consensus_queue.cc:237] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.967237 22477 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:27.971127 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:27.973011 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:27.973680 22399 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.971208 22634 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:27.982841 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:27.982999 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:27.979288 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:27.983572 22663 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.984998 22551 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:27.985373 22667 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.985996 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:27.985684 22591 tablet_bootstrap.cc:654] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.990948 22594 tablet_bootstrap.cc:492] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:27.991447 22594 ts_tablet_manager.cc:1403] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.022s
W20260709 12:16:27.992936 22367 leader_election.cc:343] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.993726 22663 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:27.996116 22663 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:27.996243 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:27.996915 22477 raft_consensus.cc:2393] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 1: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:16:28.000074 22366 leader_election.cc:343] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.000597 22366 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:28.002236 22635 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.004127 22399 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:28.005021 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:28.005544 22477 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:28.005589 22594 raft_consensus.cc:359] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.006378 22594 raft_consensus.cc:385] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.006650 22594 raft_consensus.cc:740] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.006698 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:28.007419 22594 consensus_queue.cc:260] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.008291 22516 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:28.007615 22667 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.009217 22667 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.987049 22595 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:28.013717 22663 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:28.015323 22595 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.015616 22663 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.015944 22634 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:28.016006 22663 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.020763 22591 tablet_bootstrap.cc:492] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:28.021229 22591 ts_tablet_manager.cc:1403] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.007s
I20260709 12:16:28.025931 22550 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:28.028407 22594 ts_tablet_manager.cc:1434] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:16:28.029501 22594 tablet_bootstrap.cc:492] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:28.014483 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:28.033334 22591 raft_consensus.cc:359] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.057845 22591 raft_consensus.cc:385] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.058259 22591 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.059157 22591 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.061151 22663 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.064633 22594 tablet_bootstrap.cc:654] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.027388 22666 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.072942 22663 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:28.038333 22297 catalog_manager.cc:5697] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:28.033587 22400 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:28.075276 22637 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.027338 22441 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:28.068790 22476 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:28.075799 22637 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.082089 22296 catalog_manager.cc:5697] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:28.083580 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:28.084081 22591 ts_tablet_manager.cc:1434] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.063s	user 0.026s	sys 0.019s
I20260709 12:16:28.085002 22591 tablet_bootstrap.cc:492] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:28.085446 22637 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:28.086021 22650 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:16:28.083235 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 56034.4us
I20260709 12:16:28.088266 22666 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.088644 22666 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:28.076552 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 68341.3us
W20260709 12:16:28.091593 22366 leader_election.cc:343] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.091975 22595 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.091816 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:28.092172 22637 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.090233 22656 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.096315 22477 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:28.096437 22656 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.097693 22367 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:28.098551 22656 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:28.098819 22634 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:28.099578 22634 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.099906 22634 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.100536 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:28.102415 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:28.103335 22442 leader_election.cc:343] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:28.104208 22441 leader_election.cc:343] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.104734 22441 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:28.105561 22656 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.087606 22650 raft_consensus.cc:697] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:28.110011 22650 consensus_queue.cc:237] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.112615 22637 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.118636 22634 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.110041 22666 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:28.156739 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:28.157605 22476 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.173962 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:28.174636 22475 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.174798 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:16:28.176297 22366 leader_election.cc:343] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.187618 22634 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:28.189134 22516 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:28.190457 22666 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:28.190960 22666 raft_consensus.cc:697] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:28.191833 22666 consensus_queue.cc:237] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.194701 22635 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:28.193866 22634 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:28.212965 22516 leader_election.cc:343] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.251950 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:16:28.256220 22516 leader_election.cc:343] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.258245 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:28.214296 22634 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.266052 22476 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:28.267704 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:28.269126 22595 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:28.269634 22595 raft_consensus.cc:697] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:28.270483 22595 consensus_queue.cc:237] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:28.271164 22347 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:28.279906 22592 tablet_bootstrap.cc:654] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.294947 22594 tablet_bootstrap.cc:492] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:28.295379 22594 ts_tablet_manager.cc:1403] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.266s	user 0.019s	sys 0.003s
I20260709 12:16:28.297607 22667 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.302678 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:28.303323 22475 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:28.303501 22400 raft_consensus.cc:2393] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 1: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:16:28.304728 22594 raft_consensus.cc:359] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.305537 22594 raft_consensus.cc:385] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.306051 22594 raft_consensus.cc:740] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.304898 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:28.307286 22476 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.304867 22367 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:28.310102 22635 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:28.311808 22634 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:28.312958 22594 consensus_queue.cc:260] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.311861 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:28.318035 22591 tablet_bootstrap.cc:654] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.314255 22635 raft_consensus.cc:697] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:28.318575 22656 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.318850 22635 consensus_queue.cc:237] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.322506 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:28.323271 22476 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
W20260709 12:16:28.324488 22367 leader_election.cc:343] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.324249 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:28.326737 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:28.326996 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:28.332515 22594 ts_tablet_manager.cc:1434] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.004s
I20260709 12:16:28.302049 22667 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:28.334077 22674 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:28.334488 22594 tablet_bootstrap.cc:492] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:28.334528 22674 raft_consensus.cc:697] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:28.335414 22674 consensus_queue.cc:237] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:28.330192 22516 leader_election.cc:343] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.330267 22677 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.351140 22636 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.372015 22636 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:28.372953 22594 tablet_bootstrap.cc:654] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.374608 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:28.375248 22477 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:28.362810 22366 leader_election.cc:343] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.388878 22654 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.379904 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:28.398674 22679 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.399791 22592 tablet_bootstrap.cc:492] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:28.400256 22592 ts_tablet_manager.cc:1403] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.482s	user 0.007s	sys 0.014s
I20260709 12:16:28.409132 22591 tablet_bootstrap.cc:492] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:28.409718 22591 ts_tablet_manager.cc:1403] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.325s	user 0.017s	sys 0.002s
I20260709 12:16:28.413534 22650 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:28.403465 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:28.416039 22592 raft_consensus.cc:359] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.417068 22592 raft_consensus.cc:385] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.417302 22592 raft_consensus.cc:740] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.411401 22297 catalog_manager.cc:5697] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:28.418440 22592 consensus_queue.cc:260] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.422308 22299 catalog_manager.cc:5697] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:28.418833 22550 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.430279 22592 ts_tablet_manager.cc:1434] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.003s
I20260709 12:16:28.431023 22592 tablet_bootstrap.cc:492] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:28.429059 22297 catalog_manager.cc:5697] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:28.435634 22654 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.437039 22677 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.437595 22591 raft_consensus.cc:359] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.438303 22591 raft_consensus.cc:385] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.438563 22591 raft_consensus.cc:740] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.440899 22591 consensus_queue.cc:260] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.444428 22594 tablet_bootstrap.cc:492] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:28.444950 22594 ts_tablet_manager.cc:1403] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.111s	user 0.015s	sys 0.008s
I20260709 12:16:28.446060 22591 ts_tablet_manager.cc:1434] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:16:28.449316 22591 tablet_bootstrap.cc:492] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:28.449813 22594 raft_consensus.cc:359] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.450711 22594 raft_consensus.cc:385] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.450994 22594 raft_consensus.cc:740] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.451833 22594 consensus_queue.cc:260] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.454736 22477 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:28.456468 22594 ts_tablet_manager.cc:1434] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:16:28.456250 22367 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:28.457392 22679 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:28.458148 22679 raft_consensus.cc:697] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:28.457532 22594 tablet_bootstrap.cc:492] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:28.459110 22679 consensus_queue.cc:237] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.463806 22680 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:28.466488 22296 catalog_manager.cc:5697] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:28.472105 22654 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:16:28.480609 22650 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.481309 22650 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.487114 22650 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:28.489423 22680 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.492336 22550 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:28.494663 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:28.494943 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:28.495872 22441 leader_election.cc:343] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:28.496359 22442 leader_election.cc:343] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.496820 22442 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:28.498615 22650 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.508931 22637 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.511390 22299 catalog_manager.cc:5697] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:28.514304 22299 catalog_manager.cc:5697] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:28.512733 22637 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.516230 22591 tablet_bootstrap.cc:654] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.517362 22637 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:28.521130 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:16:28.523643 22367 leader_election.cc:343] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.526496 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:28.527884 22366 leader_election.cc:343] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.528326 22366 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:28.530259 22592 tablet_bootstrap.cc:654] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.530953 22637 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.530979 22696 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:28.571506 22594 tablet_bootstrap.cc:654] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.579530 22677 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.580135 22677 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.582571 22677 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:28.584224 22594 tablet_bootstrap.cc:492] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:28.584713 22594 ts_tablet_manager.cc:1403] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.127s	user 0.010s	sys 0.006s
I20260709 12:16:28.584604 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:28.584991 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:28.585253 22399 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
W20260709 12:16:28.586987 22516 leader_election.cc:343] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.588997 22516 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:16:28.589617 22296 catalog_manager.cc:5697] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:28.590235 22677 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:28.591549 22677 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.591889 22677 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.605036 22705 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.605647 22705 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.609119 22705 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:28.610041 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:28.610217 22677 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:28.611737 22441 leader_election.cc:343] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.612357 22677 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:28.589735 22592 tablet_bootstrap.cc:492] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:28.613323 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:28.614555 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:28.615511 22516 leader_election.cc:343] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.613309 22592 ts_tablet_manager.cc:1403] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.182s	user 0.017s	sys 0.018s
I20260709 12:16:28.613417 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:28.617492 22399 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.618916 22592 raft_consensus.cc:359] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.619590 22592 raft_consensus.cc:385] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.619854 22592 raft_consensus.cc:740] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.620467 22592 consensus_queue.cc:260] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:28.626437 22442 leader_election.cc:343] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.626995 22442 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:28.627945 22399 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:28.629391 22516 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:16:28.631052 22677 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:28.632349 22677 raft_consensus.cc:697] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:28.633093 22592 ts_tablet_manager.cc:1434] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:16:28.633249 22677 consensus_queue.cc:237] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.634064 22592 tablet_bootstrap.cc:492] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:28.634141 22674 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.638697 22705 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.639319 22650 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.642130 22594 raft_consensus.cc:359] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.642551 22591 tablet_bootstrap.cc:492] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:28.650110 22591 ts_tablet_manager.cc:1403] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.201s	user 0.020s	sys 0.023s
I20260709 12:16:28.653064 22591 raft_consensus.cc:359] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.654985 22591 raft_consensus.cc:385] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.655725 22591 raft_consensus.cc:740] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.644770 22594 raft_consensus.cc:385] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.647598 22592 tablet_bootstrap.cc:654] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.657192 22591 consensus_queue.cc:260] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.661054 22591 ts_tablet_manager.cc:1434] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:16:28.661751 22594 raft_consensus.cc:740] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.666043 22591 tablet_bootstrap.cc:492] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:28.670051 22296 catalog_manager.cc:5697] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:28.672463 22591 tablet_bootstrap.cc:654] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.678834 22666 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.684100 22591 tablet_bootstrap.cc:492] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:28.684567 22591 ts_tablet_manager.cc:1403] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 12:16:28.686412 22705 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.688148 22592 tablet_bootstrap.cc:492] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:28.688614 22592 ts_tablet_manager.cc:1403] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.007s
I20260709 12:16:28.688258 22591 raft_consensus.cc:359] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.689348 22591 raft_consensus.cc:385] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.689584 22591 raft_consensus.cc:740] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.690181 22591 consensus_queue.cc:260] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.691946 22591 ts_tablet_manager.cc:1434] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 12:16:28.692902 22594 consensus_queue.cc:260] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.694921 22591 tablet_bootstrap.cc:492] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:28.701514 22592 raft_consensus.cc:359] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.702076 22592 raft_consensus.cc:385] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.702287 22592 raft_consensus.cc:740] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.702837 22592 consensus_queue.cc:260] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.705822 22594 ts_tablet_manager.cc:1434] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.121s	user 0.006s	sys 0.000s
I20260709 12:16:28.706905 22594 tablet_bootstrap.cc:492] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:28.710124 22592 ts_tablet_manager.cc:1434] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 12:16:28.710911 22592 tablet_bootstrap.cc:492] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:28.719141 22594 tablet_bootstrap.cc:654] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.721959 22591 tablet_bootstrap.cc:654] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.727561 22592 tablet_bootstrap.cc:654] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.729059 22591 tablet_bootstrap.cc:492] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:28.729552 22591 ts_tablet_manager.cc:1403] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.007s
I20260709 12:16:28.732334 22591 raft_consensus.cc:359] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.733101 22591 raft_consensus.cc:385] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.733368 22591 raft_consensus.cc:740] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.734416 22591 consensus_queue.cc:260] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.735800 22594 tablet_bootstrap.cc:492] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:28.736256 22594 ts_tablet_manager.cc:1403] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.004s
I20260709 12:16:28.736347 22591 ts_tablet_manager.cc:1434] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:28.737561 22591 tablet_bootstrap.cc:492] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:28.738420 22637 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.738734 22594 raft_consensus.cc:359] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.739393 22594 raft_consensus.cc:385] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.739641 22594 raft_consensus.cc:740] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.740275 22594 consensus_queue.cc:260] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.742391 22594 ts_tablet_manager.cc:1434] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:16:28.743124 22592 tablet_bootstrap.cc:492] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:28.743621 22592 ts_tablet_manager.cc:1403] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.001s
I20260709 12:16:28.744120 22591 tablet_bootstrap.cc:654] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.746212 22592 raft_consensus.cc:359] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.746877 22592 raft_consensus.cc:385] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.747159 22592 raft_consensus.cc:740] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.747844 22592 consensus_queue.cc:260] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.749400 22594 tablet_bootstrap.cc:492] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:28.752874 22592 ts_tablet_manager.cc:1434] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:16:28.753997 22592 tablet_bootstrap.cc:492] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:28.755661 22591 tablet_bootstrap.cc:492] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:28.756131 22591 ts_tablet_manager.cc:1403] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:16:28.757229 22548 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.758826 22591 raft_consensus.cc:359] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.759541 22591 raft_consensus.cc:385] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.759801 22591 raft_consensus.cc:740] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.760483 22591 consensus_queue.cc:260] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.762720 22591 ts_tablet_manager.cc:1434] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 12:16:28.763710 22591 tablet_bootstrap.cc:492] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:28.765689 22679 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.766856 22666 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.767398 22666 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.771395 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:28.772133 22399 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:28.773699 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:28.769534 22666 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:28.775173 22674 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:28.775684 22674 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.776221 22674 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.783469 22674 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.775216 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:28.785127 22591 tablet_bootstrap.cc:654] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.785223 22477 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:28.786391 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:28.786989 22399 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.787765 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:28.789870 22674 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:28.793635 22399 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:28.773833 22594 tablet_bootstrap.cc:654] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.795128 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:16:28.795445 22399 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.796178 22666 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:28.796695 22666 raft_consensus.cc:697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:28.796801 22677 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.797544 22666 consensus_queue.cc:237] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.793553 22592 tablet_bootstrap.cc:654] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.810273 22594 tablet_bootstrap.cc:492] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:28.810086 22666 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.810756 22594 ts_tablet_manager.cc:1403] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.062s	user 0.005s	sys 0.008s
I20260709 12:16:28.813373 22594 raft_consensus.cc:359] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.818848 22594 raft_consensus.cc:385] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.819128 22594 raft_consensus.cc:740] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.819774 22594 consensus_queue.cc:260] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.821379 22591 tablet_bootstrap.cc:492] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:28.822322 22591 ts_tablet_manager.cc:1403] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.008s
I20260709 12:16:28.823835 22592 tablet_bootstrap.cc:492] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:28.824281 22592 ts_tablet_manager.cc:1403] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.000s
I20260709 12:16:28.824857 22679 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.825381 22591 raft_consensus.cc:359] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.826090 22591 raft_consensus.cc:385] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.826335 22591 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.825374 22679 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.826813 22592 raft_consensus.cc:359] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.827467 22592 raft_consensus.cc:385] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.827314 22591 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.827726 22592 raft_consensus.cc:740] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.829681 22591 ts_tablet_manager.cc:1434] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:16:28.831511 22594 ts_tablet_manager.cc:1434] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:16:28.838519 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:28.838792 22594 tablet_bootstrap.cc:492] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
W20260709 12:16:28.841464 22366 leader_election.cc:343] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.842097 22679 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:28.844449 22591 tablet_bootstrap.cc:492] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:28.838567 22592 consensus_queue.cc:260] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.848426 22299 catalog_manager.cc:5697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:28.850975 22591 tablet_bootstrap.cc:654] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.853014 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:28.853827 22477 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:28.855145 22592 ts_tablet_manager.cc:1434] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:16:28.855057 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:28.853012 22594 tablet_bootstrap.cc:654] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.856133 22592 tablet_bootstrap.cc:492] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:28.856168 22679 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:28.856660 22679 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.856982 22679 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.867869 22400 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.873633 22591 tablet_bootstrap.cc:492] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:28.874495 22591 ts_tablet_manager.cc:1403] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.007s
I20260709 12:16:28.878041 22591 raft_consensus.cc:359] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.878824 22591 raft_consensus.cc:385] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.879117 22591 raft_consensus.cc:740] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.879316 22595 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.880002 22591 consensus_queue.cc:260] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.887933 22591 ts_tablet_manager.cc:1434] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:16:28.888928 22591 tablet_bootstrap.cc:492] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:28.892937 22677 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.895010 22591 tablet_bootstrap.cc:654] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.898097 22677 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.898651 22677 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.900631 22592 tablet_bootstrap.cc:654] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.900760 22677 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:28.900923 22594 tablet_bootstrap.cc:492] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:28.902099 22594 ts_tablet_manager.cc:1403] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.010s
I20260709 12:16:28.902745 22656 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.903185 22656 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.904726 22594 raft_consensus.cc:359] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.905153 22656 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:28.905397 22594 raft_consensus.cc:385] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.905730 22594 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.907287 22591 tablet_bootstrap.cc:492] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:28.907748 22591 ts_tablet_manager.cc:1403] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.003s
I20260709 12:16:28.910006 22594 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.912310 22594 ts_tablet_manager.cc:1434] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:16:28.912566 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:28.913233 22594 tablet_bootstrap.cc:492] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:28.913184 22548 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:28.914422 22441 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:28.915256 22656 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:28.915608 22656 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.915958 22656 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.918311 22591 raft_consensus.cc:359] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.919119 22591 raft_consensus.cc:385] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.919404 22591 raft_consensus.cc:740] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.920260 22591 consensus_queue.cc:260] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.922904 22591 ts_tablet_manager.cc:1434] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:16:28.923985 22591 tablet_bootstrap.cc:492] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:28.927906 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:28.928826 22400 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:28.928933 22679 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.932129 22594 tablet_bootstrap.cc:654] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.933718 22656 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.937923 22636 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.932286 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:28.939232 22474 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.930051 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:28.942266 22705 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.942816 22705 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:28.943634 22516 leader_election.cc:343] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.946137 22592 tablet_bootstrap.cc:492] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:28.946666 22592 ts_tablet_manager.cc:1403] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.091s	user 0.020s	sys 0.003s
I20260709 12:16:28.950243 22705 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:28.952270 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:28.966118 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:28.971834 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:28.972476 22399 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.973001 22474 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:28.977838 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:28.978685 22636 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:28.978936 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:28.979269 22636 raft_consensus.cc:697] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:28.979595 22551 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.980175 22636 consensus_queue.cc:237] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.982216 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:28.982254 22516 leader_election.cc:343] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.983060 22402 raft_consensus.cc:2393] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 1: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:16:28.982909 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:28.965211 22592 raft_consensus.cc:359] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.984041 22674 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.984262 22592 raft_consensus.cc:385] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.985356 22442 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:28.986085 22551 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:28.986466 22705 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.984568 22592 raft_consensus.cc:740] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.980566 22399 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:28.988291 22592 consensus_queue.cc:260] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:28.987251 22656 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:28.994261 22592 ts_tablet_manager.cc:1434] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.002s
I20260709 12:16:28.995481 22441 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:28.998579 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:28.991588 22679 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:29.001152 22366 leader_election.cc:343] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.002992 22592 tablet_bootstrap.cc:492] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:29.008086 22656 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.010389 22656 raft_consensus.cc:697] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:29.011408 22634 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.012005 22634 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.012514 22705 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:29.013311 22674 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.015412 22656 consensus_queue.cc:237] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.013836 22674 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.018285 22594 tablet_bootstrap.cc:492] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:29.018234 22634 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:29.018741 22594 ts_tablet_manager.cc:1403] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.106s	user 0.008s	sys 0.003s
I20260709 12:16:29.020737 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:29.028540 22366 leader_election.cc:343] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.029405 22674 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:29.030148 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:29.032334 22594 raft_consensus.cc:359] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.032888 22594 raft_consensus.cc:385] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.033097 22594 raft_consensus.cc:740] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
W20260709 12:16:29.033298 22516 leader_election.cc:343] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.033491 22636 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.034027 22594 consensus_queue.cc:260] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.034300 22636 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.035609 22594 ts_tablet_manager.cc:1434] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 12:16:29.035389 22677 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.040796 22636 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:29.039173 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:29.041582 22551 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:29.040027 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:16:29.043646 22367 leader_election.cc:343] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.043779 22366 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:29.044106 22367 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:29.049212 22679 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.049666 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:29.049712 22679 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.050400 22477 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:29.050683 22679 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.051445 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:29.052218 22634 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:29.053216 22367 leader_election.cc:343] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.054770 22703 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.055779 22703 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.059510 22703 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:29.060072 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:29.060747 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:29.061477 22674 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.061965 22674 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.062345 22674 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:29.062484 22441 leader_election.cc:343] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.063946 22591 tablet_bootstrap.cc:654] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.071506 22592 tablet_bootstrap.cc:654] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.071797 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:29.074033 22442 leader_election.cc:343] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.074550 22442 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:29.075296 22654 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:29.076452 22637 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.078388 22594 tablet_bootstrap.cc:492] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:29.087809 22654 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.089030 22654 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.096061 22594 tablet_bootstrap.cc:654] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.092001 22674 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.098194 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:29.098564 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:29.099462 22591 tablet_bootstrap.cc:492] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:29.106128 22591 ts_tablet_manager.cc:1403] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.182s	user 0.012s	sys 0.001s
W20260709 12:16:29.106791 22441 leader_election.cc:343] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.103873 22679 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.104024 22297 catalog_manager.cc:5697] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:29.100813 22654 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:29.114048 22442 leader_election.cc:343] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.114503 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:29.116266 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:29.116895 22548 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:29.118023 22367 leader_election.cc:343] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.114341 22592 tablet_bootstrap.cc:492] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:29.119270 22592 ts_tablet_manager.cc:1403] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.123s	user 0.017s	sys 0.019s
I20260709 12:16:29.118420 22299 catalog_manager.cc:5697] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:29.114580 22442 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:29.123646 22654 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:29.115893 22679 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:29.125989 22591 raft_consensus.cc:359] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.127719 22591 raft_consensus.cc:385] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.128036 22591 raft_consensus.cc:740] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.128753 22591 consensus_queue.cc:260] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.131759 22548 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:29.129679 22674 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:29.136026 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:29.136759 22591 ts_tablet_manager.cc:1434] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:16:29.137707 22591 tablet_bootstrap.cc:492] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
W20260709 12:16:29.137970 22516 leader_election.cc:343] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.137789 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:29.139434 22477 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.139281 22366 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:16:29.140399 22592 raft_consensus.cc:359] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.140738 22634 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.141096 22592 raft_consensus.cc:385] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.141410 22592 raft_consensus.cc:740] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.143173 22592 consensus_queue.cc:260] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.143527 22634 raft_consensus.cc:697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:29.144507 22634 consensus_queue.cc:237] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.147517 22592 ts_tablet_manager.cc:1434] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:16:29.143724 22595 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:16:29.152107 22592 tablet_bootstrap.cc:492] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:29.154029 22594 tablet_bootstrap.cc:492] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:29.154578 22594 ts_tablet_manager.cc:1403] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.004s
I20260709 12:16:29.168310 22477 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:29.169857 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:29.171106 22595 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.171587 22595 raft_consensus.cc:697] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:29.172546 22594 raft_consensus.cc:359] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.172392 22595 consensus_queue.cc:237] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.173424 22594 raft_consensus.cc:385] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.173692 22594 raft_consensus.cc:740] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.174659 22594 consensus_queue.cc:260] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.176676 22594 ts_tablet_manager.cc:1434] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:16:29.177593 22594 tablet_bootstrap.cc:492] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:29.188118 22591 tablet_bootstrap.cc:654] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.199787 22594 tablet_bootstrap.cc:654] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.200738 22592 tablet_bootstrap.cc:654] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.200139 22299 catalog_manager.cc:5697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:29.206914 22594 tablet_bootstrap.cc:492] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:29.207463 22594 ts_tablet_manager.cc:1403] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.030s	user 0.005s	sys 0.006s
I20260709 12:16:29.210582 22591 tablet_bootstrap.cc:492] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:29.211104 22591 ts_tablet_manager.cc:1403] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.004s
I20260709 12:16:29.213832 22594 raft_consensus.cc:359] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.214566 22594 raft_consensus.cc:385] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.214866 22592 tablet_bootstrap.cc:492] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:29.215359 22592 ts_tablet_manager.cc:1403] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.004s
I20260709 12:16:29.215108 22594 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.216876 22594 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.218462 22592 raft_consensus.cc:359] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.219197 22592 raft_consensus.cc:385] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.219595 22592 raft_consensus.cc:740] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.219188 22594 ts_tablet_manager.cc:1434] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:16:29.220242 22592 consensus_queue.cc:260] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.221339 22594 tablet_bootstrap.cc:492] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:29.222383 22592 ts_tablet_manager.cc:1434] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:16:29.220252 22591 raft_consensus.cc:359] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.223357 22592 tablet_bootstrap.cc:492] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:29.225227 22297 catalog_manager.cc:5697] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:29.228881 22594 tablet_bootstrap.cc:654] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.223316 22591 raft_consensus.cc:385] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.229936 22591 raft_consensus.cc:740] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.230252 22592 tablet_bootstrap.cc:654] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.230681 22591 consensus_queue.cc:260] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.232780 22591 ts_tablet_manager.cc:1434] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.001s
I20260709 12:16:29.234180 22591 tablet_bootstrap.cc:492] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:29.240025 22591 tablet_bootstrap.cc:654] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.240509 22594 tablet_bootstrap.cc:492] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:29.241076 22594 ts_tablet_manager.cc:1403] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:16:29.243955 22594 raft_consensus.cc:359] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.244659 22594 raft_consensus.cc:385] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.246007 22594 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.246680 22594 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.247066 22476 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.247558 22592 tablet_bootstrap.cc:492] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:29.248030 22592 ts_tablet_manager.cc:1403] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 12:16:29.248837 22594 ts_tablet_manager.cc:1434] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 12:16:29.249972 22594 tablet_bootstrap.cc:492] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:29.256058 22592 raft_consensus.cc:359] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.256731 22594 tablet_bootstrap.cc:654] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.256774 22592 raft_consensus.cc:385] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.257151 22592 raft_consensus.cc:740] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.257896 22592 consensus_queue.cc:260] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.259958 22674 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.260389 22592 ts_tablet_manager.cc:1434] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:16:29.260681 22595 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.261472 22592 tablet_bootstrap.cc:492] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:29.267920 22592 tablet_bootstrap.cc:654] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.274598 22592 tablet_bootstrap.cc:492] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:29.275156 22592 ts_tablet_manager.cc:1403] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:16:29.276724 22591 tablet_bootstrap.cc:492] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:29.277297 22591 ts_tablet_manager.cc:1403] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.009s
I20260709 12:16:29.278153 22592 raft_consensus.cc:359] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.278888 22592 raft_consensus.cc:385] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.279155 22592 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.279888 22592 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.280323 22591 raft_consensus.cc:359] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.281169 22591 raft_consensus.cc:385] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.281508 22591 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.282347 22592 ts_tablet_manager.cc:1434] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:29.283372 22592 tablet_bootstrap.cc:492] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:29.282438 22591 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.286576 22591 ts_tablet_manager.cc:1434] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:16:29.287695 22591 tablet_bootstrap.cc:492] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:29.290442 22592 tablet_bootstrap.cc:654] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.293473 22591 tablet_bootstrap.cc:654] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.293643 22594 tablet_bootstrap.cc:492] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:29.294248 22594 ts_tablet_manager.cc:1403] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.011s
I20260709 12:16:29.298031 22594 raft_consensus.cc:359] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.298815 22594 raft_consensus.cc:385] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.299083 22594 raft_consensus.cc:740] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.299748 22594 consensus_queue.cc:260] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.312166 22594 ts_tablet_manager.cc:1434] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:16:29.313290 22594 tablet_bootstrap.cc:492] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:29.319237 22594 tablet_bootstrap.cc:654] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.331048 22592 tablet_bootstrap.cc:492] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:29.332580 22594 tablet_bootstrap.cc:492] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:29.333115 22594 ts_tablet_manager.cc:1403] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:16:29.331547 22592 ts_tablet_manager.cc:1403] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.048s	user 0.027s	sys 0.007s
I20260709 12:16:29.335920 22592 raft_consensus.cc:359] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.336697 22592 raft_consensus.cc:385] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.336395 22594 raft_consensus.cc:359] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.337005 22592 raft_consensus.cc:740] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.337105 22594 raft_consensus.cc:385] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.337414 22594 raft_consensus.cc:740] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.338145 22594 consensus_queue.cc:260] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.338335 22592 consensus_queue.cc:260] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.340140 22594 ts_tablet_manager.cc:1434] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 12:16:29.340426 22592 ts_tablet_manager.cc:1434] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:16:29.341048 22594 tablet_bootstrap.cc:492] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:29.341333 22592 tablet_bootstrap.cc:492] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:29.347440 22594 tablet_bootstrap.cc:654] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.350441 22634 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.351022 22634 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.354241 22674 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.354852 22674 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.355808 22592 tablet_bootstrap.cc:654] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.357018 22674 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:29.359206 22594 tablet_bootstrap.cc:492] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:29.359076 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:29.359802 22594 ts_tablet_manager.cc:1403] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:16:29.360440 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:29.362054 22366 leader_election.cc:343] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:29.362560 22367 leader_election.cc:343] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.362476 22594 raft_consensus.cc:359] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.363132 22594 raft_consensus.cc:385] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.363090 22367 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:29.363547 22594 raft_consensus.cc:740] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.364051 22679 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:29.364459 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:29.364320 22594 consensus_queue.cc:260] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:29.366089 22516 leader_election.cc:343] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.366238 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:29.366681 22674 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.366825 22594 ts_tablet_manager.cc:1434] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:16:29.366961 22477 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:29.367545 22674 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.368224 22594 tablet_bootstrap.cc:492] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:29.368870 22516 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:29.369531 22674 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:29.369963 22595 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.370358 22595 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.370715 22595 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.359568 22634 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:29.373368 22347 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:29.374089 22594 tablet_bootstrap.cc:654] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.376204 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:29.376674 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:29.376827 22476 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
W20260709 12:16:29.378288 22516 leader_election.cc:343] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.379040 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:29.379856 22674 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.380221 22674 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.380563 22674 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.387329 22594 tablet_bootstrap.cc:492] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:29.387823 22594 ts_tablet_manager.cc:1403] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.003s
I20260709 12:16:29.388375 22595 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.390312 22594 raft_consensus.cc:359] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.391002 22594 raft_consensus.cc:385] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.391268 22594 raft_consensus.cc:740] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.391585 22595 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:29.376677 22591 tablet_bootstrap.cc:492] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:29.392465 22591 ts_tablet_manager.cc:1403] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.105s	user 0.019s	sys 0.024s
I20260709 12:16:29.392874 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:29.395326 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:29.395871 22477 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.395098 22591 raft_consensus.cc:359] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.397168 22591 raft_consensus.cc:385] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.397464 22591 raft_consensus.cc:740] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.391947 22594 consensus_queue.cc:260] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.398185 22591 consensus_queue.cc:260] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.399724 22594 ts_tablet_manager.cc:1434] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:16:29.401731 22594 tablet_bootstrap.cc:492] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:29.402557 22591 ts_tablet_manager.cc:1434] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
W20260709 12:16:29.400691 22516 leader_election.cc:343] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.403518 22591 tablet_bootstrap.cc:492] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:29.404353 22674 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.410353 22591 tablet_bootstrap.cc:654] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.410447 22594 tablet_bootstrap.cc:654] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.398159 22592 tablet_bootstrap.cc:492] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:29.411149 22592 ts_tablet_manager.cc:1403] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.026s
I20260709 12:16:29.410720 22477 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:29.413617 22674 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:29.413687 22592 raft_consensus.cc:359] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.414542 22592 raft_consensus.cc:385] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.414402 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:29.414853 22592 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.415691 22592 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.415350 22516 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:29.417128 22674 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.417630 22674 raft_consensus.cc:697] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:29.417861 22592 ts_tablet_manager.cc:1434] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:16:29.410593 22634 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.418598 22634 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.418752 22674 consensus_queue.cc:237] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.420946 22634 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:29.418789 22592 tablet_bootstrap.cc:492] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:29.422808 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:29.423454 22551 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
W20260709 12:16:29.423949 22516 leader_election.cc:343] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.424861 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:29.426028 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:29.426632 22476 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.428114 22592 tablet_bootstrap.cc:654] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.431493 22634 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.432106 22634 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.432547 22634 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.434908 22594 tablet_bootstrap.cc:492] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:29.435575 22594 ts_tablet_manager.cc:1403] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.034s	user 0.005s	sys 0.020s
I20260709 12:16:29.438238 22594 raft_consensus.cc:359] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.438953 22594 raft_consensus.cc:385] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.440235 22594 raft_consensus.cc:740] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.439158 22592 tablet_bootstrap.cc:492] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:29.440836 22592 ts_tablet_manager.cc:1403] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.005s
I20260709 12:16:29.440918 22594 consensus_queue.cc:260] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.441385 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:29.442497 22477 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:29.443126 22594 ts_tablet_manager.cc:1434] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:16:29.443677 22592 raft_consensus.cc:359] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.444381 22592 raft_consensus.cc:385] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.444665 22592 raft_consensus.cc:740] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.445415 22592 consensus_queue.cc:260] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.447516 22592 ts_tablet_manager.cc:1434] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:29.448396 22592 tablet_bootstrap.cc:492] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:29.453850 22592 tablet_bootstrap.cc:654] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.444108 22594 tablet_bootstrap.cc:492] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:29.461879 22594 tablet_bootstrap.cc:654] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.468626 22634 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.470263 22476 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:29.471511 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:29.474983 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:29.475653 22476 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.475965 22595 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.476542 22595 raft_consensus.cc:697] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:29.475253 22592 tablet_bootstrap.cc:492] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:29.477448 22595 consensus_queue.cc:237] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.478143 22592 ts_tablet_manager.cc:1403] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 12:16:29.480248 22654 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.480489 22667 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.480775 22654 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.480913 22667 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.482846 22667 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:29.482893 22654 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:29.483981 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:29.484768 22551 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 1: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:16:29.485049 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:29.480795 22592 raft_consensus.cc:359] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.485638 22399 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:29.485903 22592 raft_consensus.cc:385] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.486222 22592 raft_consensus.cc:740] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.486333 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:29.487607 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:29.488036 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:29.488152 22551 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.488649 22477 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:29.488188 22592 consensus_queue.cc:260] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.490216 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:29.491709 22592 ts_tablet_manager.cc:1434] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:16:29.492025 22666 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.492554 22666 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.492934 22442 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:29.494238 22656 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.494758 22705 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.496016 22592 tablet_bootstrap.cc:492] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:29.496662 22551 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:29.497885 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:29.490463 22654 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.502213 22680 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.503302 22297 catalog_manager.cc:5697] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:29.503449 22674 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.504235 22680 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.506752 22674 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.507112 22674 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.508280 22680 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:29.501647 22634 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:29.502229 22679 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.510259 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:29.510545 22679 raft_consensus.cc:697] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:29.511368 22679 consensus_queue.cc:237] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:29.511775 22366 leader_election.cc:343] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.515419 22594 tablet_bootstrap.cc:492] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:29.516552 22594 ts_tablet_manager.cc:1403] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.000s
I20260709 12:16:29.516935 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:29.517585 22477 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:29.517532 22666 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:29.520018 22594 raft_consensus.cc:359] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.520799 22594 raft_consensus.cc:385] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.521108 22594 raft_consensus.cc:740] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.522260 22594 consensus_queue.cc:260] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.505016 22654 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.527658 22591 tablet_bootstrap.cc:492] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:29.527515 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:29.528142 22591 ts_tablet_manager.cc:1403] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.125s	user 0.018s	sys 0.041s
I20260709 12:16:29.528368 22477 raft_consensus.cc:2393] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 1: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:16:29.529735 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:29.529865 22703 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:29.531395 22442 leader_election.cc:343] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.531597 22594 ts_tablet_manager.cc:1434] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:16:29.531735 22703 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.532269 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:29.534093 22367 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:29.537565 22594 tablet_bootstrap.cc:492] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:29.537956 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:29.538621 22634 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.539016 22634 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.539474 22654 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:29.539969 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:29.540570 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:29.540632 22399 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:29.540629 22591 raft_consensus.cc:359] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.542161 22591 raft_consensus.cc:385] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.542083 22442 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:29.542543 22591 raft_consensus.cc:740] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.529150 22656 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:29.543295 22592 tablet_bootstrap.cc:654] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.541095 22703 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:29.543699 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:29.543455 22591 consensus_queue.cc:260] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.543988 22703 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.544363 22703 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:29.542421 22441 leader_election.cc:343] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.544719 22703 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.545601 22548 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:29.545960 22591 ts_tablet_manager.cc:1434] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:16:29.541170 22666 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.544826 22441 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:29.546896 22591 tablet_bootstrap.cc:492] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:29.539347 22634 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.550727 22654 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:29.552049 22674 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.610664 22703 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.631409 22476 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:29.655722 22654 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.649945 22666 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:29.660307 22654 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.663786 22703 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:29.683145 22674 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:29.687206 22399 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.690790 22297 catalog_manager.cc:5697] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:29.704401 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:29.705081 22548 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.681263 22777 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
W20260709 12:16:29.722292 22773 log.cc:927] Time spent T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:16:29.747512 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:29.748319 22400 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.718163 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:29.821801 22780 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.822455 22780 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:29.801164 22402 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:29.781128 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 61296.9us
W20260709 12:16:30.359676 22400 consensus_meta.cc:287] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.611s	user 0.007s	sys 0.003s
I20260709 12:16:30.156065 22402 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:29.972950 22656 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.407163 22637 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:30.205395 22399 consensus_meta.cc:287] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.000s
I20260709 12:16:30.008970 22654 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:30.388832 22594 tablet_bootstrap.cc:654] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.040750 22780 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:29.935415 22548 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
W20260709 12:16:30.148384 22634 consensus_meta.cc:287] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.578s	user 0.008s	sys 0.000s
I20260709 12:16:30.393359 22591 tablet_bootstrap.cc:654] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.400879 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:29.913265 22299 catalog_manager.cc:5697] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:30.239972 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:30.142191 22703 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.854334 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:30.408422 22637 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.431281 22592 tablet_bootstrap.cc:492] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:30.361532 22635 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.063s
I20260709 12:16:30.434581 22592 ts_tablet_manager.cc:1403] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.940s	user 0.054s	sys 0.053s
I20260709 12:16:30.408840 22400 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:30.417317 22778 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.426301 22550 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:30.415716 22656 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.417873 22634 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.437894 22476 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.435467 22703 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.456032 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:30.456693 22637 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:30.459642 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:30.440023 22778 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:30.464859 22366 leader_election.cc:343] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.468638 22656 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:30.469002 22637 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:30.472126 22366 leader_election.cc:343] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.472848 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:30.468369 22592 raft_consensus.cc:359] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.473804 22592 raft_consensus.cc:385] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.474165 22592 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.468505 22635 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:16:30.467603 22703 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:30.467607 22634 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:30.477680 22592 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.476171 22656 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:30.478367 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:30.483621 22775 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:16:30.486598 22592 ts_tablet_manager.cc:1434] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.000s
I20260709 12:16:30.487646 22592 tablet_bootstrap.cc:492] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:30.488543 22656 raft_consensus.cc:697] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:30.482380 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:16:30.497660 22366 leader_election.cc:343] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.499534 22778 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:30.507330 22703 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:30.516664 22703 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.517066 22703 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.517899 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:30.518556 22474 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:30.523289 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:30.524123 22472 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.506240 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:30.535112 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:30.539788 22595 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:30.540524 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:30.541265 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:16:30.541602 22367 leader_election.cc:343] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.529224 22656 consensus_queue.cc:237] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.542053 22367 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:30.542845 22477 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:30.531690 22476 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
W20260709 12:16:30.546908 22441 leader_election.cc:343] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:30.547652 22441 leader_election.cc:343] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.557272 22591 tablet_bootstrap.cc:492] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:30.558017 22591 ts_tablet_manager.cc:1403] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 1.011s	user 0.017s	sys 0.027s
I20260709 12:16:30.561518 22591 raft_consensus.cc:359] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.562448 22591 raft_consensus.cc:385] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.562815 22591 raft_consensus.cc:740] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.563649 22591 consensus_queue.cc:260] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.567022 22591 ts_tablet_manager.cc:1434] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:16:30.542870 22778 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:30.569531 22591 tablet_bootstrap.cc:492] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:30.574189 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:30.575800 22592 tablet_bootstrap.cc:654] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.568914 22367 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:30.583302 22367 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:30.583501 22703 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.569908 22634 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:30.585567 22703 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:30.589156 22594 tablet_bootstrap.cc:492] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:30.614243 22637 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:30.619853 22594 ts_tablet_manager.cc:1403] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 1.082s	user 0.040s	sys 0.096s
I20260709 12:16:30.577756 22775 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:30.587005 22634 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.625319 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:30.626601 22594 raft_consensus.cc:359] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:30.616283 22368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.022s	sys 0.050s
I20260709 12:16:30.619932 22637 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.629812 22594 raft_consensus.cc:385] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.588017 22777 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:30.588558 22635 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:16:30.630924 22368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.024s	sys 0.050s
I20260709 12:16:30.614090 22778 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.632272 22594 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.631294 22543 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.618149 22472 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:30.631246 22595 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:16:30.635543 22778 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.627058 22775 raft_consensus.cc:697] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:30.636897 22594 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.633200 22635 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.632762 22777 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.644059 22594 ts_tablet_manager.cc:1434] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:16:30.643393 22635 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.644968 22594 tablet_bootstrap.cc:492] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:30.651914 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:30.652318 22543 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
W20260709 12:16:30.653152 22347 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:30.641798 22780 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.654565 22780 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.655836 22778 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:30.658243 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:30.658934 22401 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:30.710036 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:30.710644 22775 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.712393 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:30.726792 22635 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.648578 22777 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.739681 22637 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:30.740988 22703 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:30.742393 22442 leader_election.cc:343] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.744148 22591 tablet_bootstrap.cc:654] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.744241 22442 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:30.746084 22654 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:30.746451 22654 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.746783 22654 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.750710 22635 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:30.754091 22780 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:30.755918 22654 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.758564 22634 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:30.763856 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:30.767810 22594 tablet_bootstrap.cc:654] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.768231 22654 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:30.771080 22366 leader_election.cc:343] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.775396 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:30.776800 22592 tablet_bootstrap.cc:492] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:30.777274 22592 ts_tablet_manager.cc:1403] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.290s	user 0.014s	sys 0.004s
I20260709 12:16:30.779861 22592 raft_consensus.cc:359] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.780517 22592 raft_consensus.cc:385] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.780766 22592 raft_consensus.cc:740] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.781944 22788 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:30.782516 22788 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.783665 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:30.784399 22367 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:30.784740 22788 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:30.781661 22592 consensus_queue.cc:260] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.789300 22777 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.788332 22299 catalog_manager.cc:5697] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:30.790560 22401 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 1: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:16:30.797068 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:30.797596 22634 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:30.798225 22592 ts_tablet_manager.cc:1434] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:16:30.799643 22592 tablet_bootstrap.cc:492] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:30.798166 22634 raft_consensus.cc:697] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:30.802783 22634 consensus_queue.cc:237] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.812749 22595 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:30.813884 22777 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:30.814239 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:30.809654 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:30.825057 22654 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:30.825804 22654 raft_consensus.cc:697] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:30.826249 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:30.827050 22474 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 1: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:16:30.826669 22654 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.828434 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:30.831804 22634 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.833205 22634 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.835362 22634 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:30.835821 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:30.839871 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:30.840353 22634 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:30.840817 22400 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.835268 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:30.842540 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:30.846868 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:30.848469 22298 catalog_manager.cc:5697] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:30.868738 22592 tablet_bootstrap.cc:654] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.868880 22299 catalog_manager.cc:5697] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:30.878284 22594 tablet_bootstrap.cc:492] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:30.878823 22594 ts_tablet_manager.cc:1403] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.234s	user 0.029s	sys 0.012s
W20260709 12:16:30.870870 22366 leader_election.cc:343] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.885892 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:30.886618 22474 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.891286 22654 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.891832 22654 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.902448 22591 tablet_bootstrap.cc:492] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:30.933655 22591 ts_tablet_manager.cc:1403] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.364s	user 0.016s	sys 0.015s
I20260709 12:16:30.927927 22474 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:30.900393 22401 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.895859 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:30.895704 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:30.934861 22634 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.947412 22634 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.949435 22634 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:30.949591 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:30.950453 22777 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.950924 22777 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.951514 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:30.952181 22402 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.952777 22777 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:30.933416 22677 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.954005 22677 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.955866 22677 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:30.940765 22654 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:30.943272 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:30.943946 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:30.945324 22367 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:30.959489 22402 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:30.904392 22399 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:16:30.960860 22594 raft_consensus.cc:359] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:30.961318 22367 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:30.961987 22634 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:30.962512 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:30.963162 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:30.933051 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 114072us
W20260709 12:16:30.911727 22442 leader_election.cc:343] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.974151 22594 raft_consensus.cc:385] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.974941 22777 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:30.989872 22594 raft_consensus.cc:740] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.992944 22594 consensus_queue.cc:260] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.016579 22591 raft_consensus.cc:359] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.017334 22591 raft_consensus.cc:385] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.017550 22591 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.018471 22591 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.022646 22594 ts_tablet_manager.cc:1434] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.144s	user 0.032s	sys 0.013s
I20260709 12:16:31.024029 22594 tablet_bootstrap.cc:492] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:31.023957 22591 ts_tablet_manager.cc:1434] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.000s
W20260709 12:16:31.024925 22366 leader_election.cc:343] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.032114 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:31.032868 22472 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
W20260709 12:16:31.014442 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 101930us
W20260709 12:16:31.013365 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 52153.1us
I20260709 12:16:31.039691 22591 tablet_bootstrap.cc:492] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
W20260709 12:16:31.020398 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 71366.6us
I20260709 12:16:31.042460 22595 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:31.046494 22442 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:31.050464 22775 consensus_queue.cc:1059] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:31.051404 22595 raft_consensus.cc:3055] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:31.051788 22595 raft_consensus.cc:740] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:31.052852 22595 consensus_queue.cc:260] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.055322 22594 tablet_bootstrap.cc:654] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.055819 22595 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:31.058319 22654 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:31.068974 22516 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:31.070641 22592 tablet_bootstrap.cc:492] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:31.071177 22592 ts_tablet_manager.cc:1403] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.272s	user 0.019s	sys 0.028s
I20260709 12:16:31.072563 22813 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:31.073060 22813 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.073367 22813 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.081871 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:31.062599 22367 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:31.091219 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:31.091536 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:31.091957 22472 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:31.092188 22399 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:31.094291 22367 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:31.079082 22442 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:31.095158 22777 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:31.098336 22777 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:31.098886 22634 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:31.101337 22592 raft_consensus.cc:359] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.102109 22592 raft_consensus.cc:385] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.102433 22592 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.104925 22654 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:31.105633 22654 raft_consensus.cc:697] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:31.106462 22654 consensus_queue.cc:237] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.103552 22592 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.111416 22592 ts_tablet_manager.cc:1434] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.000s
I20260709 12:16:31.112423 22592 tablet_bootstrap.cc:492] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
W20260709 12:16:31.114019 22441 leader_election.cc:343] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:31.114809 22441 leader_election.cc:343] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.118491 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:31.121016 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:31.121909 22637 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:31.122404 22591 tablet_bootstrap.cc:654] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.123765 22299 catalog_manager.cc:5697] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:31.129093 22367 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:31.130324 22780 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:31.131654 22367 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:31.134881 22780 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:31.135399 22594 tablet_bootstrap.cc:492] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:31.135890 22594 ts_tablet_manager.cc:1403] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.112s	user 0.010s	sys 0.001s
W20260709 12:16:31.122844 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 45950.6us
I20260709 12:16:31.138441 22592 tablet_bootstrap.cc:654] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.139400 22442 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:31.140784 22703 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:31.141137 22703 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.141980 22594 raft_consensus.cc:359] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.142627 22594 raft_consensus.cc:385] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.142911 22594 raft_consensus.cc:740] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.143445 22703 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.143541 22594 consensus_queue.cc:260] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.145589 22594 ts_tablet_manager.cc:1434] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:16:31.141338 22367 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:31.147639 22594 tablet_bootstrap.cc:492] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:31.147815 22780 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:31.148481 22780 raft_consensus.cc:697] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:31.149097 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:31.149397 22780 consensus_queue.cc:237] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.150699 22703 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.151198 22637 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:31.151604 22637 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.151940 22637 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.123951 22813 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.153503 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:31.154247 22401 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.154788 22813 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:31.158676 22637 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.148481 22591 tablet_bootstrap.cc:492] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:31.159896 22591 ts_tablet_manager.cc:1403] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.120s	user 0.021s	sys 0.003s
I20260709 12:16:31.160475 22594 tablet_bootstrap.cc:654] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.161885 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:16:31.162405 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 88988.9us
I20260709 12:16:31.163120 22591 raft_consensus.cc:359] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.163834 22591 raft_consensus.cc:385] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.164098 22591 raft_consensus.cc:740] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
W20260709 12:16:31.165807 22516 leader_election.cc:343] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:31.165907 22366 leader_election.cc:343] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.166359 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:31.166766 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:31.167316 22474 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.167689 22595 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:31.168859 22703 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:31.168929 22677 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.169354 22591 consensus_queue.cc:260] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.169412 22637 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:31.170321 22677 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.173503 22677 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:31.170817 22367 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:31.170953 22401 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:31.174968 22637 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:31.173569 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:31.176035 22548 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.177416 22442 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:31.178296 22705 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:31.180119 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:31.180189 22705 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:31.179039 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:31.181344 22705 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.182488 22398 raft_consensus.cc:2393] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 1: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:16:31.180402 22591 ts_tablet_manager.cc:1434] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:16:31.184839 22591 tablet_bootstrap.cc:492] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
W20260709 12:16:31.192659 22516 leader_election.cc:343] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.200112 22299 catalog_manager.cc:5697] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:31.212996 22474 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:31.223383 22297 catalog_manager.cc:5697] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:31.229274 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:31.243528 22477 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.212517 22654 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:16:31.268348 22548 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:31.271335 22477 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:31.277084 22591 tablet_bootstrap.cc:654] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.263753 22516 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:31.294792 22594 tablet_bootstrap.cc:492] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:31.312978 22594 ts_tablet_manager.cc:1403] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.166s	user 0.008s	sys 0.018s
I20260709 12:16:31.303238 22592 tablet_bootstrap.cc:492] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:31.297958 22677 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:16:31.296312 22813 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:31.302716 22402 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.315366 22813 raft_consensus.cc:697] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:31.316181 22813 consensus_queue.cc:237] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.299897 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:31.318701 22635 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:31.300019 22781 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.319216 22635 raft_consensus.cc:697] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:31.320461 22781 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.322459 22781 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:31.321535 22635 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.324369 22592 ts_tablet_manager.cc:1403] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.212s	user 0.015s	sys 0.009s
I20260709 12:16:31.296473 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:31.335224 22677 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:31.340531 22594 raft_consensus.cc:359] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.341017 22592 raft_consensus.cc:359] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.341337 22594 raft_consensus.cc:385] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.341583 22592 raft_consensus.cc:385] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.341677 22594 raft_consensus.cc:740] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.342010 22592 raft_consensus.cc:740] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.344323 22592 consensus_queue.cc:260] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.342556 22594 consensus_queue.cc:260] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.328275 22705 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:16:31.328100 22654 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:16:31.352716 22594 ts_tablet_manager.cc:1434] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:16:31.353495 22594 tablet_bootstrap.cc:492] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:31.354104 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:31.365468 22592 ts_tablet_manager.cc:1434] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:16:31.366312 22592 tablet_bootstrap.cc:492] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:31.382467 22705 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.382792 22654 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:31.383057 22705 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:31.383567 22366 consensus_peers.cc:597] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:31.385351 22705 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:31.381652 22297 catalog_manager.cc:5697] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:31.356119 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:31.437986 22298 catalog_manager.cc:5697] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:31.448148 22788 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.448733 22788 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:31.438759 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 49066.7us
I20260709 12:16:31.452412 22822 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:31.462576 22592 tablet_bootstrap.cc:654] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.467410 22788 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:31.469745 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:31.470690 22475 raft_consensus.cc:2393] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 1: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:16:31.473274 22441 leader_election.cc:343] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.473990 22591 tablet_bootstrap.cc:492] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:31.474448 22591 ts_tablet_manager.cc:1403] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.290s	user 0.026s	sys 0.014s
I20260709 12:16:31.476732 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:31.478796 22788 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:31.480484 22442 leader_election.cc:343] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.481241 22442 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:31.482080 22781 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:31.483150 22441 leader_election.cc:343] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.496822 22594 tablet_bootstrap.cc:654] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.497893 22837 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.498378 22837 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.500391 22837 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:31.496205 22635 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.502421 22635 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.504758 22591 raft_consensus.cc:359] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.512326 22591 raft_consensus.cc:385] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.512673 22591 raft_consensus.cc:740] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.514519 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:31.493896 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:31.517417 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:31.513399 22591 consensus_queue.cc:260] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.540591 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:31.541208 22366 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:31.519706 22635 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:31.545792 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:31.549925 22782 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.544822 22591 ts_tablet_manager.cc:1434] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.002s
I20260709 12:16:31.554440 22591 tablet_bootstrap.cc:492] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
W20260709 12:16:31.556635 22442 leader_election.cc:343] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.557689 22442 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:31.558959 22781 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:31.576879 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:31.592741 22822 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.598028 22822 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:31.593118 22441 leader_election.cc:343] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.603220 22367 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:16:31.607844 22442 leader_election.cc:343] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.608054 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:31.600535 22822 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:31.621206 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:31.622144 22396 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 1: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:16:31.623974 22782 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:31.625311 22591 tablet_bootstrap.cc:654] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.632790 22635 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:31.635380 22594 tablet_bootstrap.cc:492] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:31.638355 22442 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:31.641605 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:31.644460 22595 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.652514 22592 tablet_bootstrap.cc:492] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:31.653031 22592 ts_tablet_manager.cc:1403] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.287s	user 0.011s	sys 0.011s
I20260709 12:16:31.654381 22595 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:31.637800 22594 ts_tablet_manager.cc:1403] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.284s	user 0.025s	sys 0.038s
I20260709 12:16:31.643065 22654 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:31.643672 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 50995.8us
I20260709 12:16:31.670631 22594 raft_consensus.cc:359] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.671340 22594 raft_consensus.cc:385] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.672549 22594 raft_consensus.cc:740] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.673231 22654 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:31.674685 22594 consensus_queue.cc:260] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.677227 22594 ts_tablet_manager.cc:1434] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:16:31.678205 22594 tablet_bootstrap.cc:492] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:31.683892 22594 tablet_bootstrap.cc:654] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.685379 22591 tablet_bootstrap.cc:492] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:31.685881 22591 ts_tablet_manager.cc:1403] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.133s	user 0.006s	sys 0.008s
I20260709 12:16:31.689360 22591 raft_consensus.cc:359] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.690078 22591 raft_consensus.cc:385] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.690338 22591 raft_consensus.cc:740] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.690878 22299 catalog_manager.cc:5697] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:31.693485 22592 raft_consensus.cc:359] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.694160 22592 raft_consensus.cc:385] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.694419 22592 raft_consensus.cc:740] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.694737 22594 tablet_bootstrap.cc:492] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:31.691134 22591 consensus_queue.cc:260] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.695144 22594 ts_tablet_manager.cc:1403] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:16:31.701260 22594 raft_consensus.cc:359] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.701989 22594 raft_consensus.cc:385] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.702263 22594 raft_consensus.cc:740] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.695043 22592 consensus_queue.cc:260] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.705329 22592 ts_tablet_manager.cc:1434] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:16:31.706720 22592 tablet_bootstrap.cc:492] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:31.696959 22591 ts_tablet_manager.cc:1434] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:16:31.709414 22591 tablet_bootstrap.cc:492] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:31.713835 22781 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:31.715375 22591 tablet_bootstrap.cc:654] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.715734 22595 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:31.717669 22782 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:31.702867 22594 consensus_queue.cc:260] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.719841 22594 ts_tablet_manager.cc:1434] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:16:31.720724 22594 tablet_bootstrap.cc:492] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:31.773432 22592 tablet_bootstrap.cc:654] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.782586 22594 tablet_bootstrap.cc:654] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.799978 22591 tablet_bootstrap.cc:492] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:31.800293 22551 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.800506 22591 ts_tablet_manager.cc:1403] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.091s	user 0.024s	sys 0.008s
I20260709 12:16:31.807902 22595 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:31.808410 22705 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:31.833573 22591 raft_consensus.cc:359] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.835336 22591 raft_consensus.cc:385] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.835669 22591 raft_consensus.cc:740] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.836483 22591 consensus_queue.cc:260] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.837815 22705 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.836858 22782 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:16:31.839150 22705 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.844821 22705 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:31.849706 22591 ts_tablet_manager.cc:1434] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 12:16:31.850960 22591 tablet_bootstrap.cc:492] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:31.853632 22592 tablet_bootstrap.cc:492] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:31.854173 22592 ts_tablet_manager.cc:1403] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.148s	user 0.039s	sys 0.015s
I20260709 12:16:31.854200 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:31.854514 22654 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:16:31.861363 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:31.862649 22854 log.cc:927] Time spent T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:16:31.863710 22441 leader_election.cc:343] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:31.867461 22852 log.cc:927] Time spent T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:16:31.879704 22366 consensus_peers.cc:597] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:31.894559 22347 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:31.895238 22788 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:31.906360 22543 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.911885 22591 tablet_bootstrap.cc:654] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.912138 22705 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.912720 22705 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.915527 22705 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:31.917258 22822 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.918869 22822 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.922869 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:31.926110 22441 leader_election.cc:343] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.928257 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:31.928947 22396 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:31.930194 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:31.931859 22516 leader_election.cc:343] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.938635 22442 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:31.945081 22822 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:31.941499 22705 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:31.945858 22705 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.946240 22705 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.947847 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:31.948531 22474 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:31.951634 22592 raft_consensus.cc:359] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.952504 22592 raft_consensus.cc:385] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.952767 22592 raft_consensus.cc:740] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.953390 22594 tablet_bootstrap.cc:492] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:31.953363 22592 consensus_queue.cc:260] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.954003 22594 ts_tablet_manager.cc:1403] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.233s	user 0.017s	sys 0.028s
I20260709 12:16:31.954784 22516 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:16:31.962369 22442 leader_election.cc:343] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.967005 22442 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:31.967825 22654 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:31.969623 22595 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:31.970127 22595 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.970494 22595 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.977139 22594 raft_consensus.cc:359] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.977905 22594 raft_consensus.cc:385] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.977507 22595 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.978173 22594 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.979086 22594 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:31.981045 22592 ts_tablet_manager.cc:1434] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.126s	user 0.009s	sys 0.002s
I20260709 12:16:31.982110 22592 tablet_bootstrap.cc:492] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:31.987347 22594 ts_tablet_manager.cc:1434] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.005s
I20260709 12:16:31.988306 22594 tablet_bootstrap.cc:492] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:31.989027 22595 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:31.996543 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:32.000012 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:16:32.000255 22516 leader_election.cc:343] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.000830 22474 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.009617 22591 tablet_bootstrap.cc:492] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:32.010291 22591 ts_tablet_manager.cc:1403] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.160s	user 0.012s	sys 0.007s
I20260709 12:16:32.013645 22592 tablet_bootstrap.cc:654] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.015664 22591 raft_consensus.cc:359] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.016309 22591 raft_consensus.cc:385] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.016510 22591 raft_consensus.cc:740] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.017053 22591 consensus_queue.cc:260] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.019065 22591 ts_tablet_manager.cc:1434] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:16:32.019997 22591 tablet_bootstrap.cc:492] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:32.021956 22705 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.028326 22705 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:32.027334 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:32.030721 22594 tablet_bootstrap.cc:654] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.032119 22400 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.037820 22591 tablet_bootstrap.cc:654] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.037973 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:16:32.045441 22441 leader_election.cc:343] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.044490 22595 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.046592 22595 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.048528 22595 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:32.049758 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:32.050542 22473 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:32.052769 22474 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:32.058419 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:32.059546 22516 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:32.060933 22592 tablet_bootstrap.cc:492] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:32.061049 22677 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:32.062089 22400 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:32.062278 22592 ts_tablet_manager.cc:1403] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.080s	user 0.019s	sys 0.015s
I20260709 12:16:32.061476 22822 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:32.063010 22822 raft_consensus.cc:697] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:32.063870 22822 consensus_queue.cc:237] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.064499 22592 raft_consensus.cc:359] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.064975 22592 raft_consensus.cc:385] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.065140 22592 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.065953 22592 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.067445 22591 tablet_bootstrap.cc:492] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:32.067541 22594 tablet_bootstrap.cc:492] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:32.068014 22592 ts_tablet_manager.cc:1434] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:16:32.068104 22594 ts_tablet_manager.cc:1403] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.080s	user 0.008s	sys 0.004s
I20260709 12:16:32.068118 22591 ts_tablet_manager.cc:1403] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.003s
I20260709 12:16:32.068941 22592 tablet_bootstrap.cc:492] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:32.069660 22442 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:32.070778 22705 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:32.070796 22594 raft_consensus.cc:359] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.071362 22705 raft_consensus.cc:697] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:32.071583 22594 raft_consensus.cc:385] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.062274 22677 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.071919 22594 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.072131 22677 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.072580 22594 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.072800 22705 consensus_queue.cc:237] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.074569 22594 ts_tablet_manager.cc:1434] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:32.075398 22594 tablet_bootstrap.cc:492] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:32.079541 22591 raft_consensus.cc:359] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.080237 22591 raft_consensus.cc:385] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.095377 22591 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.095219 22298 catalog_manager.cc:5697] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:32.080849 22594 tablet_bootstrap.cc:654] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.096110 22591 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.082175 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:32.098454 22591 ts_tablet_manager.cc:1434] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 12:16:32.086570 22677 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.098424 22397 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:32.099401 22591 tablet_bootstrap.cc:492] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:32.081969 22592 tablet_bootstrap.cc:654] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.099694 22705 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.100668 22677 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:32.097424 22297 catalog_manager.cc:5697] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:32.100509 22705 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.102131 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:32.102725 22474 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.104691 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:32.106087 22441 leader_election.cc:343] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.113505 22705 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:32.117030 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:32.118211 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:32.118829 22402 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.120275 22635 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.120729 22635 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:32.125053 22442 leader_election.cc:343] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.125598 22442 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:32.126272 22635 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:32.126798 22837 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:32.128999 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:32.129907 22474 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
W20260709 12:16:32.131878 22367 leader_election.cc:343] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.133886 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:32.135542 22366 leader_election.cc:343] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.136013 22366 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:32.136889 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:32.138078 22822 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:32.138624 22822 raft_consensus.cc:697] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:32.138739 22635 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:32.139590 22822 consensus_queue.cc:237] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.140933 22402 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:32.143414 22594 tablet_bootstrap.cc:492] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:32.143810 22594 ts_tablet_manager.cc:1403] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.069s	user 0.005s	sys 0.004s
I20260709 12:16:32.146442 22594 raft_consensus.cc:359] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.146939 22594 raft_consensus.cc:385] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.147140 22594 raft_consensus.cc:740] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.147675 22594 consensus_queue.cc:260] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.149318 22594 ts_tablet_manager.cc:1434] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:32.150436 22594 tablet_bootstrap.cc:492] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:32.160301 22591 tablet_bootstrap.cc:654] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.162205 22298 catalog_manager.cc:5697] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:32.174142 22594 tablet_bootstrap.cc:654] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.175488 22592 tablet_bootstrap.cc:492] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:32.175958 22592 ts_tablet_manager.cc:1403] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.107s	user 0.023s	sys 0.028s
I20260709 12:16:32.179123 22592 raft_consensus.cc:359] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.179818 22592 raft_consensus.cc:385] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.180084 22592 raft_consensus.cc:740] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.180722 22592 consensus_queue.cc:260] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.182811 22592 ts_tablet_manager.cc:1434] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:32.184064 22592 tablet_bootstrap.cc:492] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:32.188289 22591 tablet_bootstrap.cc:492] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:32.188941 22592 tablet_bootstrap.cc:654] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.189074 22591 ts_tablet_manager.cc:1403] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.090s	user 0.004s	sys 0.022s
I20260709 12:16:32.189795 22822 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.190274 22822 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.191762 22591 raft_consensus.cc:359] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.192416 22822 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:32.192412 22591 raft_consensus.cc:385] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.193377 22591 raft_consensus.cc:740] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.193992 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:32.194069 22591 consensus_queue.cc:260] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.198117 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:32.200978 22591 ts_tablet_manager.cc:1434] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.003s
I20260709 12:16:32.210155 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:32.210937 22822 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:32.213018 22822 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.213477 22822 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.215545 22822 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:32.216300 22592 tablet_bootstrap.cc:492] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:32.216867 22592 ts_tablet_manager.cc:1403] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.008s
I20260709 12:16:32.218780 22594 tablet_bootstrap.cc:492] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:32.219254 22594 ts_tablet_manager.cc:1403] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.006s
I20260709 12:16:32.219172 22592 raft_consensus.cc:359] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.219805 22592 raft_consensus.cc:385] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.220012 22592 raft_consensus.cc:740] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.220517 22592 consensus_queue.cc:260] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.222406 22592 ts_tablet_manager.cc:1434] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:16:32.222239 22594 raft_consensus.cc:359] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.223524 22594 raft_consensus.cc:385] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.223827 22594 raft_consensus.cc:740] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.224591 22594 consensus_queue.cc:260] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.225351 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:32.225517 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:32.225819 22592 tablet_bootstrap.cc:492] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:32.225992 22474 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:32.226161 22402 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:32.226760 22594 ts_tablet_manager.cc:1434] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:16:32.227175 22516 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:32.227936 22822 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:32.228286 22822 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.228615 22822 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.231926 22592 tablet_bootstrap.cc:654] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.233359 22594 tablet_bootstrap.cc:492] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:32.237669 22822 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.239992 22594 tablet_bootstrap.cc:654] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.238770 22591 tablet_bootstrap.cc:492] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:32.255211 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:32.255971 22474 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.263873 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:32.264578 22402 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.253641 22591 tablet_bootstrap.cc:654] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.272739 22402 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:32.287000 22516 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:32.288137 22677 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:32.288787 22677 raft_consensus.cc:697] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:32.289752 22677 consensus_queue.cc:237] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.274492 22474 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:32.274609 22837 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.276005 22822 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:32.294137 22837 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.298233 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:32.299377 22837 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:32.300592 22441 leader_election.cc:343] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.302368 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:32.303697 22442 leader_election.cc:343] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.304214 22442 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:32.305470 22837 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:32.306650 22837 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.307171 22837 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.312052 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:32.313876 22441 leader_election.cc:343] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.314538 22837 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:32.317009 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:32.321012 22442 leader_election.cc:343] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.321424 22442 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:32.322106 22594 tablet_bootstrap.cc:492] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:32.322268 22705 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:32.322667 22594 ts_tablet_manager.cc:1403] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.090s	user 0.039s	sys 0.034s
I20260709 12:16:32.324000 22592 tablet_bootstrap.cc:492] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:32.324470 22592 ts_tablet_manager.cc:1403] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.099s	user 0.032s	sys 0.039s
I20260709 12:16:32.325335 22594 raft_consensus.cc:359] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.326093 22594 raft_consensus.cc:385] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.326354 22594 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.326862 22592 raft_consensus.cc:359] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.327116 22594 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.327533 22592 raft_consensus.cc:385] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.327913 22592 raft_consensus.cc:740] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.328588 22592 consensus_queue.cc:260] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.331766 22591 tablet_bootstrap.cc:492] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:32.332381 22592 ts_tablet_manager.cc:1434] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:16:32.333316 22592 tablet_bootstrap.cc:492] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:32.333794 22591 ts_tablet_manager.cc:1403] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.132s	user 0.031s	sys 0.010s
I20260709 12:16:32.337028 22591 raft_consensus.cc:359] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.337847 22591 raft_consensus.cc:385] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.338169 22591 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.338867 22591 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.339651 22594 ts_tablet_manager.cc:1434] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:16:32.341292 22592 tablet_bootstrap.cc:654] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.341296 22591 ts_tablet_manager.cc:1434] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:32.342648 22591 tablet_bootstrap.cc:492] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:32.349725 22594 tablet_bootstrap.cc:492] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:32.353221 22591 tablet_bootstrap.cc:654] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.349884 22298 catalog_manager.cc:5697] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:32.353623 22677 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.354364 22677 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.356545 22677 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:32.357478 22594 tablet_bootstrap.cc:654] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.358593 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:32.359256 22474 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:32.360587 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:32.361531 22677 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:32.362038 22677 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.362553 22677 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.371122 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:32.372674 22516 leader_election.cc:343] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.376487 22837 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.377111 22837 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.379989 22677 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.383278 22592 tablet_bootstrap.cc:492] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:32.383795 22592 ts_tablet_manager.cc:1403] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.051s	user 0.030s	sys 0.015s
I20260709 12:16:32.383556 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:32.385561 22441 leader_election.cc:343] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.385864 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:32.386034 22837 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:32.386549 22400 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:32.387133 22592 raft_consensus.cc:359] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.387806 22592 raft_consensus.cc:385] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.388065 22592 raft_consensus.cc:740] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.388188 22594 tablet_bootstrap.cc:492] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:32.388662 22594 ts_tablet_manager.cc:1403] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.012s
I20260709 12:16:32.388696 22592 consensus_queue.cc:260] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.390918 22592 ts_tablet_manager.cc:1434] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:16:32.391809 22592 tablet_bootstrap.cc:492] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:32.392083 22442 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:32.393219 22837 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:32.392098 22782 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.394363 22782 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.395376 22594 raft_consensus.cc:359] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.396059 22635 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.396262 22594 raft_consensus.cc:385] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.393611 22837 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.398324 22592 tablet_bootstrap.cc:654] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.396644 22594 raft_consensus.cc:740] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.402750 22837 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.397555 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:32.403942 22474 raft_consensus.cc:2393] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 1: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:16:32.396615 22635 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.405478 22594 consensus_queue.cc:260] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.396344 22782 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:32.407618 22594 ts_tablet_manager.cc:1434] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:16:32.401912 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:32.409034 22594 tablet_bootstrap.cc:492] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:32.411151 22635 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:32.407482 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:32.412086 22474 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:32.412652 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:32.413340 22367 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:16:32.414264 22366 leader_election.cc:343] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.415220 22635 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:32.415643 22635 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.415997 22635 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:32.417318 22516 leader_election.cc:343] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.417644 22677 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:32.418790 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:32.419924 22474 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.398092 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:32.421490 22366 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:32.422333 22782 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.425151 22594 tablet_bootstrap.cc:654] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.425534 22654 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.426990 22654 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.428491 22635 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.429466 22654 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:32.430164 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:32.431048 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:32.434221 22442 leader_election.cc:343] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.434491 22474 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:32.435884 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:32.437036 22677 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:32.437554 22677 raft_consensus.cc:697] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:16:32.439555 22441 leader_election.cc:343] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.438478 22677 consensus_queue.cc:237] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.440219 22442 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:32.446306 22654 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:32.449839 22782 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:32.458753 22837 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.468454 22594 tablet_bootstrap.cc:492] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:32.468951 22594 ts_tablet_manager.cc:1403] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.060s	user 0.005s	sys 0.011s
I20260709 12:16:32.471913 22543 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.472201 22837 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:32.473233 22635 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:32.473366 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:32.476336 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:32.476976 22474 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.480369 22592 tablet_bootstrap.cc:492] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:32.480870 22592 ts_tablet_manager.cc:1403] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.089s	user 0.024s	sys 0.036s
W20260709 12:16:32.484045 22441 leader_election.cc:343] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.486084 22592 raft_consensus.cc:359] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.486924 22592 raft_consensus.cc:385] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.487280 22592 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.488065 22592 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.488281 22594 raft_consensus.cc:359] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.489337 22594 raft_consensus.cc:385] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.489670 22594 raft_consensus.cc:740] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.492136 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:32.492743 22400 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.496244 22591 tablet_bootstrap.cc:492] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:32.496822 22591 ts_tablet_manager.cc:1403] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.154s	user 0.012s	sys 0.014s
I20260709 12:16:32.487210 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:32.499799 22592 ts_tablet_manager.cc:1434] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:16:32.500823 22592 tablet_bootstrap.cc:492] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:32.500478 22591 raft_consensus.cc:359] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:32.501026 22366 leader_election.cc:343] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.501250 22591 raft_consensus.cc:385] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.501686 22591 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.502861 22297 catalog_manager.cc:5697] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:32.502475 22591 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.513036 22400 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:32.531682 22474 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:32.533227 22367 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:32.534824 22782 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:32.535390 22782 raft_consensus.cc:697] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:32.536298 22782 consensus_queue.cc:237] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.533363 22442 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:32.538782 22594 consensus_queue.cc:260] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.539240 22654 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:32.539772 22654 raft_consensus.cc:697] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:32.540616 22654 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.540966 22594 ts_tablet_manager.cc:1434] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.072s	user 0.002s	sys 0.004s
I20260709 12:16:32.542625 22594 tablet_bootstrap.cc:492] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:32.544761 22591 ts_tablet_manager.cc:1434] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.048s	user 0.022s	sys 0.009s
I20260709 12:16:32.554328 22591 tablet_bootstrap.cc:492] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:32.558480 22837 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:32.559033 22837 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.561113 22837 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:32.557997 22592 tablet_bootstrap.cc:654] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.562757 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:32.572630 22402 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 2: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:16:32.577558 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:32.578938 22545 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:16:32.582048 22441 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:32.583073 22705 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:32.583436 22705 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:32.583786 22705 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:32.586862 22837 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.587327 22837 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.589291 22837 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:32.591850 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:32.592103 22677 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:32.593473 22442 leader_election.cc:343] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.593513 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:32.593490 22705 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.598239 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:32.598984 22402 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 2: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:16:32.600428 22441 leader_election.cc:343] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.600991 22441 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:32.601917 22837 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:32.603958 22705 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:32.602757 22297 catalog_manager.cc:5697] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:32.607641 22298 catalog_manager.cc:5697] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:32.617738 22677 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:32.623540 22594 tablet_bootstrap.cc:654] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.632200 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:32.639449 22591 tablet_bootstrap.cc:654] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.649250 22705 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:32.671847 22592 tablet_bootstrap.cc:492] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:32.672300 22592 ts_tablet_manager.cc:1403] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.172s	user 0.007s	sys 0.011s
I20260709 12:16:32.673602 22677 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:16:32.682919 22592 raft_consensus.cc:359] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.686367 22592 raft_consensus.cc:385] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.686707 22592 raft_consensus.cc:740] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.687433 22592 consensus_queue.cc:260] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.701498 22677 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:16:32.705951 22441 consensus_peers.cc:597] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:32.707295 22545 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:16:32.708971 22441 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:32.710340 22654 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:32.711988 22654 raft_consensus.cc:697] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:32.712881 22654 consensus_queue.cc:237] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.716485 22592 ts_tablet_manager.cc:1434] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.044s	user 0.002s	sys 0.006s
I20260709 12:16:32.718361 22592 tablet_bootstrap.cc:492] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:32.741022 22594 tablet_bootstrap.cc:492] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:32.741564 22594 ts_tablet_manager.cc:1403] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.199s	user 0.011s	sys 0.012s
I20260709 12:16:32.754722 22594 raft_consensus.cc:359] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.757196 22594 raft_consensus.cc:385] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.757661 22594 raft_consensus.cc:740] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.769925 22595 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:32.769493 22298 catalog_manager.cc:5697] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 2, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:32.782320 22894 log.cc:927] Time spent T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:16:32.787811 22591 tablet_bootstrap.cc:492] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:32.786863 22594 consensus_queue.cc:260] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.789024 22591 ts_tablet_manager.cc:1403] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.243s	user 0.016s	sys 0.013s
I20260709 12:16:32.788056 22635 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.791501 22635 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.794167 22635 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:32.794456 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:32.795213 22477 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:32.795399 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:32.796576 22367 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:16:32.798640 22366 leader_election.cc:343] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.801793 22592 tablet_bootstrap.cc:654] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.802125 22635 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:32.803726 22635 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.804117 22635 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.806779 22594 ts_tablet_manager.cc:1434] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 12:16:32.808571 22594 tablet_bootstrap.cc:492] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:32.809959 22591 raft_consensus.cc:359] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.810822 22591 raft_consensus.cc:385] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.811115 22591 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.811767 22591 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.833065 22591 ts_tablet_manager.cc:1434] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:16:32.838883 22591 tablet_bootstrap.cc:492] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
W20260709 12:16:32.850461 22516 consensus_peers.cc:597] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:32.856360 22635 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.865476 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:32.866168 22474 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.879566 22635 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:32.884480 22474 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:32.877735 22890 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.887030 22367 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:32.892659 22890 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.893937 22782 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:32.894445 22782 raft_consensus.cc:697] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:32.894835 22890 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:32.895274 22782 consensus_queue.cc:237] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.898283 22591 tablet_bootstrap.cc:654] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.898566 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:32.901659 22594 tablet_bootstrap.cc:654] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.899873 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:32.903097 22550 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:32.905694 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:32.906559 22474 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:32.900857 22677 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:16:32.918278 22297 catalog_manager.cc:5697] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:32.920886 22905 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:16:32.918288 22366 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:16:32.921891 22366 leader_election.cc:343] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.924021 22890 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:32.924377 22890 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.924697 22890 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:32.932924 22366 consensus_peers.cc:597] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:32.934844 22890 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.937459 22822 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:32.939081 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:32.939536 22477 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.944733 22890 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:32.951247 22477 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:32.959406 22592 tablet_bootstrap.cc:492] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:32.959872 22592 ts_tablet_manager.cc:1403] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.242s	user 0.009s	sys 0.016s
I20260709 12:16:32.958884 22367 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:32.965080 22890 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:32.965595 22890 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:32.967423 22890 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:32.969422 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:32.970088 22545 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.986786 22594 tablet_bootstrap.cc:492] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:32.987350 22594 ts_tablet_manager.cc:1403] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.179s	user 0.013s	sys 0.003s
I20260709 12:16:32.992712 22591 tablet_bootstrap.cc:492] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:32.993237 22591 ts_tablet_manager.cc:1403] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.155s	user 0.014s	sys 0.006s
I20260709 12:16:32.992049 22837 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.999128 22837 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.006754 22837 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:33.007809 22550 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.008627 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:33.011324 22441 leader_election.cc:343] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.012108 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:33.008572 22545 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:33.018844 22837 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.020218 22592 raft_consensus.cc:359] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.020947 22592 raft_consensus.cc:385] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.021201 22592 raft_consensus.cc:740] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
W20260709 12:16:33.022374 22442 leader_election.cc:343] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.022826 22442 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:33.017669 22594 raft_consensus.cc:359] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.024353 22594 raft_consensus.cc:385] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.024643 22594 raft_consensus.cc:740] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.024569 22837 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:33.028352 22594 consensus_queue.cc:260] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.029876 22592 consensus_queue.cc:260] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.030933 22591 raft_consensus.cc:359] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.031579 22591 raft_consensus.cc:385] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.031845 22591 raft_consensus.cc:740] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.033021 22591 consensus_queue.cc:260] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.035072 22594 ts_tablet_manager.cc:1434] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:16:33.037792 22594 tablet_bootstrap.cc:492] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:33.040246 22591 ts_tablet_manager.cc:1434] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:16:33.041409 22591 tablet_bootstrap.cc:492] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:33.043064 22592 ts_tablet_manager.cc:1434] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.001s
I20260709 12:16:33.038146 22297 catalog_manager.cc:5697] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.043985 22592 tablet_bootstrap.cc:492] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:33.050189 22837 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.075042 22837 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:33.083962 22347 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:33.085800 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:33.089905 22442 leader_election.cc:343] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.098981 22837 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:33.102694 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:33.105021 22441 leader_election.cc:343] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.105515 22441 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:33.108978 22654 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:33.113307 22594 tablet_bootstrap.cc:654] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.113828 22591 tablet_bootstrap.cc:654] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.125123 22837 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:33.121590 22913 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.127665 22913 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.134522 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:33.139357 22592 tablet_bootstrap.cc:654] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.142045 22913 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:33.121920 22890 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.143553 22890 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.149349 22890 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:33.149540 22788 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:33.150913 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:33.152037 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:33.152666 22473 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
W20260709 12:16:33.152736 22366 leader_election.cc:343] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.153981 22788 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.154018 22367 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:33.154561 22788 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.155181 22890 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.155532 22890 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.155862 22890 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.156667 22788 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:33.158509 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:33.159401 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:33.160283 22550 raft_consensus.cc:2410] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:16:33.165078 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:33.168144 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:33.174048 22366 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:33.174482 22592 tablet_bootstrap.cc:492] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:33.176637 22592 ts_tablet_manager.cc:1403] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.133s	user 0.011s	sys 0.002s
I20260709 12:16:33.177688 22890 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.179857 22890 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:33.171379 22913 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:33.182263 22592 raft_consensus.cc:359] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.182976 22592 raft_consensus.cc:385] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.183248 22592 raft_consensus.cc:740] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.184142 22592 consensus_queue.cc:260] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.185243 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:33.185660 22594 tablet_bootstrap.cc:492] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:33.185844 22473 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.186141 22594 ts_tablet_manager.cc:1403] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.149s	user 0.020s	sys 0.009s
I20260709 12:16:33.187493 22891 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.187969 22891 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.188594 22594 raft_consensus.cc:359] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.190271 22891 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:33.191216 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:33.192639 22473 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:33.193202 22594 raft_consensus.cc:385] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.193550 22594 raft_consensus.cc:740] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.194319 22594 consensus_queue.cc:260] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.195080 22592 ts_tablet_manager.cc:1434] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:16:33.195780 22591 tablet_bootstrap.cc:492] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:33.196223 22591 ts_tablet_manager.cc:1403] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.155s	user 0.009s	sys 0.002s
I20260709 12:16:33.196460 22592 tablet_bootstrap.cc:492] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:33.196892 22367 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:33.197659 22788 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:33.198791 22591 raft_consensus.cc:359] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.191833 22474 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:33.199494 22591 raft_consensus.cc:385] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.200388 22788 raft_consensus.cc:697] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:33.201694 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:33.202610 22788 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.200875 22890 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:33.204102 22594 ts_tablet_manager.cc:1434] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:16:33.200722 22367 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:33.205044 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:33.208211 22366 leader_election.cc:343] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.208657 22890 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.199805 22591 raft_consensus.cc:740] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.209034 22890 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.209396 22890 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.209568 22591 consensus_queue.cc:260] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.210482 22550 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:33.216559 22890 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.218269 22591 ts_tablet_manager.cc:1434] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 12:16:33.219198 22591 tablet_bootstrap.cc:492] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:33.218503 22594 tablet_bootstrap.cc:492] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:33.225219 22890 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:33.227566 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:33.228188 22550 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.229132 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:33.229713 22474 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.232067 22592 tablet_bootstrap.cc:654] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.235280 22594 tablet_bootstrap.cc:654] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.239053 22591 tablet_bootstrap.cc:654] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.240675 22474 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:33.253412 22299 catalog_manager.cc:5697] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.236052 22550 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:33.257985 22366 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:33.259946 22788 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:33.260442 22788 raft_consensus.cc:697] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:33.261284 22788 consensus_queue.cc:237] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.266963 22594 tablet_bootstrap.cc:492] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:33.267055 22591 tablet_bootstrap.cc:492] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:33.267390 22592 tablet_bootstrap.cc:492] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:33.267590 22591 ts_tablet_manager.cc:1403] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.008s
I20260709 12:16:33.267836 22592 ts_tablet_manager.cc:1403] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.006s
I20260709 12:16:33.267491 22594 ts_tablet_manager.cc:1403] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.003s
I20260709 12:16:33.270196 22591 raft_consensus.cc:359] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.270380 22592 raft_consensus.cc:359] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.270987 22592 raft_consensus.cc:385] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.270927 22591 raft_consensus.cc:385] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.270901 22594 raft_consensus.cc:359] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.271431 22592 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.271555 22591 raft_consensus.cc:740] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.271754 22594 raft_consensus.cc:385] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.272156 22594 raft_consensus.cc:740] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.272306 22592 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.272598 22591 consensus_queue.cc:260] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.272913 22594 consensus_queue.cc:260] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.274784 22592 ts_tablet_manager.cc:1434] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:33.275682 22299 catalog_manager.cc:5697] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.280933 22591 ts_tablet_manager.cc:1434] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:16:33.281359 22594 ts_tablet_manager.cc:1434] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:16:33.282119 22591 tablet_bootstrap.cc:492] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:33.282315 22594 tablet_bootstrap.cc:492] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:33.288873 22594 tablet_bootstrap.cc:654] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.292107 22591 tablet_bootstrap.cc:654] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:33.292232 22366 consensus_peers.cc:597] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:33.293648 22545 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:33.295193 22889 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:33.305986 22402 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:33.307657 22889 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.306038 22592 tablet_bootstrap.cc:492] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:33.316783 22592 tablet_bootstrap.cc:654] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.327026 22591 tablet_bootstrap.cc:492] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:33.327518 22591 ts_tablet_manager.cc:1403] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.009s
I20260709 12:16:33.331722 22594 tablet_bootstrap.cc:492] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:33.331949 22592 tablet_bootstrap.cc:492] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:33.332340 22594 ts_tablet_manager.cc:1403] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.050s	user 0.025s	sys 0.008s
I20260709 12:16:33.332340 22592 ts_tablet_manager.cc:1403] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 12:16:33.335606 22594 raft_consensus.cc:359] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.335708 22592 raft_consensus.cc:359] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.336448 22594 raft_consensus.cc:385] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.336501 22592 raft_consensus.cc:385] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.336854 22594 raft_consensus.cc:740] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.337733 22594 consensus_queue.cc:260] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.339161 22591 raft_consensus.cc:359] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.339830 22591 raft_consensus.cc:385] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.340109 22591 raft_consensus.cc:740] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.340227 22594 ts_tablet_manager.cc:1434] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:16:33.340839 22591 consensus_queue.cc:260] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.341435 22594 tablet_bootstrap.cc:492] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:33.347469 22594 tablet_bootstrap.cc:654] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.348924 22591 ts_tablet_manager.cc:1434] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:16:33.358884 22591 tablet_bootstrap.cc:492] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:33.337009 22592 raft_consensus.cc:740] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.368316 22592 consensus_queue.cc:260] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.371191 22592 ts_tablet_manager.cc:1434] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:16:33.371934 22591 tablet_bootstrap.cc:654] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.374571 22592 tablet_bootstrap.cc:492] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:33.397132 22592 tablet_bootstrap.cc:654] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.399761 22594 tablet_bootstrap.cc:492] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:33.400295 22594 ts_tablet_manager.cc:1403] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.027s
I20260709 12:16:33.405355 22594 raft_consensus.cc:359] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.406162 22594 raft_consensus.cc:385] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.406462 22594 raft_consensus.cc:740] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.407164 22594 consensus_queue.cc:260] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.409260 22594 ts_tablet_manager.cc:1434] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:16:33.411301 22594 tablet_bootstrap.cc:492] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:33.411360 22592 tablet_bootstrap.cc:492] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:33.412014 22592 ts_tablet_manager.cc:1403] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.009s
I20260709 12:16:33.415133 22592 raft_consensus.cc:359] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.415979 22592 raft_consensus.cc:385] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.416244 22592 raft_consensus.cc:740] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.416803 22592 consensus_queue.cc:260] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.419767 22591 tablet_bootstrap.cc:492] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:33.420248 22591 ts_tablet_manager.cc:1403] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.005s
I20260709 12:16:33.422940 22592 ts_tablet_manager.cc:1434] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:16:33.423125 22594 tablet_bootstrap.cc:654] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.424279 22591 raft_consensus.cc:359] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.424945 22591 raft_consensus.cc:385] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.425203 22591 raft_consensus.cc:740] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.425866 22591 consensus_queue.cc:260] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.427270 22591 ts_tablet_manager.cc:1434] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:16:33.428121 22591 tablet_bootstrap.cc:492] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:33.433656 22592 tablet_bootstrap.cc:492] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:33.434382 22594 tablet_bootstrap.cc:492] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:33.434826 22594 ts_tablet_manager.cc:1403] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.004s
I20260709 12:16:33.437247 22594 raft_consensus.cc:359] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.437953 22594 raft_consensus.cc:385] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.438230 22594 raft_consensus.cc:740] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.438915 22594 consensus_queue.cc:260] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.434401 22591 tablet_bootstrap.cc:654] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.440240 22592 tablet_bootstrap.cc:654] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.443732 22594 ts_tablet_manager.cc:1434] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:16:33.444942 22594 tablet_bootstrap.cc:492] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:33.450580 22594 tablet_bootstrap.cc:654] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.452796 22788 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.453387 22788 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.454787 22904 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.455331 22904 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.457698 22904 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:33.459344 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:33.459314 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:33.462435 22477 raft_consensus.cc:2393] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 1: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:16:33.464334 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:33.465512 22904 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.474604 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:33.475379 22477 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:33.476344 22591 tablet_bootstrap.cc:492] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:33.476805 22591 ts_tablet_manager.cc:1403] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.003s
I20260709 12:16:33.477969 22594 tablet_bootstrap.cc:492] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:33.479427 22367 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:33.479522 22591 raft_consensus.cc:359] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.480268 22591 raft_consensus.cc:385] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.480546 22591 raft_consensus.cc:740] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.480620 22890 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.481098 22890 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.481362 22594 ts_tablet_manager.cc:1403] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.003s
I20260709 12:16:33.481496 22890 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.481216 22591 consensus_queue.cc:260] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.483601 22591 ts_tablet_manager.cc:1434] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:33.484494 22591 tablet_bootstrap.cc:492] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:33.484472 22594 raft_consensus.cc:359] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.485343 22594 raft_consensus.cc:385] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.485646 22594 raft_consensus.cc:740] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.486312 22594 consensus_queue.cc:260] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.488396 22594 ts_tablet_manager.cc:1434] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:33.489321 22594 tablet_bootstrap.cc:492] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:33.493468 22917 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.494064 22917 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.495431 22594 tablet_bootstrap.cc:654] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.496241 22913 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.496775 22913 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.498817 22913 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:33.500319 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:33.502723 22635 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:16:33.504021 22442 leader_election.cc:343] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.507349 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:33.508176 22594 tablet_bootstrap.cc:492] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:33.508675 22594 ts_tablet_manager.cc:1403] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.005s
W20260709 12:16:33.509128 22516 leader_election.cc:343] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.510102 22917 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:33.510409 22545 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.511644 22594 raft_consensus.cc:359] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.512486 22594 raft_consensus.cc:385] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.512812 22594 raft_consensus.cc:740] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.513490 22594 consensus_queue.cc:260] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.514042 22591 tablet_bootstrap.cc:654] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.516383 22594 ts_tablet_manager.cc:1434] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:33.517503 22594 tablet_bootstrap.cc:492] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:33.520640 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:33.521446 22472 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:33.523687 22594 tablet_bootstrap.cc:654] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.523787 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:33.524571 22550 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:33.526065 22441 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:33.526901 22917 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.527287 22917 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.527683 22917 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.528108 22591 tablet_bootstrap.cc:492] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:33.529062 22591 ts_tablet_manager.cc:1403] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.007s
I20260709 12:16:33.536815 22594 tablet_bootstrap.cc:492] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:33.537474 22594 ts_tablet_manager.cc:1403] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:16:33.533242 22591 raft_consensus.cc:359] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.538579 22591 raft_consensus.cc:385] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.538879 22591 raft_consensus.cc:740] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.540376 22594 raft_consensus.cc:359] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.541144 22594 raft_consensus.cc:385] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.541491 22594 raft_consensus.cc:740] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.542237 22591 consensus_queue.cc:260] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.542383 22594 consensus_queue.cc:260] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.544831 22594 ts_tablet_manager.cc:1434] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:16:33.544672 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:33.545207 22788 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:33.545441 22591 ts_tablet_manager.cc:1434] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
W20260709 12:16:33.546442 22366 leader_election.cc:343] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.546731 22591 tablet_bootstrap.cc:492] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:33.548348 22594 tablet_bootstrap.cc:492] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:33.550925 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:33.552127 22677 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.552486 22677 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.552821 22677 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.555038 22594 tablet_bootstrap.cc:654] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.555212 22591 tablet_bootstrap.cc:654] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.560316 22677 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.562541 22889 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.563158 22889 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.565431 22889 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:33.566270 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:33.568451 22442 leader_election.cc:343] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.565325 22591 tablet_bootstrap.cc:492] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:33.569314 22917 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.572479 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:33.573357 22635 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.573923 22635 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:33.575217 22442 leader_election.cc:343] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.575886 22635 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:33.569350 22591 ts_tablet_manager.cc:1403] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.006s
I20260709 12:16:33.579457 22591 raft_consensus.cc:359] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.580195 22591 raft_consensus.cc:385] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.580456 22591 raft_consensus.cc:740] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.586560 22591 consensus_queue.cc:260] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.587142 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:33.590823 22677 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:33.595181 22837 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.605896 22837 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.608155 22837 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:33.613854 22677 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.614485 22677 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.592573 22889 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.587747 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:33.666234 22591 ts_tablet_manager.cc:1434] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.001s
I20260709 12:16:33.669173 22591 tablet_bootstrap.cc:492] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:33.676487 22677 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:33.677023 22677 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.677580 22677 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.628307 22917 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:33.681447 22677 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:33.685211 22594 tablet_bootstrap.cc:492] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:33.685830 22594 ts_tablet_manager.cc:1403] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.138s	user 0.018s	sys 0.003s
I20260709 12:16:33.633939 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:33.689299 22945 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.675678 22782 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.698689 22654 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.699201 22654 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.700261 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:33.700368 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:33.700665 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:33.700985 22543 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.703161 22654 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:33.699888 22594 raft_consensus.cc:359] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.705214 22594 raft_consensus.cc:385] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.705453 22594 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.672501 22889 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.696707 22782 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.706051 22594 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.712374 22472 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.713296 22890 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.732386 22890 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:33.718324 22904 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:33.722862 22516 leader_election.cc:343] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:33.719907 22441 leader_election.cc:343] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.736713 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:33.737442 22837 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:33.737807 22441 leader_election.cc:343] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.721971 22949 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:16:33.734076 22594 ts_tablet_manager.cc:1434] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.003s
I20260709 12:16:33.695623 22945 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:33.747696 22889 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:33.741591 22472 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:33.750975 22592 tablet_bootstrap.cc:492] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:33.751466 22592 ts_tablet_manager.cc:1403] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.318s	user 0.051s	sys 0.124s
I20260709 12:16:33.753098 22594 tablet_bootstrap.cc:492] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:33.756947 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:33.758806 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:33.765657 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 60041.3us
I20260709 12:16:33.766448 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:33.766455 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:33.768077 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:33.769407 22441 leader_election.cc:343] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.769435 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:33.770233 22472 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:33.878542 22442 leader_election.cc:343] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.879436 22442 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:33.763859 22904 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:33.915851 22782 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:33.886767 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:33.891289 22904 raft_consensus.cc:697] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:16:34.065830 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 187380us
I20260709 12:16:34.066093 22591 tablet_bootstrap.cc:700] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932: Time spent opening tablet: real 0.136s	user 0.007s	sys 0.006s
I20260709 12:16:34.057454 22837 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:34.068342 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:34.069108 22591 tablet_bootstrap.cc:654] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:34.066860 22475 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
W20260709 12:16:34.066619 22442 leader_election.cc:343] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.881312 22654 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.071734 22945 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:34.056959 22543 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:34.072082 22904 consensus_queue.cc:237] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.056936 22594 tablet_bootstrap.cc:654] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:34.080305 22654 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.102479 22654 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:34.104592 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:34.105938 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:34.115388 22441 leader_election.cc:343] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:34.116187 22441 leader_election.cc:343] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:34.116079 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:34.118010 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:34.123538 22441 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:34.134902 22913 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.142551 22953 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:34.147413 22472 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:34.141563 22913 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.150128 22953 raft_consensus.cc:697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:34.170683 22913 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:34.168742 22953 consensus_queue.cc:237] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.171785 22550 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:34.176185 22347 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:34.190549 22959 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.191219 22959 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.192793 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:34.194851 22959 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:34.213073 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:34.215217 22441 leader_election.cc:343] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:34.219470 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:34.220607 22594 tablet_bootstrap.cc:492] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:34.222136 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:34.222581 22594 ts_tablet_manager.cc:1403] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.480s	user 0.039s	sys 0.010s
I20260709 12:16:34.222802 22546 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:34.224372 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:16:34.225112 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 455096us
I20260709 12:16:34.226514 22594 raft_consensus.cc:359] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.228549 22594 raft_consensus.cc:385] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:34.229242 22594 raft_consensus.cc:740] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.230268 22594 consensus_queue.cc:260] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.233716 22516 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:34.225025 22472 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
W20260709 12:16:34.236475 22961 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
I20260709 12:16:34.236828 22949 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.237283 22949 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.224838 22441 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:34.248546 22945 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:34.248984 22945 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:34.249318 22945 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:34.262827 22594 ts_tablet_manager.cc:1434] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.002s
I20260709 12:16:34.263793 22949 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:34.264014 22822 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:34.264797 22594 tablet_bootstrap.cc:492] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:34.266563 22516 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:34.263145 22592 raft_consensus.cc:359] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.267319 22592 raft_consensus.cc:385] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:34.267611 22592 raft_consensus.cc:740] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.268278 22592 consensus_queue.cc:260] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.263795 22591 tablet_bootstrap.cc:492] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:34.269603 22591 ts_tablet_manager.cc:1403] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.602s	user 0.013s	sys 0.018s
I20260709 12:16:34.270746 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:34.274441 22366 leader_election.cc:343] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:34.275251 22592 ts_tablet_manager.cc:1434] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.524s	user 0.010s	sys 0.018s
I20260709 12:16:34.275663 22949 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:34.279714 22594 tablet_bootstrap.cc:654] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:34.283233 22592 ts_tablet_manager.cc:1467] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1: Tablet startup took 531ms
W20260709 12:16:34.284546 22592 ts_tablet_manager.cc:1469] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1: Trace:
0709 12:16:26.877911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:26.899391 (+ 21480us) service_pool.cc:224] Handling call
0709 12:16:26.901549 (+  2158us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:26.901635 (+    86us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:26.946641 (+ 45006us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:27.126198 (+179557us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:27.184699 (+ 58501us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a301a2 00007fb4fe971889 00007fb4fdaa2d88 00007fb4fdb69973 00007fb4fdb6570f 00007fb4fdb65ecd 00007fb4fdb14400 00007fb4f6f99af4 00007fb4f6f99a82
0709 12:16:27.185015 (+   316us) inbound_call.cc:177] Queueing success response
0709 12:16:33.433339 (+6248324us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:16:33.751718 (+318379us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:16:34.065983 (+314265us) tablet_replica.cc:261] Starting instrumentation
0709 12:16:34.066486 (+   503us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":171077,"raft.queue_time_us":4764,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"spinlock_wait_cycles":29183232,"tablet-open.queue_time_us":6248423}
I20260709 12:16:34.287293 22592 tablet_bootstrap.cc:492] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:34.293188 22592 tablet_bootstrap.cc:654] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:34.295172 22594 tablet_bootstrap.cc:492] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:34.295667 22594 ts_tablet_manager.cc:1403] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.011s
W20260709 12:16:34.297472 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 72765.9us
I20260709 12:16:34.297837 22594 raft_consensus.cc:359] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.298429 22594 raft_consensus.cc:385] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:34.298632 22594 raft_consensus.cc:740] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.299134 22594 consensus_queue.cc:260] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.302539 22594 ts_tablet_manager.cc:1434] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:34.303687 22594 tablet_bootstrap.cc:492] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
W20260709 12:16:34.276201 22366 leader_election.cc:343] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:34.277431 22442 leader_election.cc:343] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:34.279759 22591 raft_consensus.cc:359] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.304939 22591 raft_consensus.cc:385] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:34.304900 22442 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:34.305320 22591 raft_consensus.cc:740] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.305979 22591 consensus_queue.cc:260] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.281461 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:16:34.281952 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 55751.4us
I20260709 12:16:34.307772 22367 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:34.308772 22592 tablet_bootstrap.cc:492] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
W20260709 12:16:34.309082 22366 leader_election.cc:343] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:34.309237 22592 ts_tablet_manager.cc:1403] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
I20260709 12:16:34.309528 22591 ts_tablet_manager.cc:1434] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 12:16:34.309746 22959 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:34.310397 22591 tablet_bootstrap.cc:492] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:34.312357 22965 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:34.312585 22592 raft_consensus.cc:359] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.313300 22594 tablet_bootstrap.cc:654] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:34.313436 22592 raft_consensus.cc:385] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:34.314702 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:34.315232 22592 raft_consensus.cc:740] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.315877 22592 consensus_queue.cc:260] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.316745 22951 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:34.317126 22951 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:34.317457 22951 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:34.318094 22592 ts_tablet_manager.cc:1434] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:16:34.319121 22592 tablet_bootstrap.cc:492] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:34.312800 22965 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:34.321514 22965 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:34.323807 22399 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:34.324713 22592 tablet_bootstrap.cc:654] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:34.325129 22594 tablet_bootstrap.cc:492] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:34.325567 22594 ts_tablet_manager.cc:1403] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.004s
I20260709 12:16:34.328210 22594 raft_consensus.cc:359] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.328913 22594 raft_consensus.cc:385] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:34.329173 22594 raft_consensus.cc:740] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.315814 22367 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:34.330122 22594 consensus_queue.cc:260] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.332685 22594 ts_tablet_manager.cc:1434] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:34.333285 22948 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:34.333925 22948 raft_consensus.cc:697] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:34.334887 22594 tablet_bootstrap.cc:492] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:34.334807 22948 consensus_queue.cc:237] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.343078 22592 tablet_bootstrap.cc:492] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:34.343641 22592 ts_tablet_manager.cc:1403] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.013s
I20260709 12:16:34.345008 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:34.345912 22965 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.346159 22592 raft_consensus.cc:359] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.346846 22592 raft_consensus.cc:385] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:34.347208 22592 raft_consensus.cc:740] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.347303 22472 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:34.347898 22592 consensus_queue.cc:260] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.349675 22592 ts_tablet_manager.cc:1434] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:34.351536 22592 tablet_bootstrap.cc:492] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:34.353181 22951 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.358076 22592 tablet_bootstrap.cc:654] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:34.358937 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:34.357959 22965 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:34.365734 22951 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:34.367089 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:34.375952 22401 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:34.377719 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:34.381521 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:34.384642 22551 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:34.384912 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:34.395516 22949 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:34.367637 22945 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.369509 22591 tablet_bootstrap.cc:654] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:34.371891 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:34.372677 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:34.372717 22594 tablet_bootstrap.cc:654] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:34.424666 22477 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 1: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:16:34.428318 22945 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:34.431810 22366 leader_election.cc:343] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:34.435647 22367 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:34.440366 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:34.440937 22474 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:34.444037 22442 leader_election.cc:343] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:34.444538 22442 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:16:34.447304 22442 leader_election.cc:343] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:34.447706 22442 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:34.437747 22945 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.445834 22890 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:34.473172 22474 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:34.460253 22654 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:34.478618 22952 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:34.461715 22945 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.479970 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:34.462536 22955 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:16:34.440155 22891 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:16:34.462139 22890 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:34.484566 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:34.488670 22592 tablet_bootstrap.cc:492] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:34.490955 22890 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:34.491411 22951 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:34.489682 22400 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:34.494539 22591 tablet_bootstrap.cc:492] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:34.495565 22592 ts_tablet_manager.cc:1403] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.145s	user 0.037s	sys 0.040s
I20260709 12:16:34.496987 22591 ts_tablet_manager.cc:1403] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.187s	user 0.026s	sys 0.013s
W20260709 12:16:34.498848 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 44938.3us
I20260709 12:16:34.518070 22594 tablet_bootstrap.cc:492] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:34.518625 22594 ts_tablet_manager.cc:1403] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.184s	user 0.013s	sys 0.013s
I20260709 12:16:34.522347 22299 catalog_manager.cc:5697] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:34.528527 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 89892.3us
W20260709 12:16:34.528599 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 74458.4us
W20260709 12:16:34.529028 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 87291us
I20260709 12:16:34.534713 22592 raft_consensus.cc:359] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.536387 22592 raft_consensus.cc:385] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:34.536659 22592 raft_consensus.cc:740] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.536821 22367 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:34.541597 22592 consensus_queue.cc:260] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:34.546628 22442 leader_election.cc:343] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:34.547043 22442 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:34.549923 22960 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:34.551170 22592 ts_tablet_manager.cc:1434] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.001s
I20260709 12:16:34.552137 22367 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:34.553525 22592 tablet_bootstrap.cc:492] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:34.554183 22957 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:34.528609 22822 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:34.554550 22788 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:34.561511 22958 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.562527 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:34.562093 22958 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.574095 22594 raft_consensus.cc:359] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.667447 22594 raft_consensus.cc:385] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:34.601089 22955 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.568727 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:34.659734 22951 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.567301 22788 raft_consensus.cc:697] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:34.650594 22890 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.635113 22298 catalog_manager.cc:5697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:34.573925 22591 raft_consensus.cc:359] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.671566 22955 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.607663 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:34.573372 22400 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:34.683486 22591 raft_consensus.cc:385] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:34.686777 22591 raft_consensus.cc:740] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.687477 22591 consensus_queue.cc:260] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.671927 22951 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.685382 22394 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:34.685231 22955 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:34.683955 22788 consensus_queue.cc:237] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.573931 22945 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:34.688055 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:16:34.669538 22594 raft_consensus.cc:740] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.692101 22551 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 1: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:16:34.694993 22677 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:34.695441 22677 raft_consensus.cc:697] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:34.696039 22677 consensus_queue.cc:237] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.701239 22591 ts_tablet_manager.cc:1434] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.204s	user 0.008s	sys 0.008s
I20260709 12:16:34.694646 22397 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:34.776778 22594 consensus_queue.cc:260] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.780400 22591 tablet_bootstrap.cc:492] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
W20260709 12:16:34.785337 22441 leader_election.cc:343] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:34.786142 22441 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:34.787672 22594 ts_tablet_manager.cc:1434] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.269s	user 0.008s	sys 0.014s
I20260709 12:16:34.788425 22594 tablet_bootstrap.cc:492] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2: Bootstrap starting.
I20260709 12:16:34.783784 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:34.789889 22705 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:34.807250 22472 raft_consensus.cc:2393] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 1: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:16:34.807384 22950 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.807895 22950 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:34.812511 22442 consensus_peers.cc:597] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:34.813239 22442 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:34.815164 22952 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:34.822489 22952 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:34.822860 22952 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:34.804476 22951 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:34.827143 22950 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:34.831511 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:34.831557 22890 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:34.840845 22654 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:34.839833 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:34.818112 22953 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.824041 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:34.905435 22591 tablet_bootstrap.cc:654] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:34.906050 22994 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.867908 22953 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.911747 22592 tablet_bootstrap.cc:654] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:34.896281 22962 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.052s
I20260709 12:16:34.920251 22953 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:34.906697 22994 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.928221 22994 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:34.958045 22594 tablet_bootstrap.cc:654] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:34.965938 22592 tablet_bootstrap.cc:492] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:34.966416 22592 ts_tablet_manager.cc:1403] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.413s	user 0.029s	sys 0.015s
I20260709 12:16:34.948081 22952 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.968643 22958 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:34.970898 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:34.976081 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 114389us
I20260709 12:16:34.977617 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:34.984721 22477 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:34.970921 22952 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:34.989250 22477 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:34.990445 22591 tablet_bootstrap.cc:492] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:34.990849 22591 ts_tablet_manager.cc:1403] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.213s	user 0.021s	sys 0.000s
I20260709 12:16:34.990700 22592 raft_consensus.cc:359] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.992743 22592 raft_consensus.cc:385] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:34.993074 22592 raft_consensus.cc:740] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.976428 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:34.991071 22971 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.995142 22592 consensus_queue.cc:260] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.002193 22472 raft_consensus.cc:2393] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 1: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:16:35.008549 22591 raft_consensus.cc:359] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.009276 22591 raft_consensus.cc:385] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:35.013077 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:35.018168 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:35.019155 22475 raft_consensus.cc:2393] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 1: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:16:35.009543 22591 raft_consensus.cc:740] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.022858 22591 consensus_queue.cc:260] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:34.997488 22971 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.032300 22971 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:35.033252 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:35.041208 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 46621.3us
I20260709 12:16:35.023007 22400 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
W20260709 12:16:35.046211 22366 leader_election.cc:343] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:35.046924 22366 leader_election.cc:343] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:35.047086 22442 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:35.048030 22297 catalog_manager.cc:5697] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:35.053722 22591 ts_tablet_manager.cc:1434] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.001s
I20260709 12:16:35.054559 22591 tablet_bootstrap.cc:492] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:35.055228 22594 tablet_bootstrap.cc:492] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2: No bootstrap required, opened a new log
I20260709 12:16:35.055725 22594 ts_tablet_manager.cc:1403] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2: Time spent bootstrapping tablet: real 0.267s	user 0.013s	sys 0.003s
I20260709 12:16:35.058440 22594 raft_consensus.cc:359] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.058992 22591 tablet_bootstrap.cc:654] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:35.059533 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:35.060156 22548 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:35.062096 22366 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:35.066847 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:35.067967 22367 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:35.069203 22367 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:35.059180 22594 raft_consensus.cc:385] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:35.071142 22594 raft_consensus.cc:740] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.074939 22677 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:35.079967 22951 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:35.080962 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:35.062378 22958 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:35.083302 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:35.083039 22594 consensus_queue.cc:260] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.085477 22958 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:35.087515 22543 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:35.092356 22441 leader_election.cc:343] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:35.084547 22971 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:35.109318 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:35.110824 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:35.112687 22366 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:35.084856 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:35.116462 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:35.120783 22594 ts_tablet_manager.cc:1434] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 12:16:35.095975 22951 raft_consensus.cc:697] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:35.099009 22958 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:35.121701 22592 ts_tablet_manager.cc:1434] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.155s	user 0.022s	sys 0.021s
I20260709 12:16:35.124542 22951 consensus_queue.cc:237] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.125947 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:35.129241 22441 leader_election.cc:343] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:35.130087 22441 leader_election.cc:343] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:35.115515 22788 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:35.129176 22592 tablet_bootstrap.cc:492] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:35.118436 22471 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
W20260709 12:16:35.140252 22441 leader_election.cc:343] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:35.144860 22635 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:35.153600 22442 leader_election.cc:343] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:35.154137 22442 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:16:35.155236 22442 leader_election.cc:343] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:35.155611 22442 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:35.156908 22994 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:35.158389 22994 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:35.140177 22990 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:35.159446 22990 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:35.161973 22990 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:35.167052 22971 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:35.198194 22913 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:35.200238 22958 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.204512 22958 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:35.195127 22990 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.200356 22788 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 12:16:35.215296 22347 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:35.219038 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:35.219741 22399 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:35.220757 22591 tablet_bootstrap.cc:492] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:35.221283 22591 ts_tablet_manager.cc:1403] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.167s	user 0.012s	sys 0.000s
I20260709 12:16:35.226213 22591 raft_consensus.cc:359] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.226969 22591 raft_consensus.cc:385] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:35.227224 22591 raft_consensus.cc:740] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.227460 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:35.227898 22591 consensus_queue.cc:260] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.231177 22399 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:35.232393 22591 ts_tablet_manager.cc:1434] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:16:35.233335 22591 tablet_bootstrap.cc:492] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:35.233572 22990 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:35.234956 22442 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:35.235985 22654 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:35.236455 22654 raft_consensus.cc:697] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:35.237088 22654 consensus_queue.cc:237] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.238256 22400 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
W20260709 12:16:35.241586 22441 leader_election.cc:343] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:35.258205 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:35.275353 22469 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:35.276744 22442 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:35.260087 22543 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:35.285066 22958 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:35.299998 22592 tablet_bootstrap.cc:654] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:35.307371 22591 tablet_bootstrap.cc:654] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:35.295680 22958 raft_consensus.cc:697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:35.315907 22962 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:35.317402 22958 consensus_queue.cc:237] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.376515 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:35.378333 22547 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:35.398070 22469 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:35.402979 22635 consensus_queue.cc:1048] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:35.424423 22677 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:35.435273 22297 catalog_manager.cc:5697] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:35.440609 22889 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.455063 22889 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.464485 22889 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:35.466856 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:35.471200 22592 tablet_bootstrap.cc:492] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:35.493291 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:35.489521 22677 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.494966 22677 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.500658 22592 ts_tablet_manager.cc:1403] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.372s	user 0.007s	sys 0.012s
I20260709 12:16:35.500559 22299 catalog_manager.cc:5697] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:35.531742 22441 leader_election.cc:343] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:35.536131 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 57062.2us
I20260709 12:16:35.537962 22677 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:16:35.536286 22442 leader_election.cc:343] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:35.544646 22367 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:35.547297 22592 raft_consensus.cc:359] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.550818 22592 raft_consensus.cc:385] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:35.551333 22592 raft_consensus.cc:740] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.550455 22635 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:35.552026 22635 raft_consensus.cc:697] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:35.553275 22635 consensus_queue.cc:237] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.559795 22591 tablet_bootstrap.cc:492] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:35.560108 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:35.561203 22470 raft_consensus.cc:2393] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 1: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:16:35.561036 22591 ts_tablet_manager.cc:1403] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.328s	user 0.017s	sys 0.008s
I20260709 12:16:35.552066 22592 consensus_queue.cc:260] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.567286 22592 ts_tablet_manager.cc:1434] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.066s	user 0.002s	sys 0.007s
I20260709 12:16:35.564231 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:35.568634 22592 tablet_bootstrap.cc:492] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:35.589720 22442 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:35.590736 22543 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:35.587769 22298 catalog_manager.cc:5697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:35.594555 22591 raft_consensus.cc:359] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.595031 22705 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:35.595327 22591 raft_consensus.cc:385] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:35.595603 22591 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
W20260709 12:16:35.596050 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 82959.2us
I20260709 12:16:35.596319 22591 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.592331 22298 catalog_manager.cc:5697] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:35.598600 22591 ts_tablet_manager.cc:1434] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 12:16:35.599829 22591 tablet_bootstrap.cc:492] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:35.587797 22547 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:35.621470 22788 consensus_queue.cc:1048] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:35.636299 22990 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:35.639138 22516 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:35.674450 22591 tablet_bootstrap.cc:654] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:35.681429 22965 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:35.684588 22990 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:35.705703 22592 tablet_bootstrap.cc:654] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:35.725904 22994 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:35.730006 22299 catalog_manager.cc:5697] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:35.734123 22299 catalog_manager.cc:5697] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:35.738076 22441 consensus_peers.cc:597] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:35.742241 22591 tablet_bootstrap.cc:492] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:35.742645 22591 ts_tablet_manager.cc:1403] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.143s	user 0.012s	sys 0.004s
I20260709 12:16:35.784786 22591 raft_consensus.cc:359] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.785585 22591 raft_consensus.cc:385] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:35.785884 22591 raft_consensus.cc:740] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.786639 22591 consensus_queue.cc:260] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.788341 22591 ts_tablet_manager.cc:1434] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.046s	user 0.003s	sys 0.002s
I20260709 12:16:35.789642 22591 tablet_bootstrap.cc:492] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:35.800058 22990 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.800465 22994 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.800581 22990 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.800944 22994 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.802977 22990 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:35.807015 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:35.808449 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:35.813758 22366 leader_election.cc:343] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:35.803014 22994 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:35.815402 22442 leader_election.cc:343] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:35.820907 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:35.821615 22469 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:35.826155 22992 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:35.826587 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:35.831030 22367 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:35.834877 22990 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:35.835307 22990 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:35.835705 22990 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:35.837330 22441 leader_election.cc:343] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:35.837925 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:35.838696 22889 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:35.840090 22591 tablet_bootstrap.cc:654] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:35.842216 22994 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.842756 22994 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:35.844813 22441 consensus_peers.cc:597] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:35.851922 22994 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:35.856604 22592 tablet_bootstrap.cc:492] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:35.857899 22592 ts_tablet_manager.cc:1403] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.290s	user 0.009s	sys 0.011s
I20260709 12:16:35.853693 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:35.860989 22442 leader_election.cc:343] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:35.862824 22990 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.866215 22592 raft_consensus.cc:359] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.866971 22592 raft_consensus.cc:385] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:35.867235 22592 raft_consensus.cc:740] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.867332 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:35.867900 22549 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 0.
I20260709 12:16:35.868605 22592 consensus_queue.cc:260] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.870399 22441 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:35.871388 22592 ts_tablet_manager.cc:1434] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:16:35.880851 22889 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:35.881271 22889 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:35.881592 22889 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:35.882485 22592 tablet_bootstrap.cc:492] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:35.888810 22592 tablet_bootstrap.cc:654] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:35.888994 22889 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.890522 22990 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:35.892313 22889 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:35.893002 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:35.893600 22591 tablet_bootstrap.cc:492] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:35.894071 22591 ts_tablet_manager.cc:1403] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.005s
W20260709 12:16:35.894348 22442 leader_election.cc:343] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:35.894981 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:16:35.896100 22366 leader_election.cc:343] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:35.897106 22591 raft_consensus.cc:359] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.898135 22591 raft_consensus.cc:385] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:35.898427 22591 raft_consensus.cc:740] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.898432 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:35.899106 22469 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:35.899175 22591 consensus_queue.cc:260] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.901327 22591 ts_tablet_manager.cc:1434] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:16:35.902369 22591 tablet_bootstrap.cc:492] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:35.904191 22469 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:35.905962 22367 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:35.906949 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:35.907570 22543 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:35.906989 22990 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:35.913695 22990 raft_consensus.cc:697] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:35.914551 22990 consensus_queue.cc:237] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.918884 22591 tablet_bootstrap.cc:654] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:35.918965 22543 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:35.920720 22441 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:35.921859 22992 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:35.922369 22992 raft_consensus.cc:697] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:35.923338 22992 consensus_queue.cc:237] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.925283 22592 tablet_bootstrap.cc:492] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:35.925812 22592 ts_tablet_manager.cc:1403] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.006s
I20260709 12:16:35.928422 22592 raft_consensus.cc:359] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.929113 22592 raft_consensus.cc:385] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:35.929391 22592 raft_consensus.cc:740] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.929697 22965 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.930262 22965 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.940388 22592 consensus_queue.cc:260] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.945727 22965 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:35.946771 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:35.947469 22477 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:35.948614 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:35.949380 22965 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:35.949720 22965 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:35.950071 22965 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:35.956398 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:35.957080 22400 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:35.969498 22592 ts_tablet_manager.cc:1434] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.043s	user 0.002s	sys 0.004s
I20260709 12:16:35.972116 22592 tablet_bootstrap.cc:492] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:35.973681 22591 tablet_bootstrap.cc:492] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:35.975188 22591 ts_tablet_manager.cc:1403] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.073s	user 0.020s	sys 0.016s
I20260709 12:16:35.966037 22965 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.989887 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:35.989601 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:35.990456 22477 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:35.990489 22400 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:35.991806 22591 raft_consensus.cc:359] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.992491 22591 raft_consensus.cc:385] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:35.992794 22591 raft_consensus.cc:740] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.993487 22591 consensus_queue.cc:260] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:35.998844 22477 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:35.998728 22298 catalog_manager.cc:5697] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.000183 22591 ts_tablet_manager.cc:1434] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:16:36.001505 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:36.002324 22950 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:36.002774 22950 raft_consensus.cc:697] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:36.003530 22950 consensus_queue.cc:237] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.004195 22400 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:36.005501 22299 catalog_manager.cc:5697] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.001231 22591 tablet_bootstrap.cc:492] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:36.008051 22592 tablet_bootstrap.cc:654] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:36.010785 22965 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:36.013912 22591 tablet_bootstrap.cc:654] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:36.027457 22299 catalog_manager.cc:5697] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:36.031641 22592 tablet_bootstrap.cc:492] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:36.032156 22592 ts_tablet_manager.cc:1403] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.001s
I20260709 12:16:36.035297 22592 raft_consensus.cc:359] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.036005 22592 raft_consensus.cc:385] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:36.036265 22592 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.036921 22592 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.039177 22592 ts_tablet_manager.cc:1434] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:16:36.040772 22591 tablet_bootstrap.cc:492] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:36.041381 22591 ts_tablet_manager.cc:1403] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.000s
I20260709 12:16:36.044099 22591 raft_consensus.cc:359] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.044790 22591 raft_consensus.cc:385] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:36.045789 22592 tablet_bootstrap.cc:492] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:36.051705 22592 tablet_bootstrap.cc:654] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:36.051859 22950 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:36.060993 22592 tablet_bootstrap.cc:492] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:36.061695 22592 ts_tablet_manager.cc:1403] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.003s
I20260709 12:16:36.052403 22950 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.062887 22965 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:36.063369 22965 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.065340 22965 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:36.065400 22950 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:36.066704 22591 raft_consensus.cc:740] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.067153 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:36.067778 22469 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:36.068785 22592 raft_consensus.cc:359] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.069465 22592 raft_consensus.cc:385] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:36.069715 22592 raft_consensus.cc:740] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.069830 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:36.070511 22592 consensus_queue.cc:260] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.070848 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:36.071365 22400 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:36.071470 22393 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:36.072233 22591 consensus_queue.cc:260] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.074047 22591 ts_tablet_manager.cc:1434] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:16:36.076112 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:36.077045 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:36.077196 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:36.077857 22950 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:36.077908 22477 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:36.078356 22950 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:36.078732 22950 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.079690 22591 tablet_bootstrap.cc:492] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:36.079501 23010 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:36.080803 22592 ts_tablet_manager.cc:1434] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:16:36.084486 22965 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:36.084951 22965 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:36.085296 22965 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.111898 22592 tablet_bootstrap.cc:492] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:36.121006 22591 tablet_bootstrap.cc:654] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:36.139178 22949 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:36.139655 22949 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.146361 22949 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:36.147917 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:36.148160 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:36.148720 22470 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:36.150056 22367 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:36.152766 22788 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:36.153152 22788 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:36.153471 22788 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.140906 22950 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.158730 22950 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:36.160774 22788 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:36.164309 22366 leader_election.cc:343] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:36.164163 22965 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.165887 23010 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:36.166775 22965 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:36.184582 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:36.185248 22477 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.186832 22592 tablet_bootstrap.cc:654] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:36.184820 22788 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:36.193017 22477 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:36.194344 22367 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:36.195436 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:36.196063 22400 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.196122 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:36.196729 22469 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.196909 22635 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:36.197407 22635 raft_consensus.cc:697] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:36.198793 22635 consensus_queue.cc:237] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.205464 22469 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:36.205859 22400 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:36.210427 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:36.230840 22592 tablet_bootstrap.cc:492] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:36.231956 22592 ts_tablet_manager.cc:1403] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.150s	user 0.008s	sys 0.030s
I20260709 12:16:36.234303 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:36.234786 22400 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.234846 22592 raft_consensus.cc:359] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.235598 22592 raft_consensus.cc:385] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:36.235867 22592 raft_consensus.cc:740] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.236197 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:36.236792 22473 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.236636 22592 consensus_queue.cc:260] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.238410 22592 ts_tablet_manager.cc:1434] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:16:36.239493 22592 tablet_bootstrap.cc:492] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:36.244990 22473 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:36.245393 22592 tablet_bootstrap.cc:654] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:36.246817 22366 leader_election.cc:343] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:36.249682 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:36.250620 22677 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:36.251067 22677 raft_consensus.cc:697] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:36.251811 22677 consensus_queue.cc:237] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.259599 22592 tablet_bootstrap.cc:492] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:36.263088 22592 ts_tablet_manager.cc:1403] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.003s
I20260709 12:16:36.264504 22591 tablet_bootstrap.cc:492] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:36.265017 22591 ts_tablet_manager.cc:1403] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.186s	user 0.016s	sys 0.029s
I20260709 12:16:36.259567 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:36.265998 22677 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:36.266507 22677 raft_consensus.cc:697] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:36.267083 22592 raft_consensus.cc:359] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.267783 22592 raft_consensus.cc:385] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:36.268066 22592 raft_consensus.cc:740] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.268141 22591 raft_consensus.cc:359] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.267331 22677 consensus_queue.cc:237] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.268812 22591 raft_consensus.cc:385] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:36.269107 22591 raft_consensus.cc:740] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.271781 22400 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:36.269716 22591 consensus_queue.cc:260] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.275502 22592 consensus_queue.cc:260] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.275525 22591 ts_tablet_manager.cc:1434] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:16:36.277367 22592 ts_tablet_manager.cc:1434] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 12:16:36.278373 22592 tablet_bootstrap.cc:492] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:36.278883 22591 tablet_bootstrap.cc:492] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:36.285523 22591 tablet_bootstrap.cc:654] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:36.299062 22592 tablet_bootstrap.cc:654] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:36.312573 22299 catalog_manager.cc:5697] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.319980 22592 tablet_bootstrap.cc:492] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:36.320544 22592 ts_tablet_manager.cc:1403] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.000s
I20260709 12:16:36.322001 22591 tablet_bootstrap.cc:492] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:36.322696 22591 ts_tablet_manager.cc:1403] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.000s
I20260709 12:16:36.325492 22592 raft_consensus.cc:359] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.325804 22591 raft_consensus.cc:359] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.326323 22592 raft_consensus.cc:385] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:36.326381 22591 raft_consensus.cc:385] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:36.326669 22592 raft_consensus.cc:740] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.326699 22591 raft_consensus.cc:740] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.327396 22592 consensus_queue.cc:260] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.327396 22591 consensus_queue.cc:260] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.329808 22591 ts_tablet_manager.cc:1434] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:16:36.330806 22591 tablet_bootstrap.cc:492] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:36.329401 22298 catalog_manager.cc:5697] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:36.333007 22592 ts_tablet_manager.cc:1434] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:16:36.334096 22592 tablet_bootstrap.cc:492] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1: Bootstrap starting.
I20260709 12:16:36.335386 22298 catalog_manager.cc:5697] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:36.337324 22591 tablet_bootstrap.cc:654] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:36.340395 22592 tablet_bootstrap.cc:654] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:36.348105 22635 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:36.348627 22635 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.350308 22591 tablet_bootstrap.cc:492] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:36.350772 22591 ts_tablet_manager.cc:1403] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 12:16:36.350965 22592 tablet_bootstrap.cc:492] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1: No bootstrap required, opened a new log
I20260709 12:16:36.351540 22635 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:36.352221 22592 ts_tablet_manager.cc:1403] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 12:16:36.353040 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:36.353338 22591 raft_consensus.cc:359] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.354038 22591 raft_consensus.cc:385] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:36.354295 22591 raft_consensus.cc:740] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.354951 22591 consensus_queue.cc:260] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.355053 22592 raft_consensus.cc:359] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.355883 22592 raft_consensus.cc:385] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:36.356161 22592 raft_consensus.cc:740] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.356819 22592 consensus_queue.cc:260] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.358728 22591 ts_tablet_manager.cc:1434] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:36.359745 22591 tablet_bootstrap.cc:492] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:36.360270 22592 ts_tablet_manager.cc:1434] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 12:16:36.361887 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:36.366990 22400 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.370963 22366 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:36.372081 22949 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:36.375726 22591 tablet_bootstrap.cc:654] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:36.381551 22591 tablet_bootstrap.cc:492] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:36.382027 22591 ts_tablet_manager.cc:1403] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.007s
I20260709 12:16:36.384639 22591 raft_consensus.cc:359] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.385306 22591 raft_consensus.cc:385] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:36.385564 22591 raft_consensus.cc:740] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.386179 22591 consensus_queue.cc:260] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.388195 22591 ts_tablet_manager.cc:1434] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:36.389978 22965 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:36.390513 22965 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.392110 22889 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:36.393646 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:36.394353 22393 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:36.395562 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:36.397317 23047 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:36.397750 22591 tablet_bootstrap.cc:492] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932: Bootstrap starting.
I20260709 12:16:36.398365 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:36.398937 22477 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 0.
I20260709 12:16:36.397673 23047 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:36.400003 23047 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.400923 22965 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:36.404045 22591 tablet_bootstrap.cc:654] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:36.407505 22347 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:36.413899 23047 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.417207 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:36.418094 22393 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.426635 22654 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:36.440266 22393 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:36.441893 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:36.441833 23047 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:36.443964 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:36.445228 22477 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.442828 22965 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:36.450048 22965 raft_consensus.cc:697] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:36.450956 22965 consensus_queue.cc:237] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.454941 22477 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:36.455442 22591 tablet_bootstrap.cc:492] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932: No bootstrap required, opened a new log
I20260709 12:16:36.455976 22591 ts_tablet_manager.cc:1403] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932: Time spent bootstrapping tablet: real 0.058s	user 0.026s	sys 0.029s
I20260709 12:16:36.458046 23047 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:36.458523 23047 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.458747 22591 raft_consensus.cc:359] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.459601 22591 raft_consensus.cc:385] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:36.459934 22591 raft_consensus.cc:740] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.460685 23047 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:36.462972 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:36.460678 22591 consensus_queue.cc:260] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.466603 22591 ts_tablet_manager.cc:1434] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:16:36.464613 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:36.468967 22516 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:36.469650 22965 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:36.475190 22298 catalog_manager.cc:5697] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:36.505710 22545 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.511745 22949 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:36.523630 22543 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.528023 22635 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:36.554438 23047 consensus_queue.cc:1048] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:36.558197 23047 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:36.558686 23047 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.561609 23047 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:36.564134 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:36.564275 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:36.565017 22477 raft_consensus.cc:2393] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 1: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:16:36.567806 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:36.568912 23047 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.576324 23047 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:36.584553 22949 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:36.590324 22965 consensus_queue.cc:1048] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:36.611919 22949 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:36.620083 22965 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:36.620615 22965 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.622993 22965 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:36.623894 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:36.629228 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:36.630647 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:36.631428 22965 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:36.679247 22949 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:36.679770 22949 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.681713 22949 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:36.682325 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:36.682999 22477 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:36.683041 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:36.683671 22543 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 0.
I20260709 12:16:36.683945 22367 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:36.684839 22949 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:36.685195 22949 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:36.685461 22949 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.690712 22954 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:36.692126 22949 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.693992 22949 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:36.694643 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:36.695245 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:36.695827 22543 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.697152 22477 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.702718 22543 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:36.703822 22366 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:36.704730 22949 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:36.705201 22949 raft_consensus.cc:697] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:36.706050 22949 consensus_queue.cc:237] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:36.708488 22477 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:36.717298 22965 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:36.718199 22298 catalog_manager.cc:5697] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.837910 23047 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:36.855217 23047 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:36.875586 22400 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.885589 22543 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:36.932683 22954 consensus_queue.cc:1048] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:36.943459 22954 consensus_queue.cc:1048] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:37.254522 22635 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:37.275813 23010 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:38.056260 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:38.083747 23084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:38.084086 23087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:38.084863 23085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:38.085283 21244 server_base.cc:1061] running on GCE node
I20260709 12:16:38.087307 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:38.087602 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:38.087829 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599398087809 us; error 0 us; skew 500 ppm
I20260709 12:16:38.088449 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:38.091682 21244 webserver.cc:533] Webserver started at http://127.20.191.4:43919/ using document root <none> and password file <none>
I20260709 12:16:38.092163 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:38.092331 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:38.092579 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:38.093865 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-3-root/instance:
uuid: "65951063312d4a1e9123f92354101c71"
format_stamp: "Formatted at 2026-07-09 12:16:38 on dist-test-slave-7c1h"
I20260709 12:16:38.098343 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:16:38.101895 23092 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:38.102785 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:16:38.103104 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-3-root
uuid: "65951063312d4a1e9123f92354101c71"
format_stamp: "Formatted at 2026-07-09 12:16:38 on dist-test-slave-7c1h"
I20260709 12:16:38.103384 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:38.127854 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:38.130059 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:38.132426 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:38.135039 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:38.135253 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:38.135458 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:38.135597 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:38.195329 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.4:34357
I20260709 12:16:38.195420 23155 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.4:34357 every 8 connection(s)
I20260709 12:16:38.200990 21244 auto_leader_rebalancer-test.cc:439] add a tserver: 65951063312d4a1e9123f92354101c71
I20260709 12:16:38.213469 23156 heartbeater.cc:344] Connected to a master server at 127.20.191.62:37293
I20260709 12:16:38.214047 23156 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:38.214986 23156 heartbeater.cc:507] Master 127.20.191.62:37293 requested a full tablet report, sending...
I20260709 12:16:38.216976 22299 ts_manager.cc:194] Registered new tserver with Master: 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:38.218410 22299 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32988
I20260709 12:16:38.558984 22469 consensus_queue.cc:237] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:38.568259 22393 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:38.570046 22917 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:38.572485 22545 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:38.573603 22917 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:38.578584 22889 raft_consensus.cc:2955] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:38.580384 22393 raft_consensus.cc:2955] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
W20260709 12:16:38.597380 22441 consensus_peers.cc:597] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4e53d64761746008e02335e67f74c08. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:38.598664 22299 catalog_manager.cc:5697] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:38.602372 22543 raft_consensus.cc:2955] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:38.613641 22401 consensus_queue.cc:237] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:38.628265 22543 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:38.628891 22473 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:38.630120 23010 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:38.633273 23010 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:38.639894 22366 consensus_peers.cc:597] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a0d5063dbb1a45fdb6db1177b40d5c72. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:38.646972 23010 raft_consensus.cc:2955] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:38.650890 22477 raft_consensus.cc:2955] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:38.667377 22401 consensus_queue.cc:237] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:38.670974 22545 raft_consensus.cc:2955] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:38.694681 22298 catalog_manager.cc:5697] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:38.710270 22366 consensus_peers.cc:597] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 906ffc7e978c43a2841f212271a02a94. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:38.711767 22543 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:38.712925 22477 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:38.713161 22949 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:38.718585 22949 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:38.723444 23081 raft_consensus.cc:2955] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:38.725251 22543 raft_consensus.cc:2955] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:38.737946 22477 raft_consensus.cc:2955] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:38.739899 22473 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:38.745543 22298 catalog_manager.cc:5697] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:38.761268 22543 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:38.763301 22441 consensus_peers.cc:597] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a6a426ef4624f2cb84081714ee42138. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:38.763628 22401 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:38.763983 22917 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:38.772056 22917 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:38.798918 23167 raft_consensus.cc:2955] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:38.801200 22543 raft_consensus.cc:2955] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:38.803103 22401 raft_consensus.cc:2955] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:38.817178 22298 catalog_manager.cc:5697] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:39.005959 23184 ts_tablet_manager.cc:933] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:39.008649 23184 tablet_copy_client.cc:323] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.2:46187
I20260709 12:16:39.021267 22487 tablet_copy_service.cc:140] P 25ebf14868c042dca42f54b3e251e1b2: Received BeginTabletCopySession request for tablet c4e53d64761746008e02335e67f74c08 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:43060)
I20260709 12:16:39.021927 22487 tablet_copy_service.cc:161] P 25ebf14868c042dca42f54b3e251e1b2: Beginning new tablet copy session on tablet c4e53d64761746008e02335e67f74c08 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:43060: session id = 65951063312d4a1e9123f92354101c71-c4e53d64761746008e02335e67f74c08
I20260709 12:16:39.026784 23187 ts_tablet_manager.cc:933] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:16:39.033969 23187 tablet_copy_client.cc:323] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.1:37927
I20260709 12:16:39.036031 22487 tablet_copy_source_session.cc:215] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:39.040382 23184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e53d64761746008e02335e67f74c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.055604 22412 tablet_copy_service.cc:140] P b8621fa34be04d3fa2d68a300f858cd1: Received BeginTabletCopySession request for tablet a0d5063dbb1a45fdb6db1177b40d5c72 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:58054)
I20260709 12:16:39.056303 22412 tablet_copy_service.cc:161] P b8621fa34be04d3fa2d68a300f858cd1: Beginning new tablet copy session on tablet a0d5063dbb1a45fdb6db1177b40d5c72 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:58054: session id = 65951063312d4a1e9123f92354101c71-a0d5063dbb1a45fdb6db1177b40d5c72
I20260709 12:16:39.065442 22412 tablet_copy_source_session.cc:215] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:39.071499 23184 tablet_copy_client.cc:806] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:39.072337 23184 tablet_copy_client.cc:670] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:39.081914 23184 tablet_copy_client.cc:538] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:39.087747 23187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d5063dbb1a45fdb6db1177b40d5c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.096048 23184 tablet_bootstrap.cc:492] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:16:39.111532 23187 tablet_copy_client.cc:806] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:39.112210 23187 tablet_copy_client.cc:670] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:39.116583 23187 tablet_copy_client.cc:538] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:39.128513 23187 tablet_bootstrap.cc:492] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:16:39.132907 23184 tablet_bootstrap.cc:492] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:39.134130 23184 tablet_bootstrap.cc:492] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:16:39.134898 23184 ts_tablet_manager.cc:1403] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.039s	user 0.030s	sys 0.000s
I20260709 12:16:39.138173 23184 raft_consensus.cc:359] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:39.139076 23184 raft_consensus.cc:740] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:16:39.139606 23184 consensus_queue.cc:260] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:39.149734 23156 heartbeater.cc:499] Master 127.20.191.62:37293 was elected leader, sending a full tablet report...
I20260709 12:16:39.150424 23184 ts_tablet_manager.cc:1434] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:16:39.155959 22487 tablet_copy_service.cc:342] P 25ebf14868c042dca42f54b3e251e1b2: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-c4e53d64761746008e02335e67f74c08 received from {username='slave'} at 127.0.0.1:43060
I20260709 12:16:39.156421 22487 tablet_copy_service.cc:434] P 25ebf14868c042dca42f54b3e251e1b2: ending tablet copy session 65951063312d4a1e9123f92354101c71-c4e53d64761746008e02335e67f74c08 on tablet c4e53d64761746008e02335e67f74c08 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:16:39.164288 23187 tablet_bootstrap.cc:492] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:39.165343 23187 tablet_bootstrap.cc:492] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:16:39.166095 23187 ts_tablet_manager.cc:1403] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.038s	user 0.024s	sys 0.000s
I20260709 12:16:39.169131 23187 raft_consensus.cc:359] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:39.169728 23187 raft_consensus.cc:740] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:16:39.170410 23187 consensus_queue.cc:260] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:39.174850 23187 ts_tablet_manager.cc:1434] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
I20260709 12:16:39.176765 22412 tablet_copy_service.cc:342] P b8621fa34be04d3fa2d68a300f858cd1: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-a0d5063dbb1a45fdb6db1177b40d5c72 received from {username='slave'} at 127.0.0.1:58054
I20260709 12:16:39.177148 22412 tablet_copy_service.cc:434] P b8621fa34be04d3fa2d68a300f858cd1: ending tablet copy session 65951063312d4a1e9123f92354101c71-a0d5063dbb1a45fdb6db1177b40d5c72 on tablet a0d5063dbb1a45fdb6db1177b40d5c72 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:16:39.217425 23187 ts_tablet_manager.cc:933] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:16:39.219009 23187 tablet_copy_client.cc:323] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.1:37927
I20260709 12:16:39.220556 22412 tablet_copy_service.cc:140] P b8621fa34be04d3fa2d68a300f858cd1: Received BeginTabletCopySession request for tablet 906ffc7e978c43a2841f212271a02a94 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:58054)
I20260709 12:16:39.221073 22412 tablet_copy_service.cc:161] P b8621fa34be04d3fa2d68a300f858cd1: Beginning new tablet copy session on tablet 906ffc7e978c43a2841f212271a02a94 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:58054: session id = 65951063312d4a1e9123f92354101c71-906ffc7e978c43a2841f212271a02a94
I20260709 12:16:39.228183 22412 tablet_copy_source_session.cc:215] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:39.230963 23187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906ffc7e978c43a2841f212271a02a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.241354 23187 tablet_copy_client.cc:806] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:39.241896 23187 tablet_copy_client.cc:670] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:39.245605 23187 tablet_copy_client.cc:538] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:39.253497 23184 ts_tablet_manager.cc:933] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:39.254621 23187 tablet_bootstrap.cc:492] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:16:39.265738 23184 tablet_copy_client.cc:323] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.2:46187
I20260709 12:16:39.267681 22487 tablet_copy_service.cc:140] P 25ebf14868c042dca42f54b3e251e1b2: Received BeginTabletCopySession request for tablet 9a6a426ef4624f2cb84081714ee42138 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:43060)
I20260709 12:16:39.268257 22487 tablet_copy_service.cc:161] P 25ebf14868c042dca42f54b3e251e1b2: Beginning new tablet copy session on tablet 9a6a426ef4624f2cb84081714ee42138 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:43060: session id = 65951063312d4a1e9123f92354101c71-9a6a426ef4624f2cb84081714ee42138
I20260709 12:16:39.276131 22487 tablet_copy_source_session.cc:215] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:39.280951 23184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a6a426ef4624f2cb84081714ee42138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.280982 23187 tablet_bootstrap.cc:492] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:39.281921 23187 tablet_bootstrap.cc:492] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:16:39.282488 23187 ts_tablet_manager.cc:1403] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.013s
I20260709 12:16:39.284688 23187 raft_consensus.cc:359] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:39.285303 23187 raft_consensus.cc:740] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:16:39.285888 23187 consensus_queue.cc:260] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:39.289620 23187 ts_tablet_manager.cc:1434] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:16:39.292176 22412 tablet_copy_service.cc:342] P b8621fa34be04d3fa2d68a300f858cd1: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-906ffc7e978c43a2841f212271a02a94 received from {username='slave'} at 127.0.0.1:58054
I20260709 12:16:39.292626 22412 tablet_copy_service.cc:434] P b8621fa34be04d3fa2d68a300f858cd1: ending tablet copy session 65951063312d4a1e9123f92354101c71-906ffc7e978c43a2841f212271a02a94 on tablet 906ffc7e978c43a2841f212271a02a94 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:16:39.303994 23184 tablet_copy_client.cc:806] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:39.304584 23184 tablet_copy_client.cc:670] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:39.308610 23184 tablet_copy_client.cc:538] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:39.318089 23184 tablet_bootstrap.cc:492] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:16:39.337795 23184 tablet_bootstrap.cc:492] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:39.338641 23184 tablet_bootstrap.cc:492] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:16:39.339185 23184 ts_tablet_manager.cc:1403] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 12:16:39.341264 23184 raft_consensus.cc:359] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:39.341969 23184 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:16:39.342461 23184 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:39.344343 23184 ts_tablet_manager.cc:1434] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:39.346298 22487 tablet_copy_service.cc:342] P 25ebf14868c042dca42f54b3e251e1b2: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-9a6a426ef4624f2cb84081714ee42138 received from {username='slave'} at 127.0.0.1:43060
I20260709 12:16:39.346738 22487 tablet_copy_service.cc:434] P 25ebf14868c042dca42f54b3e251e1b2: ending tablet copy session 65951063312d4a1e9123f92354101c71-9a6a426ef4624f2cb84081714ee42138 on tablet 9a6a426ef4624f2cb84081714ee42138 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:16:39.518743 23131 raft_consensus.cc:1217] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:39.601918 23131 raft_consensus.cc:1217] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:39.742144 23131 raft_consensus.cc:1217] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:39.823140 23131 raft_consensus.cc:1217] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:39.990958 22917 raft_consensus.cc:1064] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:16:39.993462 22917 consensus_queue.cc:237] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:39.999071 22543 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:39.999430 22401 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:40.001114 23131 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:40.001000 22917 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:40.002276 22889 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:40.003167 23197 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:40.021677 22889 raft_consensus.cc:2955] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.027310 22543 raft_consensus.cc:2955] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.029745 23131 raft_consensus.cc:2955] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.034765 22401 raft_consensus.cc:2955] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.043215 22299 catalog_manager.cc:5697] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:40.076191 22477 consensus_queue.cc:237] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:40.084575 23131 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:40.088294 23196 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:40.084817 22543 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:40.092250 23196 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:40.104861 22889 raft_consensus.cc:2955] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.110829 23131 raft_consensus.cc:2955] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.116416 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c4e53d64761746008e02335e67f74c08 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:40.116297 22543 raft_consensus.cc:2955] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.134590 22298 catalog_manager.cc:5697] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.149210 22387 tablet_service.cc:1558] Processing DeleteTablet for tablet c4e53d64761746008e02335e67f74c08 with delete_type TABLET_DATA_TOMBSTONED (TS b8621fa34be04d3fa2d68a300f858cd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48918
I20260709 12:16:40.169970 23207 tablet_replica.cc:333] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:16:40.178382 23081 raft_consensus.cc:1064] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:16:40.181802 23081 consensus_queue.cc:237] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:40.189186 22475 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:40.189442 22543 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:40.203712 22949 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:40.212198 22949 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:40.218408 23010 raft_consensus.cc:1064] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:16:40.220867 23010 consensus_queue.cc:237] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:40.189719 23131 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:40.224586 22949 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:40.241338 23130 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:40.243508 22949 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:40.259868 22543 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:40.261580 22475 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:40.261521 23210 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:40.263197 22949 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:40.269255 23207 raft_consensus.cc:2243] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:40.270362 23207 raft_consensus.cc:2272] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:40.274456 23207 ts_tablet_manager.cc:1916] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:40.282786 23210 raft_consensus.cc:2955] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.284631 23131 raft_consensus.cc:2955] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.292886 23212 raft_consensus.cc:2955] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.294391 22545 raft_consensus.cc:2955] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.318450 22297 catalog_manager.cc:5697] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.319983 22475 raft_consensus.cc:2955] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.335597 22296 catalog_manager.cc:5697] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.341930 23207 ts_tablet_manager.cc:1929] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:40.345114 23207 log.cc:1199] T c4e53d64761746008e02335e67f74c08 P b8621fa34be04d3fa2d68a300f858cd1: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-0-root/wals/c4e53d64761746008e02335e67f74c08
I20260709 12:16:40.347621 22285 catalog_manager.cc:5028] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): tablet c4e53d64761746008e02335e67f74c08 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:16:40.348171 23131 raft_consensus.cc:2955] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.348902 22545 raft_consensus.cc:2955] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.366211 22475 raft_consensus.cc:2955] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.373973 22393 consensus_queue.cc:237] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:40.381539 23131 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:40.386600 23081 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:40.387207 22393 consensus_queue.cc:237] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:40.388705 22545 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:40.390764 23081 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:40.405288 22469 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:40.409919 22949 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:40.410382 23010 raft_consensus.cc:2955] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.414163 23196 raft_consensus.cc:1064] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:16:40.416615 23196 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:40.419438 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a0d5063dbb1a45fdb6db1177b40d5c72 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:40.420733 22546 raft_consensus.cc:2955] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.422318 23130 raft_consensus.cc:2955] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.426864 23131 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:40.428840 23081 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:40.443627 23210 raft_consensus.cc:2955] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.452873 22469 raft_consensus.cc:2955] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.454078 23130 raft_consensus.cc:2955] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.455876 22298 catalog_manager.cc:5697] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:40.465325 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 906ffc7e978c43a2841f212271a02a94 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:40.474251 22543 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:40.475569 23197 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:40.481169 22299 catalog_manager.cc:5697] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.486294 22393 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:40.490835 22458 tablet_service.cc:1558] Processing DeleteTablet for tablet a0d5063dbb1a45fdb6db1177b40d5c72 with delete_type TABLET_DATA_TOMBSTONED (TS 25ebf14868c042dca42f54b3e251e1b2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36278
I20260709 12:16:40.491909 23197 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:40.481268 23131 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:40.511349 23197 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:40.520181 22538 tablet_service.cc:1558] Processing DeleteTablet for tablet 906ffc7e978c43a2841f212271a02a94 with delete_type TABLET_DATA_TOMBSTONED (TS 8c3bcfa13ca74a24ab8999a408532932 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54490
I20260709 12:16:40.523625 23221 tablet_replica.cc:333] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:16:40.524799 23221 raft_consensus.cc:2243] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:40.525445 23221 raft_consensus.cc:2272] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:40.529224 22889 raft_consensus.cc:2955] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.530726 23221 ts_tablet_manager.cc:1916] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:40.531384 22393 raft_consensus.cc:2955] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.538549 22543 raft_consensus.cc:2955] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.546911 23131 raft_consensus.cc:2955] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.553292 22299 catalog_manager.cc:5697] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:40.564280 23223 tablet_replica.cc:333] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:16:40.565320 23223 raft_consensus.cc:2243] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:40.566074 23223 raft_consensus.cc:2272] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:40.573254 22469 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:40.581939 23221 ts_tablet_manager.cc:1929] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:40.582432 23221 log.cc:1199] T a0d5063dbb1a45fdb6db1177b40d5c72 P 25ebf14868c042dca42f54b3e251e1b2: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-1-root/wals/a0d5063dbb1a45fdb6db1177b40d5c72
I20260709 12:16:40.586591 23223 ts_tablet_manager.cc:1916] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:40.589111 22546 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:40.590787 23196 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:40.591444 23131 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:40.592793 22917 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:40.597469 22285 catalog_manager.cc:5028] TS 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): tablet a0d5063dbb1a45fdb6db1177b40d5c72 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:16:40.629494 23197 raft_consensus.cc:2955] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.634907 23223 ts_tablet_manager.cc:1929] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:40.635376 23223 log.cc:1199] T 906ffc7e978c43a2841f212271a02a94 P 8c3bcfa13ca74a24ab8999a408532932: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-2-root/wals/906ffc7e978c43a2841f212271a02a94
I20260709 12:16:40.635784 22546 raft_consensus.cc:2955] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.637519 22284 catalog_manager.cc:5028] TS 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): tablet 906ffc7e978c43a2841f212271a02a94 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:16:40.644744 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a6a426ef4624f2cb84081714ee42138 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:40.646139 23131 raft_consensus.cc:2955] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.666414 22298 catalog_manager.cc:5697] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:40.678813 22387 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a6a426ef4624f2cb84081714ee42138 with delete_type TABLET_DATA_TOMBSTONED (TS b8621fa34be04d3fa2d68a300f858cd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48918
I20260709 12:16:40.679800 23207 tablet_replica.cc:333] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:16:40.680891 23207 raft_consensus.cc:2243] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:40.681699 23207 raft_consensus.cc:2272] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:40.688625 23207 ts_tablet_manager.cc:1916] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:40.702708 23207 ts_tablet_manager.cc:1929] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:40.703014 23207 log.cc:1199] T 9a6a426ef4624f2cb84081714ee42138 P b8621fa34be04d3fa2d68a300f858cd1: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-0-root/wals/9a6a426ef4624f2cb84081714ee42138
I20260709 12:16:40.704270 22285 catalog_manager.cc:5028] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): tablet 9a6a426ef4624f2cb84081714ee42138 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:16:41.759456 22399 consensus_queue.cc:237] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:41.765722 22469 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:41.765893 22545 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:41.766256 22366 consensus_peers.cc:597] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14fbfde86a044b028b2032a062d189e9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:41.767333 23209 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:41.768497 23226 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:41.776863 23209 raft_consensus.cc:2955] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:41.780632 22547 raft_consensus.cc:2955] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:41.787482 22469 raft_consensus.cc:2955] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:41.793576 22475 consensus_queue.cc:237] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:41.799608 22299 catalog_manager.cc:5697] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
W20260709 12:16:41.805733 22441 consensus_peers.cc:597] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3bf88f0980e49afb7b7f1dabfbb3815. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:41.806525 22547 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:41.808025 23196 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:41.808827 22399 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:41.810410 23227 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:41.829332 23227 raft_consensus.cc:2955] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:41.830912 22399 raft_consensus.cc:2955] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:41.832319 22547 raft_consensus.cc:2955] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:41.845306 22475 consensus_queue.cc:237] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:16:41.866684 22441 consensus_peers.cc:597] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8e9f45e270942459d8aa926ed037bec. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:41.865869 22547 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:41.863183 22298 catalog_manager.cc:5697] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:41.869815 22399 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:41.870711 23197 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:41.873257 23227 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:41.894389 23197 raft_consensus.cc:2955] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:41.900482 22547 raft_consensus.cc:2955] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:41.901600 22400 raft_consensus.cc:2955] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:41.917480 22298 catalog_manager.cc:5697] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:41.946344 22547 consensus_queue.cc:237] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:41.960388 22475 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:41.961791 23097 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:41.962037 22400 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:41.963987 23097 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:41.971293 23097 raft_consensus.cc:2955] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:41.972378 22475 raft_consensus.cc:2955] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
W20260709 12:16:41.976138 22515 consensus_peers.cc:597] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c23bd5666c81480f8ce12f767a245571. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:41.978547 22400 raft_consensus.cc:2955] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:41.993122 22298 catalog_manager.cc:5697] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:42.194989 23250 ts_tablet_manager.cc:933] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:16:42.206073 23250 tablet_copy_client.cc:323] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.1:37927
I20260709 12:16:42.207741 22412 tablet_copy_service.cc:140] P b8621fa34be04d3fa2d68a300f858cd1: Received BeginTabletCopySession request for tablet 14fbfde86a044b028b2032a062d189e9 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:58054)
I20260709 12:16:42.208258 22412 tablet_copy_service.cc:161] P b8621fa34be04d3fa2d68a300f858cd1: Beginning new tablet copy session on tablet 14fbfde86a044b028b2032a062d189e9 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:58054: session id = 65951063312d4a1e9123f92354101c71-14fbfde86a044b028b2032a062d189e9
I20260709 12:16:42.225119 22412 tablet_copy_source_session.cc:215] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:42.228708 23250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14fbfde86a044b028b2032a062d189e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.243855 23250 tablet_copy_client.cc:806] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:42.244418 23250 tablet_copy_client.cc:670] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:42.248211 23250 tablet_copy_client.cc:538] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:42.254755 23250 tablet_bootstrap.cc:492] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:16:42.272807 23250 tablet_bootstrap.cc:492] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:42.273658 23250 tablet_bootstrap.cc:492] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:16:42.274371 23250 ts_tablet_manager.cc:1403] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.009s
I20260709 12:16:42.277086 23250 raft_consensus.cc:359] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:42.277709 23250 raft_consensus.cc:740] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:16:42.278257 23250 consensus_queue.cc:260] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:42.281081 23250 ts_tablet_manager.cc:1434] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:16:42.283537 22412 tablet_copy_service.cc:342] P b8621fa34be04d3fa2d68a300f858cd1: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-14fbfde86a044b028b2032a062d189e9 received from {username='slave'} at 127.0.0.1:58054
I20260709 12:16:42.283983 22412 tablet_copy_service.cc:434] P b8621fa34be04d3fa2d68a300f858cd1: ending tablet copy session 65951063312d4a1e9123f92354101c71-14fbfde86a044b028b2032a062d189e9 on tablet 14fbfde86a044b028b2032a062d189e9 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:16:42.332638 23250 ts_tablet_manager.cc:933] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:42.334533 23250 tablet_copy_client.cc:323] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.2:46187
I20260709 12:16:42.336143 22487 tablet_copy_service.cc:140] P 25ebf14868c042dca42f54b3e251e1b2: Received BeginTabletCopySession request for tablet c3bf88f0980e49afb7b7f1dabfbb3815 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:43060)
I20260709 12:16:42.336684 22487 tablet_copy_service.cc:161] P 25ebf14868c042dca42f54b3e251e1b2: Beginning new tablet copy session on tablet c3bf88f0980e49afb7b7f1dabfbb3815 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:43060: session id = 65951063312d4a1e9123f92354101c71-c3bf88f0980e49afb7b7f1dabfbb3815
I20260709 12:16:42.344256 22487 tablet_copy_source_session.cc:215] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:42.348331 23250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3bf88f0980e49afb7b7f1dabfbb3815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.364686 23250 tablet_copy_client.cc:806] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:42.365275 23250 tablet_copy_client.cc:670] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:42.368906 23250 tablet_copy_client.cc:538] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:42.376052 23250 tablet_bootstrap.cc:492] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:16:42.398267 23250 tablet_bootstrap.cc:492] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:42.399032 23250 tablet_bootstrap.cc:492] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:16:42.399750 23250 ts_tablet_manager.cc:1403] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.005s
I20260709 12:16:42.402077 23250 raft_consensus.cc:359] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:42.402781 23250 raft_consensus.cc:740] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:16:42.403314 23250 consensus_queue.cc:260] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:42.405718 23250 ts_tablet_manager.cc:1434] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:16:42.407554 22487 tablet_copy_service.cc:342] P 25ebf14868c042dca42f54b3e251e1b2: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-c3bf88f0980e49afb7b7f1dabfbb3815 received from {username='slave'} at 127.0.0.1:43060
I20260709 12:16:42.407950 22487 tablet_copy_service.cc:434] P 25ebf14868c042dca42f54b3e251e1b2: ending tablet copy session 65951063312d4a1e9123f92354101c71-c3bf88f0980e49afb7b7f1dabfbb3815 on tablet c3bf88f0980e49afb7b7f1dabfbb3815 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:16:42.471992 23250 ts_tablet_manager.cc:933] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:42.490772 23250 tablet_copy_client.cc:323] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.2:46187
I20260709 12:16:42.492745 22487 tablet_copy_service.cc:140] P 25ebf14868c042dca42f54b3e251e1b2: Received BeginTabletCopySession request for tablet e8e9f45e270942459d8aa926ed037bec from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:43060)
I20260709 12:16:42.493304 22487 tablet_copy_service.cc:161] P 25ebf14868c042dca42f54b3e251e1b2: Beginning new tablet copy session on tablet e8e9f45e270942459d8aa926ed037bec from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:43060: session id = 65951063312d4a1e9123f92354101c71-e8e9f45e270942459d8aa926ed037bec
I20260709 12:16:42.502291 22487 tablet_copy_source_session.cc:215] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:42.505736 23250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8e9f45e270942459d8aa926ed037bec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.519850 23250 tablet_copy_client.cc:806] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:42.520314 23250 tablet_copy_client.cc:670] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:42.525118 23250 tablet_copy_client.cc:538] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:42.536268 23250 tablet_bootstrap.cc:492] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:16:42.536939 23258 ts_tablet_manager.cc:933] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:42.539718 23258 tablet_copy_client.cc:323] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.3:38645
I20260709 12:16:42.553998 23250 tablet_bootstrap.cc:492] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:42.554922 23250 tablet_bootstrap.cc:492] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:16:42.555605 23250 ts_tablet_manager.cc:1403] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 12:16:42.556366 22561 tablet_copy_service.cc:140] P 8c3bcfa13ca74a24ab8999a408532932: Received BeginTabletCopySession request for tablet c23bd5666c81480f8ce12f767a245571 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:49290)
I20260709 12:16:42.556890 22561 tablet_copy_service.cc:161] P 8c3bcfa13ca74a24ab8999a408532932: Beginning new tablet copy session on tablet c23bd5666c81480f8ce12f767a245571 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:49290: session id = 65951063312d4a1e9123f92354101c71-c23bd5666c81480f8ce12f767a245571
I20260709 12:16:42.558657 23250 raft_consensus.cc:359] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:42.559604 23250 raft_consensus.cc:740] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:16:42.561180 23250 consensus_queue.cc:260] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:42.564371 22561 tablet_copy_source_session.cc:215] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:42.568219 23258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23bd5666c81480f8ce12f767a245571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.568966 23250 ts_tablet_manager.cc:1434] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:16:42.577343 22487 tablet_copy_service.cc:342] P 25ebf14868c042dca42f54b3e251e1b2: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-e8e9f45e270942459d8aa926ed037bec received from {username='slave'} at 127.0.0.1:43060
I20260709 12:16:42.577841 22487 tablet_copy_service.cc:434] P 25ebf14868c042dca42f54b3e251e1b2: ending tablet copy session 65951063312d4a1e9123f92354101c71-e8e9f45e270942459d8aa926ed037bec on tablet e8e9f45e270942459d8aa926ed037bec with peer 65951063312d4a1e9123f92354101c71
I20260709 12:16:42.603437 23258 tablet_copy_client.cc:806] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:42.604094 23258 tablet_copy_client.cc:670] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:42.607986 23258 tablet_copy_client.cc:538] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:42.617461 23258 tablet_bootstrap.cc:492] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:16:42.638512 23258 tablet_bootstrap.cc:492] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:42.639219 23258 tablet_bootstrap.cc:492] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:16:42.639757 23258 ts_tablet_manager.cc:1403] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.009s
I20260709 12:16:42.642316 23258 raft_consensus.cc:359] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:42.643113 23258 raft_consensus.cc:740] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:16:42.643659 23258 consensus_queue.cc:260] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:42.645787 23258 ts_tablet_manager.cc:1434] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:16:42.647511 22561 tablet_copy_service.cc:342] P 8c3bcfa13ca74a24ab8999a408532932: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-c23bd5666c81480f8ce12f767a245571 received from {username='slave'} at 127.0.0.1:49290
I20260709 12:16:42.647946 22561 tablet_copy_service.cc:434] P 8c3bcfa13ca74a24ab8999a408532932: ending tablet copy session 65951063312d4a1e9123f92354101c71-c23bd5666c81480f8ce12f767a245571 on tablet c23bd5666c81480f8ce12f767a245571 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:16:42.700438 23131 raft_consensus.cc:1217] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:42.713222 23131 raft_consensus.cc:1217] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:43.072873 23131 raft_consensus.cc:1217] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:43.124881 23131 raft_consensus.cc:1217] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:43.162482 23226 raft_consensus.cc:1064] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:16:43.164834 23226 consensus_queue.cc:237] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:43.171200 23131 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:43.171989 22547 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:43.172333 22475 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:43.173627 23209 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:43.174508 23256 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:43.175441 23226 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:43.197319 23256 raft_consensus.cc:2955] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.204222 22475 raft_consensus.cc:2955] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.213536 22547 raft_consensus.cc:2955] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.215176 23131 raft_consensus.cc:2955] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.223481 22299 catalog_manager.cc:5697] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.277473 23196 raft_consensus.cc:1064] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:16:43.280047 23196 consensus_queue.cc:237] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:43.300846 23131 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:43.300874 22546 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:43.304672 23264 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:43.311033 22400 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:43.306738 23264 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:16:43.315920 23227 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:43.340068 23196 raft_consensus.cc:2955] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.361913 22400 raft_consensus.cc:2955] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.361625 23131 raft_consensus.cc:2955] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.371661 22401 consensus_queue.cc:237] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:43.363761 22547 raft_consensus.cc:2955] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.397946 22297 catalog_manager.cc:5697] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:43.407368 23130 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:43.410290 22545 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:43.410370 23226 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:43.417234 23256 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:43.424964 22475 consensus_queue.cc:237] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:43.438151 23226 raft_consensus.cc:2955] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.444773 22545 raft_consensus.cc:2955] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.451541 22400 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:43.453625 23130 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:43.453419 23227 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:43.456845 23264 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:43.465232 23130 raft_consensus.cc:2955] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.469314 23196 raft_consensus.cc:2955] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.476311 22400 raft_consensus.cc:2955] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.483920 22296 catalog_manager.cc:5697] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.490110 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c3bf88f0980e49afb7b7f1dabfbb3815 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:43.497648 22458 tablet_service.cc:1558] Processing DeleteTablet for tablet 14fbfde86a044b028b2032a062d189e9 with delete_type TABLET_DATA_TOMBSTONED (TS 25ebf14868c042dca42f54b3e251e1b2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36278
I20260709 12:16:43.502632 22297 catalog_manager.cc:5697] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:43.507288 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 14fbfde86a044b028b2032a062d189e9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:43.511787 23131 raft_consensus.cc:2955] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.527729 22538 tablet_service.cc:1558] Processing DeleteTablet for tablet c3bf88f0980e49afb7b7f1dabfbb3815 with delete_type TABLET_DATA_TOMBSTONED (TS 8c3bcfa13ca74a24ab8999a408532932 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54490
I20260709 12:16:43.530969 23285 tablet_replica.cc:333] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:16:43.532160 23285 raft_consensus.cc:2243] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:43.535737 23285 raft_consensus.cc:2272] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:43.540620 23285 ts_tablet_manager.cc:1916] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:43.548072 23286 tablet_replica.cc:333] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:16:43.549139 23286 raft_consensus.cc:2243] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:43.549986 23286 raft_consensus.cc:2272] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:43.559031 23285 ts_tablet_manager.cc:1929] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:43.559473 23285 log.cc:1199] T 14fbfde86a044b028b2032a062d189e9 P 25ebf14868c042dca42f54b3e251e1b2: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-1-root/wals/14fbfde86a044b028b2032a062d189e9
I20260709 12:16:43.561004 23286 ts_tablet_manager.cc:1916] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:43.561151 22285 catalog_manager.cc:5028] TS 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): tablet 14fbfde86a044b028b2032a062d189e9 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:16:43.578603 23286 ts_tablet_manager.cc:1929] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:43.578961 23286 log.cc:1199] T c3bf88f0980e49afb7b7f1dabfbb3815 P 8c3bcfa13ca74a24ab8999a408532932: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-2-root/wals/c3bf88f0980e49afb7b7f1dabfbb3815
I20260709 12:16:43.580426 22284 catalog_manager.cc:5028] TS 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): tablet c3bf88f0980e49afb7b7f1dabfbb3815 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:16:43.631716 23264 raft_consensus.cc:1064] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:16:43.634564 23264 consensus_queue.cc:237] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:43.641887 23131 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:43.642827 22400 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:43.643313 22546 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:43.643527 23264 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:43.644618 23196 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:43.645551 23281 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:43.667692 22965 raft_consensus.cc:1064] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:16:43.670162 22965 consensus_queue.cc:237] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:43.673148 22545 raft_consensus.cc:2955] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.671195 23196 raft_consensus.cc:2955] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.701634 23131 raft_consensus.cc:2955] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.703625 22296 catalog_manager.cc:5697] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.729384 23131 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:43.731070 23272 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:43.732100 22475 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:43.736444 23272 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:43.752321 22400 raft_consensus.cc:2955] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.762295 22477 consensus_queue.cc:237] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:43.767007 22401 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:43.771150 23272 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:43.772570 23131 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:43.783250 22393 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:43.787261 23227 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:43.796348 23227 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:43.801353 23196 raft_consensus.cc:2955] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.803853 23272 raft_consensus.cc:2955] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.807327 22475 raft_consensus.cc:2955] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.811345 22401 raft_consensus.cc:2955] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.815527 23129 raft_consensus.cc:2955] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.817703 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e8e9f45e270942459d8aa926ed037bec with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:43.828521 22296 catalog_manager.cc:5697] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:43.848301 23131 raft_consensus.cc:2955] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.853432 22538 tablet_service.cc:1558] Processing DeleteTablet for tablet e8e9f45e270942459d8aa926ed037bec with delete_type TABLET_DATA_TOMBSTONED (TS 8c3bcfa13ca74a24ab8999a408532932 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54490
I20260709 12:16:43.854938 23286 tablet_replica.cc:333] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:16:43.855990 23286 raft_consensus.cc:2243] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:43.856647 23286 raft_consensus.cc:2272] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:43.866063 22299 catalog_manager.cc:5697] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.872823 23286 ts_tablet_manager.cc:1916] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:43.848206 22401 raft_consensus.cc:2955] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.894754 23286 ts_tablet_manager.cc:1929] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:43.895193 22546 consensus_queue.cc:237] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:43.895205 23286 log.cc:1199] T e8e9f45e270942459d8aa926ed037bec P 8c3bcfa13ca74a24ab8999a408532932: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-2-root/wals/e8e9f45e270942459d8aa926ed037bec
I20260709 12:16:43.901417 22284 catalog_manager.cc:5028] TS 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): tablet e8e9f45e270942459d8aa926ed037bec (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:16:43.908237 22401 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:43.908288 23131 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:43.910084 23272 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:43.912744 23270 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:43.924026 23270 raft_consensus.cc:2955] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.927773 23129 raft_consensus.cc:2955] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.930675 22401 raft_consensus.cc:2955] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.944733 22299 catalog_manager.cc:5697] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:43.957449 22284 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c23bd5666c81480f8ce12f767a245571 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:43.967963 22458 tablet_service.cc:1558] Processing DeleteTablet for tablet c23bd5666c81480f8ce12f767a245571 with delete_type TABLET_DATA_TOMBSTONED (TS 25ebf14868c042dca42f54b3e251e1b2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36278
I20260709 12:16:43.968914 23285 tablet_replica.cc:333] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:16:43.970065 23285 raft_consensus.cc:2243] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:43.970772 23285 raft_consensus.cc:2272] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:43.974766 23285 ts_tablet_manager.cc:1916] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:43.994477 23285 ts_tablet_manager.cc:1929] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:43.994872 23285 log.cc:1199] T c23bd5666c81480f8ce12f767a245571 P 25ebf14868c042dca42f54b3e251e1b2: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-1-root/wals/c23bd5666c81480f8ce12f767a245571
I20260709 12:16:44.000749 22285 catalog_manager.cc:5028] TS 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): tablet c23bd5666c81480f8ce12f767a245571 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:16:45.054217 22547 consensus_queue.cc:237] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:45.060122 22470 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:45.060581 22515 consensus_peers.cc:597] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b59a53e40d134aaa9cfbc682ee81be3e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:45.061471 22397 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:45.062050 23305 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.062831 23300 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.077288 23298 raft_consensus.cc:2955] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:45.085299 22470 raft_consensus.cc:2955] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:45.093909 22397 raft_consensus.cc:2955] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:45.106839 22296 catalog_manager.cc:5697] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:45.108614 22401 consensus_queue.cc:237] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:16:45.128407 22366 consensus_peers.cc:597] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 41ad743163ad40dba602eb017e958a78. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:45.129151 22546 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:45.130378 23308 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.131119 22470 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:45.132390 23308 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.147848 23308 raft_consensus.cc:2955] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:45.148881 22547 raft_consensus.cc:2955] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:45.163170 22399 consensus_queue.cc:237] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:45.166487 22475 raft_consensus.cc:2955] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:45.179276 22546 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:45.182389 22366 consensus_peers.cc:597] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2dae2730adf94f9da39f2dffbb692494. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:45.182425 23226 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:45.183099 22470 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:45.186980 23301 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.194479 22297 catalog_manager.cc:5697] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:45.198024 23301 raft_consensus.cc:2955] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:45.202412 22546 raft_consensus.cc:2955] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:45.205710 22475 raft_consensus.cc:2955] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:45.215171 22547 consensus_queue.cc:237] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:45.223150 22399 raft_consensus.cc:1275] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:45.223322 22515 consensus_peers.cc:597] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db333e4f6a9549d88edc232a61e2fc65. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:45.223994 22475 raft_consensus.cc:1275] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:45.220685 22296 catalog_manager.cc:5697] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:45.226883 23298 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.227753 23306 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.241343 23298 raft_consensus.cc:2955] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:45.243458 22399 raft_consensus.cc:2955] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:45.244334 22475 raft_consensus.cc:2955] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:45.264065 22299 catalog_manager.cc:5697] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:45.543318 23152 debug-util.cc:398] Leaking SignalData structure 0x7b08002347c0 after lost signal to thread 21247
W20260709 12:16:45.545717 23152 debug-util.cc:398] Leaking SignalData structure 0x7b08000f8ee0 after lost signal to thread 22333
W20260709 12:16:45.549010 23152 debug-util.cc:398] Leaking SignalData structure 0x7b0800275580 after lost signal to thread 22426
W20260709 12:16:45.551894 23152 debug-util.cc:398] Leaking SignalData structure 0x7b0800306c60 after lost signal to thread 22501
W20260709 12:16:45.555444 23152 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef620 after lost signal to thread 22575
I20260709 12:16:45.632884 23330 ts_tablet_manager.cc:933] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:45.675263 23152 debug-util.cc:398] Leaking SignalData structure 0x7b08002ad560 after lost signal to thread 23155
I20260709 12:16:45.762894 23333 ts_tablet_manager.cc:933] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:45.787014 23333 tablet_copy_client.cc:323] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.3:38645
I20260709 12:16:45.792757 22561 tablet_copy_service.cc:140] P 8c3bcfa13ca74a24ab8999a408532932: Received BeginTabletCopySession request for tablet db333e4f6a9549d88edc232a61e2fc65 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:49290)
I20260709 12:16:45.793452 22561 tablet_copy_service.cc:161] P 8c3bcfa13ca74a24ab8999a408532932: Beginning new tablet copy session on tablet db333e4f6a9549d88edc232a61e2fc65 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:49290: session id = 65951063312d4a1e9123f92354101c71-db333e4f6a9549d88edc232a61e2fc65
I20260709 12:16:45.824231 23330 tablet_copy_client.cc:323] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.3:38645
I20260709 12:16:45.831493 22560 tablet_copy_service.cc:140] P 8c3bcfa13ca74a24ab8999a408532932: Received BeginTabletCopySession request for tablet b59a53e40d134aaa9cfbc682ee81be3e from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:49290)
I20260709 12:16:45.832201 22560 tablet_copy_service.cc:161] P 8c3bcfa13ca74a24ab8999a408532932: Beginning new tablet copy session on tablet b59a53e40d134aaa9cfbc682ee81be3e from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:49290: session id = 65951063312d4a1e9123f92354101c71-b59a53e40d134aaa9cfbc682ee81be3e
I20260709 12:16:45.838913 23339 ts_tablet_manager.cc:933] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:16:45.859825 23340 ts_tablet_manager.cc:933] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:16:45.873003 22560 tablet_copy_source_session.cc:215] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:45.894250 23340 tablet_copy_client.cc:323] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.1:37927
I20260709 12:16:45.895292 23330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59a53e40d134aaa9cfbc682ee81be3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:45.896438 22412 tablet_copy_service.cc:140] P b8621fa34be04d3fa2d68a300f858cd1: Received BeginTabletCopySession request for tablet 41ad743163ad40dba602eb017e958a78 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:58054)
I20260709 12:16:45.897029 22412 tablet_copy_service.cc:161] P b8621fa34be04d3fa2d68a300f858cd1: Beginning new tablet copy session on tablet 41ad743163ad40dba602eb017e958a78 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:58054: session id = 65951063312d4a1e9123f92354101c71-41ad743163ad40dba602eb017e958a78
I20260709 12:16:45.908609 22561 tablet_copy_source_session.cc:215] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:45.910676 23339 tablet_copy_client.cc:323] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.1:37927
I20260709 12:16:45.962093 23333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db333e4f6a9549d88edc232a61e2fc65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:45.969117 22412 tablet_copy_source_session.cc:215] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:45.993475 23340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ad743163ad40dba602eb017e958a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:46.003818 22412 tablet_copy_service.cc:140] P b8621fa34be04d3fa2d68a300f858cd1: Received BeginTabletCopySession request for tablet 2dae2730adf94f9da39f2dffbb692494 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:58054)
I20260709 12:16:46.004420 22412 tablet_copy_service.cc:161] P b8621fa34be04d3fa2d68a300f858cd1: Beginning new tablet copy session on tablet 2dae2730adf94f9da39f2dffbb692494 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:58054: session id = 65951063312d4a1e9123f92354101c71-2dae2730adf94f9da39f2dffbb692494
I20260709 12:16:46.006700 23330 tablet_copy_client.cc:806] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:46.007352 23330 tablet_copy_client.cc:670] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:46.009827 23333 tablet_copy_client.cc:806] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:46.010337 23333 tablet_copy_client.cc:670] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:46.014729 23333 tablet_copy_client.cc:538] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:46.025314 23333 tablet_bootstrap.cc:492] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:16:46.028307 23330 tablet_copy_client.cc:538] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:46.067085 22412 tablet_copy_source_session.cc:215] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:46.071188 23339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dae2730adf94f9da39f2dffbb692494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:46.085600 23330 tablet_bootstrap.cc:492] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:16:46.088719 23339 tablet_copy_client.cc:806] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:46.089322 23339 tablet_copy_client.cc:670] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:46.097007 23333 tablet_bootstrap.cc:492] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:46.097883 23339 tablet_copy_client.cc:538] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:46.097997 23333 tablet_bootstrap.cc:492] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:16:46.098901 23333 ts_tablet_manager.cc:1403] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.074s	user 0.026s	sys 0.001s
I20260709 12:16:46.109133 23333 raft_consensus.cc:359] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:46.110466 23333 raft_consensus.cc:740] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:16:46.111764 23339 tablet_bootstrap.cc:492] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:16:46.112828 23340 tablet_copy_client.cc:806] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:46.115715 23340 tablet_copy_client.cc:670] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:46.116945 23333 consensus_queue.cc:260] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:46.125130 23340 tablet_copy_client.cc:538] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:46.144141 23333 ts_tablet_manager.cc:1434] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.045s	user 0.021s	sys 0.005s
I20260709 12:16:46.146008 22560 tablet_copy_service.cc:342] P 8c3bcfa13ca74a24ab8999a408532932: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-db333e4f6a9549d88edc232a61e2fc65 received from {username='slave'} at 127.0.0.1:49290
I20260709 12:16:46.146513 22560 tablet_copy_service.cc:434] P 8c3bcfa13ca74a24ab8999a408532932: ending tablet copy session 65951063312d4a1e9123f92354101c71-db333e4f6a9549d88edc232a61e2fc65 on tablet db333e4f6a9549d88edc232a61e2fc65 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:16:46.150918 23129 raft_consensus.cc:1217] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:46.178599 23340 tablet_bootstrap.cc:492] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:16:46.184689 23339 tablet_bootstrap.cc:492] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:46.185745 23339 tablet_bootstrap.cc:492] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:16:46.192384 23339 ts_tablet_manager.cc:1403] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.081s	user 0.025s	sys 0.001s
I20260709 12:16:46.196652 23330 tablet_bootstrap.cc:492] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:46.197660 23330 tablet_bootstrap.cc:492] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:16:46.198405 23330 ts_tablet_manager.cc:1403] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.113s	user 0.018s	sys 0.010s
I20260709 12:16:46.199806 23339 raft_consensus.cc:359] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:46.200687 23339 raft_consensus.cc:740] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:16:46.201675 23339 consensus_queue.cc:260] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:46.209293 23339 ts_tablet_manager.cc:1434] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:16:46.201742 23330 raft_consensus.cc:359] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:46.210685 23330 raft_consensus.cc:740] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:16:46.211547 22412 tablet_copy_service.cc:342] P b8621fa34be04d3fa2d68a300f858cd1: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-2dae2730adf94f9da39f2dffbb692494 received from {username='slave'} at 127.0.0.1:58054
I20260709 12:16:46.212037 22412 tablet_copy_service.cc:434] P b8621fa34be04d3fa2d68a300f858cd1: ending tablet copy session 65951063312d4a1e9123f92354101c71-2dae2730adf94f9da39f2dffbb692494 on tablet 2dae2730adf94f9da39f2dffbb692494 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:16:46.211423 23330 consensus_queue.cc:260] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:46.216514 23330 ts_tablet_manager.cc:1434] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:16:46.222045 22560 tablet_copy_service.cc:342] P 8c3bcfa13ca74a24ab8999a408532932: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-b59a53e40d134aaa9cfbc682ee81be3e received from {username='slave'} at 127.0.0.1:49290
I20260709 12:16:46.222517 22560 tablet_copy_service.cc:434] P 8c3bcfa13ca74a24ab8999a408532932: ending tablet copy session 65951063312d4a1e9123f92354101c71-b59a53e40d134aaa9cfbc682ee81be3e on tablet b59a53e40d134aaa9cfbc682ee81be3e with peer 65951063312d4a1e9123f92354101c71
I20260709 12:16:46.230427 23340 tablet_bootstrap.cc:492] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:46.231468 23340 tablet_bootstrap.cc:492] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:16:46.233287 23340 ts_tablet_manager.cc:1403] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.055s	user 0.028s	sys 0.000s
I20260709 12:16:46.259846 23340 raft_consensus.cc:359] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:46.260864 23340 raft_consensus.cc:740] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:16:46.261574 23340 consensus_queue.cc:260] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:46.264591 23340 ts_tablet_manager.cc:1434] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.003s
I20260709 12:16:46.268154 22412 tablet_copy_service.cc:342] P b8621fa34be04d3fa2d68a300f858cd1: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-41ad743163ad40dba602eb017e958a78 received from {username='slave'} at 127.0.0.1:58054
I20260709 12:16:46.268625 22412 tablet_copy_service.cc:434] P b8621fa34be04d3fa2d68a300f858cd1: ending tablet copy session 65951063312d4a1e9123f92354101c71-41ad743163ad40dba602eb017e958a78 on tablet 41ad743163ad40dba602eb017e958a78 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:16:46.288646 23129 raft_consensus.cc:1217] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:46.599756 23129 raft_consensus.cc:1217] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:46.624572 23331 raft_consensus.cc:1064] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:16:46.627372 23331 consensus_queue.cc:237] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:46.666558 23129 raft_consensus.cc:1275] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:46.667814 22399 raft_consensus.cc:1275] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:46.669672 23305 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:46.672794 23305 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:46.688436 23128 raft_consensus.cc:1217] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:46.732524 22469 raft_consensus.cc:1275] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:46.751865 23308 raft_consensus.cc:1064] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:16:46.754532 23308 consensus_queue.cc:237] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:46.787911 23353 raft_consensus.cc:2955] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:46.791754 23305 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:46.802291 22399 raft_consensus.cc:2955] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:46.806936 23129 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:46.809365 22546 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:46.811316 23209 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:46.814170 23209 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:46.815199 22469 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:46.816504 23209 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:46.823256 23128 raft_consensus.cc:2955] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:46.855754 22297 catalog_manager.cc:5697] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:46.860598 22477 raft_consensus.cc:2955] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:46.940830 23308 raft_consensus.cc:2955] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:46.952013 22546 raft_consensus.cc:2955] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:46.981840 23128 raft_consensus.cc:2955] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.022874 22299 catalog_manager.cc:5697] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:47.060719 22475 raft_consensus.cc:2955] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.068454 22397 consensus_queue.cc:237] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:47.086184 23128 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:47.087790 22475 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:47.088459 23308 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:47.089816 23209 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:47.114292 23352 raft_consensus.cc:2955] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.122598 23128 raft_consensus.cc:2955] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.139905 23331 raft_consensus.cc:1064] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:16:47.140782 22469 raft_consensus.cc:2955] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.142663 23331 consensus_queue.cc:237] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:47.160079 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2dae2730adf94f9da39f2dffbb692494 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:47.168159 22299 catalog_manager.cc:5697] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:47.184757 22469 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:47.185757 22393 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:47.191002 23300 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:47.193885 23331 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:47.198230 22538 tablet_service.cc:1558] Processing DeleteTablet for tablet 2dae2730adf94f9da39f2dffbb692494 with delete_type TABLET_DATA_TOMBSTONED (TS 8c3bcfa13ca74a24ab8999a408532932 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54490
I20260709 12:16:47.200474 23128 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:47.202214 23300 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:47.225942 23353 raft_consensus.cc:2955] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.227914 23128 raft_consensus.cc:2955] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.296242 23209 raft_consensus.cc:1064] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:16:47.311728 23209 consensus_queue.cc:237] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:47.283455 22393 raft_consensus.cc:2955] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.327144 22299 catalog_manager.cc:5697] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.368000 23365 tablet_replica.cc:333] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:16:47.369201 23365 raft_consensus.cc:2243] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:47.370489 22546 consensus_queue.cc:237] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:47.376377 23365 raft_consensus.cc:2272] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:47.392871 23129 raft_consensus.cc:1275] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:47.425406 23365 ts_tablet_manager.cc:1916] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:16:47.436652 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 43553.5us
W20260709 12:16:47.389556 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 120852us
W20260709 12:16:47.488380 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 52294.9us
I20260709 12:16:47.511749 23128 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:47.504462 23305 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:16:47.562942 22471 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:47.578265 23365 ts_tablet_manager.cc:1929] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:47.579355 23365 log.cc:1199] T 2dae2730adf94f9da39f2dffbb692494 P 8c3bcfa13ca74a24ab8999a408532932: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-2-root/wals/2dae2730adf94f9da39f2dffbb692494
I20260709 12:16:47.581013 22545 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:47.595779 23378 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:47.606571 23383 raft_consensus.cc:2955] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.632863 23128 raft_consensus.cc:2955] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.647691 22298 catalog_manager.cc:5697] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:16:47.700448 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 192401us
I20260709 12:16:47.761416 22387 tablet_service.cc:1558] Processing DeleteTablet for tablet db333e4f6a9549d88edc232a61e2fc65 with delete_type TABLET_DATA_TOMBSTONED (TS b8621fa34be04d3fa2d68a300f858cd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48918
I20260709 12:16:47.769343 23386 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 12:16:47.778205 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 54171.4us
W20260709 12:16:47.778800 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 71437.6us
I20260709 12:16:47.780777 23390 tablet_replica.cc:333] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:16:47.789288 23368 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:47.792558 23390 raft_consensus.cc:2243] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:16:47.800024 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 283183us
I20260709 12:16:47.800868 23390 raft_consensus.cc:2272] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:47.807883 23390 ts_tablet_manager.cc:1916] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:47.811466 22471 raft_consensus.cc:1275] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:47.813899 22284 catalog_manager.cc:5028] TS 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): tablet 2dae2730adf94f9da39f2dffbb692494 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:16:47.816789 22469 raft_consensus.cc:2955] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.832401 22284 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet db333e4f6a9549d88edc232a61e2fc65 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:47.855101 22545 consensus_queue.cc:237] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:47.864816 23129 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:47.866780 23390 ts_tablet_manager.cc:1929] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:47.867422 23390 log.cc:1199] T db333e4f6a9549d88edc232a61e2fc65 P b8621fa34be04d3fa2d68a300f858cd1: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-0-root/wals/db333e4f6a9549d88edc232a61e2fc65
I20260709 12:16:47.867333 23375 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:47.870005 22285 catalog_manager.cc:5028] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): tablet db333e4f6a9549d88edc232a61e2fc65 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:16:47.878453 23383 raft_consensus.cc:2955] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.882776 23386 raft_consensus.cc:2955] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.886098 23128 raft_consensus.cc:2955] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.896737 23130 raft_consensus.cc:2955] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.897159 22469 raft_consensus.cc:2955] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.910442 22296 catalog_manager.cc:5697] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.915756 23353 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:47.916599 22298 catalog_manager.cc:5697] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.927819 22284 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b59a53e40d134aaa9cfbc682ee81be3e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:47.928790 22546 raft_consensus.cc:2955] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.930541 22471 raft_consensus.cc:2955] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.933880 22387 tablet_service.cc:1558] Processing DeleteTablet for tablet b59a53e40d134aaa9cfbc682ee81be3e with delete_type TABLET_DATA_TOMBSTONED (TS b8621fa34be04d3fa2d68a300f858cd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48918
I20260709 12:16:47.947957 22469 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:47.956212 23390 tablet_replica.cc:333] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:16:47.964764 22399 consensus_queue.cc:237] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:47.974304 23390 raft_consensus.cc:2243] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:47.975759 23130 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:47.980836 23390 raft_consensus.cc:2272] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:47.982353 23368 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:47.992430 23353 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:16:47.996910 23390 ts_tablet_manager.cc:1916] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:47.996151 23386 raft_consensus.cc:2955] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:47.999264 23130 raft_consensus.cc:2955] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:48.005086 22547 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:48.009999 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 41ad743163ad40dba602eb017e958a78 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:48.011477 23379 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:48.015940 22547 raft_consensus.cc:2955] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:48.017092 22297 catalog_manager.cc:5697] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:48.028807 22458 tablet_service.cc:1558] Processing DeleteTablet for tablet 41ad743163ad40dba602eb017e958a78 with delete_type TABLET_DATA_TOMBSTONED (TS 25ebf14868c042dca42f54b3e251e1b2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36278
I20260709 12:16:48.024133 23390 ts_tablet_manager.cc:1929] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:48.037066 23390 log.cc:1199] T b59a53e40d134aaa9cfbc682ee81be3e P b8621fa34be04d3fa2d68a300f858cd1: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-0-root/wals/b59a53e40d134aaa9cfbc682ee81be3e
I20260709 12:16:48.037699 23393 tablet_replica.cc:333] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:16:48.041143 22285 catalog_manager.cc:5028] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): tablet b59a53e40d134aaa9cfbc682ee81be3e (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:16:48.032218 22469 raft_consensus.cc:2955] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:48.075053 23393 raft_consensus.cc:2243] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:48.076962 23393 raft_consensus.cc:2272] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:48.083215 23393 ts_tablet_manager.cc:1916] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:48.102788 23393 ts_tablet_manager.cc:1929] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:48.103319 23393 log.cc:1199] T 41ad743163ad40dba602eb017e958a78 P 25ebf14868c042dca42f54b3e251e1b2: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-1-root/wals/41ad743163ad40dba602eb017e958a78
I20260709 12:16:48.105077 22285 catalog_manager.cc:5028] TS 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): tablet 41ad743163ad40dba602eb017e958a78 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:16:49.156471 22546 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:49.167522 22471 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:49.169504 22515 consensus_peers.cc:597] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3367203e404b4201ac57986dc36a032e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:49.170271 23382 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:49.173424 22393 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:49.176276 23395 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:49.185398 23383 raft_consensus.cc:2955] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:49.188244 22393 raft_consensus.cc:2955] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:49.190191 22471 raft_consensus.cc:2955] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:49.200052 22399 consensus_queue.cc:237] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:49.208174 22296 catalog_manager.cc:5697] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:49.223449 22366 consensus_peers.cc:597] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4931c1eea6843949b1447b3e6106340. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:49.225390 22546 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:49.227012 22469 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:49.226852 23379 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:49.230307 23379 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:49.250982 23386 raft_consensus.cc:2955] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:49.272356 22546 raft_consensus.cc:2955] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:49.284111 22399 consensus_queue.cc:237] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:49.312817 22547 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:49.314632 22366 consensus_peers.cc:597] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eed3b8d7432b461c802823d02d952440. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:49.316300 23379 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:49.321065 22475 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:49.323004 23405 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:49.326635 22471 raft_consensus.cc:2955] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:49.355002 22299 catalog_manager.cc:5697] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:49.370056 23379 raft_consensus.cc:2955] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:49.385596 22476 raft_consensus.cc:2955] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:49.389513 22296 catalog_manager.cc:5697] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:49.386394 22547 raft_consensus.cc:2955] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:49.394716 22471 consensus_queue.cc:237] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:16:49.449265 22441 consensus_peers.cc:597] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c98e38137cdf48ddae2d7d3311ccb425. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:49.450918 22393 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:49.451319 22546 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:49.452628 23402 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:49.453363 23389 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:49.468153 23389 raft_consensus.cc:2955] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:49.471553 22393 raft_consensus.cc:2955] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:49.477005 22546 raft_consensus.cc:2955] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:49.490985 22297 catalog_manager.cc:5697] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:49.694280 23417 ts_tablet_manager.cc:933] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:49.696081 23417 tablet_copy_client.cc:323] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.3:38645
I20260709 12:16:49.697907 22560 tablet_copy_service.cc:140] P 8c3bcfa13ca74a24ab8999a408532932: Received BeginTabletCopySession request for tablet 3367203e404b4201ac57986dc36a032e from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:49290)
I20260709 12:16:49.698457 22560 tablet_copy_service.cc:161] P 8c3bcfa13ca74a24ab8999a408532932: Beginning new tablet copy session on tablet 3367203e404b4201ac57986dc36a032e from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:49290: session id = 65951063312d4a1e9123f92354101c71-3367203e404b4201ac57986dc36a032e
I20260709 12:16:49.706950 22560 tablet_copy_source_session.cc:215] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:49.710992 23417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3367203e404b4201ac57986dc36a032e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:49.731534 23417 tablet_copy_client.cc:806] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:49.732307 23417 tablet_copy_client.cc:670] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:49.736699 23417 tablet_copy_client.cc:538] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:49.745697 23417 tablet_bootstrap.cc:492] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:16:49.781992 23417 tablet_bootstrap.cc:492] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:49.783185 23417 tablet_bootstrap.cc:492] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:16:49.785208 23417 ts_tablet_manager.cc:1403] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.011s
I20260709 12:16:49.789675 23420 ts_tablet_manager.cc:933] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:16:49.790759 23417 raft_consensus.cc:359] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:49.794448 23417 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:16:49.795260 23417 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:49.811578 23420 tablet_copy_client.cc:323] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.1:37927
I20260709 12:16:49.813419 22412 tablet_copy_service.cc:140] P b8621fa34be04d3fa2d68a300f858cd1: Received BeginTabletCopySession request for tablet eed3b8d7432b461c802823d02d952440 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:58054)
I20260709 12:16:49.814052 22412 tablet_copy_service.cc:161] P b8621fa34be04d3fa2d68a300f858cd1: Beginning new tablet copy session on tablet eed3b8d7432b461c802823d02d952440 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:58054: session id = 65951063312d4a1e9123f92354101c71-eed3b8d7432b461c802823d02d952440
I20260709 12:16:49.816002 23417 ts_tablet_manager.cc:1434] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.005s
I20260709 12:16:49.818337 22560 tablet_copy_service.cc:342] P 8c3bcfa13ca74a24ab8999a408532932: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-3367203e404b4201ac57986dc36a032e received from {username='slave'} at 127.0.0.1:49290
I20260709 12:16:49.819442 23421 ts_tablet_manager.cc:933] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:16:49.819633 22560 tablet_copy_service.cc:434] P 8c3bcfa13ca74a24ab8999a408532932: ending tablet copy session 65951063312d4a1e9123f92354101c71-3367203e404b4201ac57986dc36a032e on tablet 3367203e404b4201ac57986dc36a032e with peer 65951063312d4a1e9123f92354101c71
I20260709 12:16:49.826087 22412 tablet_copy_source_session.cc:215] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:49.829752 23420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed3b8d7432b461c802823d02d952440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:49.836004 23421 tablet_copy_client.cc:323] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.1:37927
I20260709 12:16:49.837637 22412 tablet_copy_service.cc:140] P b8621fa34be04d3fa2d68a300f858cd1: Received BeginTabletCopySession request for tablet e4931c1eea6843949b1447b3e6106340 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:58054)
I20260709 12:16:49.838299 22412 tablet_copy_service.cc:161] P b8621fa34be04d3fa2d68a300f858cd1: Beginning new tablet copy session on tablet e4931c1eea6843949b1447b3e6106340 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:58054: session id = 65951063312d4a1e9123f92354101c71-e4931c1eea6843949b1447b3e6106340
I20260709 12:16:49.849404 23420 tablet_copy_client.cc:806] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:49.850157 23420 tablet_copy_client.cc:670] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:49.851848 22412 tablet_copy_source_session.cc:215] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:49.855530 23421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4931c1eea6843949b1447b3e6106340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:49.876772 23420 tablet_copy_client.cc:538] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:49.919009 23421 tablet_copy_client.cc:806] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:49.923301 23420 tablet_bootstrap.cc:492] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:16:49.923962 23421 tablet_copy_client.cc:670] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:49.927599 23421 tablet_copy_client.cc:538] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:49.937566 23421 tablet_bootstrap.cc:492] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:16:49.969986 23421 tablet_bootstrap.cc:492] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:49.971103 23421 tablet_bootstrap.cc:492] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:16:49.971931 23421 ts_tablet_manager.cc:1403] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.008s
I20260709 12:16:49.975067 23421 raft_consensus.cc:359] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:49.976025 23421 raft_consensus.cc:740] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:16:49.976747 23421 consensus_queue.cc:260] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:49.979194 23421 ts_tablet_manager.cc:1434] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:49.970213 23420 tablet_bootstrap.cc:492] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:49.981024 22411 tablet_copy_service.cc:342] P b8621fa34be04d3fa2d68a300f858cd1: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-e4931c1eea6843949b1447b3e6106340 received from {username='slave'} at 127.0.0.1:58054
I20260709 12:16:49.981452 22411 tablet_copy_service.cc:434] P b8621fa34be04d3fa2d68a300f858cd1: ending tablet copy session 65951063312d4a1e9123f92354101c71-e4931c1eea6843949b1447b3e6106340 on tablet e4931c1eea6843949b1447b3e6106340 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:16:49.981729 23420 tablet_bootstrap.cc:492] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:16:49.984543 23420 ts_tablet_manager.cc:1403] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.018s
I20260709 12:16:49.992656 23420 raft_consensus.cc:359] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:49.993676 23420 raft_consensus.cc:740] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:16:49.994465 23420 consensus_queue.cc:260] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:49.997551 23420 ts_tablet_manager.cc:1434] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 12:16:49.999287 22411 tablet_copy_service.cc:342] P b8621fa34be04d3fa2d68a300f858cd1: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-eed3b8d7432b461c802823d02d952440 received from {username='slave'} at 127.0.0.1:58054
I20260709 12:16:49.999715 22411 tablet_copy_service.cc:434] P b8621fa34be04d3fa2d68a300f858cd1: ending tablet copy session 65951063312d4a1e9123f92354101c71-eed3b8d7432b461c802823d02d952440 on tablet eed3b8d7432b461c802823d02d952440 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:16:50.007937 23420 ts_tablet_manager.cc:933] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:50.030438 23420 tablet_copy_client.cc:323] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.2:46187
I20260709 12:16:50.033454 22487 tablet_copy_service.cc:140] P 25ebf14868c042dca42f54b3e251e1b2: Received BeginTabletCopySession request for tablet c98e38137cdf48ddae2d7d3311ccb425 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:43060)
I20260709 12:16:50.034075 22487 tablet_copy_service.cc:161] P 25ebf14868c042dca42f54b3e251e1b2: Beginning new tablet copy session on tablet c98e38137cdf48ddae2d7d3311ccb425 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:43060: session id = 65951063312d4a1e9123f92354101c71-c98e38137cdf48ddae2d7d3311ccb425
I20260709 12:16:50.043401 22487 tablet_copy_source_session.cc:215] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:50.046526 23420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98e38137cdf48ddae2d7d3311ccb425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:50.066787 23420 tablet_copy_client.cc:806] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:50.067414 23420 tablet_copy_client.cc:670] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:50.080328 23420 tablet_copy_client.cc:538] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:50.088533 23420 tablet_bootstrap.cc:492] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:16:50.122546 23420 tablet_bootstrap.cc:492] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:50.123342 23420 tablet_bootstrap.cc:492] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:16:50.123955 23420 ts_tablet_manager.cc:1403] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.004s
I20260709 12:16:50.126127 23420 raft_consensus.cc:359] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:50.126796 23420 raft_consensus.cc:740] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:16:50.127369 23420 consensus_queue.cc:260] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:50.129379 23420 ts_tablet_manager.cc:1434] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:50.139050 22487 tablet_copy_service.cc:342] P 25ebf14868c042dca42f54b3e251e1b2: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-c98e38137cdf48ddae2d7d3311ccb425 received from {username='slave'} at 127.0.0.1:43060
I20260709 12:16:50.139603 22487 tablet_copy_service.cc:434] P 25ebf14868c042dca42f54b3e251e1b2: ending tablet copy session 65951063312d4a1e9123f92354101c71-c98e38137cdf48ddae2d7d3311ccb425 on tablet c98e38137cdf48ddae2d7d3311ccb425 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:16:50.213709 23130 raft_consensus.cc:1217] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:50.284449 23130 raft_consensus.cc:1217] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:50.387849 23130 raft_consensus.cc:1217] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:50.435142 23130 raft_consensus.cc:1217] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:50.651186 23379 raft_consensus.cc:1064] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:16:50.653623 23379 consensus_queue.cc:237] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:50.666579 23130 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:50.668483 23386 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:50.670380 22545 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:50.678048 22476 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:50.678643 23379 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:50.680552 23386 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:50.708237 23379 raft_consensus.cc:2955] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:50.711472 22545 raft_consensus.cc:2955] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:50.732959 22475 raft_consensus.cc:2955] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:50.735570 22296 catalog_manager.cc:5697] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:50.738941 23128 raft_consensus.cc:2955] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:50.831095 23386 raft_consensus.cc:1064] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:16:50.831485 23383 raft_consensus.cc:1064] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:16:50.833683 23386 consensus_queue.cc:237] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:50.837100 23383 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:50.847424 22393 consensus_queue.cc:237] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:50.859520 23130 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:50.861281 23429 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:50.868928 23128 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:50.870915 22476 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:50.872390 22471 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:50.875900 22545 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:50.879681 23403 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:50.881040 23441 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:50.883294 23441 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:50.885218 22476 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:50.887789 23382 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:50.892371 23386 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:50.894320 22393 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:50.897894 23429 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:50.903740 23130 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:50.906925 23441 raft_consensus.cc:2955] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:50.914331 22476 raft_consensus.cc:2955] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:50.948951 23386 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:50.969724 22299 catalog_manager.cc:5697] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:51.002014 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e4931c1eea6843949b1447b3e6106340 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:51.012709 23383 raft_consensus.cc:2955] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:51.046793 23389 raft_consensus.cc:1064] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
W20260709 12:16:51.124944 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 166361us
I20260709 12:16:51.128618 23389 consensus_queue.cc:237] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:16:51.168713 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 160367us
I20260709 12:16:51.179243 22399 raft_consensus.cc:2955] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:16:51.229295 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 53284.2us
I20260709 12:16:51.243023 22545 raft_consensus.cc:2955] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:16:51.293128 23432 log.cc:927] Time spent T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:16:51.308559 22299 catalog_manager.cc:5697] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:51.376614 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 129048us
I20260709 12:16:51.237244 23128 raft_consensus.cc:2955] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:51.173995 23443 raft_consensus.cc:2955] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:51.543744 23129 raft_consensus.cc:2955] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:51.694111 23130 raft_consensus.cc:2955] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:16:51.759722 22516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.006s	sys 0.003s
W20260709 12:16:51.760159 22516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.006s	sys 0.003s
I20260709 12:16:51.764814 22393 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:51.766520 22538 tablet_service.cc:1558] Processing DeleteTablet for tablet e4931c1eea6843949b1447b3e6106340 with delete_type TABLET_DATA_TOMBSTONED (TS 8c3bcfa13ca74a24ab8999a408532932 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54490
I20260709 12:16:51.769927 23475 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:51.775954 23126 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 1 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:51.782648 23484 tablet_replica.cc:333] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:16:51.783337 22546 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:16:51.794518 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 45162.6us
I20260709 12:16:51.819124 22297 catalog_manager.cc:5697] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:16:51.825332 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 58072.3us
I20260709 12:16:51.846181 23467 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:51.851707 22393 consensus_queue.cc:237] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:51.887203 23129 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:51.890172 23386 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:51.890518 22548 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:51.899945 22477 raft_consensus.cc:2955] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:51.911077 22471 raft_consensus.cc:2955] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:51.917642 23484 raft_consensus.cc:2243] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.918494 23484 raft_consensus.cc:2272] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.924686 23467 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:51.925560 23386 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:51.927839 23451 raft_consensus.cc:2955] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:51.937889 23484 ts_tablet_manager.cc:1916] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:51.940263 23129 raft_consensus.cc:2955] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:51.942972 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eed3b8d7432b461c802823d02d952440 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:51.955199 22298 catalog_manager.cc:5697] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:51.967372 22458 tablet_service.cc:1558] Processing DeleteTablet for tablet eed3b8d7432b461c802823d02d952440 with delete_type TABLET_DATA_TOMBSTONED (TS 25ebf14868c042dca42f54b3e251e1b2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36278
I20260709 12:16:51.968998 22548 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:51.974606 22547 raft_consensus.cc:2955] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:51.986562 23129 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:51.988358 23473 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:51.992285 23492 tablet_replica.cc:333] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:16:51.999562 23482 raft_consensus.cc:2955] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:52.001732 23492 raft_consensus.cc:2243] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.006812 23128 raft_consensus.cc:2955] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:52.010164 22471 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:52.005514 23484 ts_tablet_manager.cc:1929] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:52.011163 23484 log.cc:1199] T e4931c1eea6843949b1447b3e6106340 P 8c3bcfa13ca74a24ab8999a408532932: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-2-root/wals/e4931c1eea6843949b1447b3e6106340
I20260709 12:16:52.010907 23492 raft_consensus.cc:2272] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.011925 23473 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:52.016825 23492 ts_tablet_manager.cc:1916] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:52.017714 22284 catalog_manager.cc:5028] TS 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): tablet e4931c1eea6843949b1447b3e6106340 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:16:52.037109 23467 raft_consensus.cc:2955] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:52.043861 22471 raft_consensus.cc:2955] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:52.044070 23130 raft_consensus.cc:2955] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:52.053715 23492 ts_tablet_manager.cc:1929] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:52.060818 23492 log.cc:1199] T eed3b8d7432b461c802823d02d952440 P 25ebf14868c042dca42f54b3e251e1b2: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-1-root/wals/eed3b8d7432b461c802823d02d952440
I20260709 12:16:52.062718 22285 catalog_manager.cc:5028] TS 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): tablet eed3b8d7432b461c802823d02d952440 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:16:52.071043 22393 raft_consensus.cc:2955] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:52.087111 22299 catalog_manager.cc:5697] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:52.097175 22284 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3367203e404b4201ac57986dc36a032e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:52.132264 22297 catalog_manager.cc:5697] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New cstate: current_term: 1 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:52.170503 22387 tablet_service.cc:1558] Processing DeleteTablet for tablet 3367203e404b4201ac57986dc36a032e with delete_type TABLET_DATA_TOMBSTONED (TS b8621fa34be04d3fa2d68a300f858cd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48918
I20260709 12:16:52.250375 23494 tablet_replica.cc:333] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:16:52.251437 23494 raft_consensus.cc:2243] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.252283 23494 raft_consensus.cc:2272] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.254041 22471 consensus_queue.cc:237] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:52.257463 22543 raft_consensus.cc:2955] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:52.274307 23130 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:52.282059 23454 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:52.307166 23454 raft_consensus.cc:2955] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:52.308745 22543 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:52.324504 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c98e38137cdf48ddae2d7d3311ccb425 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:52.327680 22297 catalog_manager.cc:5697] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:52.334745 23475 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:52.340071 23130 raft_consensus.cc:2955] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:52.349666 22387 tablet_service.cc:1558] Processing DeleteTablet for tablet c98e38137cdf48ddae2d7d3311ccb425 with delete_type TABLET_DATA_TOMBSTONED (TS b8621fa34be04d3fa2d68a300f858cd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48918
I20260709 12:16:52.354883 23494 ts_tablet_manager.cc:1916] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:52.350627 22543 raft_consensus.cc:2955] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:16:52.369817 23494 ts_tablet_manager.cc:1929] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:52.370343 23494 log.cc:1199] T 3367203e404b4201ac57986dc36a032e P b8621fa34be04d3fa2d68a300f858cd1: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-0-root/wals/3367203e404b4201ac57986dc36a032e
I20260709 12:16:52.372182 23494 tablet_replica.cc:333] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:16:52.372689 22285 catalog_manager.cc:5028] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): tablet 3367203e404b4201ac57986dc36a032e (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:16:52.373275 23494 raft_consensus.cc:2243] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.374197 23494 raft_consensus.cc:2272] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.377730 23494 ts_tablet_manager.cc:1916] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:52.390002 23494 ts_tablet_manager.cc:1929] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:52.390321 23494 log.cc:1199] T c98e38137cdf48ddae2d7d3311ccb425 P b8621fa34be04d3fa2d68a300f858cd1: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-0-root/wals/c98e38137cdf48ddae2d7d3311ccb425
I20260709 12:16:52.391697 22285 catalog_manager.cc:5028] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): tablet c98e38137cdf48ddae2d7d3311ccb425 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:16:54.433952 23495 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.434584 23495 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.436919 23495 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.456048 23495 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:54.456899 23495 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.459667 23495 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:54.502172 21249 debug-util.cc:398] Leaking SignalData structure 0x7b080000f820 after lost signal to thread 22366
W20260709 12:16:54.502803 21249 kernel_stack_watchdog.cc:198] Thread 22366 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 111ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 12:16:54.530066 23495 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:54.530884 23495 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.533638 23495 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.541138 23502 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.555127 23505 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.557611 23500 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.576464 23500 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:54.576799 23505 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:54.579315 23500 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.579596 23505 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:54.579783 23500 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.576524 23502 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:54.580794 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:54.580387 23500 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:54.590433 23502 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.590659 23500 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.587409 23505 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:54.591815 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:54.592185 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:54.579962 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:54.591531 23505 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:54.571904 23501 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:54.580474 23454 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:16:54.615227 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 1.2254e+06us
I20260709 12:16:54.631508 23386 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.635097 23386 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.645828 23386 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.649132 23386 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.649634 23386 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.651369 23386 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.617623 23501 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.630295 23454 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.662256 23507 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.671077 23508 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:54.694047 23500 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.706507 23404 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.723820 23505 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.722023 23519 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.724645 23501 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.710675 23508 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.724937 23519 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.726039 23510 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.726545 23510 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.726972 23508 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.727080 23519 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:54.714654 23500 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:54.729020 23500 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.729805 23518 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.730104 23454 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.714934 23504 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.735034 23404 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.703768 23507 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:54.742314 23507 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:54.736976 22330 debug-util.cc:398] Leaking SignalData structure 0x7b0800039760 after lost signal to thread 21247
W20260709 12:16:54.744524 22330 debug-util.cc:398] Leaking SignalData structure 0x7b0800067ee0 after lost signal to thread 22333
I20260709 12:16:54.735991 23504 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:54.746065 22330 debug-util.cc:398] Leaking SignalData structure 0x7b08002c11c0 after lost signal to thread 22426
W20260709 12:16:54.747313 22330 debug-util.cc:398] Leaking SignalData structure 0x7b080033e0c0 after lost signal to thread 22501
I20260709 12:16:54.747576 23504 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:54.748488 22330 debug-util.cc:398] Leaking SignalData structure 0x7b08001f9940 after lost signal to thread 22575
I20260709 12:16:54.749418 23404 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:54.749743 22330 debug-util.cc:398] Leaking SignalData structure 0x7b0800322480 after lost signal to thread 23155
I20260709 12:16:54.758734 23495 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.758845 23504 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.759477 23495 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.760003 23512 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.758739 23527 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.759652 23507 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:54.765753 23511 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.765836 23499 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.730360 23518 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:54.772485 23521 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:54.762387 23504 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.776481 23510 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:54.779449 23507 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:54.795264 23503 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.796011 23495 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.793984 22477 consensus_queue.cc:237] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:54.777323 23517 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.791548 23512 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.807432 23516 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:54.808099 23516 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.795056 23525 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.795760 23503 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:16:54.778635 23499 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.821797 23528 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.788982 23527 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:54.802079 23521 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.830687 23527 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:54.830837 23521 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.831226 23527 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.833374 23527 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.834846 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:54.835551 23523 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.822355 23528 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.835938 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:54.836222 23514 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:54.818775 23513 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:54.842757 23386 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.843257 23386 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.844841 23386 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.790819 23511 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.818869 23506 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.835469 23527 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.845990 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:54.842705 23501 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:54.833096 23524 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.856184 23386 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.846679 23507 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:54.818925 23525 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:16:54.836081 23523 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:54.859498 23386 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.826375 23517 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.853487 23526 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.881791 23386 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.859299 23454 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.880998 23518 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:54.883720 23504 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.843142 23514 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.858392 23501 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.885331 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:54.897279 23507 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:54.887523 23404 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.897576 23503 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:16:54.895452 23530 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.895766 23499 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.895938 23497 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.896358 23515 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.896736 23512 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.852779 23513 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.890884 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:54.906805 23499 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.897830 23507 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:54.907367 23499 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.908658 23523 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:54.909149 23499 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.897934 23404 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.910087 23516 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.909155 23507 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.911168 23535 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.911391 23404 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.856554 23506 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.879046 23524 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.897996 23531 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.892848 23454 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.906996 23533 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:54.904385 23504 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.927361 23538 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.927553 23503 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.888862 23526 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.929261 23507 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:54.945569 23500 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.946058 23501 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.947404 23454 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.931706 23528 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:54.948877 23404 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.943034 23516 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.952739 23544 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:54.928537 23504 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:54.960600 23404 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.934315 23511 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.943379 23518 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.947894 23538 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.948614 23512 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.924758 23515 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.957901 23528 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:16:54.955849 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 75070.1us
I20260709 12:16:54.911736 23535 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.943545 23503 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.957125 23499 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.956693 23534 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:54.932282 23497 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.960403 23532 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.954499 23507 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:54.955631 23500 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:54.920989 23530 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.962270 23447 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.961858 23525 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:54.970337 23404 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.958029 23539 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.961576 23516 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.966148 23454 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.979512 23507 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.940373 23531 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.938767 23533 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.959596 23536 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:54.966374 23540 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.965049 23518 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.979944 23541 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.968986 23512 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:54.968137 23528 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.052276 23497 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:55.045918 23537 log.cc:927] Time spent T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:16:55.048950 23506 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:55.039199 23534 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:55.164892 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:55.131318 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:54.998515 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:16:55.177325 23128 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:55.131582 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:54.998808 23454 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.125340 23505 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:54.972281 23499 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.175688 23529 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:55.047645 23524 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:55.150823 23510 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:55.209903 23505 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:55.198952 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:16:54.966782 23544 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.197180 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:55.156663 23519 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:55.197517 23536 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.209525 23508 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:55.210180 23510 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.199632 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:16:55.213579 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:55.213946 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:55.061218 23500 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:55.214493 23534 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:55.214939 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:55.215211 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:55.215981 23454 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:55.216089 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:55.218146 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:55.219213 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:55.220908 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:55.220999 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:55.221215 22394 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 1.
I20260709 12:16:55.221446 23521 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:55.222010 23504 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:55.218884 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:55.142055 23527 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:55.175647 23516 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.975600 23511 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:55.123183 23514 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.983767 23447 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:55.247066 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:16:55.255371 23447 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:55.142799 23526 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:55.092198 23503 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:55.227468 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 60534.4us
I20260709 12:16:55.256021 23545 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:55.256482 23545 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:55.256840 23545 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.206710 23538 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:55.178876 23517 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:55.064532 23530 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:55.066269 23535 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:54.986117 23513 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:55.198961 23518 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:55.092463 23520 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:54.986843 23515 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:55.261163 23520 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.263470 23520 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:55.230934 22546 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:55.211248 23525 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:55.264161 23525 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.264562 23545 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:55.266245 23525 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:55.054174 23543 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:55.216859 23524 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:55.235508 22548 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:55.267194 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:55.197137 23540 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.053988 23542 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:55.226754 23512 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:55.270071 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:55.238057 23454 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:55.239634 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:55.272486 22393 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:55.246874 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:55.244920 23527 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.273239 22550 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 1.
I20260709 12:16:55.229672 23529 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:55.273988 23553 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:55.048694 23532 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.244329 23533 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:55.245095 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:55.250501 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:55.236263 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:55.247390 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:55.248212 23506 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:55.266974 23524 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.270203 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:55.239828 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:55.270679 22475 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 1.
I20260709 12:16:55.197374 23541 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.271131 23522 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:55.247623 23521 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.243577 23528 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:55.229122 23519 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.266640 23545 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:55.267769 22477 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 1.
I20260709 12:16:55.246397 23534 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:55.278868 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:55.278803 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:55.227842 23508 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.243453 22551 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 1.
I20260709 12:16:55.288561 23498 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:55.237699 22542 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 1.
I20260709 12:16:55.027410 23539 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.312814 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:55.281639 23542 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.277465 23454 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.313174 23552 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:55.281365 23553 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.274850 23543 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.272579 23551 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:55.315732 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:55.420531 23533 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:55.291460 23520 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:56.043138 23533 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.466432 23541 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:56.040360 23524 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:55.311363 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:16:55.463742 23521 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:55.462745 23531 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:56.074800 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:55.409920 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:55.421512 23540 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:55.430639 23529 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:55.433990 23510 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:56.069748 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:56.401723 22477 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:56.403164 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:56.404682 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:55.419041 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:56.408396 22470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43060 (request call id 18) took 1138 ms. Trace:
I20260709 12:16:56.408843 22470 rpcz_store.cc:276] 0709 12:16:55.270028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.272142 (+  2114us) service_pool.cc:224] Handling call
0709 12:16:56.408159 (+1136017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:55.430083 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:16:56.411461 22472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43060 (request call id 20) took 1139 ms (client timeout 1514 ms). Trace:
W20260709 12:16:56.412003 22472 rpcz_store.cc:269] 0709 12:16:55.272153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.278029 (+  5876us) service_pool.cc:224] Handling call
0709 12:16:56.411240 (+1133211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:55.387192 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:56.414402 22473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43060 (request call id 19) took 1142 ms. Trace:
I20260709 12:16:56.414757 22473 rpcz_store.cc:276] 0709 12:16:55.271869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.272053 (+   184us) service_pool.cc:224] Handling call
0709 12:16:56.414202 (+1142149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:55.324738 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:16:56.064800 22517 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:54498 dropped due to backpressure: service queue is full with 50 items
I20260709 12:16:56.067335 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:56.506776 22542 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:16:56.507495 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1118) took 1244 ms. Trace:
I20260709 12:16:56.507871 22542 rpcz_store.cc:276] 0709 12:16:55.263219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:56.067017 (+803798us) service_pool.cc:224] Handling call
0709 12:16:56.507404 (+440387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:56.509289 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:56.042166 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:55.371963 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:56.066412 22468 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 1.
I20260709 12:16:56.532435 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43060 (request call id 21) took 1254 ms. Trace:
I20260709 12:16:55.448467 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:56.534664 22474 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:56.535224 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 876) took 1146 ms. Trace:
I20260709 12:16:56.065948 22543 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
W20260709 12:16:56.538159 22543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1103) took 1279 ms (client timeout 1505 ms). Trace:
W20260709 12:16:56.538494 22543 rpcz_store.cc:269] 0709 12:16:55.258576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.278577 (+ 20001us) service_pool.cc:224] Handling call
0709 12:16:56.537996 (+1259419us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:56.539532 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:56.540346 22543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1098) took 1283 ms. Trace:
I20260709 12:16:56.076169 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:56.076112 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:55.467743 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:56.544063 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1119) took 1280 ms. Trace:
I20260709 12:16:56.345635 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:56.346113 22394 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:56.347780 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:56.545899 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 753) took 1273 ms. Trace:
I20260709 12:16:56.546054 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 749) took 1320 ms. Trace:
I20260709 12:16:56.353475 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:56.357878 23559 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:16:56.368076 22516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.057s	user 0.001s	sys 0.013s
I20260709 12:16:55.450146 23095 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:56.151628 23505 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:56.551869 23505 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.552270 23505 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:56.552657 23505 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.066207 23094 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:56.539887 22441 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36286 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1101)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1097)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1093)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1079)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1082)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1109)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1076)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1107)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1092)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1094)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1102)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1106)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1104)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1103)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1075)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1099)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1096)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1105)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 872)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 873)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 874)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 875)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 879)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 881)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 883)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 888)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1072)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1073)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1074)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1077)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1078)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1080)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1081)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1083)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1086)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1087)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1088)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1089)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1090)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1091)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1095)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1098)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1100)
W20260709 12:16:56.559765 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 493517us
I20260709 12:16:56.376106 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:55.286478 23447 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:56.076160 23454 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:56.062562 23498 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.403537 23499 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:55.316114 23506 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:56.073868 23508 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:55.289232 23511 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:56.043217 23520 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:56.045399 23519 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:56.336068 23521 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:55.396054 23522 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:56.744208 23521 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.387446 23526 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:56.747594 22545 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:56.748148 23526 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.387650 23527 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:56.454859 22366 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.3:38645 timed out after 1.505s (SENT) [suppressed 3 similar messages]
W20260709 12:16:57.154944 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 700227us
I20260709 12:16:56.549788 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.158385 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.159425 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:56.499027 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.164773 22400 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:56.536914 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 743) took 1317 ms. Trace:
I20260709 12:16:56.547924 22402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 746) took 1328 ms. Trace:
I20260709 12:16:57.166814 22401 rpcz_store.cc:276] 0709 12:16:55.219125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.219222 (+    97us) service_pool.cc:224] Handling call
0709 12:16:55.222057 (+  2835us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:56.249616 (+1027559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:56.249662 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:56.249710 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:56.249725 (+    15us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:56.536532 (+286807us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540005d2d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:16:56.536575 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:56.536744 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2361971584}
I20260709 12:16:56.546334 22394 rpcz_store.cc:276] 0709 12:16:55.272188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.274741 (+  2553us) service_pool.cc:224] Handling call
0709 12:16:56.344890 (+1070149us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fe9c 00007fb4f5a2fa5b 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:16:56.345249 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:56.545535 (+200286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:56.545836 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6212480}
I20260709 12:16:56.546555 22395 rpcz_store.cc:276] 0709 12:16:55.225396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.226004 (+   608us) service_pool.cc:224] Handling call
0709 12:16:56.347515 (+1121511us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:16:56.545979 (+198464us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10043776}
I20260709 12:16:55.323796 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:57.171577 22398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 752) took 1922 ms (client timeout 2205 ms). Trace:
W20260709 12:16:57.172008 22398 rpcz_store.cc:269] 0709 12:16:55.249068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.251181 (+  2113us) service_pool.cc:224] Handling call
0709 12:16:57.171402 (+1920221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:56.383080 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.173650 22396 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
W20260709 12:16:57.174261 22396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 748) took 1949 ms (client timeout 1914 ms). Trace:
I20260709 12:16:56.563001 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:56.451313 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:56.559887 22441 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36286 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1101)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1097)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1093)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1079)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1082)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1109)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1076)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1111)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1107)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1092)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1094)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1102)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1106)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1104)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1103)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1075)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1099)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1096)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1105)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 872)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 873)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 874)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 875)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 879)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 881)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 883)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 888)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1072)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1073)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1074)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1077)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1078)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1080)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1081)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1083)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1086)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1087)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1088)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1089)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1090)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1091)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1095)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1098)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1100)
W20260709 12:16:57.181384 22441 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36286 dropped due to backpressure: service queue is full with 50 items [suppressed 2 similar messages]
I20260709 12:16:57.181619 22441 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36286 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1101)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1097)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1093)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1079)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1082)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1109)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1076)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1111)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1107)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1092)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1094)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1102)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1106)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1104)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1103)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1075)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1099)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1096)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1105)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 872)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 873)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 874)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 875)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 879)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 881)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 883)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 888)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1072)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1073)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1074)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1077)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1078)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1080)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1081)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1083)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1086)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1087)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1088)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1089)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1090)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1091)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1095)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1098)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1100)
W20260709 12:16:55.372112 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 114906us
I20260709 12:16:56.532819 22468 rpcz_store.cc:276] 0709 12:16:55.278090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.289022 (+ 10932us) service_pool.cc:224] Handling call
0709 12:16:56.532249 (+1243227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:56.519764 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.186813 22472 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
W20260709 12:16:57.187450 22472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 884) took 1722 ms (client timeout 2181 ms). Trace:
I20260709 12:16:56.390733 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:16:57.191260 22475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 891) took 1724 ms (client timeout 1635 ms). Trace:
W20260709 12:16:57.191709 22475 rpcz_store.cc:269] 0709 12:16:55.466599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:56.390027 (+923428us) service_pool.cc:224] Handling call
0709 12:16:57.191199 (+801172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.192755 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.194037 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:56.388265 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 869) took 1118 ms. Trace:
I20260709 12:16:56.434382 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:56.385725 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1070) took 1095 ms. Trace:
I20260709 12:16:56.471858 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:16:57.197069 22470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 889) took 1731 ms (client timeout 1915 ms). Trace:
I20260709 12:16:57.196674 22471 rpcz_store.cc:276] 0709 12:16:55.289839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.290019 (+   180us) service_pool.cc:224] Handling call
0709 12:16:56.384202 (+1094183us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b5800084c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:16:56.384665 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:56.385073 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:56.385099 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:56.385157 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:56.385201 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:56.385268 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:56.385447 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57646848}
I20260709 12:16:56.416810 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 871) took 1126 ms. Trace:
I20260709 12:16:56.535537 22474 rpcz_store.cc:276] 0709 12:16:55.388506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.410554 (+ 22048us) service_pool.cc:224] Handling call
0709 12:16:56.535156 (+1124602us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:56.405496 22477 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:57.199255 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:16:57.199698 22477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 886) took 1734 ms (client timeout 1799 ms). Trace:
I20260709 12:16:55.289391 22544 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 1.
W20260709 12:16:56.519754 22549 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1114) took 1257 ms (client timeout 1636 ms). Trace:
I20260709 12:16:57.199994 22474 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
W20260709 12:16:57.201133 22544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49290 (request call id 18) took 1985 ms (client timeout 1649 ms). Trace:
W20260709 12:16:56.530162 22550 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1106) took 1270 ms (client timeout 1502 ms). Trace:
W20260709 12:16:57.201872 22544 rpcz_store.cc:269] 0709 12:16:55.215884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.247118 (+ 31234us) service_pool.cc:224] Handling call
0709 12:16:57.200920 (+1953802us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:57.202469 22550 rpcz_store.cc:269] 0709 12:16:55.259395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.275158 (+ 15763us) service_pool.cc:224] Handling call
0709 12:16:56.529991 (+1254833us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:57.203163 22544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 774) took 1649 ms (client timeout 1538 ms). Trace:
I20260709 12:16:56.544579 22551 rpcz_store.cc:276] 0709 12:16:55.263502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:56.075834 (+812332us) service_pool.cc:224] Handling call
0709 12:16:56.543834 (+468000us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:56.398427 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1079) took 1297 ms. Trace:
I20260709 12:16:56.540717 22543 rpcz_store.cc:276] 0709 12:16:55.257277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:56.539192 (+1281915us) service_pool.cc:224] Handling call
0709 12:16:56.540281 (+  1089us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:56.461941 22517 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:54498 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49290 (request call id 17)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1098)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1109)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1113)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1111)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1105)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1101)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1112)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 762)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1120)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1087)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1090)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1091)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1094)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1095)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1096)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1097)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1099)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1100)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1102)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1104)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1107)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 757)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 763)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 765)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 766)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 773)
W20260709 12:16:57.205492 22543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1113) took 1943 ms (client timeout 1886 ms). Trace:
I20260709 12:16:56.563593 23447 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.208511 23447 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:56.602880 23506 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:56.571403 23498 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:56.565474 23505 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:56.592155 23511 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:55.403056 23528 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:57.215116 23528 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:57.215981 22542 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 1.
I20260709 12:16:57.213349 22517 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54496 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1111)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1105)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1101)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1112)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 762)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1120)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49290 (request call id 21)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1126)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1087)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1090)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1091)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1094)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1095)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1096)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1097)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1099)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1100)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1102)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1104)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1107)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 757)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 763)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 765)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 766)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 773)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1121)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1124)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1127)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1128)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1129)
W20260709 12:16:57.217365 22542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49290 (request call id 17) took 2001 ms (client timeout 1864 ms). Trace:
I20260709 12:16:56.045368 23533 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:56.715561 23520 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:56.067864 23534 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:56.396596 23536 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:56.063269 23539 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:56.064535 23542 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:56.590721 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 1.3095e+06us
W20260709 12:16:57.223619 23095 connection.cc:256] RPC call timeout handler was delayed by -1.1118865670000559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 12:16:56.042272 23543 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:55.387514 23544 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:56.311128 23545 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:56.050957 23546 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:55.410617 23547 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:57.227366 23546 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:57.228124 23547 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:55.421710 23550 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:57.230530 23547 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:57.230919 23546 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:57.230688 23550 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.231855 22548 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
W20260709 12:16:57.232645 22548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1092) took 1977 ms (client timeout 1802 ms). Trace:
I20260709 12:16:56.065058 23551 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:56.063824 23552 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:56.547109 23559 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:57.236653 23551 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.236773 23552 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:56.063288 23553 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:56.663657 23556 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:57.239173 23556 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.240986 23556 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:56.751415 23521 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:56.432570 23560 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:56.611393 23094 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:56.612119 23562 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:57.244511 23562 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:57.247327 23562 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:57.248348 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.249133 22397 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 1.
I20260709 12:16:56.586750 23563 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.251533 23563 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.251926 23563 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:57.252261 23563 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.746778 23522 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:56.750705 23526 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:16:56.751125 22545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1093) took 1495 ms (client timeout 1525 ms). Trace:
W20260709 12:16:56.926859 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:56.548038 22516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.256s	user 0.002s	sys 0.013s
W20260709 12:16:57.260876 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 1.96894e+06us
I20260709 12:16:57.167689 22402 rpcz_store.cc:276] 0709 12:16:55.219916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.223941 (+  4025us) service_pool.cc:224] Handling call
0709 12:16:56.353210 (+1129269us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2feee 000000000036eb39 00007fb4fdaa31e0 00007fb4fdb6c0c4 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:16:56.547863 (+194653us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5953792}
W20260709 12:16:57.174659 22396 rpcz_store.cc:269] 0709 12:16:55.225126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.226047 (+   921us) service_pool.cc:224] Handling call
0709 12:16:56.382721 (+1156674us) spinlock_profiling.cc:243] Waited 3.6 ms on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:16:57.174185 (+791464us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8284416}
W20260709 12:16:57.187806 22472 rpcz_store.cc:269] 0709 12:16:55.464633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:56.519370 (+1054737us) service_pool.cc:224] Handling call
0709 12:16:57.187361 (+667991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.184175 22441 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36286 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1101)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1097)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1093)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1079)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1082)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1109)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1076)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1111)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1107)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1092)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1094)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1102)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1106)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1104)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1103)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1075)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1099)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1096)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1105)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 872)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 873)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 874)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 875)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 879)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 881)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 883)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 888)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1072)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1073)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1074)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1077)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1078)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1080)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1081)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1083)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1086)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1087)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1088)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1089)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1090)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1091)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1095)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1098)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1100)
I20260709 12:16:57.189640 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.264662 22468 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.195457 22442 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.195595 22469 rpcz_store.cc:276] 0709 12:16:55.269283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.269475 (+   192us) service_pool.cc:224] Handling call
0709 12:16:55.269801 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:56.067842 (+798041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:56.067872 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:56.067914 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:56.067944 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:56.387686 (+319742us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b54002021d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:16:56.387748 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:56.388037 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1786242944}
W20260709 12:16:57.197647 22470 rpcz_store.cc:269] 0709 12:16:55.466055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:56.434035 (+967980us) service_pool.cc:224] Handling call
0709 12:16:57.197004 (+762969us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:57.266165 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 70920.4us
I20260709 12:16:57.266444 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.266629 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.267185 22469 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.196686 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.198251 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.197434 22473 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
W20260709 12:16:57.200011 22477 rpcz_store.cc:269] 0709 12:16:55.465204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:56.404312 (+939108us) service_pool.cc:224] Handling call
0709 12:16:57.199644 (+795332us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.200227 22476 rpcz_store.cc:276] 0709 12:16:55.290078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.324489 (+ 34411us) service_pool.cc:224] Handling call
0709 12:16:56.416623 (+1092134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.200976 23525 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:57.202167 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:16:57.203539 22544 rpcz_store.cc:269] 0709 12:16:56.029540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.202948 (+1173408us) service_pool.cc:211] Skipping call since client already timed out
0709 12:16:57.203091 (+   143us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:16:57.275969 23525 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:16:57.201596 22549 rpcz_store.cc:269] 0709 12:16:55.262158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:56.041861 (+779703us) service_pool.cc:224] Handling call
0709 12:16:56.519565 (+477704us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:57.204540 22551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 769) took 1652 ms (client timeout 1563 ms). Trace:
W20260709 12:16:57.288985 22551 rpcz_store.cc:269] 0709 12:16:55.552608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.204403 (+1651795us) service_pool.cc:211] Skipping call since client already timed out
0709 12:16:57.204499 (+    96us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:16:57.289301 22549 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1108) took 2029 ms (client timeout 1994 ms). Trace:
W20260709 12:16:57.203455 22550 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1109) took 1943 ms (client timeout 1853 ms). Trace:
W20260709 12:16:57.289914 22550 rpcz_store.cc:269] 0709 12:16:55.260202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.203267 (+1943065us) service_pool.cc:211] Skipping call since client already timed out
0709 12:16:57.203387 (+   120us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:16:57.289698 22549 rpcz_store.cc:269] 0709 12:16:55.259938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.289096 (+2029158us) service_pool.cc:211] Skipping call since client already timed out
0709 12:16:57.289243 (+   147us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:16:57.290838 22550 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1111) took 2029 ms (client timeout 2028 ms). Trace:
I20260709 12:16:57.204732 22547 rpcz_store.cc:276] 0709 12:16:55.101119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.101227 (+   108us) service_pool.cc:224] Handling call
0709 12:16:55.101512 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:55.324568 (+223056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:55.324598 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:55.324636 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:55.324664 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:56.397735 (+1073071us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54003ca5d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:16:56.397822 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:56.398088 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512350080}
I20260709 12:16:57.291182 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.291606 23525 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:57.291890 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:57.292091 22549 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1110) took 2031 ms (client timeout 2031 ms). Trace:
W20260709 12:16:57.292721 22547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1105) took 2033 ms (client timeout 2105 ms). Trace:
W20260709 12:16:57.293064 22547 rpcz_store.cc:269] 0709 12:16:55.259117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.291585 (+2032468us) service_pool.cc:224] Handling call
0709 12:16:57.292667 (+  1082us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:56.586702 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:16:57.205888 22543 rpcz_store.cc:269] 0709 12:16:55.261865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.205353 (+1943488us) service_pool.cc:211] Skipping call since client already timed out
0709 12:16:57.205440 (+    87us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:16:57.296157 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:57.296756 22551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1117) took 2033 ms (client timeout 2008 ms). Trace:
I20260709 12:16:55.448210 23532 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.217904 23528 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:57.219153 22366 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:16:57.217949 22542 rpcz_store.cc:269] 0709 12:16:55.215602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:56.508871 (+1293269us) service_pool.cc:224] Handling call
0709 12:16:57.217153 (+708282us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b54001b8d54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:16:57.217268 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1607572736}
W20260709 12:16:57.292495 22549 rpcz_store.cc:269] 0709 12:16:55.260475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.290828 (+2030353us) service_pool.cc:224] Handling call
0709 12:16:57.292024 (+  1196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.220655 23505 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.298950 23521 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:57.221520 23534 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:57.299386 23521 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:57.224243 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:57.299881 23521 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.300253 22399 raft_consensus.cc:2393] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 2: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:16:57.226552 23545 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:16:57.232975 22548 rpcz_store.cc:269] 0709 12:16:55.255596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:56.075986 (+820390us) service_pool.cc:224] Handling call
0709 12:16:57.232494 (+1156508us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54001b8854. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:16:57.232592 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1585249536}
I20260709 12:16:57.302500 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:57.303265 22548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 767) took 1751 ms (client timeout 2012 ms). Trace:
I20260709 12:16:57.233055 23550 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:57.303591 23545 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:16:57.303589 22548 rpcz_store.cc:269] 0709 12:16:55.552111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.302188 (+1750077us) service_pool.cc:224] Handling call
0709 12:16:57.303216 (+  1028us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.237252 23559 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:57.242635 23560 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:57.298969 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.305152 22542 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
W20260709 12:16:57.305714 22542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 770) took 1752 ms (client timeout 1906 ms). Trace:
I20260709 12:16:57.306097 23560 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:57.256592 22545 rpcz_store.cc:269] 0709 12:16:55.255873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.278625 (+ 22752us) service_pool.cc:224] Handling call
0709 12:16:56.750903 (+1472278us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b540031d3d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:16:56.751057 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568459648}
I20260709 12:16:57.307211 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.307933 22545 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
W20260709 12:16:57.308413 22545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 768) took 1756 ms (client timeout 2061 ms). Trace:
W20260709 12:16:57.308710 22545 rpcz_store.cc:269] 0709 12:16:55.552366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.306893 (+1754527us) service_pool.cc:224] Handling call
0709 12:16:57.308362 (+  1469us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.258073 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:16:57.310197 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 52228.7us
W20260709 12:16:56.459481 22546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1083) took 1328 ms (client timeout 1539 ms). Trace:
I20260709 12:16:57.277175 22474 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
W20260709 12:16:57.278246 22544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 760) took 1861 ms (client timeout 1826 ms). Trace:
I20260709 12:16:57.313061 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.299283 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:57.313306 22544 rpcz_store.cc:269] 0709 12:16:55.416671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.277991 (+1861320us) service_pool.cc:211] Skipping call since client already timed out
0709 12:16:57.278157 (+   166us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:16:57.313854 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:57.314334 22549 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 772) took 1761 ms (client timeout 1914 ms). Trace:
I20260709 12:16:57.314663 22399 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:57.314829 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.315622 22544 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
W20260709 12:16:57.312847 22546 rpcz_store.cc:269] 0709 12:16:55.131223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.131343 (+   120us) service_pool.cc:224] Handling call
0709 12:16:56.459050 (+1327707us) spinlock_profiling.cc:243] Waited 52.7 ms on lock 0x7b540040f954. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:16:56.459268 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121123072}
W20260709 12:16:57.316185 22544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 771) took 1763 ms (client timeout 2093 ms). Trace:
I20260709 12:16:57.316731 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:57.313441 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 94394.2us
I20260709 12:16:57.281126 22471 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
W20260709 12:16:57.316560 22544 rpcz_store.cc:269] 0709 12:16:55.553072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.314510 (+1761438us) service_pool.cc:224] Handling call
0709 12:16:57.316128 (+  1618us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.317569 22397 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:57.318164 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.318785 22471 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.319552 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.217346 22517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1090) took 1962 ms. Trace:
I20260709 12:16:57.276750 23553 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.320147 22471 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.320226 23553 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:57.320459 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.320744 23553 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.321002 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.281121 23552 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:57.286561 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.322104 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.322245 22469 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.323246 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.286962 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.317334 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.324738 22474 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.288008 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.318214 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:57.325006 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.325977 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.326299 22476 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.326670 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.327172 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.327387 22548 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.327797 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.328307 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.328472 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.267925 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.294052 23551 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:57.294094 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.287915 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.330219 23551 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:57.295132 23543 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:57.330739 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.294414 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.331197 22396 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
W20260709 12:16:57.296867 22543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1112) took 2035 ms (client timeout 2185 ms). Trace:
W20260709 12:16:57.291210 22550 rpcz_store.cc:269] 0709 12:16:55.261255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.290637 (+2029382us) service_pool.cc:211] Skipping call since client already timed out
0709 12:16:57.290779 (+   142us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:16:57.330762 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.332369 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.312000 23560 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.323938 22469 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.332610 22468 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.332947 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.316643 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.333348 23543 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.332722 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.326747 22398 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:57.333982 22546 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:57.334612 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:16:57.335072 22546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 764) took 1783 ms (client timeout 2166 ms). Trace:
W20260709 12:16:57.297230 22551 rpcz_store.cc:269] 0709 12:16:55.262952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.293838 (+2030886us) service_pool.cc:211] Skipping call since client already timed out
0709 12:16:57.296676 (+  2838us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:16:57.335448 22546 rpcz_store.cc:269] 0709 12:16:55.551329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.316391 (+1765062us) service_pool.cc:224] Handling call
0709 12:16:57.334998 (+ 18607us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.336315 23543 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.332480 23551 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:57.312028 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.336803 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.325451 22475 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
W20260709 12:16:57.268193 22473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 890) took 1801 ms (client timeout 2107 ms). Trace:
I20260709 12:16:57.337354 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1087) took 2110 ms. Trace:
I20260709 12:16:57.337708 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.337282 22402 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:57.338460 22393 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:57.338706 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:16:57.337610 22473 rpcz_store.cc:269] 0709 12:16:55.466317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:56.471483 (+1005166us) service_pool.cc:224] Handling call
0709 12:16:57.268130 (+796647us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.325590 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.335726 22550 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
W20260709 12:16:57.331830 22543 rpcz_store.cc:269] 0709 12:16:55.261541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.295855 (+2034314us) service_pool.cc:224] Handling call
0709 12:16:57.296802 (+   947us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.332945 23560 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:57.319712 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.333981 22476 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
W20260709 12:16:57.330878 22547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1101) took 2072 ms (client timeout 2121 ms). Trace:
I20260709 12:16:57.264061 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.341197 22543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1091) took 2085 ms. Trace:
W20260709 12:16:57.341377 22547 rpcz_store.cc:269] 0709 12:16:55.258082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.293702 (+2035620us) service_pool.cc:224] Handling call
0709 12:16:57.330801 (+ 37099us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.341598 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.342264 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.339865 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.342938 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1094) took 2086 ms. Trace:
I20260709 12:16:57.342870 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.333648 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.344525 22473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 872) took 2030 ms. Trace:
I20260709 12:16:57.333801 22470 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.340363 23560 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:57.306077 22542 rpcz_store.cc:269] 0709 12:16:55.552835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.298658 (+1745823us) service_pool.cc:224] Handling call
0709 12:16:57.305654 (+  6996us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.340513 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.341593 22543 rpcz_store.cc:276] 0709 12:16:55.255333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.340202 (+2084869us) service_pool.cc:224] Handling call
0709 12:16:57.340566 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.340839 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.340868 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.340918 (+    50us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.340947 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.341004 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.341118 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.309690 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.346419 22545 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
W20260709 12:16:57.346904 22545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 762) took 1929 ms (client timeout 2220 ms). Trace:
I20260709 12:16:57.346946 22543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1096) took 2090 ms. Trace:
I20260709 12:16:57.347029 22544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1120) took 1290 ms. Trace:
I20260709 12:16:57.346946 22475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 875) took 1968 ms. Trace:
I20260709 12:16:57.348696 22517 rpcz_store.cc:276] 0709 12:16:55.255026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.217268 (+1962242us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:16:57.337904 22546 rpcz_store.cc:276] 0709 12:16:55.227080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.336345 (+2109265us) service_pool.cc:224] Handling call
0709 12:16:57.336800 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.336994 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.337019 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.337058 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.337113 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.337169 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.337285 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19712}
I20260709 12:16:57.340559 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.349882 22474 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.350414 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1099) took 2092 ms. Trace:
I20260709 12:16:57.349347 22517 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54496 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1100)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1102)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1104)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1107)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 757)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 763)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 765)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 766)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 773)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1121)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1124)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1127)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1128)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1129)
I20260709 12:16:57.293640 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.361299 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.351071 22470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 877) took 1954 ms. Trace:
I20260709 12:16:57.362357 22470 rpcz_store.cc:276] 0709 12:16:55.396552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.350192 (+1953640us) service_pool.cc:224] Handling call
0709 12:16:57.350507 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.350731 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.350757 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.350814 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.350843 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.350898 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.351017 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.363066 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 879) took 1942 ms. Trace:
I20260709 12:16:57.363422 22477 rpcz_store.cc:276] 0709 12:16:55.420498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.362269 (+1941771us) service_pool.cc:224] Handling call
0709 12:16:57.362578 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.362760 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.362784 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.362821 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.362849 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.362920 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.363015 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.345055 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 874) took 1972 ms. Trace:
I20260709 12:16:57.342938 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1095) took 2086 ms. Trace:
I20260709 12:16:57.365150 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 881) took 1913 ms. Trace:
I20260709 12:16:57.343415 22550 rpcz_store.cc:276] 0709 12:16:55.256139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.341967 (+2085828us) service_pool.cc:224] Handling call
0709 12:16:57.342339 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.342566 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.342598 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.342666 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:57.342702 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.342765 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.342877 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.352686 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1100) took 2094 ms. Trace:
W20260709 12:16:57.347249 22545 rpcz_store.cc:269] 0709 12:16:55.550642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.309395 (+1758753us) service_pool.cc:224] Handling call
0709 12:16:57.346848 (+ 37453us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.347379 22543 rpcz_store.cc:276] 0709 12:16:55.256735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.346030 (+2089295us) service_pool.cc:224] Handling call
0709 12:16:57.346395 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.346658 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.346680 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.346721 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.346748 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.346796 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.346890 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.340986 22397 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:57.350773 22546 rpcz_store.cc:276] 0709 12:16:55.257524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.349452 (+2091928us) service_pool.cc:224] Handling call
0709 12:16:57.349817 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.350094 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.350128 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.350192 (+    64us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.350224 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.350277 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.350367 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.348654 22475 rpcz_store.cc:276] 0709 12:16:55.378944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.346161 (+1967217us) service_pool.cc:224] Handling call
0709 12:16:57.346443 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.346643 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.346668 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.346720 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.346749 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.346796 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.346891 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.366575 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.344740 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 873) took 2020 ms. Trace:
W20260709 12:16:57.323499 22549 rpcz_store.cc:269] 0709 12:16:55.553301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.298946 (+1745645us) service_pool.cc:224] Handling call
0709 12:16:57.314255 (+ 15309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.367214 22545 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.368044 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.368716 22543 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.369045 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1102) took 2110 ms. Trace:
I20260709 12:16:57.369233 22545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1104) took 2110 ms. Trace:
I20260709 12:16:57.370208 22543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1107) took 2110 ms. Trace:
I20260709 12:16:57.370450 23550 consensus_queue.cc:1059] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:57.369585 22545 rpcz_store.cc:276] 0709 12:16:55.258849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.368378 (+2109529us) service_pool.cc:224] Handling call
0709 12:16:57.368679 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.368939 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.368963 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.369000 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.369030 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.369082 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.369181 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.369467 22549 rpcz_store.cc:276] 0709 12:16:55.258330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.368097 (+2109767us) service_pool.cc:224] Handling call
0709 12:16:57.368423 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.368653 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.368682 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.368760 (+    78us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.368813 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.368878 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.368985 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.371675 23550 raft_consensus.cc:3055] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:57.372035 23550 raft_consensus.cc:740] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:57.372133 22545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 754) took 2090 ms. Trace:
I20260709 12:16:57.364347 22470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 880) took 1934 ms. Trace:
I20260709 12:16:57.357561 23563 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:57.373446 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.373116 23550 consensus_queue.cc:260] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:57.365382 23553 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.375051 22468 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 2: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:16:57.321610 22471 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.375451 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 756) took 2057 ms. Trace:
I20260709 12:16:57.370684 22543 rpcz_store.cc:276] 0709 12:16:55.259647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.369349 (+2109702us) service_pool.cc:224] Handling call
0709 12:16:57.369675 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.369918 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.369941 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.369976 (+    35us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.370001 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.370048 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.370155 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.376673 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 888) took 1911 ms. Trace:
I20260709 12:16:57.377197 22475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 882) took 1915 ms. Trace:
I20260709 12:16:57.351140 22473 rpcz_store.cc:276] 0709 12:16:55.314350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.343523 (+2029173us) service_pool.cc:224] Handling call
0709 12:16:57.343841 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.344069 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.344094 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.344249 (+   155us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.344283 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.344341 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.344444 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.366019 22551 rpcz_store.cc:276] 0709 12:16:55.257831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.351848 (+2094017us) service_pool.cc:224] Handling call
0709 12:16:57.352167 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.352355 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.352387 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.352441 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:57.352479 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.352535 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.352632 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.377565 22475 rpcz_store.cc:276] 0709 12:16:55.461667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.366985 (+1905318us) service_pool.cc:224] Handling call
0709 12:16:57.376591 (+  9606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.376840 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.376869 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.376923 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:57.376951 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.377006 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.377124 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.379022 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 878) took 1965 ms. Trace:
W20260709 12:16:57.381284 22572 debug-util.cc:398] Leaking SignalData structure 0x7b080016fc60 after lost signal to thread 21247
I20260709 12:16:57.367273 22476 rpcz_store.cc:276] 0709 12:16:55.324278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.343865 (+2019587us) service_pool.cc:224] Handling call
0709 12:16:57.344223 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.344433 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.344456 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.344522 (+    66us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.344554 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.344602 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.344693 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.379387 22474 rpcz_store.cc:276] 0709 12:16:55.413828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.350491 (+1936663us) service_pool.cc:224] Handling call
0709 12:16:57.377790 (+ 27299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.377976 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.378001 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.378037 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.378064 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.378112 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.378854 (+   742us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b5400160650. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:16:57.378954 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62038784}
I20260709 12:16:57.372618 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 755) took 2060 ms. Trace:
W20260709 12:16:57.382650 22572 debug-util.cc:398] Leaking SignalData structure 0x7b080014a8e0 after lost signal to thread 22333
I20260709 12:16:57.375804 22546 rpcz_store.cc:276] 0709 12:16:55.318281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.374650 (+2056369us) service_pool.cc:224] Handling call
0709 12:16:57.374977 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.375170 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.375193 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.375229 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.375255 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.375304 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.375398 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:57.383409 22572 debug-util.cc:398] Leaking SignalData structure 0x7b080014e900 after lost signal to thread 22347
I20260709 12:16:57.381373 22470 rpcz_store.cc:276] 0709 12:16:55.429676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.363398 (+1933722us) service_pool.cc:224] Handling call
0709 12:16:57.363757 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.363962 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.363991 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.364056 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:57.364106 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.364175 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.364294 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.384547 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 761) took 1967 ms. Trace:
I20260709 12:16:57.358495 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.385572 22546 rpcz_store.cc:276] 0709 12:16:55.416930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.383720 (+1966790us) service_pool.cc:224] Handling call
0709 12:16:57.384047 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.384276 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.384301 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.384337 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.384363 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.384408 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.384494 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.343485 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.348627 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1097) took 2091 ms. Trace:
I20260709 12:16:57.329604 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.377094 22471 rpcz_store.cc:276] 0709 12:16:55.465727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.375849 (+1910122us) service_pool.cc:224] Handling call
0709 12:16:57.376188 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.376373 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.376396 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.376448 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.376475 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.376523 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.376614 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.387424 22548 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.379571 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 758) took 1992 ms. Trace:
I20260709 12:16:57.388027 22472 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.388870 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 765) took 1837 ms. Trace:
I20260709 12:16:57.382680 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 759) took 1966 ms. Trace:
I20260709 12:16:57.372663 22545 rpcz_store.cc:276] 0709 12:16:55.282070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.371324 (+2089254us) service_pool.cc:224] Handling call
0709 12:16:57.371632 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.371812 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.371836 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.371891 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:57.371919 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.371965 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.372064 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.389572 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.388401 22551 rpcz_store.cc:276] 0709 12:16:55.389966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.378519 (+1988553us) service_pool.cc:224] Handling call
0709 12:16:57.378855 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.379100 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.379127 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.379191 (+    64us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.379226 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.379284 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.379510 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.374919 23550 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:57.384619 22572 debug-util.cc:398] Leaking SignalData structure 0x7b08002ea520 after lost signal to thread 22426
I20260709 12:16:57.348596 22544 rpcz_store.cc:276] 0709 12:16:56.039913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.317927 (+1278014us) service_pool.cc:224] Handling call
0709 12:16:57.329855 (+ 11928us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.377528 22543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 757) took 1990 ms. Trace:
I20260709 12:16:57.389253 22548 rpcz_store.cc:276] 0709 12:16:55.551608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.388093 (+1836485us) service_pool.cc:224] Handling call
0709 12:16:57.388403 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.388584 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.388608 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.388663 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:57.388690 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.388735 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.388821 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.401503 22544 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:57.402179 22544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 773) took 1848 ms. Trace:
I20260709 12:16:57.402563 22544 rpcz_store.cc:276] 0709 12:16:55.553529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.400781 (+1847252us) service_pool.cc:224] Handling call
0709 12:16:57.401134 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.401918 (+   784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.402120 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.403223 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.406402 22543 rpcz_store.cc:276] 0709 12:16:55.386787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.376633 (+1989846us) service_pool.cc:224] Handling call
0709 12:16:57.376949 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.377226 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.377250 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.377298 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:57.377325 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.377374 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.377478 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.387463 22477 rpcz_store.cc:276] 0709 12:16:55.451823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.364362 (+1912539us) service_pool.cc:224] Handling call
0709 12:16:57.364646 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.364858 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.364882 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.364933 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.364959 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.365008 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.365095 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.364776 22469 rpcz_store.cc:276] 0709 12:16:55.372360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.344157 (+1971797us) service_pool.cc:224] Handling call
0709 12:16:57.344442 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.344663 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.344685 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.344722 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:57.344782 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.344834 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.345005 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:57.408900 22572 debug-util.cc:398] Leaking SignalData structure 0x7b08003178c0 after lost signal to thread 22501
W20260709 12:16:57.410040 22572 debug-util.cc:398] Leaking SignalData structure 0x7b080031ca60 after lost signal to thread 22575
I20260709 12:16:57.393092 22550 rpcz_store.cc:276] 0709 12:16:55.416322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.381798 (+1965476us) service_pool.cc:224] Handling call
0709 12:16:57.382143 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.382355 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.382381 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.382425 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.382470 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.382524 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.382619 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.399817 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.383193 22549 rpcz_store.cc:276] 0709 12:16:55.312198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.371695 (+2059497us) service_pool.cc:224] Handling call
0709 12:16:57.372016 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.372286 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.372316 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.372364 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:57.372393 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.372451 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.372568 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.389593 23563 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.357131 23521 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.416097 23521 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.387444 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 763) took 1836 ms. Trace:
I20260709 12:16:57.355064 23560 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:57.365500 22547 rpcz_store.cc:276] 0709 12:16:55.256391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.342101 (+2085710us) service_pool.cc:224] Handling call
0709 12:16:57.342417 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.342680 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.342703 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.342740 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.342766 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.342810 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.342889 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.399899 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.421037 22546 rpcz_store.cc:276] 0709 12:16:55.551007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.386614 (+1835607us) service_pool.cc:224] Handling call
0709 12:16:57.386911 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.387151 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.387175 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.387228 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.387253 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.387300 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.387396 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:57.410315 22572 debug-util.cc:398] Leaking SignalData structure 0x7b08003212a0 after lost signal to thread 22576
I20260709 12:16:57.427048 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:57.427309 22572 debug-util.cc:398] Leaking SignalData structure 0x7b0800355d20 after lost signal to thread 23155
W20260709 12:16:57.426000 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 814726us
I20260709 12:16:57.430485 23094 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.431598 23567 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.387169 22542 rpcz_store.cc:276] 0709 12:16:55.256997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.347611 (+2090614us) service_pool.cc:224] Handling call
0709 12:16:57.347995 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.348283 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.348319 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.348378 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.348415 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.348472 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.348573 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.416695 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.293628 22441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 883) took 1829 ms. Trace:
I20260709 12:16:57.435436 23528 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.435896 23528 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:57.436472 23528 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.437794 23560 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:57.435879 22516 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.417950 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.434294 23553 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.418426 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.445165 22545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 766) took 1893 ms. Trace:
I20260709 12:16:57.445708 22516 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.445561 22545 rpcz_store.cc:276] 0709 12:16:55.551858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.394058 (+1842200us) service_pool.cc:224] Handling call
0709 12:16:57.443474 (+ 49416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.444857 (+  1383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.444885 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.444921 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.444947 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.444997 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.445102 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:57.435139 22441 rpcz_store.cc:276] 0709 12:16:55.464335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.293549 (+1829214us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:16:57.372604 22442 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.449430 23549 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.447127 23534 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.450013 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.453645 22441 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36296 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
I20260709 12:16:57.454526 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.455551 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:16:57.456036 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 83532.1us
I20260709 12:16:57.457154 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.458254 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.458451 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.460026 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.460206 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.457150 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.460520 23528 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.461374 22477 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.461874 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.462158 23534 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.462616 23534 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:57.463023 23534 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.463315 23553 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.463707 23553 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:57.464084 23553 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.464880 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.466408 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.466588 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.470003 22469 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.471843 23525 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.472048 22516 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:16:57.472419 23525 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:57.466435 23094 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:57.472923 23525 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.473347 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:57.473846 23560 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.474293 23560 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:57.474545 22442 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.474718 23560 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.479123 23528 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:57.482903 23560 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:57.487207 23560 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.483574 23525 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.484133 23551 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.489059 23551 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:57.489513 23551 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.484925 23094 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.485090 22442 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:16:57.448895 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 73347.1us
I20260709 12:16:57.484316 23550 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.491693 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.492609 23528 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.493017 23528 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:57.493371 23528 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.495083 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:57.500061 23552 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.500497 23552 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:57.500859 23552 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.503961 23094 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:57.505040 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:57.505219 23094 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.505523 23567 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.505944 23567 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:57.501271 23528 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.506327 23567 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.509310 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.508848 23563 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.510165 23563 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:57.510588 23563 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.511065 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.511628 22550 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.512984 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.516870 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:16:57.517565 23131 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:16:57.517904 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:57.518669 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:57.519960 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.522636 22442 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.522825 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:16:57.523088 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:16:57.523684 22442 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.523877 23130 raft_consensus.cc:2393] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 2: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:16:57.524209 23532 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.524534 23542 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.525032 23542 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:57.525121 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:57.526144 23131 raft_consensus.cc:2393] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 2: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:16:57.526122 22442 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.526914 23543 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.527043 22442 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.527354 23543 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:57.527899 23543 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.525432 23542 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.502348 23560 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.533102 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:16:57.532212 22550 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2.
I20260709 12:16:57.524601 23532 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:57.536576 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:16:57.537741 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.538836 22366 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.539701 23521 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.540071 23521 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:57.540434 23521 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.535312 23532 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.535094 23539 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.543609 23094 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.543397 23539 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:57.544708 23522 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.545082 23539 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.543269 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:16:57.545840 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.531544 23560 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:57.546551 22550 raft_consensus.cc:2393] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 2: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:16:57.547096 23505 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.548475 22442 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.550148 22516 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.547516 23560 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.552631 23525 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:57.553220 23511 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.554435 23511 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:57.549633 23505 raft_consensus.cc:697] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 2 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:16:57.555377 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.555630 23511 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.556316 23505 consensus_queue.cc:237] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:57.573480 23550 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.574079 23550 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:57.574477 23550 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.549845 23552 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.580319 23552 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.582463 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:57.598047 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 49714.2us
I20260709 12:16:57.586165 23565 raft_consensus.cc:2955] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:57.582887 23563 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:57.553201 23534 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.542416 23567 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:57.600971 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.604030 23129 raft_consensus.cc:2393] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 2: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:16:57.610262 22397 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:57.610416 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:57.613211 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:16:57.613399 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 124213us
I20260709 12:16:57.613524 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:57.614027 22398 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.614341 22550 raft_consensus.cc:2393] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 2: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:16:57.615762 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:57.618100 23527 consensus_queue.cc:1059] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:57.616472 22393 raft_consensus.cc:2955] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:57.619103 23527 raft_consensus.cc:3055] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:57.619485 23527 raft_consensus.cc:740] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:57.614609 23567 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.622784 22441 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.611550 23534 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:57.620419 23527 consensus_queue.cc:260] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.625028 23527 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.624836 23551 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.629282 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:57.630618 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.630981 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.631304 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:57.636341 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:57.636751 22366 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.637873 22366 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.641045 23094 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.642639 23545 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.642889 23567 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.643271 23559 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.643060 23511 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.643675 23559 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:57.644013 23551 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.644085 23559 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.647423 23511 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.628705 23528 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:57.650884 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:57.653318 22402 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.647879 23545 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:57.653955 23545 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.651368 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:57.658165 22397 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.658003 23560 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:57.661427 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:57.635221 23552 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.634687 23543 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.666704 23543 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.665892 22297 catalog_manager.cc:5697] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 1 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:57.668722 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:57.669420 22396 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.670167 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:57.638643 23563 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.670965 22441 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.671382 22402 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:16:57.672528 22442 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.678022 23559 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.680720 23559 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.677906 23532 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.690409 23543 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.664726 23552 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:57.664307 23560 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.690578 23095 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.696120 23543 raft_consensus.cc:697] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:57.696477 23563 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.697127 23543 consensus_queue.cc:237] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.708073 22441 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.702028 23552 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.703805 23511 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.706776 22396 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:16:57.715703 23551 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.718837 23542 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.720293 23551 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:57.720793 23551 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.723245 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:57.723742 22441 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.723882 22393 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.718240 23545 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.727038 23542 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.710412 23521 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:57.730058 22442 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.732744 22393 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:16:57.727214 23553 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.717264 23511 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:57.739490 22442 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.738896 23542 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.745638 23542 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:57.746047 23542 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.747058 23553 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.752204 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.738317 23511 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.755297 22441 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.756099 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:57.756662 22393 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.758997 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.758746 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:57.763970 22401 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.763581 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.744051 23566 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.743304 23543 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.736191 23550 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.766268 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.743932 22397 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:16:57.770205 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.771435 23532 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.772149 23532 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.772575 23532 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:57.772961 23532 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.757231 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.774679 22442 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.776000 23553 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.776484 23553 raft_consensus.cc:697] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:57.777364 23553 consensus_queue.cc:237] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:57.778113 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:57.759971 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.779973 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.781108 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.781493 23551 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.782137 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.782790 22474 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:57.783677 23551 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.784734 22401 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:16:57.784953 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.785454 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.786401 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.789418 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.790617 23521 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:57.790786 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.793296 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.795553 22442 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.800156 22393 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:16:57.802641 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.804585 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.802663 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.805603 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.806829 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.806684 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.807785 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.801347 23566 raft_consensus.cc:697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:57.807896 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.807996 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:57.804106 23565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43058 (request call id 5) took 3010 ms. Trace:
I20260709 12:16:57.808084 23551 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.822904 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.808259 22366 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.792557 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.833796 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:57.834090 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.835414 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.799793 23545 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.839303 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.841364 22442 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.835222 22399 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:57.832527 22398 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:16:57.809033 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:16:57.834509 22498 debug-util.cc:398] Leaking SignalData structure 0x7b08000eb140 after lost signal to thread 21247
I20260709 12:16:57.809465 23550 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:57.849522 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.812565 23566 consensus_queue.cc:237] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.851503 23576 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.851641 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.852118 23576 raft_consensus.cc:697] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:57.853026 23576 consensus_queue.cc:237] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:57.847771 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 92575.4us
I20260709 12:16:57.845403 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:57.846781 22366 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.808574 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.848786 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:57.847776 23543 raft_consensus.cc:697] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:57.839782 23551 raft_consensus.cc:697] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:57.846994 23559 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.857970 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.865301 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.850308 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.869589 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.868134 22400 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:57.871150 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.868376 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:57.872193 22394 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:16:57.870445 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.874045 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:57.874194 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.874392 23559 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:57.874853 23559 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.875151 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:57.875516 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.876984 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.867703 22299 catalog_manager.cc:5697] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 1 to 2, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 2 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:57.881605 22475 raft_consensus.cc:1240] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:57.884745 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:57.886457 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:57.889544 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:57.866840 23545 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.895412 22396 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:57.896186 22399 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:57.820603 23565 rpcz_store.cc:276] 0709 12:16:54.760536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.760658 (+   122us) service_pool.cc:224] Handling call
0709 12:16:54.793290 (+ 32632us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b540011c4a0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8acbec4 00007fb4f8b4f8d7 00007fb4f8b5b03c 00007fb4f8b5a6b3 00007fb4fdb1ad29 00007fb4f70991d4 00007fb4f7099162 00007fb4f7099091 00007fb4f709900c 00007fb4f70982c2
0709 12:16:54.811045 (+ 17755us) log.cc:844] Serialized 499 byte log entry
0709 12:16:55.141046 (+330001us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b180032f380. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:16:57.768451 (+2627405us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":258,"mutex_wait_us":6333,"raft.queue_time_us":10007,"raft.run_cpu_time_us":2301,"raft.run_wall_time_us":63864,"spinlock_wait_cycles":12607104,"thread_start_us":36444,"threads_started":1,"wal-append.queue_time_us":36795,"wal-append.run_cpu_time_us":16055,"wal-append.run_wall_time_us":1327383}
I20260709 12:16:57.898940 22394 raft_consensus.cc:1240] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:57.898597 23542 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.901196 23542 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.902025 23552 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:57.881101 22498 debug-util.cc:398] Leaking SignalData structure 0x7b08001da640 after lost signal to thread 22333
W20260709 12:16:57.903827 22498 debug-util.cc:398] Leaking SignalData structure 0x7b08001af7a0 after lost signal to thread 22347
I20260709 12:16:57.904340 23552 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:57.904999 22498 debug-util.cc:398] Leaking SignalData structure 0x7b0800095140 after lost signal to thread 22426
I20260709 12:16:57.905799 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:57.906355 23545 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:57.906814 23545 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.909051 22477 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:16:57.894212 22516 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.910471 23525 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.911019 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.895339 23551 consensus_queue.cc:237] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.912737 23534 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.913705 22516 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.915016 22516 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:57.915764 23550 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.916169 23526 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.905982 22402 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:16:57.901289 23539 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.900823 23511 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:16:57.904572 23532 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:57.917670 22516 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.926405 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:57.918747 23539 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:57.919979 22442 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:57.895319 22393 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
W20260709 12:16:57.987246 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 111070us
I20260709 12:16:58.000448 22477 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:57.940867 23511 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
W20260709 12:16:57.918040 22498 debug-util.cc:398] Leaking SignalData structure 0x7b08003487e0 after lost signal to thread 22501
I20260709 12:16:57.986765 23534 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:16:57.984799 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 57719.2us
W20260709 12:16:57.980561 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 62961.3us
W20260709 12:16:58.015295 22367 leader_election.cc:336] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.502s (SENT)
W20260709 12:16:58.016036 22367 leader_election.cc:336] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.505s (SENT)
I20260709 12:16:58.013286 23534 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:58.016568 23525 consensus_queue.cc:1059] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:58.016942 22367 leader_election.cc:336] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.525s (SENT)
W20260709 12:16:58.017397 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 97534.4us
I20260709 12:16:58.017910 23553 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:16:58.018193 22367 leader_election.cc:336] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.539s (SENT)
I20260709 12:16:57.918457 23543 consensus_queue.cc:237] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.020924 23553 raft_consensus.cc:697] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:58.021996 23553 consensus_queue.cc:237] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.029284 22366 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:16:58.030592 22498 debug-util.cc:398] Leaking SignalData structure 0x7b0800334500 after lost signal to thread 22544
I20260709 12:16:58.034708 22477 raft_consensus.cc:1240] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.017338 23534 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.039088 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:58.039701 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:58.040861 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:16:58.031612 22498 debug-util.cc:398] Leaking SignalData structure 0x7b08002e0bc0 after lost signal to thread 22575
I20260709 12:16:58.034897 22551 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:58.054517 22477 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.059007 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:58.059670 22402 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:58.049228 22498 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7e00 after lost signal to thread 22576
I20260709 12:16:58.036396 23571 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:58.068883 23577 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:16:58.073108 23587 consensus_queue.cc:1059] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.073565 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:58.028241 23549 consensus_queue.cc:1059] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:16:58.080371 23563 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:58.066867 23571 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:58.061842 23560 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:16:58.053380 23528 consensus_queue.cc:1059] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:16:58.134545 22469 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
W20260709 12:16:58.135039 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 86360.8us
I20260709 12:16:58.137966 23587 raft_consensus.cc:3055] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:58.140930 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:16:58.141273 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 66494.2us
W20260709 12:16:58.141571 21249 debug-util.cc:398] Leaking SignalData structure 0x7b080000f720 after lost signal to thread 22516
W20260709 12:16:58.157334 22367 leader_election.cc:336] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.542s (SENT)
I20260709 12:16:58.157749 22367 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:58.160333 22402 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:16:58.134812 23571 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:58.152324 22498 debug-util.cc:398] Leaking SignalData structure 0x7b0800345e00 after lost signal to thread 23155
I20260709 12:16:58.138753 23549 raft_consensus.cc:3055] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:58.152498 23587 raft_consensus.cc:740] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:58.162676 23532 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:58.173213 22367 leader_election.cc:336] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.570s (SENT)
I20260709 12:16:58.165933 23567 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:58.176877 22393 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.178555 22477 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.184383 22402 raft_consensus.cc:1240] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.179145 22367 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:58.139322 23563 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:16:58.186333 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 111240us
W20260709 12:16:58.174633 22498 debug-util.cc:398] Leaking SignalData structure 0x7b080032c4c0 after lost signal to thread 23528
I20260709 12:16:58.172412 23526 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:58.170554 23549 raft_consensus.cc:740] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:58.189461 22442 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:58.194270 22401 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
W20260709 12:16:58.190891 22498 debug-util.cc:398] Leaking SignalData structure 0x7b0800328040 after lost signal to thread 23532
W20260709 12:16:58.223483 23586 log.cc:927] Time spent T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:16:58.187659 22396 consensus_queue.cc:237] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:16:58.261222 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 88047.2us
W20260709 12:16:58.275056 22367 leader_election.cc:336] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.585s (SENT)
W20260709 12:16:58.259702 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 67809.3us
I20260709 12:16:58.260001 22402 raft_consensus.cc:1240] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.259639 22475 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.258884 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:58.190804 23526 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:16:58.258985 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 52984.2us
W20260709 12:16:58.205166 22498 debug-util.cc:398] Leaking SignalData structure 0x7b080031bdc0 after lost signal to thread 23533
I20260709 12:16:58.276065 22366 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:58.199908 23521 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.279654 22367 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:58.190971 23567 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:58.281919 23587 consensus_queue.cc:260] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.284082 23549 consensus_queue.cc:260] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.285174 23567 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:58.285425 23549 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.225193 23589 consensus_queue.cc:1059] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:16:58.262820 23543 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:58.337594 23593 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.282078 22472 raft_consensus.cc:1240] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
W20260709 12:16:58.338526 23588 log.cc:927] Time spent T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:16:58.280479 23526 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.338919 22402 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.287173 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:16:58.282255 22498 debug-util.cc:398] Leaking SignalData structure 0x7b080030a660 after lost signal to thread 23534
I20260709 12:16:58.340122 23522 raft_consensus.cc:3055] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:58.341741 23564 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.280454 23545 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:58.348766 23550 raft_consensus.cc:3055] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:58.348640 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:16:58.376539 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.378861 23545 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:58.363080 23521 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.336057 23532 consensus_queue.cc:1059] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:16:58.366158 23522 raft_consensus.cc:740] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:58.380100 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.380300 22399 raft_consensus.cc:1240] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.380678 23522 consensus_queue.cc:260] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.381183 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.381323 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.381960 23522 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.365451 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.363301 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.368093 22473 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
W20260709 12:16:58.369560 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 82475.9us
I20260709 12:16:58.384547 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:58.370018 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.371140 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.283574 23591 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.374949 23550 raft_consensus.cc:740] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:16:58.367234 22498 debug-util.cc:398] Leaking SignalData structure 0x7b0800305140 after lost signal to thread 23539
I20260709 12:16:58.386216 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.360414 23543 raft_consensus.cc:697] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:16:58.389820 22498 debug-util.cc:398] Leaking SignalData structure 0x7b08002edb00 after lost signal to thread 23542
I20260709 12:16:58.393425 23592 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:16:58.398125 22498 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe920 after lost signal to thread 23543
I20260709 12:16:58.402022 23592 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:58.428360 22400 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.367522 23593 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.431118 22393 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.428578 23592 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:58.437409 23595 log.cc:927] Time spent T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.063s	user 0.000s	sys 0.003s
W20260709 12:16:58.428350 22498 debug-util.cc:398] Leaking SignalData structure 0x7b08001a3a20 after lost signal to thread 23544
I20260709 12:16:58.411908 23590 raft_consensus.cc:3055] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:58.416911 23565 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.420208 23587 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.394117 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:58.430022 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 45569.7us
I20260709 12:16:58.448477 23590 raft_consensus.cc:740] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:58.449043 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.449147 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:58.449445 23590 consensus_queue.cc:260] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.442638 23563 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:58.443085 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.433887 23534 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.443852 23550 consensus_queue.cc:260] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.456261 23590 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.456584 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:58.447796 23559 consensus_meta.cc:287] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.572s	user 0.005s	sys 0.005s
I20260709 12:16:58.447906 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:16:58.448167 22498 debug-util.cc:398] Leaking SignalData structure 0x7b0800319c00 after lost signal to thread 23545
I20260709 12:16:58.442386 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:16:58.450438 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:58.448647 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.456802 23550 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.447443 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.461315 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.461882 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.464079 22546 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:58.460171 23131 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:58.469247 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:58.453385 23593 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.473810 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.475124 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.476073 23528 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.476861 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:16:58.477046 23525 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.477525 23129 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:16:58.479890 23534 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:16:58.466297 22498 debug-util.cc:398] Leaking SignalData structure 0x7b08002f32c0 after lost signal to thread 23546
I20260709 12:16:58.483973 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:58.486559 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.486544 23543 consensus_queue.cc:237] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.491422 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:58.455513 23553 consensus_queue.cc:1059] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:16:58.458137 23532 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 12:16:58.492789 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 216776us
W20260709 12:16:58.488211 22498 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe7a0 after lost signal to thread 23547
I20260709 12:16:58.469099 23511 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:16:58.495206 23581 raft_consensus.cc:3055] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:58.493621 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:58.498071 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:16:58.501636 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 226597us
W20260709 12:16:58.499938 22498 debug-util.cc:398] Leaking SignalData structure 0x7b080023ea40 after lost signal to thread 23550
I20260709 12:16:58.500746 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:58.503270 22366 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:58.501319 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:58.466632 23559 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.492986 23534 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.508445 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.509706 22550 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.502828 23577 raft_consensus.cc:3055] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:16:58.503801 22498 debug-util.cc:398] Leaking SignalData structure 0x7b080031b1a0 after lost signal to thread 23551
I20260709 12:16:58.501978 23581 raft_consensus.cc:740] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:16:58.514286 22367 leader_election.cc:336] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.761s (SENT)
I20260709 12:16:58.518846 22367 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:58.520129 22516 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:58.521142 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.522185 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.510659 23593 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:58.519158 22498 debug-util.cc:398] Leaking SignalData structure 0x7b08002e15a0 after lost signal to thread 23552
I20260709 12:16:58.514905 23591 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:58.514515 23577 raft_consensus.cc:740] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:58.528478 22516 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:58.533113 23583 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.540786 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:16:58.529619 22498 debug-util.cc:398] Leaking SignalData structure 0x7b0800219d40 after lost signal to thread 23553
I20260709 12:16:58.543774 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:58.542632 23577 consensus_queue.cc:260] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:58.545305 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:58.549472 23559 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:58.551880 23534 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.530072 23525 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.554100 23526 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.568531 23526 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:58.554936 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:58.570019 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:58.571277 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:16:58.555480 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:58.555780 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:58.527814 23591 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:16:58.556694 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 44941.1us
I20260709 12:16:58.553063 23581 consensus_queue.cc:260] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:58.560750 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:58.561954 22549 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:16:58.562203 22548 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:16:58.562762 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:58.563437 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:58.564567 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:58.573958 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
W20260709 12:16:58.590677 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:58.593715 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 83085.3us
I20260709 12:16:58.593812 22547 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.598690 22401 raft_consensus.cc:1240] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.600015 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:58.600795 22550 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:16:58.602029 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:58.608295 22395 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.575922 23591 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.575518 23534 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.593070 23577 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.618299 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:58.618542 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:58.619258 23593 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.621433 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:58.606308 23590 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.608721 23571 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.624924 22543 raft_consensus.cc:2955] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:58.622404 23550 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.575436 23592 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.626598 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:16:58.685106 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 58604.2us
I20260709 12:16:58.685595 22402 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.685864 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:58.687093 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:58.690413 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:58.691723 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:58.609953 23566 consensus_queue.cc:1059] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:16:58.628841 23522 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.698764 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:58.635023 23559 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.684965 23581 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.707162 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:58.707477 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:16:58.710875 23131 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.711457 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:58.625418 23551 consensus_queue.cc:1059] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 12:16:58.698429 23549 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.713512 22516 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:16:58.713292 23600 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.694386 23526 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:58.718912 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 192154us
I20260709 12:16:58.702689 23534 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.721490 23551 raft_consensus.cc:3055] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:58.718209 23525 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.731963 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:58.733242 22516 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:58.723460 22397 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.738040 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:58.737706 23571 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:58.739029 23528 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:58.739213 22545 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 2: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:16:58.739502 23528 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:16:58.739954 23528 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.727121 23600 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.744072 22547 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:16:58.726003 23551 raft_consensus.cc:740] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:58.745664 22545 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.748168 22547 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.748811 22549 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.749472 23526 consensus_queue.cc:1059] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.751184 23578 raft_consensus.cc:3055] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:58.751645 23549 consensus_queue.cc:1059] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.751853 23590 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.768406 23131 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:16:58.706075 22398 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.734447 23525 consensus_queue.cc:1059] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:16:58.752463 23534 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.765615 22549 raft_consensus.cc:1240] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.773880 23125 raft_consensus.cc:1240] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:16:58.801636 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:58.763983 23578 raft_consensus.cc:740] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:58.805344 23592 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:16:58.800729 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:58.800563 22544 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:16:58.859812 22542 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:58.860643 23606 log.cc:927] Time spent T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:16:58.858117 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:58.871613 23131 raft_consensus.cc:1240] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.875890 22547 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.789513 23551 consensus_queue.cc:260] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.887799 22549 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.854514 23550 raft_consensus.cc:3055] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:16:58.904731 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:58.907534 22551 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
W20260709 12:16:58.907625 22441 connection.cc:256] RPC call timeout handler was delayed by -1.498952989000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
W20260709 12:16:58.908108 22441 connection.cc:256] RPC call timeout handler was delayed by -1.3792529890001788s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
I20260709 12:16:58.912842 23583 consensus_queue.cc:1059] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:16:58.914062 23583 raft_consensus.cc:3055] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:58.914430 23583 raft_consensus.cc:740] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:58.915170 23583 consensus_queue.cc:260] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.915989 23577 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:58.916265 23583 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.917243 23577 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:58.917848 23559 consensus_queue.cc:1059] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.907088 23550 raft_consensus.cc:740] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:58.920286 23550 consensus_queue.cc:260] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.921299 23550 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.919279 23577 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:58.922037 23600 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.877067 23591 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.880067 23578 consensus_queue.cc:260] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.925081 23578 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.925278 23591 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:58.892335 23528 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:58.943382 22297 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50158 (request call id 185) took 1289 ms. Trace:
I20260709 12:16:58.943720 22299 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32988 (request call id 86) took 1094 ms. Trace:
W20260709 12:16:58.944626 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 90177.4us
I20260709 12:16:58.959764 22400 raft_consensus.cc:1275] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:58.968240 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 215613us
I20260709 12:16:58.942473 23564 raft_consensus.cc:3055] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:58.969075 23551 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.979149 23564 raft_consensus.cc:740] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:58.989066 23539 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:16:58.994478 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:58.995404 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:58.995783 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:58.993841 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:58.994843 22367 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:58.996721 22469 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.968892 23577 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:16:58.994482 23576 consensus_queue.cc:1059] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
W20260709 12:16:58.979267 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 126813us
I20260709 12:16:59.007922 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:16:59.009254 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:59.007289 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:58.944181 22299 rpcz_store.cc:276] 0709 12:16:57.852721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.852924 (+   203us) service_pool.cc:224] Handling call
0709 12:16:58.943664 (+1090740us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:58.068149 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:58.178034 (+109885us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:58.182709 (+  4675us) write_op.cc:435] Acquired schema lock
0709 12:16:58.186709 (+  4000us) tablet.cc:662] Decoding operations
0709 12:16:58.274312 (+ 87603us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:58.277866 (+  3554us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:58.280297 (+  2431us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:16:58.352937 (+ 72640us) tablet.cc:701] Row locks acquired
0709 12:16:58.356676 (+  3739us) write_op.cc:260] PREPARE: finished
0709 12:16:58.365246 (+  8570us) write_op.cc:270] Start()
0709 12:16:58.375708 (+ 10462us) write_op.cc:276] Timestamp: P: 1783599418362509 usec, L: 0
0709 12:16:58.383973 (+  8265us) op_driver.cc:348] REPLICATION: starting
0709 12:16:58.460573 (+ 76600us) log.cc:844] Serialized 532 byte log entry
0709 12:16:58.836710 (+376137us) op_driver.cc:464] REPLICATION: finished
0709 12:16:58.849122 (+ 12412us) write_op.cc:301] APPLY: starting
0709 12:16:58.849215 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:58.849315 (+   100us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:58.852697 (+  3382us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:58.852930 (+   233us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:58.853072 (+   142us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:16:58.853118 (+    46us) write_op.cc:312] APPLY: finished
0709 12:16:58.853292 (+   174us) log.cc:844] Serialized 22 byte log entry
0709 12:16:58.853450 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:58.853530 (+    80us) write_op.cc:454] Released schema lock
0709 12:16:58.853565 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:58.858014 (+  4449us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:58.858926 (+   912us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":81904,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":3344,"apply.run_cpu_time_us":1574,"apply.run_wall_time_us":11774,"num_ops":1,"prepare.queue_time_us":150689,"prepare.run_cpu_time_us":7984,"prepare.run_wall_time_us":408266,"replication_time_us":452581}]]}
I20260709 12:16:58.943770 22297 rpcz_store.cc:276] 0709 12:16:57.653525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.655817 (+  2292us) service_pool.cc:224] Handling call
0709 12:16:58.943288 (+1287471us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:57.890988 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:57.895464 (+  4476us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:57.895513 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:16:57.895545 (+    32us) tablet.cc:662] Decoding operations
0709 12:16:57.895949 (+   404us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:57.896050 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:57.896081 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:16:57.896349 (+   268us) tablet.cc:701] Row locks acquired
0709 12:16:57.896394 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:16:57.896565 (+   171us) write_op.cc:270] Start()
0709 12:16:57.896701 (+   136us) write_op.cc:276] Timestamp: P: 1783599417896509 usec, L: 0
0709 12:16:57.896735 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:16:57.897437 (+   702us) log.cc:844] Serialized 594 byte log entry
0709 12:16:58.480862 (+583425us) op_driver.cc:464] REPLICATION: finished
0709 12:16:58.702482 (+221620us) write_op.cc:301] APPLY: starting
0709 12:16:58.710221 (+  7739us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:58.722462 (+ 12241us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:58.722604 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:58.725193 (+  2589us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:58.725477 (+   284us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:16:58.725542 (+    65us) write_op.cc:312] APPLY: finished
0709 12:16:58.745677 (+ 20135us) log.cc:844] Serialized 22 byte log entry
0709 12:16:58.745890 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:58.745967 (+    77us) write_op.cc:454] Released schema lock
0709 12:16:58.746018 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:58.746360 (+   342us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:58.746386 (+    26us) write_op.cc:454] Released schema lock
0709 12:16:58.801844 (+ 55458us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b540038b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b5132a 00007fb4f8ad6f14 00007fb4f8ad6ec3 00007fb4f8ad6e38 00007fb4f8ad6df3 00007fb4f8ad60dc 00007fb4f8affe16 00007fb4f8ae7cbb 00007fb4f8ad239d 00007fb4f8ad5d75
Metrics: {"mutex_wait_us":6968,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":143922,"apply.run_cpu_time_us":3003,"apply.run_wall_time_us":68079,"num_ops":1,"prepare.queue_time_us":199825,"prepare.run_cpu_time_us":11066,"prepare.run_wall_time_us":162684,"raft.queue_time_us":611778,"raft.run_cpu_time_us":24586,"raft.run_wall_time_us":370317,"replication_time_us":583920,"spinlock_wait_cycles":83142016,"thread_start_us":525216,"threads_started":4,"wal-append.queue_time_us":160963}]]}
W20260709 12:16:59.011824 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 103086us
I20260709 12:16:58.981577 23566 consensus_queue.cc:1059] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:16:59.010785 23589 raft_consensus.cc:3055] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:58.994102 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:59.020963 22475 raft_consensus.cc:1240] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.022325 22367 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:59.005689 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:59.006729 23525 raft_consensus.cc:3055] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.041285 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:59.025233 23591 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.018368 22298 catalog_manager.cc:5697] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 2, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.994040 23564 consensus_queue.cc:260] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.021194 23589 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:59.068974 23525 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:59.072489 23589 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.073566 23589 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.072865 23525 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.074270 23525 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:59.052229 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:59.047012 22398 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 2: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:16:59.021888 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:59.013005 22396 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.041834 23576 raft_consensus.cc:3055] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.078224 23567 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:59.078907 22395 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:16:59.063099 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 47417.5us
I20260709 12:16:59.013069 23545 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.068285 22469 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:16:59.024230 22402 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.068360 22399 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:16:58.993257 23616 consensus_queue.cc:1059] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:16:59.070322 23564 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.070935 23511 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.022048 23528 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:16:59.070497 22298 catalog_manager.cc:5697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 2, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.071429 22441 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.078348 23576 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:59.078873 23567 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:59.039855 23566 raft_consensus.cc:3055] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.096802 23566 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:59.097916 23566 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.099237 23566 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.099952 22441 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.101311 22441 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.101965 23511 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:59.102216 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 81857.6us
I20260709 12:16:59.102735 23616 consensus_queue.cc:1243] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:16:59.103222 22367 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:16:59.084654 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 66488.6us
I20260709 12:16:59.092833 23576 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.106170 23576 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.095140 22298 catalog_manager.cc:5697] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 2, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.111255 23511 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:59.111768 23511 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:59.112164 23511 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.113147 23614 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:59.137245 23614 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:59.137616 23614 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.114550 23528 consensus_queue.cc:1059] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:16:59.116180 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.123839 22473 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.125164 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:59.131450 22550 raft_consensus.cc:1240] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.124306 22475 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.143862 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:59.144402 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:59.145367 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:59.120806 23521 consensus_queue.cc:1059] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:16:59.142107 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:59.172982 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:16:59.173628 23095 leader_election.cc:336] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.514s (SENT)
I20260709 12:16:59.147783 22298 catalog_manager.cc:5697] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 2, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.178347 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:59.114467 23559 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:16:59.179718 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 63608.6us
I20260709 12:16:59.118489 22395 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.114620 23619 raft_consensus.cc:3055] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.115912 23567 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:59.190795 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:59.185735 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:59.134593 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:59.188149 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:59.114943 23623 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.122998 23571 consensus_queue.cc:1059] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:16:59.200029 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:59.204881 22469 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:16:59.210150 23522 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:59.119278 23602 consensus_queue.cc:1059] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 12:16:59.118674 23539 consensus_queue.cc:1059] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:16:59.118821 23583 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
W20260709 12:16:59.195648 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 57005.7us
I20260709 12:16:59.118647 23545 consensus_queue.cc:1059] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:16:59.194670 22298 catalog_manager.cc:5697] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 2, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.187680 23528 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.182720 23559 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:59.218331 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:59.222081 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:59.223127 22475 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2.
I20260709 12:16:59.189849 23619 raft_consensus.cc:740] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:59.223891 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:16:59.219892 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:59.222342 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:59.234329 22551 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.234165 22474 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 1.
I20260709 12:16:59.224850 22298 catalog_manager.cc:5697] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 2, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.236454 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:59.238430 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:59.243009 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:59.244226 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:59.245812 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:59.247223 22547 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.250037 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:59.251107 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:16:59.224054 23522 raft_consensus.cc:697] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 2 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:59.225114 23559 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.254968 23131 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.205065 23511 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:59.255750 22298 catalog_manager.cc:5697] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 2, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.239614 23590 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:59.255837 23125 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.260789 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:59.267697 22545 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.267951 22548 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.244613 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:16:59.272774 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:59.276355 22477 raft_consensus.cc:2393] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 2: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:16:59.276475 22441 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.281037 22543 raft_consensus.cc:1275] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.282689 23602 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.283064 23602 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:16:59.258546 23095 leader_election.cc:336] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.535s (SENT)
I20260709 12:16:59.286856 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:59.287118 23602 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.288530 23602 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.290087 22469 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:16:59.294503 22471 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:16:59.281962 23521 raft_consensus.cc:3055] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.263142 23590 raft_consensus.cc:697] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:59.297618 23521 raft_consensus.cc:740] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:59.298664 23521 consensus_queue.cc:260] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.300060 23521 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.302812 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:59.306218 23621 raft_consensus.cc:3055] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.306671 23621 raft_consensus.cc:740] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:16:59.312322 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:59.270341 23566 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:16:59.315442 22441 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.295392 23527 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:59.323565 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 100510us
I20260709 12:16:59.310289 23619 consensus_queue.cc:260] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.316227 22544 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.319777 23522 consensus_queue.cc:237] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.292205 23095 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:59.325914 22549 raft_consensus.cc:1240] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
W20260709 12:16:59.348452 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:59.330826 23578 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.357292 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:59.333635 22542 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.336416 23567 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.395435 22474 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:16:59.401955 23527 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:16:59.402621 23527 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.405269 23511 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:59.406459 23607 raft_consensus.cc:3055] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.406881 23607 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:59.408490 22472 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:16:59.307574 23621 consensus_queue.cc:260] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:16:59.414354 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 57155.4us
I20260709 12:16:59.415275 22441 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:16:59.416157 23626 log.cc:927] Time spent T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:16:59.417695 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 275141us
I20260709 12:16:59.424098 22475 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
W20260709 12:16:59.425628 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 66898.9us
I20260709 12:16:59.412559 23567 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:59.466969 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:59.469362 22441 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:16:59.470671 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 44518.9us
I20260709 12:16:59.471472 23567 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:59.471997 23567 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.418623 23578 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:59.478063 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 56861.4us
I20260709 12:16:59.478924 22366 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:59.484293 22367 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:16:59.486085 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 65074.6us
I20260709 12:16:59.486819 22441 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.481992 23566 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.483847 23539 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.497949 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:59.502351 23545 raft_consensus.cc:3055] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.493749 23559 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.502741 23545 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:59.503273 22397 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.503619 23545 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.504805 23545 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.488099 23621 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.506431 23592 consensus_queue.cc:1059] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:59.507151 23559 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:59.507489 23528 raft_consensus.cc:3055] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.507874 23528 raft_consensus.cc:740] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:59.508638 23528 consensus_queue.cc:260] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.510267 23528 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.510558 22399 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.511754 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:59.517827 22399 raft_consensus.cc:1275] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.519452 23527 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:16:59.521886 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:59.521821 23607 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.523191 23607 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.527833 23619 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.390684 23590 consensus_queue.cc:237] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.534565 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:16:59.535470 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 56629.5us
W20260709 12:16:59.536119 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 49359.7us
W20260709 12:16:59.536461 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:59.534216 23566 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.537199 23631 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:59.540026 23631 raft_consensus.cc:697] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:59.540928 23631 consensus_queue.cc:237] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:16:59.541564 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 57356.4us
I20260709 12:16:59.543269 22367 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:59.544355 22367 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:59.545497 22367 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:59.546119 23630 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.552134 23566 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:16:59.553503 23596 consensus_queue.cc:1059] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:59.545959 23629 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.551532 22441 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.576886 22516 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.545715 23623 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.582448 22367 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:16:59.582199 22366 consensus_peers.cc:597] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0723691b01e2413baf71cbc73a551fdc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:59.588707 23578 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.584966 23549 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:59.591089 23549 raft_consensus.cc:697] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 2 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:16:59.592064 23549 consensus_queue.cc:237] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.595216 23598 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.578704 23527 consensus_queue.cc:1048] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:16:59.600123 22367 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:16:59.600821 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 49358.4us
I20260709 12:16:59.601513 22441 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:16:59.638667 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:59.638799 22441 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:16:59.581679 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 325167us
I20260709 12:16:59.644341 22441 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:16:59.646839 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 46788.1us
I20260709 12:16:59.647749 22367 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:59.606225 23633 raft_consensus.cc:2764] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:16:59.636966 23630 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.654350 22441 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.659953 22441 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.647904 23527 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.649475 23564 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.663902 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:59.660975 23565 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:59.669103 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:59.662858 23559 raft_consensus.cc:2764] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:16:59.672737 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.670828 23632 consensus_queue.cc:1059] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:16:59.674652 23527 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.678864 23566 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.657902 23624 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:59.679958 23624 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:59.680490 22441 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.681882 23577 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.676282 22544 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:16:59.680352 23624 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.683347 22441 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.684252 23551 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.685108 22441 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.685959 23566 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.686455 22441 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.687644 22441 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.688548 23566 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.689186 23551 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.690115 22441 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.691066 22441 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.656085 23576 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:59.694842 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 47183.4us
I20260709 12:16:59.695518 22441 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.697451 22367 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:59.697317 23566 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.697440 23551 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.704680 22441 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.704416 23630 consensus_queue.cc:1059] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:16:59.708942 22367 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:16:59.713896 22441 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.706477 23578 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.707690 23566 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.716209 22367 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:16:59.714956 23614 consensus_meta.cc:287] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.577s	user 0.006s	sys 0.005s
I20260709 12:16:59.712320 23602 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.722725 22366 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:16:59.716684 23551 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:59.717585 23623 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.724135 23571 raft_consensus.cc:2764] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:16:59.726259 23564 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:59.729832 23564 raft_consensus.cc:697] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:59.730737 23564 consensus_queue.cc:237] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.723749 23553 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:16:59.721040 23614 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:59.733404 22473 raft_consensus.cc:2393] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 2: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:16:59.727521 22367 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:59.734923 23571 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:59.736903 22395 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:59.738905 23551 raft_consensus.cc:697] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:59.735838 23614 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:16:59.742769 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:59.743841 23640 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.092s	user 0.000s	sys 0.002s
I20260709 12:16:59.744392 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:59.747117 23624 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.749866 23623 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.752810 22550 raft_consensus.cc:1275] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.778429 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:59.722728 23095 leader_election.cc:336] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.649s (SENT)
I20260709 12:16:59.739521 23591 raft_consensus.cc:3055] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.782337 23591 raft_consensus.cc:740] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:59.758846 23628 raft_consensus.cc:3055] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.767091 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:59.774019 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:16:59.784248 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 48971.6us
I20260709 12:16:59.791821 23527 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:59.792418 23624 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:59.799543 23576 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:59.800034 23578 consensus_queue.cc:1059] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:59.801146 23511 consensus_queue.cc:1059] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:59.808323 22367 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:59.810312 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:16:59.762144 23551 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.788759 23628 raft_consensus.cc:740] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:59.817082 22367 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:59.793005 23577 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:16:59.819311 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:16:59.821784 23126 raft_consensus.cc:1240] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.823859 22367 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:59.813374 23539 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:16:59.813383 23566 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 12:16:59.817001 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 95357.5us
I20260709 12:16:59.789736 23591 consensus_queue.cc:260] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:59.831333 23591 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.832268 23131 raft_consensus.cc:1240] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.833438 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:16:59.834964 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:16:59.828192 23623 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:59.823312 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:16:59.823943 23571 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.836750 22367 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:59.835430 22297 catalog_manager.cc:5697] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 2 to 3, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 3 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:59.824633 23564 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:59.841387 23623 raft_consensus.cc:697] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:59.852663 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:16:59.853354 22475 raft_consensus.cc:2376] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2. Re-sending same reply.
I20260709 12:16:59.866197 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:59.874094 23628 consensus_queue.cc:260] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.866473 23578 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:59.878687 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:59.865056 23623 consensus_queue.cc:237] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.880658 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:59.882109 22470 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.882506 23095 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:59.883793 23602 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:59.884366 23564 raft_consensus.cc:697] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:59.841427 23565 raft_consensus.cc:3055] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.897666 22474 raft_consensus.cc:1240] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.897626 22550 raft_consensus.cc:2955] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:59.901394 23628 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.905001 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:59.919370 22469 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.907470 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:16:59.907406 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:59.909679 22473 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 2: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:16:59.914631 22470 raft_consensus.cc:1240] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.914865 22468 raft_consensus.cc:1240] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.924559 23624 consensus_queue.cc:1059] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:59.924594 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.915163 22476 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.926896 23636 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.927074 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:16:59.927544 23583 raft_consensus.cc:3055] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.927716 23553 raft_consensus.cc:3055] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.927983 23583 raft_consensus.cc:740] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:59.927085 23578 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:16:59.929517 23577 consensus_queue.cc:1059] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:59.930280 23578 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:16:59.918044 23565 raft_consensus.cc:740] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:59.915854 23564 consensus_queue.cc:237] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:16:59.922307 23602 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:16:59.922789 22441 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:16:59.923902 23576 consensus_queue.cc:1059] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:59.925307 23527 consensus_queue.cc:1059] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:59.910106 23631 raft_consensus.cc:2955] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:16:59.932284 22473 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.928097 23567 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:59.932919 23095 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:16:59.928077 23553 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:59.935385 22298 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50166 (request call id 204) took 1461 ms. Trace:
I20260709 12:16:59.937898 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:16:59.966503 22399 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:16:59.942668 22469 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:16:59.953269 22297 catalog_manager.cc:5697] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 1 to 2, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 2 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:59.926822 23642 log.cc:927] Time spent T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.275s	user 0.002s	sys 0.000s
I20260709 12:16:59.930536 23577 raft_consensus.cc:3055] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.927567 23636 raft_consensus.cc:2764] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:16:59.951467 23614 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.971135 23577 raft_consensus.cc:740] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:16:59.964522 23567 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:16:59.968173 23589 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:16:59.968506 22442 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:16:59.982507 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 59793.5us
I20260709 12:16:59.996693 23614 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:00.000144 22441 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:00.006484 23551 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:00.006944 23551 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:00.007303 23551 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.002239 23577 consensus_queue.cc:260] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:16:59.965636 22298 rpcz_store.cc:276] 0709 12:16:58.473967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.474157 (+   190us) service_pool.cc:224] Handling call
0709 12:16:58.552234 (+ 78077us) spinlock_profiling.cc:243] Waited 65.2 ms on lock 0x7b540038b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abe090 00007fb4f8b5cf3a 00007fb4fe912e9c 00007fb4fea1104e 00007fb4fced22a4 00007fb4fced2232 00007fb4fced2161 00007fb4fced20dc 00007fb4fced1392 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:16:59.935311 (+1383077us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:59.555146 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:59.594206 (+ 39060us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:59.594242 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:16:59.594327 (+    85us) tablet.cc:662] Decoding operations
0709 12:16:59.595134 (+   807us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:59.595188 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:59.595226 (+    38us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:16:59.595892 (+   666us) tablet.cc:701] Row locks acquired
0709 12:16:59.595912 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:16:59.596049 (+   137us) write_op.cc:270] Start()
0709 12:16:59.596168 (+   119us) write_op.cc:276] Timestamp: P: 1783599419596004 usec, L: 0
0709 12:16:59.596192 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:16:59.653856 (+ 57664us) log.cc:844] Serialized 2848 byte log entry
0709 12:16:59.758051 (+104195us) op_driver.cc:464] REPLICATION: finished
0709 12:16:59.803219 (+ 45168us) write_op.cc:301] APPLY: starting
0709 12:16:59.803310 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:59.803532 (+   222us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:59.803695 (+   163us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:59.804704 (+  1009us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:59.804922 (+   218us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:16:59.804971 (+    49us) write_op.cc:312] APPLY: finished
0709 12:16:59.805253 (+   282us) log.cc:844] Serialized 58 byte log entry
0709 12:16:59.805441 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:59.805571 (+   130us) write_op.cc:454] Released schema lock
0709 12:16:59.805628 (+    57us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":9,"spinlock_wait_cycles":149991296,"child_traces":[["op",{"apply.queue_time_us":44899,"apply.run_cpu_time_us":2826,"apply.run_wall_time_us":3801,"num_ops":7,"prepare.queue_time_us":209801,"prepare.run_cpu_time_us":7599,"prepare.run_wall_time_us":110360,"replication_time_us":161631,"spinlock_wait_cycles":51968,"thread_start_us":184782,"threads_started":2}]]}
I20260709 12:17:00.015838 23527 raft_consensus.cc:3055] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:00.016342 23527 raft_consensus.cc:740] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:00.018455 23577 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.019804 23553 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:00.024233 22477 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:16:59.983121 23651 ts_tablet_manager.cc:933] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:17:00.037097 23553 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.017172 23527 consensus_queue.cc:260] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:00.011634 23567 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:00.057420 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 57363.5us
I20260709 12:17:00.071847 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:00.079021 22551 raft_consensus.cc:2393] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 2: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:00.082690 22441 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:00.000387 23583 consensus_queue.cc:260] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:00.087376 22441 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:00.058190 23607 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:00.087908 23511 consensus_queue.cc:1048] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:17:00.078809 23617 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:00.092056 23527 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.046411 23565 consensus_queue.cc:260] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:00.098685 23624 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:00.057483 23602 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:00.118353 23589 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:00.207146 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.138855 23607 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:00.140504 23592 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:00.147550 23585 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:17:00.205940 23583 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:00.279881 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:00.289871 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 268378us
I20260709 12:17:00.118517 23617 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:00.207942 23633 consensus_queue.cc:1059] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:17:00.222209 23596 consensus_queue.cc:1059] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
W20260709 12:17:00.301024 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 361480us
I20260709 12:17:00.222434 23521 consensus_queue.cc:1059] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:17:00.228343 23592 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:00.297495 23565 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.223930 23589 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:17:00.392463 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 247568us
I20260709 12:17:00.393726 22367 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:00.376549 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 289240us
W20260709 12:17:00.417292 23656 log.cc:927] Time spent T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
W20260709 12:17:00.405109 23591 consensus_meta.cc:287] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.000s
W20260709 12:17:00.384589 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 451719us
I20260709 12:17:00.423656 22397 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2.
I20260709 12:17:00.406920 23631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:58044 (request call id 7) took 2210 ms. Trace:
W20260709 12:17:00.432677 22472 consensus_meta.cc:287] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.527s	user 0.004s	sys 0.005s
I20260709 12:17:00.433079 22472 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
W20260709 12:17:00.434279 23628 consensus_meta.cc:287] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.000s
I20260709 12:17:00.407817 23596 consensus_queue.cc:1059] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:17:00.435410 23596 raft_consensus.cc:3055] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:00.435746 23596 raft_consensus.cc:740] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:00.406772 23657 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:00.437129 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 43501.3us
I20260709 12:17:00.459838 22367 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:00.462036 23559 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:00.467111 23628 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:00.531068 22399 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:00.526803 23551 consensus_meta.cc:287] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.519s	user 0.004s	sys 0.007s
W20260709 12:17:00.520352 23577 consensus_meta.cc:287] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.501s	user 0.005s	sys 0.004s
I20260709 12:17:00.550640 23672 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:00.511261 23662 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.557934 23662 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:00.529989 23618 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.484813 23528 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.483647 23657 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:00.555109 23670 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.561349 22548 raft_consensus.cc:1240] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:00.562857 23662 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:00.565002 23621 raft_consensus.cc:3055] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:00.565122 23672 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:00.530099 23590 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:00.526245 23592 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:00.514422 23628 raft_consensus.cc:697] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:00.478554 23632 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.569715 23589 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:00.591912 23596 consensus_queue.cc:260] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:00.597806 23528 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:00.484573 23651 tablet_copy_client.cc:323] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.1:37927
I20260709 12:17:00.553983 23619 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:00.628110 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 96430.1us
W20260709 12:17:00.632606 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 236033us
W20260709 12:17:00.633203 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 87858.3us
W20260709 12:17:00.609372 23567 consensus_meta.cc:287] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.004s
W20260709 12:17:00.648921 23663 log.cc:927] Time spent T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:17:00.649348 23672 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:00.686090 23672 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:00.686657 23672 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:00.687774 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:00.688488 23125 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:00.479909 23095 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:00.608446 23670 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:00.428920 23631 rpcz_store.cc:276] 0709 12:16:58.180355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.180482 (+   127us) service_pool.cc:224] Handling call
0709 12:16:58.497005 (+316523us) log.cc:844] Serialized 499 byte log entry
0709 12:16:58.537075 (+ 40070us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f5a4a0ac 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b
0709 12:16:58.792035 (+254960us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b1800048400. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f59e1c0a 00007fb4ff121219 00007fb4f5a69a40 00007fb4f5a644e4 00007fb4f5a64455 00007fb4f8aadb0b 00007fb4f8b32b63 00007fb4f8b5a752 00007fb4fdb1ad29
0709 12:16:58.918787 (+126752us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b2c00106b88. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f744da11 00007fb4f745ca0a 00007fb4f745c693 00007fb4f745c631 00007fb4f8b90b52 00007fb4f8b90cf5 00007fb4f8acd691 00007fb4f8aadeaa 00007fb4f8ab4d53 00007fb4f8ab4cd9 00007fb4f8ab4c69
0709 12:17:00.390211 (+1471424us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94073,"raft.queue_time_us":230708,"raft.run_cpu_time_us":12277,"raft.run_wall_time_us":205542,"spinlock_wait_cycles":134103552,"thread_start_us":119255,"threads_started":1,"wal-append.queue_time_us":129074,"wal-append.run_cpu_time_us":1619,"wal-append.run_wall_time_us":1011724}
I20260709 12:17:00.603514 23621 raft_consensus.cc:740] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:00.561043 23551 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:00.676419 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:00.700742 23128 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:17:00.659240 23589 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:00.603996 23657 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:00.684522 23628 consensus_queue.cc:237] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:00.688781 23672 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:00.694190 22473 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:00.695134 22475 raft_consensus.cc:1240] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:00.697177 22367 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:00.700155 22477 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:00.710872 22476 raft_consensus.cc:1240] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 12:17:00.687105 23592 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:00.608642 23590 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:00.707743 23658 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:00.678777 23619 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:00.708842 23126 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:00.718083 22468 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:00.709447 23589 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:00.725562 23589 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:00.602312 23618 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:00.678704 23567 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:00.723374 23528 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:00.729198 23592 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:00.731189 23567 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:00.739316 22543 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:00.741688 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:00.731518 23621 consensus_queue.cc:260] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:00.647408 23632 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:00.751209 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 54139.6us
I20260709 12:17:00.746035 23539 raft_consensus.cc:3055] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:00.751794 23623 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:00.758492 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:00.719036 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 256739us
I20260709 12:17:00.759575 22469 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:17:00.731204 23618 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:00.755964 23539 raft_consensus.cc:740] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:00.752815 23576 consensus_queue.cc:1059] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:17:00.775357 23559 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.775847 23617 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:00.775902 23559 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:00.780900 22469 consensus_queue.cc:237] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:17:00.782891 23553 consensus_meta.cc:287] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.000s
I20260709 12:17:00.783807 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:00.784467 22551 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:00.786125 23559 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:00.786937 23559 raft_consensus.cc:3055] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:00.787276 23559 raft_consensus.cc:740] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:00.787810 23592 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:00.771530 22402 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:00.788115 23559 consensus_queue.cc:260] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:00.791234 22442 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:00.791523 23559 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.793684 23632 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:00.799371 23624 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:00.800037 23624 raft_consensus.cc:697] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:00.800711 23657 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:00.800889 23624 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:00.825950 22441 consensus_peers.cc:597] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b42c69680a57493c942307ff09185b72. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:00.837664 22515 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:00.838970 22515 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:00.841431 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:00.810636 23095 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:00.836752 23592 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:00.835917 23672 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.851701 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:00.852607 23670 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:00.858445 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 51907.2us
I20260709 12:17:00.859781 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:00.852566 23131 raft_consensus.cc:2393] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 2: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:00.861279 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:00.861969 23657 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:00.866587 23657 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.867385 23670 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.862977 23125 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:00.863700 23619 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:00.863993 23129 raft_consensus.cc:1240] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:00.864114 23672 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:00.846112 23618 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:00.850528 23592 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:00.851536 23126 raft_consensus.cc:2393] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 2: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:00.892647 23549 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.872670 23590 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:00.873276 23633 raft_consensus.cc:3055] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:00.839120 23617 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:00.896093 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:00.867898 23670 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:00.893224 23567 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:00.895728 23633 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:00.903679 22548 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:00.893986 23618 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:00.893615 23619 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:00.906260 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:00.918560 22548 raft_consensus.cc:2393] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 2: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:00.893224 23549 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:00.897631 23617 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:00.927911 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 252330us
I20260709 12:17:00.931025 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:00.931692 22546 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:00.929354 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:00.915704 23618 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.927501 23617 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:00.945899 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.958135 23682 consensus_queue.cc:1059] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:17:00.921587 23527 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:17:00.935551 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:00.923247 23619 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:00.958140 22366 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:00.963227 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.966058 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:00.970058 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:00.973664 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:00.980185 22473 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2.
I20260709 12:17:00.955432 23591 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:17:00.969010 23522 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.989465 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:00.971463 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:00.969308 22549 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:00.990638 22393 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:00.993367 23539 consensus_queue.cc:260] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:00.969441 23623 raft_consensus.cc:697] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:00.990388 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:00.999326 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:00.963766 23583 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 12:17:01.006623 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 250905us
I20260709 12:17:00.954253 23633 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.008322 22401 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:01.009241 22366 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:00.977932 23692 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:17:01.007817 22400 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:01.012475 22396 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:01.012542 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:00.999302 23628 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.013242 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:01.021658 23654 log.cc:927] Time spent T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.965s	user 0.004s	sys 0.002s
I20260709 12:17:01.022682 23628 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.024574 23628 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:00.994635 23522 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.026077 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:01.007330 22470 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2.
I20260709 12:17:01.034549 22401 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:01.034680 23672 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:01.036170 23619 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:01.038601 23522 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:01.017122 23670 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:01.015717 23694 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:01.039745 23694 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.040107 23694 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:01.039933 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.025557 23592 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:01.050836 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:01.044484 23696 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:01.044770 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:01.045095 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:01.044684 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:01.047314 23551 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:01.047734 23553 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.042033 23567 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.057875 22516 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:01.062192 22551 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:01.050776 23658 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:01.065577 22366 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:01.043381 23539 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.070952 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:01.076830 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:01.058501 23696 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.052119 23628 consensus_queue.cc:1059] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:17:01.087505 22473 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:01.089928 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:01.090781 22473 raft_consensus.cc:2393] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 2: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:01.091456 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:01.091881 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:01.093186 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:01.094308 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:01.089795 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:01.092126 22473 raft_consensus.cc:2393] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 2: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:01.093818 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:01.071851 22398 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:01.075965 23522 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:01.081387 23672 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:01.067129 23617 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:01.095619 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:01.134136 22475 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:17:01.113088 22476 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:01.113547 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:01.111712 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:01.065589 23670 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:17:01.072628 23583 consensus_queue.cc:1059] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 12:17:01.136300 23705 log.cc:927] Time spent T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:17:01.074718 23567 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:01.135664 22474 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:17:01.129441 23672 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.082726 23696 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:01.136667 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 71172.2us
I20260709 12:17:01.146301 22547 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.082232 23526 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:01.148021 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:01.073944 23553 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:01.141736 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:01.094272 23559 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:01.142946 23669 raft_consensus.cc:3055] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:01.088012 23691 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:17:01.114408 23590 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:17:01.143689 23628 raft_consensus.cc:3055] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:01.135556 22471 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:01.157437 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:01.130538 23592 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.067736 23623 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.129681 23522 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:01.158917 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:01.163038 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:01.088424 23692 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:17:01.158810 23528 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:01.082659 23697 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 12:17:01.163856 23522 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.164345 23589 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.165922 23617 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:01.167757 22472 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:01.144284 23672 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.183457 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:01.184091 23129 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.150239 23526 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.178936 22469 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 2: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:01.156841 23559 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.156126 23658 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.168812 23577 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.161230 23628 raft_consensus.cc:740] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:01.178300 23669 raft_consensus.cc:740] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:01.181492 23591 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:01.194684 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.186355 23526 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.190385 23686 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:01.188294 23559 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.176808 23618 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:01.216320 23602 raft_consensus.cc:3055] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:01.216795 23602 raft_consensus.cc:740] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:17:01.219667 22366 consensus_peers.cc:597] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2974af5009474d6590a8e35ea1dc6b83. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:01.192155 23577 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.197639 23686 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:01.196861 23591 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:01.227000 23686 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.232097 23567 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:01.235211 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:01.204909 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 154149us
I20260709 12:17:01.243052 23095 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:01.243883 23567 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.237010 22395 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:01.251873 23129 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:01.253382 22515 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:01.326613 22547 raft_consensus.cc:1275] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:01.247404 23553 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:01.217670 23602 consensus_queue.cc:260] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:01.366080 22397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58054 (request call id 37) took 1592 ms. Trace:
I20260709 12:17:01.366535 22397 rpcz_store.cc:276] 0709 12:16:59.773560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.773708 (+   148us) service_pool.cc:224] Handling call
0709 12:17:01.365905 (+1592197us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b54001e3554. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:01.366011 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1460626304}
I20260709 12:17:01.222470 23628 consensus_queue.cc:260] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:01.371032 23674 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.325867 23528 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:01.400966 23676 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:01.410641 23676 raft_consensus.cc:697] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:17:01.391050 23657 consensus_meta.cc:287] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.003s
I20260709 12:17:01.234126 23669 consensus_queue.cc:260] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:01.408835 23691 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:01.402685 23528 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.383894 23095 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:01.431234 23657 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.461172 23549 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:01.462816 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:01.468890 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:01.458387 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 295405us
I20260709 12:17:01.473728 23681 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:01.478533 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 257836us
W20260709 12:17:01.478106 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.487216 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:01.477540 23527 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.474344 23681 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.455006 23618 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:01.466967 23528 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:01.491910 23527 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.492507 23567 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:01.498080 23706 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:01.498725 23592 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.481244 23704 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.499961 23672 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.409502 23674 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.492786 23577 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:01.475277 23628 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.515379 23681 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:01.517122 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:01.475544 23691 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:01.517225 22411 tablet_copy_service.cc:140] P b8621fa34be04d3fa2d68a300f858cd1: Received BeginTabletCopySession request for tablet 0723691b01e2413baf71cbc73a551fdc from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:58054)
I20260709 12:17:01.518043 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:01.518751 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:01.520581 23694 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.522116 22548 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:01.491551 23695 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:01.483489 23623 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.552369 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:01.511799 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:01.507534 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 142007us
I20260709 12:17:01.509325 23549 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.475347 23522 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:01.523078 23591 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:01.560395 22397 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2.
W20260709 12:17:01.561189 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 74067.4us
I20260709 12:17:01.550810 23567 raft_consensus.cc:697] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 2 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:01.521564 23706 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.509259 23578 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:17:01.558400 22411 tablet_copy_service.cc:161] P b8621fa34be04d3fa2d68a300f858cd1: Beginning new tablet copy session on tablet 0723691b01e2413baf71cbc73a551fdc from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:58054: session id = 65951063312d4a1e9123f92354101c71-0723691b01e2413baf71cbc73a551fdc
I20260709 12:17:01.580137 22543 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2.
W20260709 12:17:01.579999 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.582106 23717 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:01.582543 23590 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:01.583566 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:01.588241 23692 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.588572 23567 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:01.502151 23676 consensus_queue.cc:237] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:01.589149 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:01.569585 23589 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.594238 23619 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.562712 23623 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:01.597383 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 117199us
I20260709 12:17:01.524981 23704 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.570916 23521 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:17:01.589247 23662 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:01.610414 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.610477 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:01.569682 23695 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.620357 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:01.583065 23590 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:01.612099 23710 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 12:17:01.600306 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:01.625710 22546 raft_consensus.cc:2410] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:01.609122 23675 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:01.582695 23717 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.615005 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:01.632562 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:01.633646 23695 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:01.637853 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:01.624894 22542 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.660948 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:01.657310 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.661486 22401 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:01.644995 23672 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:01.595225 23692 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.623394 23662 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:01.634778 23696 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.639797 23675 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.653110 23670 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:01.657569 22395 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:01.673372 23521 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:01.676616 23521 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.656349 23095 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:01.679872 23689 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:01.680248 23709 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:01.680320 23689 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.682185 23709 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.682284 23689 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.682578 23709 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.683611 22442 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:01.666802 23527 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:01.670012 23658 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.670701 23674 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:01.671418 23706 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:01.687601 23522 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:01.699447 23687 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.741s	user 0.003s	sys 0.000s
I20260709 12:17:01.687697 23577 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:01.704070 23559 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.704772 23577 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.705202 23577 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:01.709052 23623 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:01.710733 23662 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:01.712416 23696 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:01.714356 22544 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.701596 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:01.718588 23704 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:01.719907 23717 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:01.718624 22399 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:01.720465 23717 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:01.720999 23717 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.722659 23590 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:01.687070 23521 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:01.735185 22402 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:01.735450 22411 tablet_copy_source_session.cc:215] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:01.738226 23691 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:01.742897 23094 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:01.744537 23658 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:01.745110 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:01.745023 23658 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.745954 23658 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.675757 23670 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.751737 23596 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.752029 23670 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:01.753615 23675 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:01.744756 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:01.759600 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:01.761269 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:01.763653 22548 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:01.764026 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:01.764683 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:01.766072 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:01.766809 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:01.688444 23694 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:01.765404 22551 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:01.771622 22548 raft_consensus.cc:2393] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 2: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:01.768242 22547 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
W20260709 12:17:01.688484 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 56678us
W20260709 12:17:01.739895 23526 consensus_meta.cc:287] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.002s
I20260709 12:17:01.803439 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:01.804602 22402 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:17:01.805707 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:01.806860 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:01.807467 22402 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:01.814661 23578 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.770663 23691 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:01.823249 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:01.708086 23686 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:01.830197 23718 log.cc:927] Time spent T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:17:01.780543 23675 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.811968 23527 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.815299 23578 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.819051 23681 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:01.854233 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.864032 23577 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.830317 23669 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.823362 23539 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:01.810575 23526 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:01.859475 23711 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 12:17:01.879179 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 58310us
I20260709 12:17:01.839346 23691 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.843933 23661 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
W20260709 12:17:01.893735 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:01.897327 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.846167 23675 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:01.860212 23527 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:01.910658 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 97724.3us
I20260709 12:17:01.875237 23681 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.883806 23539 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:01.944628 23667 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:01.938948 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 52009.1us
I20260709 12:17:01.955917 23717 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:01.957028 23691 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:01.984215 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:01.991729 23130 raft_consensus.cc:2393] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 2: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
W20260709 12:17:01.995738 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 84206.4us
I20260709 12:17:01.996747 22544 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:01.945665 23577 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.014767 23675 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:02.017671 23526 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:02.019658 23681 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.023435 23539 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.024783 23578 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:01.915628 23553 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 12:17:02.025956 22542 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.000099 23667 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.009435 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:02.010335 23559 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.050619 22297 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50176 (request call id 182) took 2375 ms. Trace:
I20260709 12:17:02.051815 22298 catalog_manager.cc:5697] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 2, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:02.064357 22298 catalog_manager.cc:5697] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 2, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:02.052902 23527 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.063290 22297 rpcz_store.cc:276] 0709 12:16:59.674887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.675009 (+   122us) service_pool.cc:224] Handling call
0709 12:17:02.050521 (+2375512us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:00.018100 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:00.018749 (+   649us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:00.018793 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:17:00.018808 (+    15us) tablet.cc:662] Decoding operations
0709 12:17:00.019258 (+   450us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:00.019324 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:00.019356 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:17:00.019724 (+   368us) tablet.cc:701] Row locks acquired
0709 12:17:00.019743 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:17:00.019901 (+   158us) write_op.cc:270] Start()
0709 12:17:00.020028 (+   127us) write_op.cc:276] Timestamp: P: 1783599420019850 usec, L: 0
0709 12:17:00.020047 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:17:00.068532 (+ 48485us) log.cc:844] Serialized 922 byte log entry
0709 12:17:00.400483 (+331951us) op_driver.cc:464] REPLICATION: finished
0709 12:17:00.708635 (+308152us) write_op.cc:301] APPLY: starting
0709 12:17:00.708733 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:00.708849 (+   116us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:00.708969 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:00.709315 (+   346us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:00.742964 (+ 33649us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:17:00.749898 (+  6934us) write_op.cc:312] APPLY: finished
0709 12:17:00.769656 (+ 19758us) log.cc:844] Serialized 28 byte log entry
0709 12:17:00.796928 (+ 27272us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:00.804551 (+  7623us) write_op.cc:454] Released schema lock
0709 12:17:00.806746 (+  2195us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:00.818808 (+ 12062us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:00.822179 (+  3371us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":86441,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":272879,"apply.run_cpu_time_us":2522,"apply.run_wall_time_us":113617,"num_ops":2,"prepare.queue_time_us":18931,"prepare.run_cpu_time_us":3584,"prepare.run_wall_time_us":69370,"replication_time_us":364730,"thread_start_us":210493,"threads_started":1}]]}
W20260709 12:17:02.080044 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 96676.9us
I20260709 12:17:02.080549 23095 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:02.080878 22441 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:02.070223 23571 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.082690 23571 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:02.082715 22441 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:02.073062 23628 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.077633 23559 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.086346 23657 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:02.089407 23681 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.098146 23728 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:02.098730 23731 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:02.088253 23578 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.087212 23686 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:02.095503 23539 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:02.063249 23658 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:02.111459 23131 raft_consensus.cc:2368] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3.
I20260709 12:17:02.103511 23681 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.095008 23628 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.113385 23728 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.110952 23732 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.099805 23559 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:02.116226 23681 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.123772 23732 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:02.126065 23559 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:02.123955 23571 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.127640 23728 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.124660 23581 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.128368 23709 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:02.108784 23578 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.117332 23667 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.112341 23539 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.113214 23731 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:02.138958 23633 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:02.147365 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 64723.3us
I20260709 12:17:02.148347 22441 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:02.135953 23722 log.cc:927] Time spent T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:17:02.150653 23728 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.151185 23728 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.151568 23728 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.150884 23651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0723691b01e2413baf71cbc73a551fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:02.144443 23733 ts_tablet_manager.cc:933] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:17:02.153506 22441 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:17:02.149544 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 152092us
I20260709 12:17:02.160208 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.162804 22477 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:02.167464 23567 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.167788 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.168460 22477 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:17:02.168219 23567 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:02.163441 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.170365 22471 raft_consensus.cc:2410] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:02.163944 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.157980 22442 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:02.169453 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:02.171489 22477 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.172894 22469 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:02.174566 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:02.175546 22471 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.173691 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.179570 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.161022 23581 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.183219 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:02.184406 22393 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.185722 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.187522 22472 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.136581 23689 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.195214 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:02.196489 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:02.197147 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:02.199512 22399 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:17:02.200536 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:02.179240 23566 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:02.202545 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:02.206956 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:02.216693 22397 raft_consensus.cc:2393] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:02.212527 22545 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:02.222141 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.222458 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.224969 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:02.225291 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:02.225998 22399 raft_consensus.cc:2393] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:02.226882 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:02.227444 22397 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:02.228797 22545 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:02.218349 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:02.215435 22393 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:02.230211 23094 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:02.231647 23732 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:17:02.184165 23581 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.237840 23740 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:02.238551 23740 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:02.239364 23691 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:02.240025 23691 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.241565 23717 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:02.242630 22516 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:02.244802 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:02.248800 22516 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:02.209117 23658 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.209522 23737 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.218238 23566 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:02.294375 23566 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.210054 23686 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:02.254958 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.314137 22476 raft_consensus.cc:2393] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 2: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:02.260026 22471 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
W20260709 12:17:02.261456 23735 log.cc:927] Time spent T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:17:02.262424 23709 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.317729 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.315562 23706 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.318343 23689 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:02.317328 23681 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.319015 23691 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:02.319886 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:02.320243 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:02.320544 23576 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:02.318395 22476 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:02.262856 23549 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:02.321751 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.322068 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:02.322798 23128 raft_consensus.cc:2393] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 2: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:02.323647 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:02.324218 22470 raft_consensus.cc:1240] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:02.324746 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:02.318806 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.264423 23578 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.269505 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:02.271807 22477 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:02.274569 23731 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:02.277477 22549 raft_consensus.cc:1240] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:02.278743 23658 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:02.251582 23717 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:02.248234 23684 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:17:02.279552 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:02.335062 22550 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:17:02.335914 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:02.282081 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:02.287063 23567 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:02.350407 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.245326 23581 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.262873 23737 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.299755 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:02.310451 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:02.356967 22546 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.240852 23740 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:02.321086 23576 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.321851 23732 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.263393 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:02.327886 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.328291 22367 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:02.325583 22543 raft_consensus.cc:2393] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:02.252331 23662 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.329667 22545 raft_consensus.cc:2393] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 2: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:02.331241 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.320390 23681 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.383195 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:02.384179 22545 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:17:02.333155 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.386375 22477 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:02.386993 22471 raft_consensus.cc:2393] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 2: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:02.333243 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.341244 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:02.342609 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:02.314565 23733 tablet_copy_client.cc:323] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.1:37927
I20260709 12:17:02.326891 23686 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:02.363945 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 133803us
I20260709 12:17:02.364265 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:02.394420 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.321780 23549 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:02.367486 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:02.371882 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:02.378175 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:02.378300 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 50101.9us
I20260709 12:17:02.332759 23545 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:17:02.387867 22393 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:02.385682 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:02.363617 23658 raft_consensus.cc:697] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 3 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:02.428742 22515 leader_election.cc:400] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3.
W20260709 12:17:02.431607 23703 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.013s	sys 0.016s
I20260709 12:17:02.390817 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.355475 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:02.394879 22550 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 3: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:02.318430 23706 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:02.395664 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.375487 23578 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.401810 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:02.441944 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:02.470822 22476 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:02.447902 22515 leader_election.cc:403] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:02.440609 23131 raft_consensus.cc:1240] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:02.389297 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 140585us
I20260709 12:17:02.470260 22548 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:02.470232 23128 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:02.380149 23539 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.447692 22551 raft_consensus.cc:2393] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:02.472738 22367 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:02.396476 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:02.446954 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:02.373919 23736 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:17:02.443332 23734 log.cc:927] Time spent T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.301s	user 0.002s	sys 0.000s
I20260709 12:17:02.480132 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:02.481594 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.448508 23549 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:02.468477 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 75221us
I20260709 12:17:02.471211 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:02.480427 23715 log.cc:927] Time spent T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.661s	user 0.006s	sys 0.004s
I20260709 12:17:02.388162 23662 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.483335 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:02.467741 23602 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.387636 23630 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:02.377749 23740 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:02.447772 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:02.384491 23732 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.512624 23591 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:02.415231 23717 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:02.386276 22542 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:02.501883 23670 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:02.371309 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:02.502976 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:02.530503 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:02.498540 23736 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.415603 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:02.564769 22472 raft_consensus.cc:2393] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:02.565303 22398 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.566083 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:02.567827 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 64969.7us
I20260709 12:17:02.445086 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:02.499076 23748 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3.
I20260709 12:17:02.422554 23526 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:02.569135 23670 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.576134 23526 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:02.577596 23670 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.582839 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:02.583729 22468 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.585944 23526 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:02.587565 22395 raft_consensus.cc:2368] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3.
W20260709 12:17:02.501499 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 88977.6us
I20260709 12:17:02.483875 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:02.589393 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.482000 23697 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.545032 22550 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.590420 22477 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:02.545413 22441 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:02.537485 22367 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:02.547679 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:02.548542 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:02.592094 22548 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:17:02.593122 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:02.548561 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:02.593369 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:02.594053 22548 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 1.
I20260709 12:17:02.593966 23697 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:02.595381 23697 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:02.595515 22476 raft_consensus.cc:1240] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:02.596249 23697 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.548779 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:02.537254 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:02.546057 23662 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.563465 23566 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.548214 23630 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:02.481470 23578 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.571547 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:02.570240 23545 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.572798 23598 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:17:02.568452 23728 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.467876 23684 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:02.591987 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 55102.4us
I20260709 12:17:02.600266 22546 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:02.600828 22550 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:02.604719 23094 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:02.634552 22367 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:02.606377 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 61026.8us
I20260709 12:17:02.635711 22367 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:02.552297 23740 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.607729 23661 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:17:02.608086 23744 log.cc:927] Time spent T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:17:02.608505 23549 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:02.556043 22549 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:17:02.573464 22366 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:02.614846 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 89726.2us
I20260709 12:17:02.616168 23736 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.602098 23716 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.548617 23658 consensus_queue.cc:237] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:02.643115 23737 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.713083 23758 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:02.713639 23758 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.625731 22475 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:02.639518 22477 raft_consensus.cc:1240] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:02.636621 22441 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:02.690511 22474 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:02.716305 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 79752.8us
W20260709 12:17:02.711571 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 106597us
I20260709 12:17:02.612771 23630 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.557825 23717 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.601965 23713 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:17:02.643172 23746 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.601665 23695 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
W20260709 12:17:02.718385 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 145027us
W20260709 12:17:02.640575 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:02.726362 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.718284 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:02.633082 22472 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.728413 22441 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:02.744885 22441 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:02.624755 23576 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.690173 23686 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:02.750562 22545 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.672886 23545 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:02.696616 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41028 (request call id 201) took 1541 ms. Trace:
I20260709 12:17:02.712047 23748 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:02.644695 23670 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.747619 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:02.752907 22543 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:17:02.720556 23559 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.756858 22549 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:02.724586 23737 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.644214 23753 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.721098 23661 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:02.742393 23736 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:02.766125 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:02.766271 23748 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.766672 23549 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:02.767803 22544 raft_consensus.cc:1240] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:02.769083 22468 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:02.759219 23670 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.643115 23684 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.728103 23746 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.776634 23129 raft_consensus.cc:2368] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3.
I20260709 12:17:02.750515 23591 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:02.761529 23741 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:02.786556 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.791148 22515 leader_election.cc:400] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3.
I20260709 12:17:02.793084 22515 leader_election.cc:403] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:02.771128 23750 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:02.771531 23545 raft_consensus.cc:697] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:02.773552 23737 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.720923 23716 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.779165 23661 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.788309 23670 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.802054 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:02.794386 23732 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.788256 23746 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.789510 23566 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.813473 23745 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:17:02.815539 23692 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:02.790477 23741 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.799847 22545 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:02.817581 22401 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.790072 23591 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.797478 23756 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.827261 22400 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2.
I20260709 12:17:02.803615 23737 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.779088 23753 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.802506 23750 raft_consensus.cc:697] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:02.834461 23545 consensus_queue.cc:237] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.835225 23581 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.836267 23716 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.836421 23717 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:02.805310 23758 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:02.806883 22411 tablet_copy_service.cc:140] P b8621fa34be04d3fa2d68a300f858cd1: Received BeginTabletCopySession request for tablet 2974af5009474d6590a8e35ea1dc6b83 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:58054)
I20260709 12:17:02.830883 23741 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.826116 23549 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3.
I20260709 12:17:02.833719 23728 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.857563 22411 tablet_copy_service.cc:161] P b8621fa34be04d3fa2d68a300f858cd1: Beginning new tablet copy session on tablet 2974af5009474d6590a8e35ea1dc6b83 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:58054: session id = 65951063312d4a1e9123f92354101c71-2974af5009474d6590a8e35ea1dc6b83
I20260709 12:17:02.833030 23756 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.861065 22469 raft_consensus.cc:2368] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3.
I20260709 12:17:02.864907 23129 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:02.866761 23717 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:02.863044 23756 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.759366 23125 rpcz_store.cc:276] 0709 12:17:01.147610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.150587 (+  2977us) service_pool.cc:224] Handling call
0709 12:17:01.166973 (+ 16386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:01.167360 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:01.167395 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:01.167900 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:17:01.666969 (+499069us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:01.669793 (+  2824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:01.673804 (+  4011us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:02.467396 (+793592us) spinlock_profiling.cc:243] Waited 7.09 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:02.623974 (+156578us) raft_consensus.cc:1685] finished
0709 12:17:02.624012 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:02.688479 (+ 64467us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":65440,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":16306560,"thread_start_us":494674,"threads_started":1,"wal-append.queue_time_us":521653}
I20260709 12:17:02.885149 22401 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:02.949038 23728 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:02.990669 23581 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.992172 23630 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:02.967952 23684 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:02.994047 23753 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.995322 22472 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:02.996964 23740 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.967017 23745 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.976331 23095 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:03.037635 23621 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.011025 23591 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:02.995209 23746 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:03.019178 22411 tablet_copy_source_session.cc:215] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:02.967625 23750 consensus_queue.cc:237] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:03.000360 23756 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:03.007644 23728 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:03.111742 22476 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:03.119560 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.120841 22476 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:03.131438 22442 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:03.114970 23726 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.110277 23757 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:03.113976 23748 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:03.135663 23630 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:03.135290 23726 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:03.170292 23662 consensus_meta.cc:287] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.555s	user 0.002s	sys 0.008s
I20260709 12:17:03.015106 23745 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:03.174321 23673 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.176317 23628 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:03.202065 22476 raft_consensus.cc:1240] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.206178 23658 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:03.194082 23662 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:03.199620 23630 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:03.199188 22472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:17:03.244055 23756 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:03.170558 23757 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:03.251523 22470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 989) took 1044 ms. Trace:
I20260709 12:17:03.254978 23628 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:03.256299 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:03.260362 22366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.007s	sys 0.035s
I20260709 12:17:03.260452 22547 raft_consensus.cc:1240] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:03.273584 22366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.008s	sys 0.035s
W20260709 12:17:03.274103 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 546695us
I20260709 12:17:03.245055 23700 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:03.275672 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:03.277678 22548 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.278028 23746 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:03.253150 22472 raft_consensus.cc:606] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:03.257341 23737 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:03.279335 22366 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:03.260568 23658 raft_consensus.cc:697] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 3 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:17:03.282837 22516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.011s	sys 0.042s
W20260709 12:17:03.317554 22516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.013s	sys 0.055s
W20260709 12:17:03.318650 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 544526us
I20260709 12:17:03.319410 22516 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:03.324791 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 45697.7us
I20260709 12:17:03.280786 23746 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:03.329972 22366 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:03.251082 23630 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:03.279429 23728 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:03.341425 22366 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:03.342026 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:03.342584 22441 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.052s	sys 0.067s
W20260709 12:17:03.342901 22441 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.052s	sys 0.067s
W20260709 12:17:03.343179 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 594351us
I20260709 12:17:03.343827 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:03.338577 23746 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:03.321015 22472 raft_consensus.cc:614] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:03.328794 23695 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.327099 23756 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.282554 22396 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:03.282928 23720 consensus_queue.cc:1059] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:17:03.349664 22516 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:03.323602 23688 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:03.322664 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 362331us
I20260709 12:17:03.354180 23726 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:03.354950 23768 log.cc:927] Time spent T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:17:03.360822 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 961) took 1165 ms. Trace:
I20260709 12:17:03.361116 23720 consensus_queue.cc:1059] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:03.350980 23695 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.341830 23621 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.359557 22516 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:03.277629 23628 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:03.347050 22468 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 3. Ops: []
I20260709 12:17:03.349212 23758 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.387691 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:03.361295 22396 rpcz_store.cc:276] 0709 12:17:02.195764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.198376 (+  2612us) service_pool.cc:224] Handling call
0709 12:17:03.249825 (+1051449us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:03.360753 (+110928us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10132352}
I20260709 12:17:03.348991 23684 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:03.365141 23770 log.cc:927] Time spent T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 12:17:03.420950 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:03.540495 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 181017us
W20260709 12:17:03.356949 23661 consensus_meta.cc:287] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 12:17:03.282222 23700 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:03.390201 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:03.352988 23756 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.362186 23526 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.541339 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:03.545435 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:03.546085 23745 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:03.261061 22470 rpcz_store.cc:276] 0709 12:17:02.207304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.608526 (+401222us) service_pool.cc:224] Handling call
0709 12:17:02.608890 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:02.609298 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:02.609332 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:02.672663 (+ 63331us) log.cc:844] Serialized 26 byte log entry
0709 12:17:03.183151 (+510488us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:03.188634 (+  5483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.192982 (+  4348us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:03.241957 (+ 48975us) raft_consensus.cc:1685] finished
0709 12:17:03.244900 (+  2943us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:03.249672 (+  4772us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":160,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"thread_start_us":447414,"threads_started":1,"wal-append.queue_time_us":488314}
I20260709 12:17:03.547013 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:03.546100 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:03.571568 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:03.572831 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:03.548027 23777 raft_consensus.cc:3055] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:03.549670 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:03.347231 23694 consensus_queue.cc:1059] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:17:03.362604 23633 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.386962 23697 raft_consensus.cc:3055] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:17:03.524968 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 118998us
I20260709 12:17:03.581624 23684 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.557524 22548 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:03.582934 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:03.482079 23695 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:03.583994 23095 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.1:37927 timed out after 2.085s (SENT) [suppressed 61 similar messages]
I20260709 12:17:03.555790 23661 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:03.587055 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:03.587481 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1185) took 1422 ms. Trace:
I20260709 12:17:03.587837 22402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 969) took 1353 ms. Trace:
I20260709 12:17:03.587814 22477 rpcz_store.cc:276] 0709 12:17:02.165110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.591074 (+425964us) service_pool.cc:224] Handling call
0709 12:17:02.591370 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:02.716058 (+124688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.587247 (+871189us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b54003e2e54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:03.587422 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110308608}
I20260709 12:17:03.561277 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:03.588383 22402 rpcz_store.cc:276] 0709 12:17:02.234198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.235170 (+   972us) service_pool.cc:224] Handling call
0709 12:17:03.586895 (+1351725us) spinlock_profiling.cc:243] Waited 900 us on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:03.587781 (+   886us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068864}
I20260709 12:17:03.589823 22546 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:03.591076 23094 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:03.588196 23526 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:03.573665 23670 consensus_meta.cc:287] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.742s	user 0.009s	sys 0.002s
I20260709 12:17:03.562069 23658 consensus_queue.cc:237] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:03.508654 23717 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:03.574126 22543 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:03.602358 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 874) took 1324 ms. Trace:
I20260709 12:17:03.603053 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:03.567827 23765 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
I20260709 12:17:03.581017 23758 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.581192 23694 raft_consensus.cc:3055] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:03.581439 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:03.594465 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:03.566493 23737 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:03.365307 23688 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:03.598941 23670 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:03.601310 23130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41028 (request call id 209) took 1154 ms. Trace:
I20260709 12:17:03.588552 23691 raft_consensus.cc:2764] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:17:03.603085 22441 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:03.602771 22547 rpcz_store.cc:276] 0709 12:17:02.277795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.280000 (+  2205us) service_pool.cc:224] Handling call
0709 12:17:02.280263 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.273691 (+993428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.602150 (+328459us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b5400065ed4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:03.602304 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2252979584}
I20260709 12:17:03.628582 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:03.629201 22547 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.587877 23661 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:03.619005 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:03.619120 23779 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:03.619732 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:03.632396 22546 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:17:03.632619 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:03.629716 22441 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:03.608953 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:03.588657 23697 raft_consensus.cc:740] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:03.594874 23777 raft_consensus.cc:740] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:03.644191 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:03.568274 23756 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.645514 22543 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:03.626587 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 276722us
I20260709 12:17:03.625362 23130 rpcz_store.cc:276] 0709 12:17:02.446761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.446901 (+   140us) service_pool.cc:224] Handling call
0709 12:17:02.468199 (+ 21298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.225431 (+757232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:03.225469 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:03.225526 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:03.225559 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.601057 (+375498us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b5400650254. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:03.601103 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:03.601247 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1706206336}
I20260709 12:17:03.630065 22477 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:17:03.646893 22366 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:03.647397 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:03.648671 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:03.648892 23708 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:03.649305 23708 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:03.625365 22544 raft_consensus.cc:2410] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:03.649652 23708 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.650614 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:03.603824 22471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 1002) took 1346 ms (client timeout 1768 ms). Trace:
W20260709 12:17:03.648829 23741 consensus_meta.cc:287] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.788s	user 0.009s	sys 0.003s
I20260709 12:17:03.654162 23741 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:03.655454 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:03.656637 23741 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
W20260709 12:17:03.654000 22471 rpcz_store.cc:269] 0709 12:17:02.257085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.330981 (+ 73896us) service_pool.cc:224] Handling call
0709 12:17:03.603614 (+1272633us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b5400211454. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:03.603759 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9302912}
I20260709 12:17:03.658975 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:03.660331 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:03.661247 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:03.645159 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 46845us
I20260709 12:17:03.662103 22477 raft_consensus.cc:2368] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3.
I20260709 12:17:03.663085 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:03.664304 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:03.660897 22471 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.671437 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:03.672384 23778 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.677564 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:03.678483 23758 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.678934 23758 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:03.617614 23694 raft_consensus.cc:740] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:03.666517 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:03.680308 22441 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:03.688112 22471 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:03.689049 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:03.681936 22545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49290 (request call id 40) took 1093 ms. Trace:
I20260709 12:17:03.658977 22547 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:03.690200 22545 rpcz_store.cc:276] 0709 12:17:02.588931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.592885 (+  3954us) service_pool.cc:224] Handling call
0709 12:17:03.681740 (+1088855us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54001b8d54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:03.681879 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360752384}
I20260709 12:17:03.682279 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1200) took 1358 ms. Trace:
I20260709 12:17:03.691728 22476 rpcz_store.cc:276] 0709 12:17:02.324353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.121531 (+797178us) service_pool.cc:224] Handling call
0709 12:17:03.121756 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.203017 (+ 81261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.682062 (+479045us) spinlock_profiling.cc:243] Waited 75.4 ms on lock 0x7b54002017d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:03.682224 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173387520}
I20260709 12:17:03.683087 22442 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:03.605142 23662 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:03.687058 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:03.687569 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.697439 22442 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:03.692912 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:03.635159 23737 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.608012 23717 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:03.725541 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:03.726526 22397 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:03.726701 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:03.727365 22402 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.709946 22441 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:03.683631 22543 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:03.728860 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:03.729959 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:03.730746 22543 raft_consensus.cc:2393] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:03.680191 23745 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:03.732290 23591 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.693858 23758 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.708132 23751 ts_tablet_manager.cc:933] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:03.736531 22442 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:03.679853 23576 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.781901 23576 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.782575 23576 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.696247 23126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34092 (request call id 126) took 1248 ms. Trace:
I20260709 12:17:03.684636 23757 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:03.697628 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:03.723212 23778 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:03.748497 22402 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:03.724696 22544 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:17:03.776921 23776 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:03.735083 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:03.777662 23728 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:03.708365 23661 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.787961 23745 raft_consensus.cc:697] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 3 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:03.724813 23737 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.742048 23577 raft_consensus.cc:2764] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:17:03.724772 23621 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.779132 23753 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.779647 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:03.781239 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:03.696643 23714 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:03.639127 23779 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:03.669559 23708 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:03.708461 23726 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.689348 23741 consensus_queue.cc:1059] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:17:03.810776 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:03.850360 23628 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:03.736400 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:03.739172 23787 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.887912 22542 raft_consensus.cc:2393] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 3: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:03.749475 23673 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:03.748697 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41028 (request call id 194) took 3942 ms. Trace:
I20260709 12:17:03.786128 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:03.739355 23630 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:03.879984 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:03.893678 22396 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:03.819576 23776 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:03.749233 23591 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:03.820094 23694 consensus_queue.cc:260] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:03.740268 23578 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:03.879619 23737 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:03.873845 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 239431us
I20260709 12:17:03.881083 23669 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:17:03.885478 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 171928us
I20260709 12:17:03.893008 23726 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.928354 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:03.792714 23777 consensus_queue.cc:260] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:03.918905 23785 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 12:17:03.893661 23700 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:03.918061 23788 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:03.955255 22400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58054 (request call id 40) took 2408 ms (client timeout 2085 ms). Trace:
I20260709 12:17:03.852452 23778 raft_consensus.cc:697] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:03.956576 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1176) took 1794 ms. Trace:
I20260709 12:17:03.984609 22474 rpcz_store.cc:276] 0709 12:17:02.162387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.162486 (+    99us) service_pool.cc:224] Handling call
0709 12:17:02.162698 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:02.719150 (+556452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.956273 (+1237123us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54002012d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:03.956500 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1213385984}
I20260709 12:17:03.812099 23697 consensus_queue.cc:260] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:03.958454 22441 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:17:03.958945 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 222491us
I20260709 12:17:03.919371 23753 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.919057 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:03.790113 23126 rpcz_store.cc:276] 0709 12:17:02.448121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.451424 (+  3303us) service_pool.cc:224] Handling call
0709 12:17:03.678683 (+1227259us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b58001c5698. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fe9c 00007fb4f5a2fa5b 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:17:03.678893 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.679065 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:03.679097 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:03.679138 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:03.679170 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.686702 (+  7532us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:03.696182 (+  9480us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11211520}
I20260709 12:17:03.886866 23621 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:03.964797 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:03.878589 23728 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:03.970367 22397 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:03.926532 23673 raft_consensus.cc:697] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:03.976145 22516 leader_election.cc:400] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3.
I20260709 12:17:03.952836 23630 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:03.967211 23628 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:03.982656 22400 rpcz_store.cc:269] 0709 12:17:01.517464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.518511 (+  1047us) service_pool.cc:224] Handling call
0709 12:17:03.926046 (+2407535us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400348354. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:03.926136 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2895124864}
W20260709 12:17:04.005901 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.006431 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.007025 22400 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:03.957532 22472 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2.
I20260709 12:17:03.920749 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:03.988420 22442 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:04.010717 22442 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:03.989691 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:03.927742 23695 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:03.974014 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:03.993005 22401 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.973215 23726 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.995136 23754 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:03.960985 23756 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.003440 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:04.035274 23128 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.986223 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.030042 22544 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.037932 22394 raft_consensus.cc:2393] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 2: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:04.038043 23591 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:04.038607 23591 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:04.039047 23591 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.040985 23591 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:03.920684 23787 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:04.042443 23633 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.042907 23633 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.043489 23787 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:04.044088 23787 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:03.986079 23670 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:04.023291 22474 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:04.047706 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 881) took 1744 ms. Trace:
I20260709 12:17:04.048115 22551 rpcz_store.cc:276] 0709 12:17:02.303390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.568428 (+265038us) service_pool.cc:224] Handling call
0709 12:17:02.874595 (+306167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:02.874816 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:02.874844 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:02.874889 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:02.874918 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:02.874975 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:04.047553 (+1172578us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54000663d0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:04.047651 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703287680}
I20260709 12:17:03.987686 23700 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:03.917728 23714 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.026674 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:03.988952 23669 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:03.988559 23788 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:04.012980 22542 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:03.985308 23745 consensus_queue.cc:237] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:04.023432 23624 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.032191 23673 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:03.995289 23125 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
W20260709 12:17:04.068670 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.004890 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:04.036449 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.036791 22548 raft_consensus.cc:2368] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
I20260709 12:17:04.023216 23630 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.037293 23733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2974af5009474d6590a8e35ea1dc6b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:04.062425 22399 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.059866 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:04.049697 23130 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:04.037073 23577 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:04.065887 22401 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:04.068549 22402 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:17:04.070405 22400 raft_consensus.cc:2393] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 2: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:03.995540 23753 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:04.148300 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.013144 23628 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.139827 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:04.126060 23131 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:04.079388 22442 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:04.066383 23751 tablet_copy_client.cc:323] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.2:46187
I20260709 12:17:04.032210 23708 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.042368 23717 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:04.154963 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 75695.1us
I20260709 12:17:04.155155 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:04.161273 23094 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:04.163017 23695 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.163516 23797 consensus_queue.cc:1059] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:04.163854 22544 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:04.162907 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:04.165096 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:03.920526 23651 rpcz_store.cc:276] 0709 12:16:59.812774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.815954 (+  3180us) service_pool.cc:224] Handling call
0709 12:17:00.047389 (+231435us) ts_tablet_manager.cc:934] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
0709 12:17:02.083393 (+2036004us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:17:02.643552 (+560159us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:02.673534 (+ 29982us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:17:02.868804 (+195270us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:17:02.869120 (+   316us) tablet_replica.cc:206] Creating consensus instance
0709 12:17:03.710093 (+840973us) ts_tablet_manager.cc:989] Replica registered.
0709 12:17:03.724839 (+ 14746us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":56258,"tablet-copy.queue_time_us":145246,"thread_start_us":398825,"threads_started":2}
I20260709 12:17:04.146715 23746 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.167994 22441 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:04.125190 23676 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:04.172786 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:04.178996 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:04.179759 22401 raft_consensus.cc:2376] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2. Re-sending same reply.
I20260709 12:17:04.174922 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:04.158663 23624 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.071908 23787 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:04.079581 23754 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:04.070643 23700 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.176240 23797 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.067633 23778 consensus_queue.cc:237] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:04.192607 22475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1189) took 2026 ms (client timeout 1819 ms). Trace:
I20260709 12:17:04.106698 23727 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 12:17:04.169440 23526 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:04.172802 23714 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.210585 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.172448 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.230190 23621 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:04.230716 22400 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2.
I20260709 12:17:04.210076 23787 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:04.231760 22394 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:04.181401 23681 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:04.214139 22475 rpcz_store.cc:269] 0709 12:17:02.166064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.179313 (+ 13249us) service_pool.cc:224] Handling call
0709 12:17:04.192412 (+2013099us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b540037fd54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:04.192528 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1024509824}
I20260709 12:17:04.162009 23776 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.217208 23700 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.217418 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:04.238987 22470 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2.
I20260709 12:17:04.183779 23704 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.218922 23576 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.221192 23128 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:04.230234 22399 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:04.190083 23651 tablet_copy_client.cc:806] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:04.180922 23708 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:17:04.233425 23681 raft_consensus.cc:697] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:04.247522 23129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34092 (request call id 130) took 1378 ms. Trace:
I20260709 12:17:04.240180 23746 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:04.251251 22475 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:04.248453 23779 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.248122 22470 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.247996 23129 rpcz_store.cc:276] 0709 12:17:02.869322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.999040 (+129718us) service_pool.cc:224] Handling call
0709 12:17:03.014518 (+ 15478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:03.204145 (+189627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:03.204175 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:03.208181 (+  4006us) log.cc:844] Serialized 26 byte log entry
0709 12:17:03.276728 (+ 68547us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:03.276792 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:04.247164 (+970372us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54002bb954. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:04.247213 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:04.247258 (+    45us) raft_consensus.cc:1685] finished
0709 12:17:04.247272 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:04.247463 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6636,"raft.queue_time_us":41158,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":4844,"spinlock_wait_cycles":435334528,"thread_start_us":25504,"threads_started":1,"wal-append.queue_time_us":314525}
I20260709 12:17:04.191983 23670 consensus_queue.cc:1059] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:17:04.184252 23676 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.238032 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:04.248034 23576 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:04.263954 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 88046.3us
I20260709 12:17:04.243062 23704 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:04.253742 23756 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:04.270265 23704 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.278092 22544 raft_consensus.cc:2393] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 2: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:04.278957 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:04.279191 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:04.282224 23754 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.236016 23526 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.259795 23728 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.299593 23630 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.253717 23746 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:04.302186 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:04.268786 23651 tablet_copy_client.cc:670] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:04.312489 23706 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:04.439522 23805 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 12:17:04.300755 23808 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:04.302407 23779 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:04.302775 23669 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.310200 23756 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:04.298143 23737 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.313482 23704 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:04.456967 23628 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.454957 23792 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.460134 23753 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.491274 23704 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:04.505475 22366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.012s
W20260709 12:17:04.506223 22366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.000s	sys 0.012s
I20260709 12:17:04.506980 22366 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:04.512094 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 211378us
I20260709 12:17:04.513659 22544 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:04.512846 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 51485.6us
I20260709 12:17:04.460842 23756 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:04.526154 22366 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:04.523056 23526 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:04.538313 22366 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:04.456905 23681 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:04.525241 23630 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.521793 23726 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.544627 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.574709 22401 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2.
I20260709 12:17:04.532400 23676 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:04.449702 23808 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:04.535362 23784 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.539407 23720 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.542397 23526 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:04.582018 23793 log.cc:927] Time spent T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 12:17:04.579861 23745 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:17:04.587651 23788 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:04.534682 23779 raft_consensus.cc:697] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 2 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:04.563460 23717 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.544306 23757 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:04.569495 23695 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:04.591974 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:04.593225 23758 consensus_meta.cc:287] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.802s	user 0.008s	sys 0.003s
I20260709 12:17:04.534507 23633 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:04.563445 23669 consensus_queue.cc:1059] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:17:04.592581 23784 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.596042 23549 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:04.622680 23549 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:04.609294 23695 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.616359 23737 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.616966 23756 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:04.602284 23676 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:04.623821 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.604399 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:04.642356 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:04.644083 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:04.645002 22542 raft_consensus.cc:2393] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:17:04.646404 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.603603 23526 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:04.624305 23784 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.655239 22473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 994) took 2443 ms. Trace:
I20260709 12:17:04.657720 22473 rpcz_store.cc:276] 0709 12:17:02.211944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.783540 (+571596us) service_pool.cc:224] Handling call
0709 12:17:02.783779 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:02.794308 (+ 10529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:02.794341 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:02.794389 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:02.794416 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:04.655004 (+1860588us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5400395654. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:04.655049 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:04.655181 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23685504}
I20260709 12:17:04.607656 23717 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:04.626536 23695 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.610775 23757 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.644387 23746 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:04.642503 23811 log.cc:927] Time spent T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.183s	user 0.001s	sys 0.001s
W20260709 12:17:04.663475 22469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1186) took 2495 ms (client timeout 1751 ms). Trace:
I20260709 12:17:04.628695 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:04.617654 23758 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:04.665861 22469 rpcz_store.cc:269] 0709 12:17:02.165363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.173498 (+  8135us) service_pool.cc:224] Handling call
0709 12:17:04.661052 (+2487554us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b5400309dd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:04.661196 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1570249600}
I20260709 12:17:04.656533 23714 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:04.676316 23778 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.676899 23778 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:04.677250 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:04.661625 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:04.680186 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:04.681154 23749 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.862s	user 0.001s	sys 0.001s
I20260709 12:17:04.682153 23726 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.683228 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1195) took 2434 ms. Trace:
I20260709 12:17:04.695035 22468 rpcz_store.cc:276] 0709 12:17:02.248564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.859615 (+611051us) service_pool.cc:224] Handling call
0709 12:17:02.859967 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.507648 (+647681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:04.682960 (+1175312us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b540016e754. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:04.683163 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083820288}
I20260709 12:17:04.696383 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:04.662832 23526 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:04.687810 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1236) took 1032 ms. Trace:
I20260709 12:17:04.688297 23778 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:04.685328 23714 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.656895 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:04.688766 22475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1205) took 1295 ms. Trace:
I20260709 12:17:04.689829 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1201) took 1297 ms. Trace:
I20260709 12:17:04.698570 22475 rpcz_store.cc:276] 0709 12:17:03.392972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.234417 (+841445us) service_pool.cc:224] Handling call
0709 12:17:04.234819 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:04.251768 (+ 16949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:04.688504 (+436736us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b54002008d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:04.688710 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37143424}
I20260709 12:17:04.650888 23676 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.690685 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.698643 22472 rpcz_store.cc:276] 0709 12:17:03.392255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.029158 (+636903us) service_pool.cc:224] Handling call
0709 12:17:04.029407 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:04.068420 (+ 39013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:04.068448 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:04.068487 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:04.068515 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:04.689600 (+621085us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b540030a2d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:04.689645 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:04.689749 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89295616}
I20260709 12:17:04.697435 22551 rpcz_store.cc:276] 0709 12:17:03.655064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.171670 (+516606us) service_pool.cc:224] Handling call
0709 12:17:04.172006 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:04.172374 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:04.172401 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:04.172863 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:17:04.589786 (+416923us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b180017a820. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f86fc4bc 00007fb4f5a4a48b 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b 00007fb4f86f3d23 00007fb4f86f40d1
0709 12:17:04.589948 (+   162us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:04.589985 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:04.590062 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:04.686405 (+ 96343us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b180017a820. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:17:04.687596 (+  1191us) raft_consensus.cc:1685] finished
0709 12:17:04.687616 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:04.687749 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":771,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":7815,"spinlock_wait_cycles":10749568,"thread_start_us":15951,"threads_started":1,"wal-append.queue_time_us":16321}
I20260709 12:17:04.703544 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:04.704283 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:04.706012 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:04.693698 22542 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.700405 23720 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.709228 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.709851 22399 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:17:04.711030 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.697932 23688 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:04.665617 23779 consensus_queue.cc:237] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:04.707208 23717 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:04.721601 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:04.712045 23808 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:04.707201 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 75741.4us
I20260709 12:17:04.722519 23129 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:17:04.759524 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:04.773907 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.779153 22402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 980) took 1045 ms. Trace:
I20260709 12:17:04.779556 22402 rpcz_store.cc:276] 0709 12:17:03.733935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.810458 (+ 76523us) service_pool.cc:224] Handling call
0709 12:17:04.778873 (+968415us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54002305d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:04.779071 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399390592}
I20260709 12:17:04.781076 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.783641 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.784215 22402 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:04.784838 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.785308 22402 raft_consensus.cc:2393] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:04.789950 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.775702 23667 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.716517 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:04.711030 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:04.776654 23688 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:04.776993 23127 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:17:04.796660 22551 raft_consensus.cc:1240] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:04.793395 23549 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:04.798149 23826 log.cc:927] Time spent T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:17:04.776495 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:04.818579 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:04.798573 23817 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.803748 22550 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:04.819298 22473 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.820036 23757 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:04.808779 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:04.822978 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:04.809056 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:04.807217 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:04.809715 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:04.824043 22469 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:04.810382 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:04.810487 23754 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.811919 23737 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.826422 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:04.826598 23757 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.826994 23757 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:04.827385 23757 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.826619 23737 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.829304 22516 leader_election.cc:400] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3.
I20260709 12:17:04.817019 22542 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:04.829998 23737 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.826448 23754 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:04.832185 23754 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:04.829618 22516 leader_election.cc:403] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:04.808717 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:04.833832 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:04.836072 23761 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3.
I20260709 12:17:04.837198 22516 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:04.808177 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:04.824811 22474 raft_consensus.cc:2393] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 2: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:04.824875 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:04.838471 22402 raft_consensus.cc:2368] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
I20260709 12:17:04.839443 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:04.835884 23717 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:04.835108 23549 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:04.842186 23549 raft_consensus.cc:697] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:04.806208 23688 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.843058 23549 consensus_queue.cc:237] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.844223 23688 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.847492 23717 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.847806 23676 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:04.848054 23717 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:04.848450 23717 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.826279 23714 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.851804 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.821759 23817 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.853529 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:04.854905 22402 raft_consensus.cc:2393] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 3: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:04.854434 23784 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:04.855973 23787 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.850122 22473 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:04.857246 23784 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:04.857498 23828 log.cc:927] Time spent T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:17:04.858126 23817 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.858727 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:04.858065 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:04.859714 22551 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:04.860163 22471 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.859755 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1240) took 1203 ms. Trace:
I20260709 12:17:04.861357 22547 rpcz_store.cc:276] 0709 12:17:03.656095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.692152 (+ 36057us) service_pool.cc:224] Handling call
0709 12:17:04.858479 (+1166327us) spinlock_profiling.cc:243] Waited 6.22 ms on lock 0x7b5800010b98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:04.859691 (+  1212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14316928}
I20260709 12:17:04.867384 22476 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:04.868095 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1009) took 1538 ms. Trace:
I20260709 12:17:04.868398 22476 rpcz_store.cc:276] 0709 12:17:03.330144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.722990 (+392846us) service_pool.cc:224] Handling call
0709 12:17:04.866936 (+1143946us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b5800084c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:17:04.867145 (+   209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:04.867842 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:04.868042 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5005056}
I20260709 12:17:04.875993 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:04.876655 22516 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:04.876601 22545 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:04.877827 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:04.878101 22545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1239) took 1222 ms. Trace:
I20260709 12:17:04.878417 22545 rpcz_store.cc:276] 0709 12:17:03.655835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.691339 (+ 35504us) service_pool.cc:224] Handling call
0709 12:17:04.875849 (+1184510us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b5800010b98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:04.878048 (+  2199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16047488}
I20260709 12:17:04.879767 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:04.880052 22471 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:04.880554 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43060 (request call id 44) took 1278 ms. Trace:
I20260709 12:17:04.880770 22471 rpcz_store.cc:276] 0709 12:17:03.602273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.723614 (+121341us) service_pool.cc:224] Handling call
0709 12:17:04.857901 (+1134287us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b5800084c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:04.880487 (+ 22586us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3901824}
I20260709 12:17:04.881621 23686 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:04.882202 23686 raft_consensus.cc:697] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:04.867993 23661 raft_consensus.cc:3055] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:04.883066 23686 consensus_queue.cc:237] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.883507 23661 raft_consensus.cc:740] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:04.884712 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.885313 22401 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
W20260709 12:17:04.884867 23827 log.cc:927] Time spent T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:17:04.890327 23526 consensus_queue.cc:1059] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:04.891153 23526 raft_consensus.cc:3055] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:04.891453 23526 raft_consensus.cc:740] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:04.891548 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 981) took 1104 ms. Trace:
I20260709 12:17:04.892266 23526 consensus_queue.cc:260] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.891983 22398 rpcz_store.cc:276] 0709 12:17:03.788336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.156776 (+368440us) service_pool.cc:224] Handling call
0709 12:17:04.890818 (+734042us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:17:04.891039 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:04.891206 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:04.891234 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:04.891281 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:04.891311 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:04.891367 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:04.891479 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8294272}
I20260709 12:17:04.893472 23526 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.896214 23717 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.875001 23695 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.897449 22399 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:04.884406 23661 consensus_queue.cc:260] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:04.795410 23667 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:04.921373 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.925683 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:04.929271 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.938045 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:04.944332 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.945977 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:04.947319 23778 raft_consensus.cc:2764] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:17:04.949504 22401 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:04.950699 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:04.950860 23667 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:04.951944 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.952955 22401 raft_consensus.cc:2393] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:04.952889 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:04.971839 22367 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:04.993898 23667 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.921924 23661 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.953662 22476 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:04.969343 23545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.716s	user 0.024s	sys 0.048s
I20260709 12:17:04.997143 22442 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:04.998092 23545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.745s	user 0.024s	sys 0.048s
I20260709 12:17:04.999329 23741 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.953104 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:04.994912 23817 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:05.012542 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.996634 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:05.004161 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:05.005014 22442 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.006450 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:05.014894 22442 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:05.015288 22476 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:05.015681 23737 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:05.017433 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:05.018273 22547 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:05.018620 22441 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:17:05.016036 22442 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.023501 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:05.025604 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:04.953801 23695 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:04.951902 23717 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:05.026330 22545 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:05.028245 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 72784.4us
I20260709 12:17:05.030921 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:04.992841 23757 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.035054 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:05.036092 23720 consensus_queue.cc:1059] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:05.016134 23737 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:05.036695 23757 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:05.037672 23812 consensus_queue.cc:1059] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:05.016302 22396 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.038220 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:05.039039 23126 raft_consensus.cc:2393] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:05.039178 23720 raft_consensus.cc:3055] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:05.039534 23720 raft_consensus.cc:740] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:05.040343 23720 consensus_queue.cc:260] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.042128 23720 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.044027 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:05.016736 23754 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.046428 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:05.046496 23130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41012 (request call id 158) took 1305 ms. Trace:
I20260709 12:17:05.049933 23130 rpcz_store.cc:276] 0709 12:17:03.809661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.822389 (+ 12728us) service_pool.cc:224] Handling call
0709 12:17:05.043875 (+1221486us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400660154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:05.043988 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287161088}
I20260709 12:17:05.051759 22545 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:05.028033 23688 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:05.027331 23733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41028 (request call id 205) took 3124 ms. Trace:
I20260709 12:17:05.074397 23733 rpcz_store.cc:276] 0709 12:17:01.902477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.902648 (+   171us) service_pool.cc:224] Handling call
0709 12:17:02.157460 (+254812us) ts_tablet_manager.cc:934] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
0709 12:17:04.034148 (+1876688us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:17:04.799578 (+765430us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:04.799695 (+   117us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:17:04.916727 (+117032us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:17:04.965741 (+ 49014us) tablet_replica.cc:206] Creating consensus instance
0709 12:17:05.016840 (+ 51099us) ts_tablet_manager.cc:989] Replica registered.
0709 12:17:05.023833 (+  6993us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":91388,"tablet-copy.queue_time_us":209736,"thread_start_us":218638,"threads_started":2}
I20260709 12:17:05.075984 23733 tablet_copy_client.cc:806] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:05.076548 23733 tablet_copy_client.cc:670] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:05.062449 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:05.048099 22516 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:05.046576 23667 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.031749 23808 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:05.067497 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:05.084702 22551 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.071336 23726 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.074378 23688 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.088214 23797 raft_consensus.cc:3055] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:05.088654 23797 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:05.084328 23808 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.090210 23808 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:05.075551 23796 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.928s	user 0.001s	sys 0.002s
I20260709 12:17:05.091988 23741 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.093303 23688 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:05.095039 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:05.095278 23761 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:05.095391 22546 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:05.045295 23737 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.097869 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:05.099014 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:05.099983 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:05.100975 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:05.102289 23758 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:05.107283 22548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 903) took 1717 ms (client timeout 1729 ms). Trace:
W20260709 12:17:05.107713 22548 rpcz_store.cc:269] 0709 12:17:03.389427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.582678 (+193251us) service_pool.cc:224] Handling call
0709 12:17:05.107100 (+1524422us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b540042ac54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:05.107226 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1041711488}
I20260709 12:17:05.086846 23667 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:05.113301 23667 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:05.080456 22401 raft_consensus.cc:2368] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3.
I20260709 12:17:05.081925 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:05.117852 22393 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:05.095800 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43060 (request call id 46) took 1493 ms. Trace:
I20260709 12:17:05.118762 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:05.118717 22477 rpcz_store.cc:276] 0709 12:17:03.602813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.716580 (+113767us) service_pool.cc:224] Handling call
0709 12:17:05.094898 (+1378318us) spinlock_profiling.cc:243] Waited 8.54 ms on lock 0x7b5800084c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:05.095744 (+   846us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19653376}
I20260709 12:17:05.119444 22393 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:05.120294 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:05.121294 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:05.122320 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:05.123514 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:05.124172 22393 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:05.086915 23633 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:05.073041 23817 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:05.118137 22366 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:05.129123 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:05.130070 22393 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.132531 22366 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:05.127424 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.126763 22548 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:05.138477 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:05.138749 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:05.138846 22543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1234) took 1487 ms. Trace:
I20260709 12:17:05.116286 23667 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:05.138119 23757 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.118105 23748 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:05.142931 22399 raft_consensus.cc:2393] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:05.139819 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:05.139349 22543 rpcz_store.cc:276] 0709 12:17:03.651756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.731399 (+ 79643us) service_pool.cc:224] Handling call
0709 12:17:03.731666 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.794376 (+ 62710us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:03.974038 (+179662us) log.cc:844] Serialized 14 byte log entry
0709 12:17:04.023265 (+ 49227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:04.023320 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:04.023362 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:05.138578 (+1115216us) spinlock_profiling.cc:243] Waited 62.5 ms on lock 0x7b54000659d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:05.138630 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:05.138783 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":213825,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":13964,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":143674240,"thread_start_us":137977,"threads_started":2,"wal-append.queue_time_us":216543}
I20260709 12:17:05.135365 23714 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:05.147907 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.156951 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.158447 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:05.161424 22393 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:05.140686 23633 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.161685 23686 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.156131 23748 raft_consensus.cc:697] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:05.163275 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:05.163786 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:05.166435 23748 consensus_queue.cc:237] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.162257 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:05.171595 22544 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:05.095800 23761 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.142817 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:05.089480 23797 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.180441 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.163883 23549 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:05.182727 23778 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:05.183307 23778 raft_consensus.cc:697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:05.184188 23778 consensus_queue.cc:237] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.174149 23714 raft_consensus.cc:697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:05.155670 23820 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:05.162132 23676 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.192169 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:05.194537 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:05.197754 22551 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
W20260709 12:17:05.198870 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.200145 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:05.201326 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:05.201979 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.203658 22401 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:05.204604 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:05.202890 22397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 972) took 1474 ms. Trace:
I20260709 12:17:05.205816 22397 rpcz_store.cc:276] 0709 12:17:03.728451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.728579 (+   128us) service_pool.cc:224] Handling call
0709 12:17:05.202679 (+1474100us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b540005cdd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:05.202826 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553611520}
I20260709 12:17:05.207434 22397 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:17:05.195997 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 180029us
I20260709 12:17:05.186642 22542 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.213656 22401 raft_consensus.cc:1240] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:05.215613 22516 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:05.212337 22442 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.217399 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
W20260709 12:17:05.218134 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.220407 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.232921 23667 raft_consensus.cc:3055] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:05.194031 23820 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:05.199762 23797 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.218202 22442 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:05.237488 22442 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.199652 23549 raft_consensus.cc:697] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:05.239277 22516 leader_election.cc:400] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3.
I20260709 12:17:05.240175 22516 leader_election.cc:403] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:05.212874 23748 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.244215 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:05.217821 23578 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.237946 23766 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:05.250672 23766 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:05.251133 23766 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.254338 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:05.255189 22395 raft_consensus.cc:2368] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3.
I20260709 12:17:05.255631 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 976) took 1524 ms. Trace:
I20260709 12:17:05.255934 22395 rpcz_store.cc:276] 0709 12:17:03.730972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.734417 (+  3445us) service_pool.cc:224] Handling call
0709 12:17:05.254140 (+1519723us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:05.255563 (+  1423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88523520}
I20260709 12:17:05.257035 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:05.234097 23522 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:05.258112 23522 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.258570 23522 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:05.238348 23758 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.262970 23761 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:05.263433 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:05.216696 23676 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.264796 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:05.265542 23549 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:05.266788 23789 log.cc:927] Time spent T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 1.301s	user 0.001s	sys 0.003s
I20260709 12:17:05.268026 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 893) took 1923 ms. Trace:
I20260709 12:17:05.194372 23737 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.268699 23694 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.270236 23737 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:05.270337 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.270728 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:05.268419 22549 rpcz_store.cc:276] 0709 12:17:03.344517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.344954 (+   437us) service_pool.cc:224] Handling call
0709 12:17:03.345532 (+   578us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:03.345940 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:03.345969 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:03.551245 (+205276us) log.cc:844] Serialized 499 byte log entry
0709 12:17:03.852721 (+301476us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:03.878997 (+ 26276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.883875 (+  4878us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:05.266166 (+1382291us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:05.267701 (+  1535us) raft_consensus.cc:1685] finished
0709 12:17:05.267721 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:05.267961 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12900608,"thread_start_us":262899,"threads_started":1,"wal-append.queue_time_us":369453}
I20260709 12:17:05.272092 23758 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.272598 23758 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:05.273068 23757 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.272899 22477 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:05.272903 22516 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:05.275467 23758 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:05.275782 22516 leader_election.cc:400] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3.
I20260709 12:17:05.277549 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.278644 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:05.279101 23779 consensus_queue.cc:1059] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:05.279333 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:05.279882 23817 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:05.279318 22477 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:05.264904 23714 consensus_queue.cc:237] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.285392 22476 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 2: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:05.233481 23667 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:05.279654 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:17:05.291208 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 158762us
W20260709 12:17:05.294996 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 53756.6us
I20260709 12:17:05.305999 22442 leader_election.cc:400] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
I20260709 12:17:05.306377 22442 leader_election.cc:403] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:05.307946 22366 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:05.237589 23820 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:05.352353 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 50068.1us
W20260709 12:17:05.354354 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 335803us
I20260709 12:17:05.359702 22366 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:05.263911 23808 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:05.301584 23798 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.306294 23681 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:05.351222 23758 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:05.399994 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 94158.8us
I20260709 12:17:05.401268 22399 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:05.402827 22442 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.354628 23676 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:17:05.405186 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 49680.5us
I20260709 12:17:05.354529 23842 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:05.397298 23591 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:05.398494 23681 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.403795 23758 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.367354 23633 consensus_queue.cc:1059] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:17:05.406425 23553 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
I20260709 12:17:05.405195 23812 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:05.412303 23842 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:05.413837 23667 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.423370 23681 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:05.427666 23844 log.cc:927] Time spent T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:17:05.451606 22397 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:05.453064 22397 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:05.454890 22542 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:05.455494 23686 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3.
I20260709 12:17:05.456532 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:05.440678 23808 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:05.457864 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:05.458264 23831 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.393s	user 0.006s	sys 0.007s
I20260709 12:17:05.459131 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:05.460778 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:05.461073 22551 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:05.460806 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:05.462618 22547 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:05.462947 22548 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:05.424947 23758 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:05.463071 22441 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:05.483464 23741 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:05.483796 22441 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:05.465656 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:05.440315 23522 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:05.466801 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 113838us
W20260709 12:17:05.468144 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 46670.5us
I20260709 12:17:05.425283 23591 raft_consensus.cc:697] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:05.470037 23797 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:05.443583 23842 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.414916 23839 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.417553 22396 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:05.474928 22402 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2.
I20260709 12:17:05.453259 23766 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.475978 23667 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.476604 22399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "65951063312d4a1e9123f92354101c71"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:17:05.497498 22399 raft_consensus.cc:606] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Received request to transfer leadership to TS 65951063312d4a1e9123f92354101c71
I20260709 12:17:05.479794 22298 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50166 (request call id 205) took 4799 ms. Trace:
I20260709 12:17:05.480239 23798 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.481117 22551 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:05.488576 22441 leader_election.cc:400] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
I20260709 12:17:05.491462 22442 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.429865 23812 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.481601 23651 tablet_copy_client.cc:538] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:05.483893 23741 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.486261 23697 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.499478 22515 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.501384 22399 raft_consensus.cc:614] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:05.492378 23750 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:05.502730 22516 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:05.505105 22442 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.499531 22441 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:05.507314 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:05.515975 22544 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:05.507849 22549 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:05.507244 23630 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:17:05.516690 23522 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:05.517796 23839 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.518837 22441 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:05.519124 23798 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:05.519459 23777 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.519595 23733 tablet_copy_client.cc:538] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:05.506263 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:05.494608 23731 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:17:05.510538 22395 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:05.496268 23695 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.513477 23766 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:05.520341 22442 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.497895 22298 rpcz_store.cc:276] 0709 12:17:00.680178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.680330 (+   152us) service_pool.cc:224] Handling call
0709 12:17:05.479698 (+4799368us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:02.155643 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:02.280133 (+124490us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:02.280171 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:17:02.280190 (+    19us) tablet.cc:662] Decoding operations
0709 12:17:02.280592 (+   402us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:02.280646 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:02.280675 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:17:02.280988 (+   313us) tablet.cc:701] Row locks acquired
0709 12:17:02.281006 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:17:02.281146 (+   140us) write_op.cc:270] Start()
0709 12:17:02.281244 (+    98us) write_op.cc:276] Timestamp: P: 1783599422281100 usec, L: 0
0709 12:17:02.281277 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:17:02.281931 (+   654us) log.cc:844] Serialized 922 byte log entry
0709 12:17:03.206068 (+924137us) op_driver.cc:464] REPLICATION: finished
0709 12:17:03.361823 (+155755us) write_op.cc:301] APPLY: starting
0709 12:17:03.361922 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:03.362029 (+   107us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:03.559435 (+197406us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:03.626101 (+ 66666us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:03.679811 (+ 53710us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:17:03.688580 (+  8769us) write_op.cc:312] APPLY: finished
0709 12:17:03.749108 (+ 60528us) log.cc:844] Serialized 28 byte log entry
0709 12:17:03.793283 (+ 44175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:03.812385 (+ 19102us) write_op.cc:454] Released schema lock
0709 12:17:03.821646 (+  9261us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:04.681025 (+859379us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b200001a878. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8702b91 00007fb4f8724a19 00007fb4f86ef8c3 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169 00007fb4f86f8131 00007fb4f86f742d 0000000000388634
0709 12:17:05.041523 (+360498us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b540038af00. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fc4be161 00007fb4fc59333d 00007fb4fc58c3c2 00007fb4fc58bb53 00007fb4fc58fd61 00007fb4fc58fd19 00007fb4fc58fca9 00007fb4fc58fc71 00007fb4fc58ee9d 0000000000388634 0000000000388479
0709 12:17:05.045873 (+  4350us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:05.047741 (+  1868us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":339121,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":139819,"apply.run_cpu_time_us":25656,"apply.run_wall_time_us":1689635,"num_ops":2,"prepare.queue_time_us":47769,"prepare.run_cpu_time_us":81722,"prepare.run_wall_time_us":399810,"raft.queue_time_us":422169,"raft.run_cpu_time_us":7134,"raft.run_wall_time_us":88329,"replication_time_us":916099,"spinlock_wait_cycles":64675072,"thread_start_us":556836,"threads_started":4,"wal-append.queue_time_us":336767}]]}
I20260709 12:17:05.515295 23750 raft_consensus.cc:697] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:05.504936 22366 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:05.509389 23812 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:05.525305 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:05.528227 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:05.528770 22473 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:05.528597 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:05.527529 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:05.527762 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:05.529646 22476 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.530730 23526 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:05.531111 23526 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.531481 23526 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:05.503873 23808 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.528934 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:05.535683 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:05.536126 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:05.540395 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:05.526486 22515 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.536620 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:05.520797 23741 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:05.523397 23850 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:17:05.545743 23581 raft_consensus.cc:2955] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
W20260709 12:17:05.549875 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.550122 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:05.550529 23787 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:05.533003 23839 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:05.551705 23839 raft_consensus.cc:697] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:05.552603 23839 consensus_queue.cc:237] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.533670 23695 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:05.550529 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:05.558440 23786 raft_consensus.cc:3055] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:05.535781 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:05.537966 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:05.568609 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:05.568715 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:05.569345 22393 raft_consensus.cc:2393] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 3: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:05.569509 22475 raft_consensus.cc:2393] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 2: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:05.536996 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:05.520828 23798 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.537398 22473 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:05.573120 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:05.559820 22397 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:17:05.562696 22487 tablet_copy_service.cc:140] P 25ebf14868c042dca42f54b3e251e1b2: Received BeginTabletCopySession request for tablet b42c69680a57493c942307ff09185b72 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:43060)
I20260709 12:17:05.533350 23676 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:05.540897 23784 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:05.540904 23661 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.575418 22397 pending_rounds.cc:85] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 1
I20260709 12:17:05.576375 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:05.579893 22476 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:05.544096 23797 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:05.580956 22472 raft_consensus.cc:2393] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:05.581501 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.604768 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:05.605510 22475 raft_consensus.cc:2368] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3.
I20260709 12:17:05.584599 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:05.606421 22367 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:05.606761 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:05.606469 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:05.581614 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 55173.4us
I20260709 12:17:05.607707 22475 raft_consensus.cc:2393] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:05.608671 22515 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.605576 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:05.592800 22473 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:05.606462 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:17:05.602025 23853 log.cc:927] Time spent T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:17:05.551795 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:05.611720 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:05.646792 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.647965 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:05.577656 23798 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:05.567651 23786 raft_consensus.cc:740] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:05.571767 23766 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.577488 23676 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.668768 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:05.611848 22397 pending_rounds.cc:107] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:05.709409 22397 raft_consensus.cc:2889] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:05.702808 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 96461.2us
I20260709 12:17:05.710150 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:05.711021 22472 raft_consensus.cc:2393] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 3: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:17:05.702996 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.602594 22487 tablet_copy_service.cc:161] P 25ebf14868c042dca42f54b3e251e1b2: Beginning new tablet copy session on tablet b42c69680a57493c942307ff09185b72 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:43060: session id = 65951063312d4a1e9123f92354101c71-b42c69680a57493c942307ff09185b72
I20260709 12:17:05.610987 23748 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.539029 23820 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:05.688532 22441 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:05.696758 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:05.602768 23757 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:05.710968 22367 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:05.682072 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:05.751595 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 63104.1us
I20260709 12:17:05.695127 23686 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:05.695502 23778 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.753693 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:05.754137 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:05.757290 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 46419.6us
I20260709 12:17:05.688822 23840 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.571617 23750 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.689128 23797 raft_consensus.cc:697] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:05.618975 23850 consensus_queue.cc:1059] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.135s
I20260709 12:17:05.696439 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:05.704509 23628 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.721545 23553 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.757424 23808 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.611418 23754 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:05.698647 23740 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.712693 23676 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.797106 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:05.832875 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 185369us
I20260709 12:17:05.848593 22397 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:05.603863 23731 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:05.644919 23095 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:05.834964 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 274530us
I20260709 12:17:05.821714 22367 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:05.580312 23591 consensus_queue.cc:237] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:05.792063 23686 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:05.619160 23851 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.215s
I20260709 12:17:05.854025 22472 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:05.826218 22468 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:05.757555 23757 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:05.834604 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:05.837451 23688 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.865021 22367 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:05.760963 23667 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.841539 23553 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.869027 23633 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:05.869385 23757 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.720402 23766 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.820080 23681 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:05.895874 22367 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:05.861384 23686 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.862052 23658 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:05.855381 23754 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.877913 22470 raft_consensus.cc:2393] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 3: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:05.912367 22367 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:05.924029 22367 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:05.906230 23694 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.931018 22476 raft_consensus.cc:2393] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 3: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:17:05.940560 23856 log.cc:927] Time spent T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:17:05.940995 22470 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:17:05.944319 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.920979 23630 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.947319 23818 consensus_queue.cc:1059] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:05.929436 23670 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.950418 23670 raft_consensus.cc:3055] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:05.950803 23670 raft_consensus.cc:740] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:05.951651 23670 consensus_queue.cc:260] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.952215 23694 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.955029 23766 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:05.955614 23716 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.956199 23716 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.956782 23681 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:05.957485 22400 raft_consensus.cc:2410] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:17:05.959403 23852 log.cc:927] Time spent T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:17:05.960376 23854 log.cc:927] Time spent T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:17:05.926494 23667 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.966492 23864 raft_consensus.cc:3055] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:05.966965 23864 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:05.967909 23864 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:05.969012 23864 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.894479 23688 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:05.965485 23695 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:05.864229 23731 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:05.914031 23797 consensus_queue.cc:237] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:05.983471 23857 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:17:06.000162 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 148320us
I20260709 12:17:06.046430 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:06.028412 23697 consensus_meta.cc:287] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.500s	user 0.003s	sys 0.007s
I20260709 12:17:06.060779 22469 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:06.031111 23820 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:06.041635 23857 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:06.068826 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 143333us
I20260709 12:17:06.070345 22367 leader_election.cc:400] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3.
I20260709 12:17:06.070655 22367 leader_election.cc:403] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:06.057363 23581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43058 (request call id 6) took 5276 ms. Trace:
I20260709 12:17:06.084106 22470 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:06.109721 22367 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:06.043476 23784 raft_consensus.cc:697] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 3 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:06.064499 23869 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.064872 23857 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.120775 22367 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:06.064565 22398 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
W20260709 12:17:06.117266 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 536923us
I20260709 12:17:06.094000 23658 raft_consensus.cc:697] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 3 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:17:06.117835 23758 consensus_meta.cc:287] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.000s
W20260709 12:17:06.118055 23526 consensus_meta.cc:287] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.584s	user 0.003s	sys 0.007s
I20260709 12:17:06.128706 22367 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:06.109309 23777 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3.
I20260709 12:17:06.119081 23553 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:06.133678 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:06.078884 23757 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:06.134536 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.125026 23697 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.096052 23863 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:17:06.125231 23812 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.127084 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:06.141027 22367 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:06.130985 23695 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.133150 23669 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:06.162320 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.129590 23808 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:17:06.140522 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:06.141351 23777 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:06.142517 23754 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:06.149736 22367 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
W20260709 12:17:06.228307 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 78663.4us
I20260709 12:17:06.228909 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:06.135742 23526 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:06.132778 23758 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:06.095973 23581 rpcz_store.cc:276] 0709 12:17:00.770415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.773093 (+  2678us) service_pool.cc:224] Handling call
0709 12:17:00.793385 (+ 20292us) log.cc:844] Serialized 499 byte log entry
0709 12:17:06.047075 (+5253690us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17300,"raft.queue_time_us":19244,"raft.run_cpu_time_us":2811,"raft.run_wall_time_us":75132}
I20260709 12:17:06.148725 23697 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.246649 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:06.230700 23731 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:06.247864 22470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:17:06.248507 22470 raft_consensus.cc:606] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:06.248262 23630 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:06.249125 23630 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:06.225407 23688 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:06.250590 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.251199 23630 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:06.251425 23733 tablet_bootstrap.cc:492] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:17:06.251587 23095 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:06.252840 23095 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:06.253616 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.255384 23686 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.257249 22469 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:06.232611 23591 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.241663 23676 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:06.233572 23658 consensus_queue.cc:237] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:06.242429 23872 log.cc:927] Time spent T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:17:06.226915 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.143896 23812 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.265951 23874 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:06.265630 23786 consensus_queue.cc:260] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:06.237028 23875 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 12:17:06.232791 23861 log.cc:927] Time spent T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:17:06.225690 23766 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:06.231492 23553 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.231619 23669 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.274739 22543 raft_consensus.cc:2393] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:06.283520 23786 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.277540 23876 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:06.255473 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 931) took 1313 ms. Trace:
I20260709 12:17:06.290930 23757 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:06.290973 22398 rpcz_store.cc:276] 0709 12:17:04.942213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.944022 (+  1809us) service_pool.cc:224] Handling call
0709 12:17:06.255300 (+1311278us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54000b59d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:06.255412 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2570390784}
I20260709 12:17:06.270694 23863 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:06.293149 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:06.295899 23812 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:06.275236 23798 consensus_meta.cc:287] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.004s
I20260709 12:17:06.282541 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:06.271333 23864 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.257740 23686 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:06.286273 23553 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.287792 23651 tablet_bootstrap.cc:492] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:17:06.284929 23766 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.275918 23688 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.208194 23784 consensus_queue.cc:237] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:06.278503 23874 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:06.306595 23670 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.293612 23863 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.293239 23758 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:06.302165 23877 log.cc:927] Time spent T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:17:06.317797 23857 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:06.312458 23798 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.320022 23857 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:06.307418 23553 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:06.302007 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:06.310341 23766 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:06.325028 23874 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:06.310050 23688 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.299331 23757 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:06.327252 23757 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.327766 23863 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:06.328919 23633 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:06.329694 23842 consensus_meta.cc:287] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.832s	user 0.006s	sys 0.006s
W20260709 12:17:06.314975 23741 consensus_meta.cc:287] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.734s	user 0.001s	sys 0.009s
I20260709 12:17:06.330123 23842 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.330396 23741 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.331316 23716 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:06.331941 23842 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:06.330127 23688 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:06.325017 23857 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.340963 23757 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:06.335966 23741 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:06.350237 23867 log.cc:927] Time spent T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.237s	user 0.000s	sys 0.003s
I20260709 12:17:06.351414 23778 raft_consensus.cc:3055] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:06.362002 23778 raft_consensus.cc:740] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:06.361286 23676 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:06.352815 23878 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 12:17:06.354492 23879 log.cc:927] Time spent T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.112s	user 0.002s	sys 0.000s
I20260709 12:17:06.362823 23778 consensus_queue.cc:260] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.364274 23778 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.360067 23864 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:06.333729 23798 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:06.399015 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:06.401691 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:06.403224 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:06.404837 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:06.296837 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:06.407012 22402 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:06.408733 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:06.410395 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:06.412201 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:06.413228 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:06.303174 22470 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 2: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:06.418481 22475 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:06.418498 22477 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:06.417676 22470 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:06.422518 22470 raft_consensus.cc:1240] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:06.424823 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 941) took 1479 ms. Trace:
I20260709 12:17:06.425464 22395 rpcz_store.cc:276] 0709 12:17:04.945154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.281349 (+336195us) service_pool.cc:224] Handling call
0709 12:17:05.281700 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:05.538495 (+256795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.424196 (+885701us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54002314d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:06.424616 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525674240}
I20260709 12:17:06.426913 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 908) took 1732 ms. Trace:
I20260709 12:17:06.427495 22394 rpcz_store.cc:276] 0709 12:17:04.694546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.697076 (+  2530us) service_pool.cc:224] Handling call
0709 12:17:04.713741 (+ 16665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:05.484484 (+770743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:05.484522 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:05.485514 (+   992us) log.cc:844] Serialized 499 byte log entry
0709 12:17:05.680752 (+195238us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:05.680826 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.426071 (+745245us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b54000389d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:06.426173 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:06.426251 (+    78us) raft_consensus.cc:1685] finished
0709 12:17:06.426264 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.426729 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1769581312,"thread_start_us":119938,"threads_started":1,"wal-append.queue_time_us":305689}
I20260709 12:17:06.431416 23578 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:06.431782 22394 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:06.432855 22398 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:06.432401 23578 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.433826 22394 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:06.435478 23566 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.436414 23566 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.442021 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:06.443118 23128 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:06.443661 23566 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:06.444813 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:06.413633 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:06.456735 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:06.463122 23578 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:06.462850 23784 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:06.466499 23784 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:06.487285 22393 raft_consensus.cc:2393] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 3: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:06.489313 23865 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:06.489933 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 942) took 1544 ms. Trace:
I20260709 12:17:06.490424 22401 rpcz_store.cc:276] 0709 12:17:04.945424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.463485 (+518061us) service_pool.cc:224] Handling call
0709 12:17:05.463704 (+   219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:05.508691 (+ 44987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:05.508747 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:05.508788 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:05.508817 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.489335 (+980518us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b54002d8f54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:06.489433 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.489717 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103058176}
I20260709 12:17:06.486143 23862 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:06.482798 22473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "65951063312d4a1e9123f92354101c71"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:17:06.494622 22473 raft_consensus.cc:606] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Received request to transfer leadership to TS 65951063312d4a1e9123f92354101c71
I20260709 12:17:06.495224 22473 raft_consensus.cc:614] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:06.494640 23862 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.486760 23818 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:06.497983 23818 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.499368 23862 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:06.499747 23866 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:06.500134 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:06.500524 23866 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.500990 23818 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:06.501893 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:06.490339 23865 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:06.505406 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:06.505934 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.507817 23784 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:06.505488 23865 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:06.523952 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:06.524843 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:06.525679 23862 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.526051 22402 raft_consensus.cc:2410] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:06.526479 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:06.497977 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:06.532605 22400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 909) took 1834 ms (client timeout 2100 ms). Trace:
I20260709 12:17:06.533216 22399 raft_consensus.cc:1275] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 12:17:06.533171 22400 rpcz_store.cc:269] 0709 12:17:04.694906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.696077 (+  1171us) service_pool.cc:224] Handling call
0709 12:17:06.528866 (+1832789us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540005d2d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:06.529107 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2898287360}
I20260709 12:17:06.533987 22399 pending_rounds.cc:85] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 1
I20260709 12:17:06.534340 22399 pending_rounds.cc:107] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:06.534659 22399 raft_consensus.cc:2889] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:06.505576 23526 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:06.529666 22396 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:06.542682 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 75202.2us
I20260709 12:17:06.547022 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:06.549868 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:06.551730 22394 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:06.552611 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1228) took 1008 ms. Trace:
I20260709 12:17:06.553138 22474 rpcz_store.cc:276] 0709 12:17:05.546787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.560578 (+ 13791us) service_pool.cc:224] Handling call
0709 12:17:06.497618 (+937040us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b5800084c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:06.552515 (+ 54897us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5938048}
I20260709 12:17:06.556219 22549 raft_consensus.cc:1240] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:06.559163 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:06.513374 23864 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:06.550450 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 72436.9us
I20260709 12:17:06.562855 23864 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:06.570262 23126 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:06.573377 23676 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.574272 23676 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.576563 22397 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:06.568536 22299 catalog_manager.cc:5697] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 1 to 2, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.589064 23676 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:06.593003 23757 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:06.594425 22487 tablet_copy_source_session.cc:215] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:06.595940 22487 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:43060 (request call id 50) took 1037 ms. Trace:
I20260709 12:17:06.596325 22487 rpcz_store.cc:276] 0709 12:17:05.558231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.562423 (+  4192us) service_pool.cc:224] Handling call
0709 12:17:06.516830 (+954407us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b5400211954. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b5e3f7 00007fb4fdaf4036 00007fb4fdafda3e 00007fb4f53c127b 00007fb4fdafd9ba 00007fb4fdaf8acc 00007fb4fdaf3c7b 00007fb4fdae88d1 00007fb4fcb9c4b4 00007fb4fcb9c442
0709 12:17:06.595830 (+ 79000us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820200704}
I20260709 12:17:06.598326 22549 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:06.598843 22515 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.010s	sys 0.019s
W20260709 12:17:06.599253 22515 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.010s	sys 0.019s
W20260709 12:17:06.599622 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 952154us
I20260709 12:17:06.600739 22515 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:06.604461 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4e53d64761746008e02335e67f74c08"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "65951063312d4a1e9123f92354101c71"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:17:06.599262 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:06.605177 22475 raft_consensus.cc:606] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Received request to transfer leadership to TS 65951063312d4a1e9123f92354101c71
I20260709 12:17:06.607278 22475 raft_consensus.cc:614] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:06.607429 23862 consensus_queue.cc:1059] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:06.607296 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:06.608505 23866 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:06.599638 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:06.609141 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 78614.8us
I20260709 12:17:06.609352 23818 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:06.609844 23818 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:06.610256 23818 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.610181 22394 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:06.614311 23797 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:06.615365 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:06.614619 23864 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:06.620188 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.620908 23797 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.620049 23786 consensus_queue.cc:1059] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:06.622138 23797 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.623229 23803 raft_consensus.cc:3055] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:06.623711 23803 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:06.625309 23797 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:06.626591 22366 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:06.627521 23797 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.628809 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:17:06.629530 22475 raft_consensus.cc:606] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:06.629988 22475 raft_consensus.cc:614] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:06.631333 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:17:06.631906 23522 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.625069 23803 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.645992 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:06.647580 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:06.651818 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.656137 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:06.647444 23864 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:17:06.611590 22299 catalog_manager.cc:5697] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 1 to 2, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.664481 22401 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:06.670970 22475 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.672049 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:06.672958 22546 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.673686 22549 raft_consensus.cc:2368] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 2. Current term is 3.
I20260709 12:17:06.675534 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:06.677104 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:06.677525 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:06.678406 23803 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.678857 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:06.679272 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:06.682646 22549 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:06.682902 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:06.698899 22542 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:06.726476 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:06.726670 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:06.727388 22551 raft_consensus.cc:2393] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:06.727463 22550 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:06.727900 22549 raft_consensus.cc:1240] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:17:06.727264 22547 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:06.732565 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:06.732781 22542 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:06.735879 23866 raft_consensus.cc:3055] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:06.736377 23866 raft_consensus.cc:740] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:06.738603 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:17:06.739495 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.740975 23866 consensus_queue.cc:260] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.741931 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:06.742410 23866 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.730453 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:06.745983 22475 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
W20260709 12:17:06.725258 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 51102us
I20260709 12:17:06.748577 22516 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:06.749163 22545 raft_consensus.cc:1240] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:06.742648 22548 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.714327 22299 catalog_manager.cc:5697] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 1 to 2, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.733475 22394 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:06.754444 23818 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:06.754493 23754 consensus_queue.cc:1059] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:17:06.766916 23754 consensus_queue.cc:1243] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer b8621fa34be04d3fa2d68a300f858cd1 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:06.767373 22393 raft_consensus.cc:2368] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 2. Current term is 3.
I20260709 12:17:06.759903 22299 catalog_manager.cc:5697] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 1 to 2, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.749390 22367 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:06.729667 22549 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:06.766157 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:06.767994 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:06.770649 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:06.765568 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:06.770049 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 57719.7us
I20260709 12:17:06.773699 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:06.770300 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:06.768561 22299 catalog_manager.cc:5697] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 1 to 2, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.770323 23777 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:06.790876 23777 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:06.791316 23777 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.795115 22545 raft_consensus.cc:2368] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 2. Current term is 3.
I20260709 12:17:06.780180 23862 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:06.805305 23553 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:06.806095 23741 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:06.807143 23779 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:06.808871 23857 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:06.812871 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:06.766978 23818 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:06.814342 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 93843.7us
I20260709 12:17:06.815132 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:06.767510 23754 raft_consensus.cc:3055] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:06.816026 23754 raft_consensus.cc:740] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:06.817097 23754 consensus_queue.cc:260] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.818504 23754 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.818955 23777 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:06.820277 22398 raft_consensus.cc:1240] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 12:17:06.821965 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 59211us
I20260709 12:17:06.822856 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:06.823509 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.823740 22542 raft_consensus.cc:2393] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 2: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:06.768558 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:06.825492 23777 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:06.833853 22548 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:06.839059 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:06.840101 22398 raft_consensus.cc:2393] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:06.841198 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:06.842160 22472 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:06.847085 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:06.836755 23797 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.853551 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:06.842028 23526 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.855787 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:06.876200 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 53473.3us
I20260709 12:17:06.862074 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:06.881749 22397 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:17:06.882222 22397 pending_rounds.cc:85] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 1
I20260709 12:17:06.882575 22397 pending_rounds.cc:107] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:06.882802 22397 raft_consensus.cc:2889] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:06.884491 22347 auto_rebalancer.cc:629] Failed to schedule move for tablet 2d5abbd8a2264ab6ac3b4face1caa842: Illegal state: Replica b8621fa34be04d3fa2d68a300f858cd1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:17:06.883875 22366 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:06.880728 23126 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.859774 23553 consensus_queue.cc:1059] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:17:06.917742 23733 tablet_bootstrap.cc:492] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:17:06.898376 23757 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:17:06.913007 23786 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.908049 23777 consensus_queue.cc:1059] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260709 12:17:06.923740 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 45828.4us
W20260709 12:17:06.938055 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.940398 23864 consensus_queue.cc:1059] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:06.925844 23578 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:17:06.957254 23797 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:06.958081 22442 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:06.958397 23094 leader_election.cc:400] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 2. Current term is 3.
I20260709 12:17:06.959103 23767 raft_consensus.cc:3055] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:17:06.959283 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 97669.1us
I20260709 12:17:06.959538 23767 raft_consensus.cc:740] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:06.960510 23767 consensus_queue.cc:260] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:06.941574 23865 raft_consensus.cc:3055] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:06.965946 22441 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:06.922916 23803 consensus_queue.cc:1059] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:17:06.965431 23767 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.966887 23865 raft_consensus.cc:740] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:06.976147 23553 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:06.966229 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:06.982147 23553 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:06.984195 23553 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.970633 23864 consensus_queue.cc:1059] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:17:06.974176 23857 consensus_queue.cc:1059] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:17:06.999125 23095 leader_election.cc:400] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 2. Current term is 3.
I20260709 12:17:06.999521 23798 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.994166 23733 tablet_bootstrap.cc:492] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
W20260709 12:17:07.001825 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 111468us
I20260709 12:17:06.982358 23818 consensus_queue.cc:1059] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:17:07.011713 22441 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:07.015970 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:06.999536 23095 leader_election.cc:403] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:06.997990 23526 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:07.023159 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:07.036216 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:07.000478 23803 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:17:07.041040 22476 raft_consensus.cc:2410] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:07.043920 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:07.042273 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:07.024065 23741 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.070595 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:07.076062 23751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42c69680a57493c942307ff09185b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:07.049333 23786 raft_consensus.cc:3055] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:07.083757 23786 raft_consensus.cc:740] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:17:07.084563 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 68731.4us
I20260709 12:17:07.047749 23862 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:07.087327 22469 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:07.090632 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:07.091300 22477 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.081386 23797 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:07.092519 22473 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:07.093938 23126 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:07.095870 23778 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.048532 23526 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.077317 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:07.098446 23578 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:07.113020 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 128668us
I20260709 12:17:07.089807 23733 ts_tablet_manager.cc:1403] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.839s	user 0.027s	sys 0.017s
I20260709 12:17:07.097941 23797 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:07.100700 23864 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 2. Current term is 3.
I20260709 12:17:07.089062 23741 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:17:07.107725 23757 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.113220 23566 raft_consensus.cc:3055] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:07.135175 22548 raft_consensus.cc:1275] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:07.131417 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:07.145095 22545 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:07.145097 22551 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:07.084627 23865 consensus_queue.cc:260] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:07.109022 23862 raft_consensus.cc:697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:07.132658 23784 raft_consensus.cc:3055] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:07.130293 22366 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:07.156873 22551 raft_consensus.cc:1240] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:07.134166 23578 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.161924 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:07.163450 22547 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:07.098892 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:07.170636 22477 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:07.146795 23566 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:17:07.169672 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.178632 23902 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.179986 22471 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:17:07.181490 23779 raft_consensus.cc:3055] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:07.181967 23779 raft_consensus.cc:740] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:07.182425 22473 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:17:07.183141 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 49078.7us
I20260709 12:17:07.154371 23784 raft_consensus.cc:740] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:07.139439 23778 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.194851 23915 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:07.196022 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 64666us
I20260709 12:17:07.197840 22477 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:07.198081 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:07.147006 23757 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:07.205338 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 91543.3us
I20260709 12:17:07.207146 22366 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:07.185200 23865 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.207823 22442 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:07.211755 23857 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.212174 23857 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.212400 23757 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:07.213158 22551 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:07.213980 23915 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.214859 22550 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:07.216204 23915 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:07.216542 22366 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:07.216795 23915 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.217720 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:07.219787 22366 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:07.222623 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 66461.3us
I20260709 12:17:07.222679 22474 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:07.225433 22367 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:07.166261 23786 consensus_queue.cc:260] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:07.182765 23797 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.212486 23857 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.225553 23913 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.212491 23578 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:07.243161 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:07.243399 23904 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.243144 23553 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.244300 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:07.244868 23778 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:07.245291 23906 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.224686 23757 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:07.244763 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:07.232327 23754 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:07.245200 23905 log.cc:927] Time spent T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:17:07.273542 22475 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:07.182457 23862 consensus_queue.cc:237] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.174432 22398 raft_consensus.cc:2955] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:17:07.255481 22393 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:07.237025 23915 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.252264 23798 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:17:07.226032 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:07.226533 23818 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.260221 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:07.246032 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:07.261945 22548 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:07.261978 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:07.263401 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:07.266325 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:07.237836 22468 raft_consensus.cc:1240] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:17:07.250296 23913 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.274956 23094 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:07.283401 22400 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:07.266562 23906 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.292824 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:07.270895 23754 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.279608 23797 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.282305 23915 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.294440 22551 raft_consensus.cc:2410] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:07.260727 23903 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.286521 22397 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:07.291534 23578 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.233110 23566 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.299901 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:07.290297 23526 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:07.266289 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 175999us
I20260709 12:17:07.308768 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:07.294200 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:07.286044 23818 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:07.290510 23676 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.297518 23906 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.299867 23754 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.292825 23913 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.317353 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:07.318481 22476 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:07.293836 23757 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.317422 23094 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:07.307334 23915 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.327677 23803 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:07.320099 23818 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.320856 23578 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.330488 23566 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:07.315478 23866 consensus_meta.cc:287] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.568s	user 0.012s	sys 0.000s
I20260709 12:17:07.310217 23778 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.313794 23522 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:07.332719 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 106134us
W20260709 12:17:07.327975 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 89573.5us
I20260709 12:17:07.338822 22477 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:07.321026 23748 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.339882 23676 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.348520 23918 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:17:07.349661 23778 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.350122 23578 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:07.350689 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:07.350857 23751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41012 (request call id 155) took 5033 ms. Trace:
W20260709 12:17:07.368003 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.289628 23904 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.331465 23553 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:07.369343 22546 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:07.364109 22475 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:07.321218 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:07.371078 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:07.365006 22367 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:07.374528 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 63486.3us
I20260709 12:17:07.377092 22402 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:07.344406 22470 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:07.381632 23094 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:07.381857 22476 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:07.391567 23676 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:07.376773 23522 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.398653 23733 raft_consensus.cc:359] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 2 LEARNER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:17:07.402581 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 96419.4us
I20260709 12:17:07.403761 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:07.354646 23864 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:07.399937 23733 raft_consensus.cc:740] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
W20260709 12:17:07.432381 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.398542 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:07.436170 22516 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:07.434226 23526 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.410516 22543 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:07.439224 23094 leader_election.cc:400] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 2. Current term is 3.
I20260709 12:17:07.446213 22550 raft_consensus.cc:1240] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:17:07.440678 22515 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:07.452736 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 105345us
I20260709 12:17:07.410595 23553 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:07.454707 22367 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:07.405360 23912 consensus_queue.cc:1059] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.171s
I20260709 12:17:07.453478 23851 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.467093 23908 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:07.480209 23741 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:17:07.506050 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 69967us
I20260709 12:17:07.494937 23748 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:17:07.516404 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 79855.6us
I20260709 12:17:07.517344 22515 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:07.490198 23904 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:07.489931 23553 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.518326 23526 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:07.368108 23751 rpcz_store.cc:276] 0709 12:17:02.317884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.319040 (+  1156us) service_pool.cc:224] Handling call
0709 12:17:03.790019 (+1470979us) ts_tablet_manager.cc:934] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
0709 12:17:07.074515 (+3284496us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:17:07.215359 (+140844us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:07.215469 (+   110us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:17:07.270717 (+ 55248us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:17:07.314271 (+ 43554us) tablet_replica.cc:206] Creating consensus instance
0709 12:17:07.350631 (+ 36360us) ts_tablet_manager.cc:989] Replica registered.
0709 12:17:07.350752 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":67020,"tablet-copy.queue_time_us":323068,"thread_start_us":348968,"threads_started":2}
I20260709 12:17:07.534184 23916 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:07.534303 23904 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:07.535151 23904 raft_consensus.cc:697] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:07.536494 23904 consensus_queue.cc:237] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:07.537535 23553 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:07.538416 23911 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:07.539132 23911 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.540889 23866 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.542021 23748 raft_consensus.cc:697] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:07.543308 23748 consensus_queue.cc:237] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:07.545100 22544 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
W20260709 12:17:07.541620 23767 consensus_meta.cc:287] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.000s
I20260709 12:17:07.547144 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:07.549505 23931 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:17:07.550418 23921 log.cc:927] Time spent T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:17:07.552917 23931 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:07.555836 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:07.556851 23866 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.557233 23866 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.557547 23866 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.503986 23864 consensus_queue.cc:1059] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:17:07.558938 23922 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.541414 23911 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:07.521719 23757 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:07.548768 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:07.505841 23741 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.500451 23733 consensus_queue.cc:260] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:17:07.574743 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 57512.2us
I20260709 12:17:07.506129 23851 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:07.579622 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:07.605878 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 386151us
W20260709 12:17:07.608109 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 331336us
I20260709 12:17:07.585783 23751 tablet_copy_client.cc:806] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
W20260709 12:17:07.576829 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 165633us
I20260709 12:17:07.585011 22395 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:07.620188 22515 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:07.623502 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:07.628083 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:07.619649 23751 tablet_copy_client.cc:670] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:07.635093 23930 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:17:07.637660 23909 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:07.639165 23651 tablet_bootstrap.cc:492] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:07.640194 23651 tablet_bootstrap.cc:492] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:17:07.641160 23651 ts_tablet_manager.cc:1403] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 1.354s	user 0.055s	sys 0.046s
I20260709 12:17:07.624814 23911 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:07.643831 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:07.625602 22398 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:07.662403 22366 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:07.664752 23862 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:07.627758 23913 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:07.671938 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 43924.9us
I20260709 12:17:07.649808 23930 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.676468 23920 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:07.677080 23920 raft_consensus.cc:697] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:07.678002 23933 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:17:07.679301 23913 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:07.680158 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:07.680852 22398 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:07.681830 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:07.671294 23748 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.682404 22398 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:07.683413 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:07.684073 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:07.684840 23126 raft_consensus.cc:2393] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:07.685839 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:07.686652 23128 raft_consensus.cc:2410] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:07.687937 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:07.688705 23124 raft_consensus.cc:1217] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 2 LEARNER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:17:07.688509 23866 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.689433 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:07.690073 22546 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:07.690537 22545 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:07.691035 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:07.691761 22551 raft_consensus.cc:2393] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:07.655951 23911 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:07.695091 23911 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:07.696130 23929 log.cc:927] Time spent T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:17:07.696743 23754 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.697839 22469 raft_consensus.cc:1240] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:07.698313 23927 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:17:07.698809 23924 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 12:17:07.700217 23917 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:17:07.702118 23733 ts_tablet_manager.cc:1434] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.563s	user 0.007s	sys 0.010s
W20260709 12:17:07.702455 23733 ts_tablet_manager.cc:1467] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: Tablet startup took 573ms
I20260709 12:17:07.703488 23865 raft_consensus.cc:3055] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:07.703907 23865 raft_consensus.cc:740] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:07.704396 23920 consensus_queue.cc:237] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.704854 23865 consensus_queue.cc:260] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:07.708051 23851 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:07.669723 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:07.664253 23906 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.674083 23930 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.721171 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:07.738371 23779 consensus_queue.cc:260] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:07.739856 22394 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 2: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:07.742928 22393 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:07.699033 23778 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:07.746910 22442 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:07.682216 22396 raft_consensus.cc:2368] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
I20260709 12:17:07.758195 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:07.761226 22442 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:07.761441 22473 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
W20260709 12:17:07.760344 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 87570.8us
I20260709 12:17:07.764326 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:07.765435 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:07.768576 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:07.769584 22516 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:07.769776 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:07.770053 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:07.770533 23748 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.771042 23748 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.771481 22549 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:07.771705 23757 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.772217 23757 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.772634 23757 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.772476 23948 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:07.774411 22475 raft_consensus.cc:2393] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:07.771827 22393 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:07.770488 22542 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:07.776589 22400 raft_consensus.cc:1240] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:07.757097 23930 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:07.779608 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 159708us
I20260709 12:17:07.773590 23754 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:07.781872 23779 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.784665 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:07.785910 23934 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:07.786360 23857 consensus_meta.cc:287] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.535s	user 0.001s	sys 0.010s
I20260709 12:17:07.786918 23857 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:07.787382 23741 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:07.789425 23857 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:07.789934 23910 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:07.794983 23910 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:07.768749 23915 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.795428 23130 raft_consensus.cc:1240] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:17:07.796401 22366 consensus_peers.cc:597] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:07.795403 23910 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:07.797037 22366 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:07.797910 23941 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:07.798573 23945 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:07.798425 23941 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.758813 23864 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.799625 23864 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:07.790309 23566 consensus_queue.cc:1059] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:07.786415 23934 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.806630 23934 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.806761 23566 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:07.807777 23909 raft_consensus.cc:3055] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:07.808162 23909 raft_consensus.cc:740] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:07.771412 23748 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.791983 23866 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:07.793943 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:07.816131 22395 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:07.817025 22442 leader_election.cc:400] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
I20260709 12:17:07.817119 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:07.817938 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:07.818151 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:07.818717 22551 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:07.812697 23797 consensus_meta.cc:287] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.003s
I20260709 12:17:07.810544 23784 consensus_queue.cc:260] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:07.822736 23784 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.809026 23909 consensus_queue.cc:260] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:07.823740 23786 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:07.793960 23865 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.803609 22399 raft_consensus.cc:2368] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4.
I20260709 12:17:07.813910 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:07.815464 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:07.828456 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:07.817381 22442 leader_election.cc:403] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:07.806468 23948 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:17:07.825899 22402 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.760525 23522 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:07.804451 22515 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:07.813831 23851 consensus_queue.cc:1059] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:17:07.824740 23909 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.801647 23864 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:07.834357 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:07.837473 23778 consensus_queue.cc:1059] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:07.838759 23916 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:07.849066 22442 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:07.855082 22366 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:07.857354 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:07.863330 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 58957.2us
I20260709 12:17:07.864653 23778 consensus_queue.cc:1243] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:07.848326 23857 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:17:07.865310 23778 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:07.865862 23951 raft_consensus.cc:3055] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:07.865309 23767 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.866165 23778 raft_consensus.cc:697] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:07.866669 23951 raft_consensus.cc:740] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:07.867674 23951 consensus_queue.cc:260] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.868172 23926 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.869040 23951 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.871337 23767 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:07.867551 23778 consensus_queue.cc:237] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:07.873577 23767 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:07.845515 22396 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:07.874150 23918 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.874686 23918 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:07.874253 23767 consensus_queue.cc:1059] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:07.877140 23926 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.877682 23918 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.877733 23926 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.877444 23904 raft_consensus.cc:3055] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:07.879326 23904 raft_consensus.cc:740] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:07.880271 23926 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:07.867614 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:07.884888 22402 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:07.842132 23945 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.866418 23922 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.835548 23913 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:17:07.856947 23754 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.909560 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:07.910408 23651 raft_consensus.cc:359] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:07.909358 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:07.912875 22551 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:07.913990 23757 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.915560 23906 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:07.917985 23916 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:07.919775 23915 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:07.920420 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:07.924103 22394 raft_consensus.cc:1240] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:07.924677 23930 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.934171 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:07.941705 22469 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:07.938027 23651 raft_consensus.cc:740] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:17:07.944535 23651 consensus_queue.cc:260] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:07.945148 23941 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:07.946107 23131 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:07.947098 23906 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:07.947652 23906 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.951107 23757 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:07.951526 23741 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.952057 23741 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:07.953153 23930 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:07.954339 23946 consensus_queue.cc:1059] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 12:17:07.954753 22366 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:07.955453 23946 raft_consensus.cc:3055] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:07.955821 23946 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:07.943008 22401 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:07.956758 22393 raft_consensus.cc:1240] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:07.956622 23946 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.959167 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:07.959754 22469 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:07.959430 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 110688us
I20260709 12:17:07.903775 23922 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.958930 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:07.963124 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 114139us
I20260709 12:17:07.963318 22543 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.860423 23803 consensus_queue.cc:1059] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 12:17:07.977547 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:07.978307 22551 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.964359 23767 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:07.981252 22441 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:07.980382 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:07.990527 23748 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:07.992956 23748 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:07.988123 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:07.998528 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.880244 23904 consensus_queue.cc:260] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:08.003126 22551 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:08.007176 23522 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.007725 23522 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.008266 23767 raft_consensus.cc:697] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:08.009282 23767 consensus_queue.cc:237] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.010811 23522 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:08.011716 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:08.012344 22545 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:08.012676 23902 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:08.013172 23902 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.015522 23651 ts_tablet_manager.cc:1434] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.374s	user 0.004s	sys 0.009s
I20260709 12:17:08.016196 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:08.017023 23676 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:08.017419 23676 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.965292 23922 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.017795 23676 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:07.981925 23946 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.978579 23931 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.043737 22469 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:08.043851 23748 consensus_queue.cc:1059] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:08.043850 23094 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:08.000440 23924 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.999989 23803 raft_consensus.cc:3055] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:08.051343 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:08.055891 22547 raft_consensus.cc:1240] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:17:08.056840 23131 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:17:08.062175 23131 pending_rounds.cc:85] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Aborting all ops after (but not including) 4
I20260709 12:17:08.062458 23131 pending_rounds.cc:107] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:17:08.062695 23131 raft_consensus.cc:2889] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:08.005205 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:08.039038 23818 consensus_meta.cc:287] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.663s	user 0.003s	sys 0.008s
I20260709 12:17:08.082366 23818 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:08.084195 22396 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:08.084574 23818 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:08.085292 23906 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:08.064067 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:08.087319 23866 raft_consensus.cc:3055] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:08.087739 23866 raft_consensus.cc:740] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:08.088606 23866 consensus_queue.cc:260] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:08.089241 23959 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:08.091270 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:08.069648 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:08.070029 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:08.092942 23131 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 2 LEARNER]: Advancing to term 3
I20260709 12:17:08.097618 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:08.099149 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:08.100782 23954 log.cc:927] Time spent T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 12:17:08.102490 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:08.102504 23950 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:17:08.101159 22366 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:08.118214 22516 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:08.121104 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:08.019522 23741 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:08.072068 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:08.072576 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:08.073282 22543 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:08.054705 23916 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:08.077836 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.067786 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:08.067282 23910 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.088534 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:08.087245 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:08.059685 23945 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:17:08.117594 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.061231 23803 raft_consensus.cc:740] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:08.135103 22516 leader_election.cc:400] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4.
I20260709 12:17:08.117782 23904 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.118175 23930 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:08.134684 22366 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:08.141705 22516 leader_election.cc:403] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:08.122123 23754 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
I20260709 12:17:08.125428 23915 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:08.157946 23915 raft_consensus.cc:697] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:08.158895 23915 consensus_queue.cc:237] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.127626 23797 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.127786 23924 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.160426 23924 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:08.141124 22396 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.162624 23924 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:08.135735 23916 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.163618 23916 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.167809 23922 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.169286 23930 raft_consensus.cc:697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:08.170145 23922 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:08.172739 22473 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.127939 23926 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:08.173044 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:08.186617 22543 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.181617 22473 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:08.182139 23526 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4.
W20260709 12:17:08.182298 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 53055.6us
I20260709 12:17:08.191566 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:08.193789 22411 tablet_copy_service.cc:342] P b8621fa34be04d3fa2d68a300f858cd1: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-0723691b01e2413baf71cbc73a551fdc received from {username='slave'} at 127.0.0.1:58054
I20260709 12:17:08.194418 22411 tablet_copy_service.cc:434] P b8621fa34be04d3fa2d68a300f858cd1: ending tablet copy session 65951063312d4a1e9123f92354101c71-0723691b01e2413baf71cbc73a551fdc on tablet 0723691b01e2413baf71cbc73a551fdc with peer 65951063312d4a1e9123f92354101c71
I20260709 12:17:08.057001 23931 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:17:08.184624 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:07.702778 23733 ts_tablet_manager.cc:1469] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: Trace:
0709 12:17:01.902477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.902648 (+   171us) service_pool.cc:224] Handling call
0709 12:17:02.157460 (+254812us) ts_tablet_manager.cc:934] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
0709 12:17:04.034148 (+1876688us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:17:04.799578 (+765430us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:04.799695 (+   117us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:17:04.916727 (+117032us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:17:04.965741 (+ 49014us) tablet_replica.cc:206] Creating consensus instance
0709 12:17:05.016840 (+ 51099us) ts_tablet_manager.cc:989] Replica registered.
0709 12:17:05.023833 (+  6993us) inbound_call.cc:177] Queueing success response
0709 12:17:05.261202 (+237369us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b18000bea80. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f59e1c0a 00007fb4ff121219 00007fb4f590bed8 00007fb4f5a66de2 00007fb4fdacbd23 00007fb4fdacb55d 00007fb4fdb673d8 00007fb4fdb98f4e 00007fb4fdb7dfdd
0709 12:17:06.251023 (+989821us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:17:07.150105 (+899082us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:17:07.291647 (+141542us) tablet_replica.cc:261] Starting instrumentation
0709 12:17:07.292265 (+   618us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":91388,"mutex_wait_us":4434,"raft.queue_time_us":16888,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":6017,"spinlock_wait_cycles":9801600,"tablet-copy.queue_time_us":209736,"tablet-download-pool.queue_time_us":129,"tablet-download-pool.run_cpu_time_us":1430,"tablet-download-pool.run_wall_time_us":420332,"thread_start_us":218638,"threads_started":2}
W20260709 12:17:08.185781 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:08.204901 23957 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 12:17:08.211330 23936 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:17:08.223008 22442 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:08.243686 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.186726 23767 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:08.219446 23778 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:08.253470 22543 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:08.217163 23676 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.222409 23911 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:08.277366 23902 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:08.280309 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:08.286211 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 305031us
I20260709 12:17:08.286466 23566 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:08.287068 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 67787.9us
I20260709 12:17:08.287456 23553 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:08.291741 22441 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:08.299405 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:08.294045 22411 tablet_copy_service.cc:342] P b8621fa34be04d3fa2d68a300f858cd1: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-2974af5009474d6590a8e35ea1dc6b83 received from {username='slave'} at 127.0.0.1:58054
I20260709 12:17:08.303448 22411 tablet_copy_service.cc:434] P b8621fa34be04d3fa2d68a300f858cd1: ending tablet copy session 65951063312d4a1e9123f92354101c71-2974af5009474d6590a8e35ea1dc6b83 on tablet 2974af5009474d6590a8e35ea1dc6b83 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:17:08.303535 23784 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.304100 23784 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:08.172295 23945 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:08.309530 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.266670 23778 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.308314 23553 raft_consensus.cc:697] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:08.314635 23553 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.316074 23866 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:08.318075 23931 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:08.340875 22366 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:08.266112 23767 raft_consensus.cc:697] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:08.347208 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:08.266743 23955 consensus_queue.cc:1059] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 12:17:08.241330 23930 consensus_queue.cc:237] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.320367 23778 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.321076 23903 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:08.260955 23803 consensus_queue.cc:260] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.342651 23909 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:08.374230 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 71555.8us
I20260709 12:17:08.346108 23902 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:08.301663 23911 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.387162 22543 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:08.398281 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:08.399330 22473 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:08.401021 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:08.374667 23909 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:08.382804 23903 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:08.379549 23932 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:08.418741 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:08.418934 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:08.417802 22469 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:08.420780 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 129113us
I20260709 12:17:08.421693 22441 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:08.404592 23961 log.cc:927] Time spent T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 12:17:08.386332 23902 raft_consensus.cc:697] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:08.411563 23803 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:08.447394 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 68071.4us
I20260709 12:17:08.415697 23909 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.406674 23940 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.407648 23910 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:08.443590 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:08.451534 22441 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:08.452248 22469 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:08.375474 23918 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.415256 23784 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:08.458078 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:08.435693 23903 raft_consensus.cc:697] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:08.460508 23956 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:08.600857 22474 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:08.514627 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:08.601714 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 150266us
W20260709 12:17:08.592757 22367 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.037s (SENT) [suppressed 9 similar messages]
I20260709 12:17:08.602659 22441 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:08.603291 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.449678 23767 consensus_queue.cc:237] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.598592 23906 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:08.646531 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.604215 23676 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:08.653589 23130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.006s	sys 0.035s
W20260709 12:17:08.655675 23130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.007s	sys 0.035s
I20260709 12:17:08.664346 23979 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:08.666041 23969 log.cc:927] Time spent T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:17:08.667184 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:08.650406 23959 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:08.677616 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 75054.4us
I20260709 12:17:08.453568 23940 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.682993 22441 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:08.452910 23932 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.694814 23553 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:08.695428 23910 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:08.695667 23973 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:17:08.696404 23978 log.cc:927] Time spent T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:17:08.696866 22441 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:08.697130 23946 consensus_meta.cc:287] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.001s
W20260709 12:17:08.700166 23958 log.cc:927] Time spent T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.158s	user 0.002s	sys 0.007s
I20260709 12:17:08.682140 23522 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:08.684784 23945 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:08.670531 23676 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:08.695045 23984 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:08.685166 23959 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.705570 23918 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:08.726284 22441 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:08.728667 23977 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:17:08.729238 23981 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.710449 22516 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:08.661616 23906 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:08.645792 23902 consensus_queue.cc:237] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.719476 22477 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
W20260709 12:17:08.730268 23972 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:17:08.723330 23522 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:08.757190 23865 consensus_meta.cc:287] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.918s	user 0.009s	sys 0.000s
I20260709 12:17:08.725186 23676 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.754908 23987 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:17:08.734571 23910 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:08.773617 23906 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:08.776878 23911 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:08.775904 23909 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:08.779354 23909 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:08.726636 23984 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.782763 23984 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:08.783066 23959 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:08.784328 23940 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:08.784731 23578 raft_consensus.cc:3055] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:08.785238 23578 raft_consensus.cc:740] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:17:08.791076 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.791821 23522 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:08.792258 23864 consensus_queue.cc:1059] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:08.793128 23784 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.793661 23784 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:08.795182 23676 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:08.766314 23948 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:08.796190 23948 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.796284 23784 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:08.721333 23903 consensus_queue.cc:237] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.775820 23981 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:17:08.793398 23864 raft_consensus.cc:3055] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:08.802692 23864 raft_consensus.cc:740] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:08.802778 22441 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:08.803709 23864 consensus_queue.cc:260] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:08.805192 23864 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:08.807662 23916 consensus_meta.cc:287] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.001s
I20260709 12:17:08.808128 23916 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:08.810549 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:08.759038 22396 consensus_meta.cc:287] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.597s	user 0.007s	sys 0.003s
I20260709 12:17:08.818137 22396 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:08.820168 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:08.820962 23124 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:08.803555 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:08.825244 23866 consensus_meta.cc:287] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
I20260709 12:17:08.826977 23578 consensus_queue.cc:260] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.828287 23578 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.829833 23553 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:08.830685 23990 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:08.830964 23948 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:08.812189 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:08.831878 22543 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2.
W20260709 12:17:08.833467 23934 consensus_meta.cc:287] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.974s	user 0.011s	sys 0.000s
W20260709 12:17:08.852706 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 142319us
I20260709 12:17:08.854661 22547 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:17:08.855574 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 262837us
I20260709 12:17:08.876289 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:08.882653 22397 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:08.884027 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:08.890350 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:08.891305 22394 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:08.835646 23553 raft_consensus.cc:697] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:08.892036 23864 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.892588 23864 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:08.892493 23553 consensus_queue.cc:237] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:08.897315 23974 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.302s	user 0.002s	sys 0.000s
I20260709 12:17:08.898044 23864 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:08.842226 23865 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.851922 23976 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.905822 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:08.910950 22393 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:08.855455 23906 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.912120 23906 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:08.914600 23906 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:08.916590 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:08.916970 22547 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:08.910039 22397 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:08.874648 23941 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:08.927461 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:08.881414 23993 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:08.899755 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:08.939332 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:08.940080 22469 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2.
I20260709 12:17:08.864259 23767 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:17:08.861030 23934 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.921861 23951 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:08.950398 22516 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:08.953197 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:08.969089 22473 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.969331 23994 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:08.969849 23994 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:08.970212 23994 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.970732 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:08.945716 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 996) took 1134 ms. Trace:
I20260709 12:17:08.972597 22401 rpcz_store.cc:276] 0709 12:17:07.811859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.965742 (+153883us) service_pool.cc:224] Handling call
0709 12:17:07.994752 (+ 29010us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:08.041944 (+ 47192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:08.041973 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:08.047078 (+  5105us) log.cc:844] Serialized 26 byte log entry
0709 12:17:08.371855 (+324777us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:08.371893 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:08.371954 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:08.896894 (+524940us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b240019b788. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f58ed9c4 00007fb4f58ebacb 00007fb4f5aa6dc9 00007fb4f5aa6a55 00007fb4f5aa609d 00007fb4f86d810e 00007fb4f86ef88c 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221
0709 12:17:08.945407 (+ 48513us) raft_consensus.cc:1685] finished
0709 12:17:08.945430 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:08.945654 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48751,"raft.queue_time_us":51092,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":57827,"spinlock_wait_cycles":9864960,"thread_start_us":251367,"threads_started":1,"wal-append.queue_time_us":373174}
I20260709 12:17:08.935231 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:08.974738 23124 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:08.975167 23940 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:08.975580 23940 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:08.975927 23940 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.958364 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:08.959069 23866 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:08.977113 23994 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:08.977859 23866 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.979581 23994 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:08.979895 23866 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:08.980309 23932 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:08.974334 23862 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:08.941275 23916 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:08.919253 23865 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:08.961097 22549 raft_consensus.cc:2393] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 2: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:08.941807 23959 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.923594 23976 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:08.984042 22398 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:08.963631 23934 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:08.945601 23941 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:09.010157 23941 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:08.968092 23778 consensus_meta.cc:287] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.000s
I20260709 12:17:08.990279 22393 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:08.927037 23566 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:08.932410 23981 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.969461 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:08.984532 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:17:09.022790 22441 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:08.940465 23948 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:08.945226 23904 raft_consensus.cc:1064] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:17:08.993980 23940 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.940271 23993 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:09.025727 23798 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:09.050576 23798 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.050976 23798 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.052007 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:09.052692 22544 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
W20260709 12:17:09.056558 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.057197 23956 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.057690 23956 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:09.059902 23956 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:09.060603 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:08.941689 23924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.012s	sys 0.009s
I20260709 12:17:09.010838 23778 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:09.025020 22473 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
W20260709 12:17:09.030678 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 120968us
I20260709 12:17:09.035606 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:09.073997 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 100340us
I20260709 12:17:09.074566 22393 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:08.990034 23862 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:08.968853 23951 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:09.066701 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:09.075809 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:09.077199 22469 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.026288 23948 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.077410 22473 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
W20260709 12:17:09.047158 23980 log.cc:927] Time spent T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.295s	user 0.003s	sys 0.000s
I20260709 12:17:09.074692 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:09.078912 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:09.046342 23934 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.004761 23959 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:09.080116 22471 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:09.084384 22366 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:09.124908 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:09.093276 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:09.094065 23094 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:17:09.072655 23924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.012s	sys 0.009s
I20260709 12:17:09.063633 23865 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:09.163858 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:09.165155 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 90534.2us
I20260709 12:17:09.168179 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:09.171231 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:09.171957 22472 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:09.021723 23566 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:09.082005 23948 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.182720 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:09.164464 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:09.041887 23981 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:09.172886 23916 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:09.243741 22399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 75) took 1326 ms. Trace:
I20260709 12:17:09.218739 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:09.165496 23797 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:09.236439 23131 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:17:09.271586 23131 pending_rounds.cc:85] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: Aborting all ops after (but not including) 4
I20260709 12:17:09.271962 23131 pending_rounds.cc:107] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:17:09.272267 23131 raft_consensus.cc:2889] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:09.172181 23941 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:09.202155 22476 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2.
I20260709 12:17:09.288017 22469 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:09.157596 23915 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 12:17:09.157507 24004 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.162s
I20260709 12:17:09.235133 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:09.340793 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:09.268977 22399 rpcz_store.cc:276] 0709 12:17:07.916878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.222982 (+306104us) service_pool.cc:224] Handling call
0709 12:17:08.259885 (+ 36903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:08.268025 (+  8140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:08.268060 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:08.298267 (+ 30207us) log.cc:844] Serialized 26 byte log entry
0709 12:17:08.436351 (+138084us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:08.436391 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:08.436506 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:08.981920 (+545414us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:09.215007 (+233087us) raft_consensus.cc:1685] finished
0709 12:17:09.215028 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:09.243657 (+ 28629us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":33089,"spinlock_wait_cycles":11060480,"thread_start_us":88289,"threads_started":1,"wal-append.queue_time_us":328941}
I20260709 12:17:09.343142 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:09.345423 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:09.248479 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:09.244995 23940 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:09.266618 23865 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.249392 23993 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:09.355297 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 104093us
I20260709 12:17:09.355554 22397 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:09.229612 23989 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:09.288702 23941 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.288939 22398 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.213318 23998 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:09.326668 23976 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:09.235796 23095 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:09.354918 23126 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:09.382262 23941 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.235924 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:09.268797 23916 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.288901 23797 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.395118 23566 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:09.382156 23989 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.395907 23989 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.377290 23865 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:09.365900 22544 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:09.397907 23865 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:09.386909 23998 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:09.384364 23993 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:09.398626 23998 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:09.398900 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 210312us
I20260709 12:17:09.398175 23124 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:17:09.401706 23997 log.cc:927] Time spent T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:17:09.395190 23981 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:09.398811 23993 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:09.406486 23998 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:09.386430 23959 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:09.407840 23993 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:09.408277 23916 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.411437 23797 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.412878 23864 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:09.413306 23864 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.413661 23864 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.391796 22393 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:09.201310 23866 consensus_queue.cc:1059] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.187s
W20260709 12:17:09.407109 24001 log.cc:927] Time spent T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 12:17:09.457932 23993 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.460428 23941 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:09.507546 23993 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:09.513266 23993 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:09.483414 23862 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:09.481163 23798 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:09.519582 23951 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:09.531308 24004 raft_consensus.cc:1064] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:17:09.806480 24005 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:09.807104 24005 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:09.809547 24005 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:09.810483 24021 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:09.811106 24021 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:09.813340 24021 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:09.561287 23998 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:09.835235 23951 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:09.835430 23994 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:09.895265 23924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.023s	sys 0.064s
W20260709 12:17:09.899955 22396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.035s	sys 0.044s
W20260709 12:17:09.898171 22515 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.018s	sys 0.062s
I20260709 12:17:09.898286 23951 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:09.901678 23994 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:09.904706 23797 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:09.934525 23864 consensus_meta.cc:287] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.001s
I20260709 12:17:09.934988 23864 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:09.936616 23798 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:09.907325 23924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.024s	sys 0.065s
I20260709 12:17:09.918505 23941 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:09.994644 22477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.020s	sys 0.045s
W20260709 12:17:09.998615 22514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.022s	sys 0.054s
W20260709 12:17:09.999011 22514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.022s	sys 0.055s
I20260709 12:17:09.992202 24025 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:10.000218 22477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.021s	sys 0.045s
I20260709 12:17:09.944607 23864 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:10.003918 24028 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.006124 24028 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.006474 23995 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.007045 23995 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:10.008301 24028 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:10.008920 23995 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:10.009975 24016 log.cc:927] Time spent T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:17:10.010049 24023 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:10.010597 24025 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:10.011006 24028 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.011561 24028 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:09.909085 22515 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.018s	sys 0.062s
I20260709 12:17:10.010618 24023 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.014397 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.015834 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:10.015997 24023 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:10.016613 22547 raft_consensus.cc:2410] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:10.017289 22548 raft_consensus.cc:1240] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:10.017427 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.017640 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.018349 22551 raft_consensus.cc:2368] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
I20260709 12:17:10.013972 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:10.013554 24028 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:09.911878 22396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.036s	sys 0.045s
I20260709 12:17:10.031692 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.016531 24023 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.043270 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.044225 22551 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:10.045001 22548 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:17:09.907833 23757 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.027s	sys 0.037s
I20260709 12:17:10.056547 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:10.058168 22367 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.016s	sys 0.029s
W20260709 12:17:10.067217 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 407813us
I20260709 12:17:10.058588 22544 raft_consensus.cc:2368] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
W20260709 12:17:10.058782 22367 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.016s	sys 0.030s
W20260709 12:17:10.070739 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 558014us
W20260709 12:17:10.073791 22401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.095s	sys 0.167s
W20260709 12:17:10.075976 22401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.096s	sys 0.167s
W20260709 12:17:10.068576 23757 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.028s	sys 0.038s
I20260709 12:17:10.076300 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.067793 24025 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:10.077759 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1012) took 1018 ms. Trace:
I20260709 12:17:10.079416 22548 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:17:10.080963 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.083364 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.084005 22551 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:10.057550 24023 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:10.084223 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:10.085193 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.084518 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.082127 22401 rpcz_store.cc:276] 0709 12:17:09.059423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.164138 (+104715us) service_pool.cc:224] Handling call
0709 12:17:09.180982 (+ 16844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:09.181203 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:09.359008 (+177805us) log.cc:844] Serialized 14 byte log entry
0709 12:17:10.077417 (+718409us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:10.077471 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:10.077512 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.077589 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.077705 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":861,"prepare.queue_time_us":230871,"prepare.run_cpu_time_us":4491,"prepare.run_wall_time_us":45563,"raft.queue_time_us":2715,"thread_start_us":831251,"threads_started":2}
I20260709 12:17:10.106459 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:10.084990 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:10.072769 23941 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.109550 22551 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.116794 22548 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:10.108381 23798 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:10.088021 23989 consensus_meta.cc:287] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.692s	user 0.008s	sys 0.000s
I20260709 12:17:10.079342 24021 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:10.119527 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:10.116634 23916 consensus_meta.cc:287] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.708s	user 0.010s	sys 0.000s
I20260709 12:17:10.117410 23798 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.121599 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.122784 22548 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:10.084745 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:10.126354 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:10.116405 23951 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:10.128930 22546 raft_consensus.cc:1240] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:17:10.120813 23948 consensus_meta.cc:287] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.884s	user 0.010s	sys 0.000s
I20260709 12:17:10.119263 23797 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:10.109633 22399 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:10.131291 23798 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:10.122522 22544 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:10.121558 23994 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:10.138411 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.143116 22545 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:10.138579 22551 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
W20260709 12:17:10.153851 22545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1320) took 1287 ms (client timeout 1500 ms). Trace:
I20260709 12:17:10.156863 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:10.157722 22469 raft_consensus.cc:2393] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 4: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:10.158275 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:10.159135 22470 raft_consensus.cc:2393] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 4: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:10.159240 23778 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:10.159448 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:10.121001 23941 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.161412 23094 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:17:10.154289 22545 rpcz_store.cc:269] 0709 12:17:08.856697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.856862 (+   165us) service_pool.cc:224] Handling call
0709 12:17:10.138242 (+1281380us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b5800010b98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:10.143577 (+  5335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42864896}
I20260709 12:17:10.127388 23916 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:10.179032 22548 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:10.180471 23094 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:10.124788 24021 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.131592 23127 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:10.134640 22396 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:10.123487 23989 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.212154 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:10.212062 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.238119 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:10.166445 23797 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.244705 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:10.267634 22471 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.139566 23948 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:10.237882 23955 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.277877 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:10.280879 24026 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 12:17:10.284351 22398 consensus_meta.cc:287] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.840s	user 0.008s	sys 0.000s
I20260709 12:17:10.287287 23948 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:10.288177 22542 raft_consensus.cc:2368] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4.
I20260709 12:17:10.289179 23955 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:10.290807 22398 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:10.291352 24007 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.291823 24007 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.169570 23757 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 12:17:10.238418 23902 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:10.297515 22399 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
W20260709 12:17:10.300873 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.307077 23095 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:10.310146 23916 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:10.310947 23916 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:10.311432 23916 raft_consensus.cc:697] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 4 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:10.312302 23916 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:10.318532 23955 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:10.320412 23798 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:10.320978 23798 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.322064 24021 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:10.323144 23798 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:10.324738 23941 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:10.274860 23797 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:10.327613 23797 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:10.329216 23989 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:10.305042 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1015) took 1242 ms. Trace:
I20260709 12:17:10.329838 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:10.330188 22398 rpcz_store.cc:276] 0709 12:17:09.060137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.073621 (+ 13484us) service_pool.cc:224] Handling call
0709 12:17:10.302262 (+1228641us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:10.329838 23902 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:10.332581 23902 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:10.334125 24034 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:10.334664 24034 raft_consensus.cc:697] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:10.335565 22395 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:10.335464 24034 consensus_queue.cc:237] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:10.336174 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58054 (request call id 79) took 1301 ms. Trace:
W20260709 12:17:10.340794 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 160431us
W20260709 12:17:10.340126 23865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.029s	sys 0.021s
I20260709 12:17:10.346226 22515 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:10.348230 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:10.348841 22550 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.345839 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1325) took 1213 ms. Trace:
I20260709 12:17:10.340359 23798 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:10.360996 22471 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:10.340966 23955 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:17:10.370671 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 63721us
I20260709 12:17:10.345857 23864 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:10.345921 23865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.029s	sys 0.026s
I20260709 12:17:10.374042 23797 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:10.374672 23797 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.376000 23904 consensus_queue.cc:237] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:10.377151 23797 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:10.377929 23757 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:10.378449 23757 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.379529 22550 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:10.349342 23989 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:10.380566 23094 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:10.372498 23864 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.381989 23757 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:10.382174 23864 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.383721 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1076) took 1509 ms. Trace:
I20260709 12:17:10.383980 22400 rpcz_store.cc:276] 0709 12:17:08.874478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.874917 (+   439us) service_pool.cc:224] Handling call
0709 12:17:10.383229 (+1508312us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:17:10.383382 (+   153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:10.383497 (+   115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.383512 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:10.383539 (+    27us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:10.383555 (+    16us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.383589 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.383667 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3525888}
I20260709 12:17:10.390242 23864 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:10.340207 22395 rpcz_store.cc:276] 0709 12:17:09.034903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.047784 (+ 12881us) service_pool.cc:224] Handling call
0709 12:17:10.329608 (+1281824us) spinlock_profiling.cc:243] Waited 74.2 ms on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:10.336109 (+  6501us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170640128}
I20260709 12:17:10.397121 24042 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:10.401903 24042 raft_consensus.cc:697] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 3 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:10.392218 23989 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.410462 23989 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.381067 23902 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:10.397754 23955 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.419535 23955 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:10.360471 23798 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:10.398036 23797 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:10.432484 23797 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.434718 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:10.421877 23902 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.449268 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:10.449990 22395 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.409888 24044 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.397985 24040 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:10.428232 24041 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:10.434759 23797 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:10.460585 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:10.461439 23864 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:10.464440 24041 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.465845 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34092 (request call id 154) took 1337 ms. Trace:
I20260709 12:17:10.466711 24041 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:10.479128 23990 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.479769 23990 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.481964 23990 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:10.483358 23932 raft_consensus.cc:1027] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: attempt to promote peer 65951063312d4a1e9123f92354101c71: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:17:10.484179 24042 consensus_queue.cc:237] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:10.349996 22549 rpcz_store.cc:276] 0709 12:17:09.127565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.159398 (+ 31833us) service_pool.cc:224] Handling call
0709 12:17:09.215203 (+ 55805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:09.832303 (+617100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:09.833588 (+  1285us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:09.922269 (+ 88681us) log.cc:844] Serialized 26 byte log entry
0709 12:17:10.240488 (+318219us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:10.240537 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.240625 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:10.338037 (+ 97412us) raft_consensus.cc:1685] finished
0709 12:17:10.338060 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.340671 (+  2611us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22249,"raft.queue_time_us":75768,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":701836,"threads_started":2,"wal-append.queue_time_us":366481}
I20260709 12:17:10.488744 23094 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:10.461112 24040 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.489300 23993 raft_consensus.cc:3055] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:10.489705 23993 raft_consensus.cc:740] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:10.490068 23864 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:10.490479 23864 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.490882 23864 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:10.490610 23993 consensus_queue.cc:260] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.491191 24040 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:10.491649 23993 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.493124 23902 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:10.493383 22476 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43060 (request call id 69) took 1554 ms (client timeout 1856 ms). Trace:
I20260709 12:17:10.458521 24044 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:10.493813 22476 rpcz_store.cc:269] 0709 12:17:08.938691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.939533 (+   842us) service_pool.cc:224] Handling call
0709 12:17:10.493183 (+1553650us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400395154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:10.493294 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504570624}
I20260709 12:17:10.498982 23798 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:10.466264 23124 rpcz_store.cc:276] 0709 12:17:09.128444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.172098 (+ 43654us) service_pool.cc:224] Handling call
0709 12:17:09.330630 (+158532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:09.400786 (+ 70156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.465543 (+1064757us) spinlock_profiling.cc:243] Waited 60 ms on lock 0x7b54005f0354. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:10.465742 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137975040}
I20260709 12:17:10.495790 24044 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:10.501837 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 54595.7us
I20260709 12:17:10.504424 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:10.505856 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:10.509321 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:10.510097 22476 raft_consensus.cc:2393] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 4: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:10.514072 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:10.514916 22400 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:17:10.516258 22400 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:10.522737 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:10.524246 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:10.525012 22401 raft_consensus.cc:2368] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5.
I20260709 12:17:10.525787 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43060 (request call id 65) took 1583 ms. Trace:
I20260709 12:17:10.528132 22400 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:10.526180 22477 rpcz_store.cc:276] 0709 12:17:08.930575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.930956 (+   381us) service_pool.cc:224] Handling call
0709 12:17:08.944868 (+ 13912us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:09.349524 (+404656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:09.349556 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:09.358713 (+  9157us) log.cc:844] Serialized 26 byte log entry
0709 12:17:10.002303 (+643590us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:10.002349 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.513217 (+510868us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54002b3754. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:10.513275 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:10.513333 (+    58us) raft_consensus.cc:1685] finished
0709 12:17:10.513348 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.513566 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":684,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":10655,"spinlock_wait_cycles":929743616,"thread_start_us":616525,"threads_started":1,"wal-append.queue_time_us":626551}
I20260709 12:17:10.532913 22442 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:10.539825 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:10.540738 22476 raft_consensus.cc:2393] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 4: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:10.533334 23526 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.512603 23522 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:10.544224 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:10.514098 24040 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:17:10.536741 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:10.548650 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:10.549242 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:10.551378 22477 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:17:10.541611 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:10.552732 22401 raft_consensus.cc:2393] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:17:10.556742 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.548225 23767 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.565411 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:10.551493 24041 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:10.573542 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.573899 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:10.575517 22395 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:10.575840 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:10.576437 24022 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:10.576728 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:10.577040 23803 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:10.578976 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:10.596318 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:10.570168 22401 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:17:10.580145 22477 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:10.598783 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:10.600762 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.555692 22398 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.551190 23522 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.591498 22547 raft_consensus.cc:1275] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:17:10.591713 23128 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 2 LEARNER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:10.591655 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:10.592099 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:10.592581 23125 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:10.549829 23526 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.550733 23926 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:17:10.589876 24041 raft_consensus.cc:697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:10.584275 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:10.599398 22401 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:10.602656 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.586107 23955 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:10.545406 24004 consensus_queue.cc:237] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:10.595329 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 62579.8us
I20260709 12:17:10.581302 23767 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.598085 23124 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.624306 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:10.606837 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:10.776962 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:10.589589 22549 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
W20260709 12:17:10.862165 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.718273 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:17:10.859298 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 58889.7us
I20260709 12:17:10.867452 22476 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.615512 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.832782 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:10.865195 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:10.842344 24048 log.cc:927] Time spent T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
I20260709 12:17:10.900925 22401 raft_consensus.cc:2410] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:10.621381 23126 raft_consensus.cc:2393] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:10.606107 23945 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:10.908380 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:10.909467 22547 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:10.910104 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 52043.1us
I20260709 12:17:10.603797 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:10.741629 23906 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.621975 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:10.595963 24022 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.870134 23932 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:10.789983 24034 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:10.833434 23959 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.793979 23902 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.613219 23904 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:10.915473 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:10.952778 22477 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:10.623410 23757 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:10.862350 24044 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:10.623251 22542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1328) took 1445 ms (client timeout 1763 ms). Trace:
W20260709 12:17:10.959153 22542 rpcz_store.cc:269] 0709 12:17:09.178103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.187697 (+  9594us) service_pool.cc:224] Handling call
0709 12:17:10.623006 (+1435309us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b540008d9d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:10.623181 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2058676096}
I20260709 12:17:10.959497 24041 consensus_queue.cc:237] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.960399 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.742020 23797 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:10.601887 23803 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.867715 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:10.741802 23915 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:10.917315 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:10.919052 24007 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:10.598707 23989 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:10.920272 23526 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:10.621536 22468 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:17:10.920132 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.918370 23906 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:10.843037 23864 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:10.893859 23955 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.945839 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:10.928025 24042 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:10.938511 23959 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.940490 23902 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.951220 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:10.953697 22398 raft_consensus.cc:2410] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:10.998886 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:10.999698 22398 raft_consensus.cc:2410] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:10.954488 22543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1327) took 1780 ms. Trace:
I20260709 12:17:10.937937 24034 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:10.957630 23757 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.958379 24044 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:10.861505 23748 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:10.978331 24007 raft_consensus.cc:2764] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:17:10.964993 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:11.018489 22397 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:10.934962 23932 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.959061 23127 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:17:10.969887 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:10.918164 23945 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:10.955020 22395 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 1.
I20260709 12:17:10.979144 22299 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50158 (request call id 187) took 9295 ms. Trace:
I20260709 12:17:10.972841 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:11.044590 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.044332 22545 raft_consensus.cc:2393] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:10.970439 22296 catalog_manager.cc:5697] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 1 to 3, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 3 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:10.967089 23522 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:10.997129 22399 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:17:11.003984 22551 raft_consensus.cc:2393] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:11.000155 22543 rpcz_store.cc:276] 0709 12:17:09.173715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.174544 (+   829us) service_pool.cc:224] Handling call
0709 12:17:10.953786 (+1779242us) spinlock_profiling.cc:243] Waited 8.27 ms on lock 0x7b5800010b98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:17:10.953980 (+   194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:10.954157 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.954183 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:10.954240 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:10.954271 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.954326 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.954431 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19028352}
I20260709 12:17:11.009093 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:09.523546 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:11.071583 22401 raft_consensus.cc:2410] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:11.017876 23131 raft_consensus.cc:2368] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5.
I20260709 12:17:11.034264 22393 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:11.038101 22548 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:10.971107 23797 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:11.041679 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:11.047399 24056 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:17:11.048182 22468 raft_consensus.cc:1240] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: [1.2-3.3]
I20260709 12:17:11.076743 24044 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.077682 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:11.078473 23932 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.079046 23864 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.079237 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:11.020882 23748 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:11.079912 22468 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.080658 24023 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:11.081288 23748 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:10.974409 23904 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:11.045897 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:11.082170 22545 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:11.048424 23945 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.046361 22475 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.044250 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1265) took 1869 ms. Trace:
I20260709 12:17:11.049502 23989 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:11.050947 24034 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:11.017122 24052 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:11.054575 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:11.044183 24007 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:11.056280 23757 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:11.128295 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:11.128935 22398 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.056450 23931 consensus_queue.cc:1059] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:11.058384 23902 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.059224 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:11.059245 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:11.059803 22296 catalog_manager.cc:5697] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 1 to 2, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 2 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:11.062127 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:11.065127 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:11.069675 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.092669 22542 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:11.087598 22476 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:11.088547 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:11.048319 24022 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.150864 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:11.151641 22476 raft_consensus.cc:2410] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:11.152411 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:11.149309 22544 raft_consensus.cc:1240] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:10.975891 23915 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:11.090186 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:11.091251 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:11.200322 22473 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:11.090327 22472 rpcz_store.cc:276] 0709 12:17:09.174996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.014611 (+1839615us) service_pool.cc:224] Handling call
0709 12:17:11.043751 (+ 29140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.043929 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.043951 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:11.043989 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:11.044030 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.044080 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.044198 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:11.093039 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:11.202236 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:11.202876 22401 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:11.054872 23803 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.079002 23932 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:11.132030 22475 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:11.016429 24042 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:11.146250 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:11.220330 22543 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.088944 22545 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:11.148569 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:11.149268 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:17:11.149925 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 317235us
I20260709 12:17:11.150027 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:11.147959 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:11.153394 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:11.226895 22477 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.043936 22299 rpcz_store.cc:276] 0709 12:17:01.679979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.680118 (+   139us) service_pool.cc:224] Handling call
0709 12:17:10.974815 (+9294697us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:07.234188 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:07.323174 (+ 88986us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:07.338634 (+ 15460us) write_op.cc:435] Acquired schema lock
0709 12:17:07.352533 (+ 13899us) tablet.cc:662] Decoding operations
0709 12:17:07.497956 (+145423us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:07.508160 (+ 10204us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:07.510618 (+  2458us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:17:07.560851 (+ 50233us) tablet.cc:701] Row locks acquired
0709 12:17:07.560904 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:17:07.561107 (+   203us) write_op.cc:270] Start()
0709 12:17:07.561266 (+   159us) write_op.cc:276] Timestamp: P: 1783599427561031 usec, L: 0
0709 12:17:07.561305 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:17:07.613384 (+ 52079us) log.cc:844] Serialized 2130 byte log entry
0709 12:17:08.183589 (+570205us) op_driver.cc:464] REPLICATION: finished
0709 12:17:08.390342 (+206753us) write_op.cc:301] APPLY: starting
0709 12:17:08.415268 (+ 24926us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:08.451257 (+ 35989us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:08.614162 (+162905us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:08.644979 (+ 30817us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:08.718510 (+ 73531us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:17:08.722751 (+  4241us) write_op.cc:312] APPLY: finished
0709 12:17:08.765919 (+ 43168us) log.cc:844] Serialized 46 byte log entry
0709 12:17:08.798282 (+ 32363us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:08.798390 (+   108us) write_op.cc:454] Released schema lock
0709 12:17:08.798446 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:08.799331 (+   885us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:08.799369 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":362858,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":165580,"apply.run_cpu_time_us":13382,"apply.run_wall_time_us":424001,"num_ops":5,"prepare.queue_time_us":186017,"prepare.run_cpu_time_us":28371,"prepare.run_wall_time_us":563279,"raft.queue_time_us":79001,"raft.run_cpu_time_us":50936,"raft.run_wall_time_us":150695,"replication_time_us":622110,"spinlock_wait_cycles":45440,"thread_start_us":416764,"threads_started":4,"wal-append.queue_time_us":312617,"wal-append.run_cpu_time_us":18921,"wal-append.run_wall_time_us":1862353}]]}
I20260709 12:17:11.200263 22399 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:11.117945 22547 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:11.156424 22296 catalog_manager.cc:5697] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 1 to 3, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 3 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:11.127849 22396 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:11.217994 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:11.219833 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.214381 22549 raft_consensus.cc:2393] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:11.230440 22545 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:17:11.230669 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 318747us
I20260709 12:17:11.231773 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:11.121142 24052 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:11.235462 22296 catalog_manager.cc:5697] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 1 to 3, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 3 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:11.237450 22401 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:11.238540 22401 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:11.239388 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:11.245514 22398 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:11.263952 22543 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:11.269436 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:11.271763 22547 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:11.273756 23094 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:11.312022 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:11.312764 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:11.324198 24062 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:11.240182 22394 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.325111 23904 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.324535 22296 catalog_manager.cc:5697] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 1 to 3, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 3 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:11.326764 24042 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:11.327315 23864 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:11.327163 22296 catalog_manager.cc:5697] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 1 to 2, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 2 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:11.235260 23906 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:11.228946 23932 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:11.145226 24007 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:11.333585 24007 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.239482 23126 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:11.335637 24052 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.275215 23931 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:17:11.338167 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:11.338950 22473 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:11.339412 23124 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:11.339874 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:11.777088 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:11.778905 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:11.346838 22476 raft_consensus.cc:2393] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:11.779727 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:11.780279 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:11.390784 22470 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:11.687573 24043 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:11.780943 22476 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
I20260709 12:17:11.340457 23959 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.781898 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:11.782382 24062 raft_consensus.cc:697] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:17:11.783749 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 541355us
I20260709 12:17:11.783442 24062 consensus_queue.cc:237] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:11.785315 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:11.591095 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1151) took 1023 ms. Trace:
W20260709 12:17:11.783380 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 465140us
I20260709 12:17:11.781373 24043 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:11.781490 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:11.800639 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:11.785573 22473 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:11.801343 22470 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:11.795956 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.802119 22473 raft_consensus.cc:1240] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:11.802664 22477 consensus_meta.cc:287] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.575s	user 0.007s	sys 0.000s
I20260709 12:17:11.802811 22442 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:11.803251 22473 raft_consensus.cc:1240] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:11.803803 22477 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:11.803884 22442 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:11.235371 24044 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:11.808959 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.797113 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:11.809801 22441 leader_election.cc:400] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
I20260709 12:17:11.810364 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:11.815626 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:11.816345 23931 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:11.816833 23931 raft_consensus.cc:697] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:11.817039 22469 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:11.817394 23767 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.817942 23767 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:11.818274 22469 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:11.818481 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:11.818426 23767 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:11.820226 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:11.820719 23767 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.346510 24054 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:11.821260 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1332) took 1224 ms. Trace:
I20260709 12:17:11.821388 24054 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:11.821614 22550 rpcz_store.cc:276] 0709 12:17:10.596418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.596548 (+   130us) service_pool.cc:224] Handling call
0709 12:17:10.603798 (+  7250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.608158 (+  4360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.608192 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.620198 (+ 12006us) log.cc:844] Serialized 26 byte log entry
0709 12:17:10.844417 (+224219us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:10.844460 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.844526 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:11.820285 (+975759us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b24002182b8. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f58ed9c4 00007fb4f58ebacb 00007fb4f5aa6dc9 00007fb4f5aa6a55 00007fb4f5aa5fb0 00007fb4f871c488 00007fb4f871cbe8 00007fb4f86f4398 00007fb4f86ef76a 00007fb4f86eebb6
0709 12:17:11.820997 (+   712us) raft_consensus.cc:1685] finished
0709 12:17:11.821016 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.821206 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":224502,"raft.queue_time_us":5938,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":9951,"spinlock_wait_cycles":10789248,"thread_start_us":223835,"threads_started":1,"wal-append.queue_time_us":323154}
I20260709 12:17:11.822949 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1090) took 1316 ms. Trace:
I20260709 12:17:11.823446 24054 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.824067 24054 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.823908 23931 consensus_queue.cc:237] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:11.824420 24054 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:11.824807 24054 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.825956 22402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1008) took 2767 ms. Trace:
I20260709 12:17:11.826342 22402 rpcz_store.cc:276] 0709 12:17:09.058227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.069883 (+ 11656us) service_pool.cc:224] Handling call
0709 12:17:10.953034 (+1883151us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:17:11.824322 (+871288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.824498 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.824525 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:11.824566 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:11.824594 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.824646 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.825738 (+  1092us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b540006f750. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:11.825872 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2015349504}
W20260709 12:17:11.814425 24011 log.cc:927] Time spent T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 2.334s	user 0.013s	sys 0.008s
I20260709 12:17:11.828733 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43060 (request call id 67) took 2890 ms. Trace:
I20260709 12:17:11.829842 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1334) took 1227 ms. Trace:
I20260709 12:17:11.829080 22474 rpcz_store.cc:276] 0709 12:17:08.938097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.938242 (+   145us) service_pool.cc:224] Handling call
0709 12:17:08.951841 (+ 13599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:08.952258 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:08.952288 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:08.988230 (+ 35942us) log.cc:844] Serialized 26 byte log entry
0709 12:17:09.033597 (+ 45367us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:09.033637 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:09.033702 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:11.237146 (+2203444us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:11.828384 (+591238us) raft_consensus.cc:1685] finished
0709 12:17:11.828411 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.828635 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":59497216,"thread_start_us":42112,"threads_started":1,"wal-append.queue_time_us":357629}
I20260709 12:17:11.830209 22548 rpcz_store.cc:276] 0709 12:17:10.602244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.602370 (+   126us) service_pool.cc:224] Handling call
0709 12:17:11.829668 (+1227298us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400178754. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:11.829790 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396522368}
I20260709 12:17:11.831660 22474 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:11.832948 22474 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:11.833094 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:11.788054 23955 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.823427 22396 rpcz_store.cc:276] 0709 12:17:10.506068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.510403 (+  4335us) service_pool.cc:224] Handling call
0709 12:17:10.621743 (+111340us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:11.822743 (+1201000us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b540006f754. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:11.822882 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468441088}
W20260709 12:17:11.835785 22394 consensus_meta.cc:287] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.000s
I20260709 12:17:11.836284 22394 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:11.836673 23955 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.799746 23930 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.834592 24052 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:17:11.820533 22468 consensus_meta.cc:287] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.740s	user 0.010s	sys 0.000s
I20260709 12:17:11.837842 23930 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:11.838219 22468 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:11.838415 23930 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:11.837092 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 52222.1us
I20260709 12:17:11.839169 22366 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:11.840061 23904 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:11.840431 23904 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.840762 23904 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.846043 23930 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:11.847250 22366 leader_election.cc:400] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4.
I20260709 12:17:11.847637 22366 leader_election.cc:403] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:11.848198 23945 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4.
I20260709 12:17:11.833925 23130 raft_consensus.cc:2410] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:11.850306 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1092) took 1343 ms. Trace:
I20260709 12:17:11.850706 22393 rpcz_store.cc:276] 0709 12:17:10.506586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.527536 (+ 20950us) service_pool.cc:224] Handling call
0709 12:17:10.624128 (+ 96592us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:11.850149 (+1226021us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540005e6d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:11.850254 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444506880}
I20260709 12:17:11.852329 23904 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:11.854516 23904 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.856806 22441 leader_election.cc:403] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:17:11.858064 22401 consensus_meta.cc:287] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.000s
I20260709 12:17:11.867211 22401 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:11.346257 23751 tablet_copy_client.cc:538] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:11.320200 24041 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.786362 22471 rpcz_store.cc:276] 0709 12:17:10.567922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.959936 (+392014us) service_pool.cc:224] Handling call
0709 12:17:10.960218 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:10.960394 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:11.143118 (+182724us) log.cc:844] Serialized 14 byte log entry
0709 12:17:11.590673 (+447555us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:11.590740 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:11.590785 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.590861 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.591022 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":144637,"prepare.queue_time_us":12532,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":142784,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":30229,"thread_start_us":487589,"threads_started":2,"wal-append.queue_time_us":639504}
I20260709 12:17:11.812374 22477 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:11.856496 22366 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:11.854619 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1100) took 1306 ms. Trace:
I20260709 12:17:11.814114 24044 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:11.881072 23767 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.881594 23767 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:11.881072 22395 rpcz_store.cc:276] 0709 12:17:10.548729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.603540 (+ 54811us) service_pool.cc:224] Handling call
0709 12:17:11.852634 (+1249094us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b5400225454. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:11.854565 (+  1931us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64516480}
I20260709 12:17:11.867542 24052 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:11.882098 23767 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.880532 23955 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:11.879391 24041 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:11.884500 23955 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:11.885102 23955 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
I20260709 12:17:11.885308 24041 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.886256 22476 raft_consensus.cc:2410] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:17:11.868793 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 60468.9us
I20260709 12:17:11.887979 24043 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:11.888484 23932 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.889074 23932 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:11.351126 23797 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:11.890316 24044 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:11.892724 22367 leader_election.cc:336] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.037s (SENT)
I20260709 12:17:11.889096 22366 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:11.895174 23095 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:11.896350 22441 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:11.877987 22470 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:11.898447 22474 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:11.836817 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1103) took 1254 ms. Trace:
I20260709 12:17:11.270684 24004 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.589s
I20260709 12:17:11.848243 23930 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:11.882220 24052 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:11.914288 24070 log.cc:927] Time spent T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.764s	user 0.003s	sys 0.007s
I20260709 12:17:11.915213 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:11.916551 24064 log.cc:927] Time spent T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.769s	user 0.004s	sys 0.000s
I20260709 12:17:11.939477 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:11.939754 22399 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.915558 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:11.916615 22395 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:11.941476 22441 leader_election.cc:400] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
I20260709 12:17:11.942490 22441 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:11.945333 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:11.907748 23904 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:11.906808 23864 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:17:11.985461 23095 leader_election.cc:336] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.856s (SENT)
I20260709 12:17:11.960728 22401 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
W20260709 12:17:11.955274 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 167992us
I20260709 12:17:11.909608 24041 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:11.911337 23915 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:11.959583 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:11.991336 22393 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:11.893625 23767 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:11.971457 22399 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:11.993559 22516 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:11.908102 24043 consensus_queue.cc:1059] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:17:11.996496 22402 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:17:11.998378 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 194557us
I20260709 12:17:11.907537 22394 rpcz_store.cc:276] 0709 12:17:10.582789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.149748 (+566959us) service_pool.cc:224] Handling call
0709 12:17:11.836761 (+687013us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:12.107843 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 114344us
W20260709 12:17:12.143085 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 141637us
W20260709 12:17:12.165957 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 56249.6us
I20260709 12:17:12.168759 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:11.997349 23864 raft_consensus.cc:697] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 4 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:11.993206 23904 raft_consensus.cc:697] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:17:12.179525 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 274943us
W20260709 12:17:12.185271 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 257882us
W20260709 12:17:12.186687 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.187139 22366 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
W20260709 12:17:12.188436 22367 leader_election.cc:336] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.623s (SENT)
I20260709 12:17:12.185737 23931 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:12.195863 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1275) took 1136 ms. Trace:
I20260709 12:17:12.196259 22476 rpcz_store.cc:276] 0709 12:17:11.059090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.781664 (+722574us) service_pool.cc:224] Handling call
0709 12:17:12.195653 (+413989us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400110154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:12.195803 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237943168}
I20260709 12:17:12.204344 22469 raft_consensus.cc:1275] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:17:12.204738 22469 pending_rounds.cc:85] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 1
I20260709 12:17:12.195446 22442 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:12.161104 24062 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:12.204957 22469 pending_rounds.cc:107] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 3.2
W20260709 12:17:12.207075 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 264667us
I20260709 12:17:12.207155 22469 raft_consensus.cc:2889] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:12.168186 24067 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:17:12.187286 24071 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.404s	user 0.003s	sys 0.004s
I20260709 12:17:12.189898 23931 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.211212 24009 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:12.194234 24050 log.cc:927] Time spent T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 1.639s	user 0.000s	sys 0.013s
I20260709 12:17:12.214701 22441 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:12.186004 24043 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:12.189947 23955 raft_consensus.cc:3055] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:12.193176 23915 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:12.221136 22441 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:12.220193 23931 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.211887 24084 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:12.235459 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 55059.7us
I20260709 12:17:12.203263 24034 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:17:12.236990 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:17:12.244433 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 52190.9us
I20260709 12:17:12.229719 23915 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:12.221863 23955 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:12.221614 24043 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:12.229020 24067 raft_consensus.cc:697] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:12.238070 24084 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:12.236409 23676 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:17:12.271891 24041 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:12.221967 24009 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:12.247323 23915 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.278138 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:12.282315 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:12.283932 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:12.250018 24043 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:12.285861 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:12.243824 23904 consensus_queue.cc:237] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:12.290457 24079 log.cc:927] Time spent T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:17:12.284919 24076 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:12.297027 24076 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:12.297549 24076 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:12.280894 24044 consensus_queue.cc:1059] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:17:12.230710 24062 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:12.307819 23955 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:12.308609 24062 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:12.309427 23955 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.309902 24004 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:12.273828 24084 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.311905 24060 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:12.312300 24060 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.312649 24060 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.315554 23767 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:12.248054 23864 consensus_queue.cc:237] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:12.323051 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1287) took 1204 ms. Trace:
I20260709 12:17:12.323482 22474 rpcz_store.cc:276] 0709 12:17:11.118892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.834212 (+715320us) service_pool.cc:224] Handling call
0709 12:17:11.898096 (+ 63884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.898804 (+   708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:12.322838 (+424034us) spinlock_profiling.cc:243] Waited 63.6 ms on lock 0x7b54002008d0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:12.322969 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146220800}
I20260709 12:17:12.334928 23676 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:12.335654 23676 raft_consensus.cc:697] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:17:12.337410 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 55168.9us
W20260709 12:17:12.337901 22551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1335) took 1731 ms (client timeout 1754 ms). Trace:
I20260709 12:17:12.277745 23930 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:12.350904 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 65145.1us
W20260709 12:17:12.348857 22551 rpcz_store.cc:269] 0709 12:17:10.606470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.606601 (+   131us) service_pool.cc:224] Handling call
0709 12:17:12.337672 (+1731071us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54004213d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:12.337843 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367492480}
I20260709 12:17:12.277583 24077 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:12.382484 22367 leader_election.cc:336] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.942s (SENT)
W20260709 12:17:12.394084 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.386863 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:12.394627 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.387671 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.389536 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.395570 22548 raft_consensus.cc:2393] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:12.390487 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.396234 22543 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:12.397315 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.398869 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.403362 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:12.404023 22543 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.395262 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:12.409013 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.409679 22545 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:12.409922 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.411211 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.416558 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.417361 22545 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:12.417819 22547 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:12.418576 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.419297 22548 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:12.337196 24041 consensus_queue.cc:1059] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 12:17:12.421298 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.425017 22550 raft_consensus.cc:2410] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:17:12.420872 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 190040us
I20260709 12:17:12.349699 24062 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:12.432562 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.356977 23959 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.336705 23676 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:12.383630 24086 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.435478 22551 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:12.439714 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:12.610258 24086 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:12.610812 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 171201us
I20260709 12:17:12.611625 22475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 1153) took 2033 ms. Trace:
W20260709 12:17:12.443951 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.445084 22543 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:12.611968 22475 rpcz_store.cc:276] 0709 12:17:10.578509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.950953 (+372444us) service_pool.cc:224] Handling call
0709 12:17:12.611487 (+1660534us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b5400211954. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:12.611579 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110798208}
W20260709 12:17:12.612618 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.330644 24054 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:12.405560 23930 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:12.613459 23930 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.613919 24086 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:12.614537 24054 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:12.613555 22515 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:12.453234 24052 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:12.516729 23131 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41028 (request call id 247) took 1933 ms (client timeout 1840 ms). Trace:
I20260709 12:17:12.535415 24043 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:12.536278 23757 raft_consensus.cc:3055] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:12.463976 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.615137 24054 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:12.618455 22543 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:12.619060 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.619295 24043 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:12.619467 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.438668 24062 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:12.619756 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:12.620041 24086 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:12.541600 23127 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 4 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:17:12.620438 24086 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:12.620909 24086 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.621380 24062 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:12.616164 23131 rpcz_store.cc:269] 0709 12:17:10.583775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.583961 (+   186us) service_pool.cc:224] Handling call
0709 12:17:12.516471 (+1932510us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54005b0254. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:12.516637 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396439424}
I20260709 12:17:12.618052 23757 raft_consensus.cc:740] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:12.620374 22474 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2.
I20260709 12:17:12.622910 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:12.623514 22475 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:12.540947 23915 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:12.623977 22544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 984) took 1361 ms. Trace:
W20260709 12:17:12.550382 24081 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:17:12.556757 24076 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:12.621587 24052 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:12.614728 23989 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.625753 23915 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:12.547891 24060 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:12.626147 23989 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:12.626787 22551 raft_consensus.cc:1240] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:12.619836 22549 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 4: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:12.627920 24060 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:12.628111 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.629212 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.626067 24076 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:12.557442 23931 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:12.630291 23930 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:12.631315 22550 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:12.631965 23931 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:12.632601 22546 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:12.632772 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:12.633000 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.633388 22474 raft_consensus.cc:2376] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4. Re-sending same reply.
I20260709 12:17:12.633656 22550 raft_consensus.cc:2393] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 4: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:12.634079 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:12.635000 22476 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.634070 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:12.582732 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 303855us
I20260709 12:17:12.586350 23751 tablet_bootstrap.cc:492] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:17:12.464283 24067 consensus_queue.cc:237] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:17:12.589560 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 205353us
I20260709 12:17:12.595731 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:12.582585 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 234372us
I20260709 12:17:12.535537 24077 consensus_queue.cc:1059] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 12:17:12.601516 24009 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:12.607929 24073 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.828s	user 0.004s	sys 0.001s
I20260709 12:17:12.422518 24004 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:12.432412 24034 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:17:12.622560 23757 consensus_queue.cc:260] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:12.576736 24084 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:12.634231 22473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1273) took 1575 ms. Trace:
I20260709 12:17:12.634209 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:12.639104 22543 raft_consensus.cc:2368] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4.
I20260709 12:17:12.639348 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1289) took 1509 ms. Trace:
I20260709 12:17:12.598707 22366 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:12.661171 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:12.697746 23131 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:12.671389 22476 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:12.675261 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.678345 22471 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:12.694201 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:12.701186 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:12.701566 22470 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:12.697400 22469 rpcz_store.cc:276] 0709 12:17:11.130164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.836219 (+706055us) service_pool.cc:224] Handling call
0709 12:17:12.197220 (+361001us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:12.216110 (+ 18890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:12.639131 (+423021us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b5400110150. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:12.639282 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829545728}
I20260709 12:17:12.682669 24054 raft_consensus.cc:3055] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:12.695621 22473 rpcz_store.cc:276] 0709 12:17:11.058532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.806986 (+748454us) service_pool.cc:224] Handling call
0709 12:17:11.807238 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.888861 (+ 81623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.888891 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:11.888933 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:11.888961 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:12.634015 (+745054us) spinlock_profiling.cc:243] Waited 81.4 ms on lock 0x7b5400161054. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:12.634055 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:12.634168 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187279104}
I20260709 12:17:12.695786 24009 consensus_queue.cc:1059] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:17:12.624377 22544 rpcz_store.cc:276] 0709 12:17:11.262927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.336798 (+ 73871us) service_pool.cc:224] Handling call
0709 12:17:12.615514 (+1278716us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b5800010b98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:17:12.623450 (+  7936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:12.623649 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:12.623677 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:12.623726 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:12.623762 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:12.623829 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:12.623929 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5290368}
I20260709 12:17:12.702847 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.703435 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:12.706624 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 108017us
I20260709 12:17:12.705235 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:12.707878 22471 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:12.708649 22366 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:12.704258 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:12.709692 22469 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:12.704592 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:12.711644 22442 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:12.716073 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:12.716710 23131 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:12.719435 22366 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:12.695003 23803 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.359s	user 0.009s	sys 0.028s
I20260709 12:17:12.723510 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:12.725454 22474 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:12.721657 22442 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:12.722429 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.722780 22366 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:12.720831 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:12.703755 24065 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 1.577s	user 0.004s	sys 0.034s
I20260709 12:17:12.728816 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.729353 24098 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:17:12.729996 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.731334 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.727648 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.733032 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:12.722618 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:12.733999 23131 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
W20260709 12:17:12.702546 24097 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.004s
I20260709 12:17:12.695470 24004 raft_consensus.cc:697] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:12.735880 22545 raft_consensus.cc:2393] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 3: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:12.691185 24043 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:17:12.704443 24009 consensus_queue.cc:1243] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:12.718765 24076 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:12.750499 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:12.703176 24054 raft_consensus.cc:740] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:12.750859 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:12.752442 22399 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:12.749060 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:12.761564 22397 raft_consensus.cc:2410] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:12.761739 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:12.721340 23932 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:12.721261 24060 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:12.731103 23803 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.389s	user 0.010s	sys 0.028s
I20260709 12:17:12.720990 23757 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.749444 23990 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:12.704627 24084 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:12.754663 22401 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.736596 22366 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:12.775678 22542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1343) took 1852 ms (client timeout 1582 ms). Trace:
I20260709 12:17:12.775991 22366 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:12.762352 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:12.754949 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:12.776391 22542 rpcz_store.cc:269] 0709 12:17:10.922864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.960161 (+ 37297us) service_pool.cc:224] Handling call
0709 12:17:12.775469 (+1815308us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54001e9954. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:12.775596 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279191808}
W20260709 12:17:12.737438 24096 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.114s	user 0.002s	sys 0.010s
I20260709 12:17:12.777813 23915 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:12.778240 23915 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:12.778609 23915 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.779564 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:12.724246 23127 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 3 LEARNER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:12.724581 24052 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:12.731465 24034 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:12.764761 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.731413 23959 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:12.817022 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:12.737135 24019 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:12.767249 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:12.768097 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:12.703421 23930 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:12.771183 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:12.723381 23904 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:17:12.766381 24060 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:12.754978 24099 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:12.762322 22399 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:12.777557 22397 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.813529 24052 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:12.823468 22400 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:12.825482 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:12.737061 24100 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:17:12.764056 23932 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:12.720984 23902 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:17:12.749411 24077 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:17:12.772269 22474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:17:12.871522 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:12.871930 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:12.878381 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 56562.8us
I20260709 12:17:12.781749 23990 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:12.763736 24087 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 12:17:12.811519 23989 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:12.766521 24062 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:17:12.788300 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:12.771634 24076 raft_consensus.cc:697] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:12.771772 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:12.937311 24058 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 1.716s	user 0.033s	sys 0.015s
I20260709 12:17:12.939365 22544 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:17:12.881186 22367 leader_election.cc:336] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.562s (SENT)
I20260709 12:17:12.940060 22367 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:12.940574 22544 raft_consensus.cc:3055] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:17:12.940928 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 59780.9us
W20260709 12:17:12.941717 22367 leader_election.cc:336] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.589s (SENT)
I20260709 12:17:12.805310 22401 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:12.943498 22550 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:12.817049 23959 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:12.826099 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:12.872115 24060 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.825929 24019 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:12.872097 24044 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:12.930866 22399 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
W20260709 12:17:12.893050 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 185121us
I20260709 12:17:12.931767 23990 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.824956 24034 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:12.883566 24099 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:17:12.935379 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 159471us
I20260709 12:17:12.877864 24095 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:12.776830 24004 consensus_queue.cc:237] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:12.889955 24052 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.023913 22549 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:13.013628 22397 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:13.033174 24059 consensus_queue.cc:1059] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:13.031069 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:13.035670 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:12.879976 24112 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:13.042783 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:13.027715 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:12.892400 23932 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.942519 24076 consensus_queue.cc:237] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:13.033674 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:12.941850 24100 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.934726 23945 consensus_queue.cc:1059] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 12:17:12.880609 24054 consensus_queue.cc:260] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.034917 23959 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:13.042647 24095 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.053234 24054 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.055004 24095 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:13.040038 24098 consensus_queue.cc:1059] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:13.034489 24077 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.040935 24105 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:13.055747 24077 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.055785 24105 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:13.057104 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1033) took 2052 ms. Trace:
I20260709 12:17:13.039937 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:13.057960 24105 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:13.031701 24099 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:13.036981 24044 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:13.061725 24077 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:13.062395 24044 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:13.064800 23131 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.950625 24106 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:13.066236 24106 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:13.067121 24108 log.cc:927] Time spent T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:17:12.931164 22474 raft_consensus.cc:606] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:13.047648 24061 raft_consensus.cc:3055] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:13.048314 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:13.029685 24019 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.940935 22544 raft_consensus.cc:740] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:13.049753 24034 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:13.050001 23122 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:17:13.040925 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:13.083094 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:13.006090 24107 log.cc:927] Time spent T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:17:13.040361 24086 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:13.068540 22474 raft_consensus.cc:614] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:13.057498 22398 rpcz_store.cc:276] 0709 12:17:11.005153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.249373 (+244220us) service_pool.cc:224] Handling call
0709 12:17:11.851636 (+602263us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:11.851982 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.852011 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:11.852685 (+   674us) log.cc:844] Serialized 52 byte log entry
0709 12:17:12.201944 (+349259us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:12.201990 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:12.202068 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:12.763444 (+561376us) raft_consensus.cc:1685] finished
0709 12:17:12.763462 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.056841 (+293379us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b540005e6d0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:13.057041 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1279,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"spinlock_wait_cycles":1384212224,"thread_start_us":348846,"threads_started":1,"wal-append.queue_time_us":431290}
I20260709 12:17:13.071846 23131 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
W20260709 12:17:13.089103 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 147411us
I20260709 12:17:13.068848 22366 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:13.074545 24106 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:13.075557 24098 raft_consensus.cc:3055] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:13.042205 22396 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:17:13.035147 24091 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:13.078936 24112 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:17:13.080832 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 53188.8us
I20260709 12:17:13.117868 22550 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:13.118517 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:13.086568 22441 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:13.046267 22546 raft_consensus.cc:2393] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:17:13.092020 22367 leader_election.cc:336] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.616s (SENT)
I20260709 12:17:13.093101 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:13.089988 23930 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:13.079355 23915 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:13.082078 24061 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:13.120102 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:13.123351 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:13.118983 22549 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
W20260709 12:17:13.125622 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.095396 24034 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:13.095816 24098 raft_consensus.cc:740] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:13.095510 24115 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:13.131002 22441 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:13.124529 24106 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:13.141566 24122 log.cc:927] Time spent T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:17:13.143579 23915 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:13.143832 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.146829 24086 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:13.117918 24063 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:17:13.152196 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:13.119719 23904 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:17:13.115217 24099 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.173477 24088 raft_consensus.cc:3055] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:13.173935 24088 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:13.174644 24099 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:13.155732 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:13.174767 24088 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.175469 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:13.156694 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:13.175840 24088 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.176285 22395 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:13.176164 24098 consensus_queue.cc:260] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.157119 22396 raft_consensus.cc:1240] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:13.177402 24098 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.132061 24085 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:13.158164 24060 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.133648 23930 raft_consensus.cc:2764] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:17:13.109750 22544 consensus_queue.cc:260] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.159322 24061 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.160269 24112 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.160953 24052 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.139217 22441 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:17:13.130592 24054 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:13.167279 22476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:17:13.169685 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:13.135007 24115 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:13.201498 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 77999us
W20260709 12:17:13.201817 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 78512.6us
I20260709 12:17:13.179865 22399 raft_consensus.cc:1240] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:13.202384 22367 leader_election.cc:336] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.664s (SENT)
I20260709 12:17:13.191496 22544 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:13.171209 24116 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.082s	user 0.003s	sys 0.000s
I20260709 12:17:13.138599 24121 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:13.161710 24034 raft_consensus.cc:697] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 4 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:17:13.195924 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 56764.8us
W20260709 12:17:13.274956 23095 leader_election.cc:336] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.836s (SENT)
I20260709 12:17:13.189983 23129 raft_consensus.cc:2368] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4.
I20260709 12:17:13.203106 22367 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
W20260709 12:17:13.279934 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 77578.2us
W20260709 12:17:13.280822 22367 leader_election.cc:336] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.763s (SENT)
I20260709 12:17:13.278698 22441 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:17:13.205228 22476 raft_consensus.cc:606] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:13.238554 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.127780 24091 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.258798 22547 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:13.287505 22397 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:13.239746 22551 raft_consensus.cc:1240] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:13.288347 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.288838 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:13.199570 24019 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.261211 23915 consensus_queue.cc:1059] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:17:13.259464 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:13.190434 24099 consensus_queue.cc:1059] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:17:13.293820 24099 raft_consensus.cc:3055] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:13.294245 24099 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:13.294723 24019 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:12.721159 23931 consensus_queue.cc:1175] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "65951063312d4a1e9123f92354101c71" responder_term: 4 status { last_received { term: 4 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: [3.5-3.5]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:13.288760 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.201191 24115 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.281919 24085 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:13.296223 22402 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:13.295156 24099 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.289902 24041 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:13.297250 24041 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:13.297612 22515 leader_election.cc:400] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4.
I20260709 12:17:13.297967 22515 leader_election.cc:403] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:17:13.298861 24127 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:13.299343 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 118954us
I20260709 12:17:13.301088 23904 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:13.301031 24121 consensus_queue.cc:1059] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:13.301661 23904 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.302184 24121 raft_consensus.cc:3055] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:13.302592 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:13.305505 22399 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:13.201980 24044 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:13.238147 24061 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.199646 23959 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.201798 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:13.264957 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:13.278738 23095 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:13.283934 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.284253 22470 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:17:13.334993 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 60101.9us
I20260709 12:17:13.284689 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.335927 22469 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:13.284943 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.338394 22477 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:13.285409 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.286154 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.289472 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:13.291219 22547 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:13.339588 22475 raft_consensus.cc:2393] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 2: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:17:13.293035 24120 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:17:13.305253 22442 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:13.274448 23803 raft_consensus.cc:3055] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:13.346095 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.346621 22475 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 1.
W20260709 12:17:13.316588 22367 leader_election.cc:336] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.954s (SENT)
I20260709 12:17:13.326853 22516 leader_election.cc:400] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5.
I20260709 12:17:13.348090 22516 leader_election.cc:403] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:17:13.349814 22516 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:13.295934 22468 raft_consensus.cc:2393] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:13.330996 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:13.330483 24044 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.332615 24091 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:13.341046 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 76185.5us
I20260709 12:17:13.334905 22473 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:13.297009 24099 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.343910 22442 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:13.361840 22442 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:13.361862 22401 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:13.297648 24041 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:13.348016 22367 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:13.329334 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.351207 22516 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:13.356279 22472 raft_consensus.cc:2376] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4. Re-sending same reply.
W20260709 12:17:13.367668 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 51127.9us
I20260709 12:17:13.354019 24110 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:17:13.363112 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:13.362489 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:13.302207 24009 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:13.302568 24121 raft_consensus.cc:740] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:13.378216 24121 consensus_queue.cc:260] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.379463 24121 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:13.383875 23904 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:13.345322 23803 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:13.344889 24019 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:13.358613 24042 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:17:13.386183 24019 raft_consensus.cc:697] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:13.387086 24019 consensus_queue.cc:237] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:13.389892 22476 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:13.369867 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:13.385473 24085 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:13.343179 24060 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:13.373160 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.344952 24063 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.374393 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.370564 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.409787 22544 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:17:13.432062 22473 raft_consensus.cc:2376] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5. Re-sending same reply.
I20260709 12:17:13.432413 22544 pending_rounds.cc:85] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 1
I20260709 12:17:13.392989 22543 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:13.355340 22396 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:13.429790 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 60881.5us
I20260709 12:17:13.372534 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.339463 24106 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:13.431559 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.366609 24103 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:13.358405 23930 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:13.354612 23989 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5.
W20260709 12:17:13.444150 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.436859 22470 raft_consensus.cc:2368] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4.
I20260709 12:17:13.432914 22544 pending_rounds.cc:107] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:13.362001 24044 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:13.438287 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 68641.5us
I20260709 12:17:13.390391 24086 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.439663 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.453059 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.453668 22476 raft_consensus.cc:2368] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4.
I20260709 12:17:13.354089 23864 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 12:17:13.393646 22442 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:13.361088 23945 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 12:17:13.331110 24034 consensus_queue.cc:237] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:13.447113 22544 raft_consensus.cc:2889] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:13.447477 23930 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.433974 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.450793 22516 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:13.518527 22477 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
W20260709 12:17:13.518666 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 125107us
I20260709 12:17:13.391516 23955 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:17:13.451242 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.440548 24106 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:13.438845 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.438302 24102 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:17:13.441392 23526 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:13.462472 24126 log.cc:927] Time spent T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:17:13.463063 23959 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:13.394248 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:13.490341 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.438120 22472 raft_consensus.cc:1240] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:13.519968 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.429901 24077 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:13.450393 24103 raft_consensus.cc:697] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:13.391685 23797 consensus_queue.cc:1059] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 12:17:13.522471 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.544688 23955 raft_consensus.cc:697] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:13.564600 22549 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:17:13.566691 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:13.547366 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 96676.1us
W20260709 12:17:13.547492 22367 leader_election.cc:336] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.061s (SENT)
I20260709 12:17:13.576081 22367 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:13.478729 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.563092 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.520998 23930 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:13.546399 22442 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:13.557690 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:13.577275 22477 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:13.581996 22472 raft_consensus.cc:2376] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5. Re-sending same reply.
I20260709 12:17:13.522996 24105 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:17:13.558332 24131 log.cc:927] Time spent T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:17:13.589095 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.589382 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.539778 24106 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:13.564236 24101 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:17:13.627671 24084 consensus_queue.cc:1059] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:13.628422 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.639400 22472 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:13.639886 23129 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:13.634541 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:13.645831 22477 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.585791 23767 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:13.622493 23797 consensus_queue.cc:1243] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:13.624691 23989 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.590078 24105 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:13.622741 24095 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:13.667505 24130 log.cc:927] Time spent T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:17:13.674811 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.591802 24052 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:13.623245 24077 raft_consensus.cc:697] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:13.671111 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.686923 22470 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:13.687916 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.688990 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.635712 24127 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4.
I20260709 12:17:13.628381 24074 consensus_queue.cc:1059] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:17:13.690732 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.563833 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:17:13.692093 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 115889us
W20260709 12:17:13.692962 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 145505us
W20260709 12:17:13.701241 22367 leader_election.cc:336] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.073s (SENT)
I20260709 12:17:13.701730 22367 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:13.707144 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:13.673319 24105 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:13.658412 24091 consensus_queue.cc:1059] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
W20260709 12:17:13.716656 22367 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.089s (SENT) [suppressed 35 similar messages]
I20260709 12:17:13.673486 24095 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:13.719868 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:13.720198 24135 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 12:17:13.720489 23959 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:17:13.721401 24138 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:17:13.728174 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:13.729717 22472 raft_consensus.cc:1240] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:13.729903 24095 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.690809 23767 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:17:13.744234 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.730258 23955 consensus_queue.cc:237] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.706452 24103 consensus_queue.cc:237] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.764355 23526 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:13.765039 22367 leader_election.cc:336] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.169s (SENT)
I20260709 12:17:13.769497 22472 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:13.781991 22367 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:13.782838 22477 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
W20260709 12:17:13.785353 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 148116us
I20260709 12:17:13.790853 23526 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:13.815387 23526 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.830789 22546 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:17:13.831270 22546 pending_rounds.cc:85] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 4
I20260709 12:17:13.831506 22546 pending_rounds.cc:107] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:17:13.831730 22546 raft_consensus.cc:2889] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:13.793097 23797 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:13.822428 24139 log.cc:927] Time spent T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:17:13.514866 23902 raft_consensus.cc:2955] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:17:13.867558 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 102534us
W20260709 12:17:13.867709 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 111912us
W20260709 12:17:13.871088 22367 leader_election.cc:336] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.202s (SENT)
I20260709 12:17:13.871569 22367 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:13.872529 22367 leader_election.cc:336] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.208s (SENT)
W20260709 12:17:13.873131 22474 consensus_meta.cc:287] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.002s
I20260709 12:17:13.873468 22474 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:13.870690 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:13.800067 23767 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.875330 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
W20260709 12:17:13.867997 24138 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:17:13.878613 22477 raft_consensus.cc:1240] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:13.882092 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
W20260709 12:17:13.853637 24098 consensus_meta.cc:287] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.676s	user 0.007s	sys 0.011s
I20260709 12:17:13.887384 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.876962 23797 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:13.896159 24041 consensus_meta.cc:287] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.000s
I20260709 12:17:13.888403 24084 raft_consensus.cc:3055] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:13.898412 22398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:17:13.912533 22398 raft_consensus.cc:606] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:13.912962 22398 raft_consensus.cc:614] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:13.820819 24077 consensus_queue.cc:237] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:13.902715 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:13.877511 23931 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:13.906878 24115 consensus_meta.cc:287] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.578s	user 0.009s	sys 0.000s
I20260709 12:17:13.887792 24127 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:13.907480 24121 consensus_meta.cc:287] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.528s	user 0.003s	sys 0.006s
I20260709 12:17:13.890328 23676 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:13.918251 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:13.931565 22477 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.911979 24084 raft_consensus.cc:740] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:17:13.947691 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.949294 22476 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:13.916383 23931 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:13.927295 24127 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.930425 23676 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:13.941848 24119 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.010s	sys 0.007s
I20260709 12:17:13.933996 24067 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:13.914259 24041 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:13.963057 23123 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:13.999254 24088 consensus_meta.cc:287] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.823s	user 0.011s	sys 0.000s
I20260709 12:17:14.000088 22471 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
W20260709 12:17:14.002563 24099 consensus_meta.cc:287] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.642s	user 0.010s	sys 0.000s
I20260709 12:17:13.997352 24095 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:14.005959 22475 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:14.007737 22477 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:14.008731 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:14.016939 23526 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:14.019398 23526 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:14.020690 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49290 (request call id 83) took 1088 ms. Trace:
I20260709 12:17:14.021099 22546 rpcz_store.cc:276] 0709 12:17:12.932433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.129964 (+197531us) service_pool.cc:224] Handling call
0709 12:17:13.130271 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:13.830441 (+700170us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b540002fe20. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8acbdc0 00007fb4f8b561c0 00007fb4f8b57231 00007fb4f8b53d8f 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c
0709 12:17:13.832182 (+  1741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:14.020462 (+188280us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54001400d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:14.020635 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380138752}
W20260709 12:17:14.023443 23932 consensus_meta.cc:287] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.926s	user 0.011s	sys 0.007s
W20260709 12:17:13.968802 24119 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.011s	sys 0.008s
W20260709 12:17:14.024158 24141 log.cc:927] Time spent T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.276s	user 0.000s	sys 0.025s
I20260709 12:17:13.957947 23931 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:13.958974 24127 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.023473 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:17:14.054288 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.968390 23676 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:13.928105 24115 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:14.059767 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:14.059547 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:14.404089 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:17:14.052531 23990 consensus_meta.cc:287] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 1.003s	user 0.011s	sys 0.000s
I20260709 12:17:14.060664 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:14.403648 22477 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:14.412804 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:14.412959 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:14.413506 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:14.414045 22477 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:14.412577 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 351967us
I20260709 12:17:14.416968 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:14.212975 22398 raft_consensus.cc:1240] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:14.406786 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:14.216382 22401 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:17:14.059939 22472 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:14.410871 22551 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:14.006003 24095 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:14.280248 24044 consensus_meta.cc:287] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.802s	user 0.008s	sys 0.002s
W20260709 12:17:14.277750 23930 consensus_meta.cc:287] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.649s	user 0.009s	sys 0.001s
I20260709 12:17:14.149338 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49290 (request call id 79) took 1533 ms. Trace:
W20260709 12:17:14.144587 24151 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:17:14.458994 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:14.413599 22399 raft_consensus.cc:2393] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:14.256855 23864 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:14.426723 22549 raft_consensus.cc:1240] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:14.465571 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:14.392228 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 93) took 1110 ms. Trace:
I20260709 12:17:14.450919 22545 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:17:14.142335 24142 log.cc:927] Time spent T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.246s	user 0.002s	sys 0.000s
I20260709 12:17:14.455439 22550 raft_consensus.cc:1240] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:14.455657 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:14.403259 23767 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:14.489604 22477 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:14.279630 23797 consensus_queue.cc:1059] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.188s
I20260709 12:17:14.457574 22551 raft_consensus.cc:1217] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Deduplicated request from leader. Original: 1.2->[3.3-3.4]   Dedup: 3.3->[3.4-3.4]
I20260709 12:17:14.032094 24067 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:14.250550 24085 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.446384 22471 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:14.144697 24117 raft_consensus.cc:3055] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:17:14.186077 24148 log.cc:927] Time spent T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.287s	user 0.003s	sys 0.000s
I20260709 12:17:14.469172 23959 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.448269 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:14.463176 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:14.443852 23989 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:14.057003 23932 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:14.450879 24112 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.013s	sys 0.009s
I20260709 12:17:14.547048 22543 raft_consensus.cc:2955] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:14.535003 24115 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:14.515044 22396 consensus_meta.cc:287] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 1.068s	user 0.025s	sys 0.032s
I20260709 12:17:14.482440 22395 rpcz_store.cc:276] 0709 12:17:13.282291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.286593 (+  4302us) service_pool.cc:224] Handling call
0709 12:17:13.289177 (+  2584us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:13.302745 (+ 13568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:13.302779 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:13.303288 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 12:17:13.622699 (+319411us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:13.629096 (+  6397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.661353 (+ 32257us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:14.278980 (+617627us) raft_consensus.cc:1685] finished
0709 12:17:14.279766 (+   786us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:14.389617 (+109851us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11127,"raft.queue_time_us":11115,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":19984,"thread_start_us":258448,"threads_started":1,"wal-append.queue_time_us":381103}
I20260709 12:17:14.549232 22396 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:14.549860 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1066) took 1367 ms. Trace:
I20260709 12:17:14.550311 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:14.550258 22396 rpcz_store.cc:276] 0709 12:17:13.182240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.185865 (+  3625us) service_pool.cc:224] Handling call
0709 12:17:14.549695 (+1363830us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:14.551282 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:14.551687 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:14.148324 24052 raft_consensus.cc:3055] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:17:14.586403 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.507058 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:14.443852 23990 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:14.184697 24060 raft_consensus.cc:3055] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:14.488010 23864 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:14.137079 24084 consensus_queue.cc:260] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:14.505721 23122 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:14.534209 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:14.458225 24044 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:14.541019 22475 raft_consensus.cc:2368] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4.
I20260709 12:17:14.508759 23767 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.542266 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:14.533682 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:14.625406 22400 raft_consensus.cc:2410] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:14.511147 24085 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:14.458007 22401 pending_rounds.cc:85] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 1
I20260709 12:17:14.632715 22401 pending_rounds.cc:107] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:14.633050 22401 raft_consensus.cc:2889] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:14.461082 23930 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:14.495568 22551 raft_consensus.cc:1240] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: [3.3-3.4]
I20260709 12:17:14.549778 22393 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:14.558141 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:14.531348 24106 consensus_meta.cc:287] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.869s	user 0.009s	sys 0.000s
W20260709 12:17:14.517647 24157 log.cc:927] Time spent T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:17:14.615933 22548 raft_consensus.cc:1240] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:14.618410 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:14.618646 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:14.612362 24052 raft_consensus.cc:740] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:14.552174 22468 raft_consensus.cc:2410] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:14.620692 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:14.680645 22475 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:14.488144 23123 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:17:14.620409 23131 raft_consensus.cc:2955] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:14.615648 24060 raft_consensus.cc:740] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:14.622591 24084 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:14.655613 24061 consensus_meta.cc:287] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 1.324s	user 0.015s	sys 0.006s
I20260709 12:17:14.551715 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:14.621999 22469 raft_consensus.cc:2393] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:14.622030 22441 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:14.546864 24112 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.014s	sys 0.009s
W20260709 12:17:14.551327 24152 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.473s	user 0.002s	sys 0.000s
I20260709 12:17:14.509467 24041 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:14.508570 24117 raft_consensus.cc:740] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:14.625597 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:14.552625 24007 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:14.633286 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:14.545784 24101 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.768222 22477 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:14.768332 24117 consensus_queue.cc:260] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:14.769361 22400 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:14.769498 24117 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:14.550266 23989 raft_consensus.cc:697] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:14.649629 23767 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:14.774570 23989 consensus_queue.cc:237] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:14.775974 23767 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:14.777108 22395 raft_consensus.cc:2410] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:14.552151 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:14.651484 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:14.654254 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 177533us
I20260709 12:17:14.779430 22398 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:14.622674 24044 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:14.691490 22471 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:14.679572 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:14.682490 23123 pending_rounds.cc:85] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: Aborting all ops after (but not including) 3
W20260709 12:17:14.715169 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 227332us
I20260709 12:17:14.686693 24019 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:14.549463 23932 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:14.778146 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 60567.2us
I20260709 12:17:14.779397 22401 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:14.781247 22471 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:14.546319 23959 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:14.820916 23959 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:14.821868 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:14.822669 22550 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:14.784976 22400 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:14.825384 22400 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:17:14.788184 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 322810us
I20260709 12:17:14.792686 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:14.768584 24101 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:14.654690 24106 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:14.814826 22397 raft_consensus.cc:2393] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 4: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:17:14.764997 23931 consensus_meta.cc:287] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.000s
I20260709 12:17:14.828742 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:14.811717 23123 pending_rounds.cc:107] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 12:17:14.832059 22400 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:14.828789 22367 leader_election.cc:336] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.248s (SENT)
I20260709 12:17:14.691185 23676 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:14.855978 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.849016 22550 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
W20260709 12:17:14.856572 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.850591 24147 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:14.852697 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.854698 22442 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:14.838752 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:17:14.857007 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.868147 23676 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:14.839150 23123 raft_consensus.cc:2917] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 12:17:14.869678 23123 raft_consensus.cc:2889] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 4 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:14.870231 24159 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.871163 23129 raft_consensus.cc:1240] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 4 LEARNER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:14.870744 24159 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:14.874464 22366 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:14.878249 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:14.879058 22551 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:14.835602 24112 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:14.840122 24059 raft_consensus.cc:3055] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:14.899896 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:14.900725 22550 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:14.823024 24019 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:14.921948 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 67324.1us
I20260709 12:17:14.846877 23767 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:17:14.826275 24175 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:17:14.847321 24115 consensus_queue.cc:1059] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:17:14.848687 24100 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:17:14.891136 24044 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:14.865100 23797 consensus_queue.cc:1059] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:17:14.848869 23931 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:14.855783 24156 consensus_queue.cc:1059] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
W20260709 12:17:14.928714 24105 consensus_meta.cc:287] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 1.179s	user 0.006s	sys 0.004s
I20260709 12:17:14.902729 24061 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:14.817024 24052 consensus_queue.cc:260] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:14.902951 22468 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:14.927395 22442 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:15.041381 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:14.835269 24060 consensus_queue.cc:260] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:14.926098 23990 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:14.874037 24147 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:14.899444 24059 raft_consensus.cc:740] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:15.068761 22546 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:17:15.069583 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 142267us
I20260709 12:17:15.070966 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:15.073022 24052 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:15.073486 24091 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:15.118381 24091 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:15.118885 24091 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:15.074072 23959 consensus_queue.cc:1059] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:15.122166 23959 consensus_queue.cc:1243] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:15.075799 24159 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:15.024318 24054 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:15.123836 24054 raft_consensus.cc:697] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:14.902428 24112 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:15.127677 24112 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:15.042225 24175 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.129709 24175 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:15.132169 24175 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:15.133720 24121 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.134373 24121 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:15.137147 24121 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:15.087581 23095 leader_election.cc:336] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.501s (SENT)
I20260709 12:17:15.137988 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:15.138916 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 51378.1us
I20260709 12:17:15.080390 22442 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:15.140553 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 60252.1us
I20260709 12:17:15.143828 23955 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:15.144124 24044 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.144392 23955 raft_consensus.cc:697] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:15.144716 24159 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:15.145200 24159 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:15.145305 23955 consensus_queue.cc:237] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:15.148028 24159 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:15.125064 24054 consensus_queue.cc:237] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:15.179145 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.062131 24105 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:15.152266 23930 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:15.174113 24085 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:15.081348 24115 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 12:17:15.042847 23803 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:15.177982 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1166) took 1286 ms. Trace:
I20260709 12:17:15.187182 24067 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:15.211198 22470 raft_consensus.cc:2393] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 2: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:15.175452 24044 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:14.461968 22542 rpcz_store.cc:276] 0709 12:17:12.616032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.777324 (+161292us) service_pool.cc:224] Handling call
0709 12:17:13.064344 (+287020us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5800010b98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:17:13.160887 (+ 96543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:13.161323 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:13.344385 (+183062us) log.cc:844] Serialized 14 byte log entry
0709 12:17:13.718301 (+373916us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:13.840599 (+122298us) log.cc:844] Serialized 26 byte log entry
0709 12:17:13.853786 (+ 13187us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:13.875172 (+ 21386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.879522 (+  4350us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:13.911188 (+ 31666us) raft_consensus.cc:1685] finished
0709 12:17:13.937558 (+ 26370us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:14.149056 (+211498us) spinlock_profiling.cc:243] Waited 96.3 ms on lock 0x7b540040f450. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:14.149245 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1380,"prepare.queue_time_us":46093,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":25,"raft.queue_time_us":32857,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":3293,"spinlock_wait_cycles":246157952,"thread_start_us":315890,"threads_started":2,"wal-append.queue_time_us":535138}
W20260709 12:17:15.217006 24127 consensus_meta.cc:287] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.806s	user 0.009s	sys 0.001s
I20260709 12:17:15.221042 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:17:15.193241 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 316638us
I20260709 12:17:15.232523 23864 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:15.402010 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1122) took 1074 ms. Trace:
I20260709 12:17:15.470832 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1342) took 1588 ms. Trace:
I20260709 12:17:15.206569 24059 consensus_queue.cc:260] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:15.401445 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:15.470302 22398 rpcz_store.cc:276] 0709 12:17:14.327380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.455395 (+128015us) service_pool.cc:224] Handling call
0709 12:17:15.401830 (+946435us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54000375d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:15.401949 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517212928}
I20260709 12:17:15.483222 22398 raft_consensus.cc:1240] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:15.471421 22472 rpcz_store.cc:276] 0709 12:17:13.882100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.882315 (+   215us) service_pool.cc:224] Handling call
0709 12:17:13.893212 (+ 10897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.459408 (+566196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.470593 (+1011185us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400161054. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:15.470768 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382969600}
W20260709 12:17:15.304291 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:15.508975 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:15.509531 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:15.509861 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.221980 24106 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:15.399914 24154 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.234902 24127 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:15.390774 24165 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:15.514869 24154 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:15.515842 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:15.516275 24180 log.cc:927] Time spent T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 12:17:15.209757 22468 rpcz_store.cc:276] 0709 12:17:13.888878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.797904 (+909026us) service_pool.cc:224] Handling call
0709 12:17:14.872746 (+ 74842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:15.077266 (+204520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.175215 (+ 97949us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:15.517459 22367 connection.cc:256] RPC call timeout handler was delayed by -1.5004790999998932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
W20260709 12:17:15.543862 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:15.544265 22367 connection.cc:256] RPC call timeout handler was delayed by -1.4608790999998291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
W20260709 12:17:15.545264 22367 leader_election.cc:336] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.655s (SENT)
W20260709 12:17:15.547143 22367 connection.cc:256] RPC call timeout handler was delayed by -1.2295015219999641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
W20260709 12:17:15.548007 22441 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.011s	sys 0.000s
W20260709 12:17:15.469322 24174 log.cc:927] Time spent T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.392s	user 0.000s	sys 0.001s
W20260709 12:17:15.341180 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:15.557909 22367 leader_election.cc:336] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.625s (SENT)
I20260709 12:17:15.565325 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:15.560616 22441 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.011s	sys 0.000s
W20260709 12:17:15.438849 23751 log.cc:927] Time spent T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 12:17:15.469799 23931 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:15.450534 24019 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:15.574424 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 952415us
I20260709 12:17:15.580035 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:15.443393 24172 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:15.607964 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:15.589265 23129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41028 (request call id 262) took 1177 ms. Trace:
I20260709 12:17:15.517385 23127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41028 (request call id 260) took 1114 ms. Trace:
W20260709 12:17:15.597536 24181 log.cc:927] Time spent T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.393s	user 0.000s	sys 0.001s
I20260709 12:17:15.598019 24189 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:15.598268 24182 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.391s	user 0.000s	sys 0.001s
W20260709 12:17:15.599562 24184 log.cc:927] Time spent T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.384s	user 0.001s	sys 0.000s
W20260709 12:17:15.600122 24183 log.cc:927] Time spent T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.382s	user 0.000s	sys 0.001s
W20260709 12:17:15.579704 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.635710 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:15.542189 23955 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:15.581439 24198 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.617568 22441 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:15.517053 24154 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:15.585655 24115 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:15.616003 23129 rpcz_store.cc:276] 0709 12:17:14.411890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.412007 (+   117us) service_pool.cc:224] Handling call
0709 12:17:14.870974 (+458967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.871540 (+   566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.589068 (+717528us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54004ced50. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:15.589207 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":964214528}
I20260709 12:17:15.653306 24041 raft_consensus.cc:3055] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:15.653859 24041 raft_consensus.cc:740] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:15.654837 24041 consensus_queue.cc:260] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:15.657033 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34092 (request call id 184) took 1209 ms. Trace:
I20260709 12:17:15.618927 24121 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.467926 24101 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:15.627272 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:15.664939 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 47475.7us
I20260709 12:17:15.608233 24147 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:15.647300 23751 tablet_bootstrap.cc:492] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:15.647593 23955 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:15.649031 24198 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:15.622219 22367 leader_election.cc:336] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.086s (SENT)
W20260709 12:17:15.669749 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 47555.3us
W20260709 12:17:15.670905 22367 leader_election.cc:336] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.116s (SENT)
I20260709 12:17:15.671293 22367 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:15.602496 24169 consensus_queue.cc:1059] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:17:15.665904 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:15.667176 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 105580us
W20260709 12:17:15.665406 23797 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.023s	sys 0.050s
I20260709 12:17:15.697217 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1049) took 2949 ms. Trace:
I20260709 12:17:15.698537 24198 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:15.635787 22468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4e53d64761746008e02335e67f74c08"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "65951063312d4a1e9123f92354101c71"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:17:15.706753 22393 rpcz_store.cc:276] 0709 12:17:12.747513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.749853 (+  2340us) service_pool.cc:224] Handling call
0709 12:17:12.750103 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.648904 (+1898801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.696925 (+1048021us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54002d8f54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:15.697135 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4138541440}
I20260709 12:17:15.657513 23125 rpcz_store.cc:276] 0709 12:17:14.447182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.451384 (+  4202us) service_pool.cc:224] Handling call
0709 12:17:15.656180 (+1204796us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b58001c5698. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:17:15.656418 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:15.656656 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:15.656688 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:15.656737 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:15.656773 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.656831 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.656965 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6837120}
I20260709 12:17:15.645833 24105 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:15.612264 24172 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:15.712754 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 43927.7us
W20260709 12:17:15.708346 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 479171us
W20260709 12:17:15.706537 23797 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.023s	sys 0.050s
I20260709 12:17:15.630857 24189 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:15.701826 24019 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:15.707751 24044 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:15.724826 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:15.726109 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:15.673822 24121 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:15.727188 22367 leader_election.cc:336] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.785s (SENT)
I20260709 12:17:15.727687 22367 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:15.728754 22367 leader_election.cc:336] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.800s (SENT)
I20260709 12:17:15.729158 24019 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:15.723171 24195 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:15.727205 24127 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:15.730275 24195 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:15.731889 22367 leader_election.cc:336] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.829s (SENT)
W20260709 12:17:15.710465 22395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.035s	sys 0.014s
I20260709 12:17:15.734079 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1170) took 1821 ms. Trace:
I20260709 12:17:15.713608 24146 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:15.735330 22471 rpcz_store.cc:276] 0709 12:17:13.912343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.818753 (+906410us) service_pool.cc:224] Handling call
0709 12:17:14.819042 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:14.872443 (+ 53401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:14.872471 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:14.891036 (+ 18565us) log.cc:844] Serialized 26 byte log entry
0709 12:17:15.231044 (+340008us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b18000ef680. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a49e07 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b 00007fb4f86f3d23 00007fb4f86f40d1 00007fb4f8b0fa0f
0709 12:17:15.620935 (+389891us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:15.620972 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.621039 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:15.732385 (+111346us) raft_consensus.cc:1685] finished
0709 12:17:15.732405 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.734017 (+  1612us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133171,"raft.queue_time_us":71811,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":6822,"spinlock_wait_cycles":58432256,"thread_start_us":388987,"threads_started":1,"wal-append.queue_time_us":816103}
I20260709 12:17:15.737426 22471 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:15.706687 24194 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:15.745587 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1344) took 1832 ms. Trace:
I20260709 12:17:15.733799 22441 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:15.735256 22395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.035s	sys 0.015s
I20260709 12:17:15.719156 24169 consensus_queue.cc:1243] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer b8621fa34be04d3fa2d68a300f858cd1 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:15.728812 24121 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:15.755546 22471 rpcz_store.cc:276] 0709 12:17:13.913161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.736889 (+1823728us) service_pool.cc:224] Handling call
0709 12:17:15.737194 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:15.745207 (+  8013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.745500 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:15.759723 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1069) took 1255 ms. Trace:
I20260709 12:17:15.739579 23751 tablet_bootstrap.cc:492] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:17:15.760476 24105 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:15.763989 22472 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:15.738719 24115 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:15.774718 22441 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:15.796641 22367 leader_election.cc:336] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.894s (SENT)
I20260709 12:17:15.802609 22367 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:15.803265 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1171) took 1885 ms. Trace:
W20260709 12:17:15.758028 24084 consensus_meta.cc:287] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 1.065s	user 0.009s	sys 0.002s
I20260709 12:17:15.740278 24077 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:15.811477 24084 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:15.812501 23932 raft_consensus.cc:3055] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:15.812924 23932 raft_consensus.cc:740] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:15.813310 22441 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:15.813530 22546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1386) took 1404 ms (client timeout 1687 ms). Trace:
I20260709 12:17:15.814112 24121 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:15.813825 23932 consensus_queue.cc:260] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:15.815012 23932 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:15.815727 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:15.816457 24121 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:15.817080 23797 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:15.803627 22471 rpcz_store.cc:276] 0709 12:17:13.918158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.802441 (+1884283us) service_pool.cc:224] Handling call
0709 12:17:15.802773 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:15.802940 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:15.802965 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:15.803008 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:15.803036 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.803087 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.803213 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:15.818159 22441 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:15.818662 22546 rpcz_store.cc:269] 0709 12:17:14.408948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.409098 (+   150us) service_pool.cc:224] Handling call
0709 12:17:15.813340 (+1404242us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b5400179154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:15.813472 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1214654720}
I20260709 12:17:15.804612 22472 raft_consensus.cc:1240] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:15.820037 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1172) took 1891 ms. Trace:
I20260709 12:17:15.820359 22472 rpcz_store.cc:276] 0709 12:17:13.928833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.804272 (+1875439us) service_pool.cc:224] Handling call
0709 12:17:15.804494 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:15.819799 (+ 15305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.819982 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:15.830771 22476 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:15.834318 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1173) took 1898 ms. Trace:
I20260709 12:17:15.834818 22472 rpcz_store.cc:276] 0709 12:17:13.936322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.821116 (+1884794us) service_pool.cc:224] Handling call
0709 12:17:15.833718 (+ 12602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:15.833930 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:15.833957 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:15.834004 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:15.834035 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.834092 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.834232 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:15.829490 24156 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:15.833379 24084 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:17:15.837133 24084 consensus_queue.cc:1243] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:15.836373 22472 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:15.840472 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1175) took 1886 ms. Trace:
I20260709 12:17:15.846051 22472 rpcz_store.cc:276] 0709 12:17:13.954152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.835785 (+1881633us) service_pool.cc:224] Handling call
0709 12:17:15.836171 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:15.839854 (+  3683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.840410 (+   556us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:15.818552 22468 raft_consensus.cc:606] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Received request to transfer leadership to TS 65951063312d4a1e9123f92354101c71
I20260709 12:17:15.834164 23751 ts_tablet_manager.cc:1403] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 3.248s	user 0.048s	sys 0.049s
I20260709 12:17:15.849454 22441 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:15.855931 22441 leader_election.cc:400] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4.
I20260709 12:17:15.856338 22441 leader_election.cc:403] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:15.858098 22472 raft_consensus.cc:1240] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:15.859005 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1176) took 1895 ms. Trace:
I20260709 12:17:15.859501 22472 rpcz_store.cc:276] 0709 12:17:13.963748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.847307 (+1883559us) service_pool.cc:224] Handling call
0709 12:17:15.857916 (+ 10609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:15.858683 (+   767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.858942 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:15.853096 24084 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:17:15.862226 24044 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:17:15.861346 24194 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:15.868758 24194 raft_consensus.cc:697] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:15.869742 22542 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:15.869650 24194 consensus_queue.cc:237] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:15.860759 24146 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4.
I20260709 12:17:15.870653 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:15.851809 22468 raft_consensus.cc:614] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:15.874326 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:15.874356 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:15.878961 22542 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:15.880401 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:15.618322 23127 rpcz_store.cc:276] 0709 12:17:14.403307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.405221 (+  1914us) service_pool.cc:224] Handling call
0709 12:17:14.466285 (+ 61064us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:14.690350 (+224065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:14.692270 (+  1920us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:14.774338 (+ 82068us) log.cc:844] Serialized 26 byte log entry
0709 12:17:15.002627 (+228289us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:15.024973 (+ 22346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.055551 (+ 30578us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:15.517163 (+461612us) raft_consensus.cc:1685] finished
0709 12:17:15.517188 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.517325 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":265028,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":127,"thread_start_us":279746,"threads_started":2,"wal-append.queue_time_us":377039}
W20260709 12:17:15.882951 24091 consensus_meta.cc:287] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.764s	user 0.009s	sys 0.002s
I20260709 12:17:15.883111 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1127) took 1479 ms. Trace:
I20260709 12:17:15.883523 22546 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:15.883529 22396 rpcz_store.cc:276] 0709 12:17:14.403873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.857284 (+453411us) service_pool.cc:224] Handling call
0709 12:17:14.905583 (+ 48299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:15.583439 (+677856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:15.583503 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:15.668805 (+ 85302us) log.cc:844] Serialized 26 byte log entry
0709 12:17:15.861924 (+193119us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:15.864753 (+  2829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.864843 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:15.882888 (+ 18045us) raft_consensus.cc:1685] finished
0709 12:17:15.882914 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.883051 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20102,"raft.queue_time_us":152029,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":4882,"thread_start_us":581683,"threads_started":2,"wal-append.queue_time_us":168187}
I20260709 12:17:15.889468 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:15.894639 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:15.874743 24127 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:15.894369 24193 log.cc:927] Time spent T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:17:15.883368 24091 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:15.877277 24169 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:17:15.899231 24197 consensus_queue.cc:1059] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:17:15.906756 24197 raft_consensus.cc:3055] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:15.783878 22395 rpcz_store.cc:276] 0709 12:17:14.504398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.854252 (+349854us) service_pool.cc:224] Handling call
0709 12:17:14.854549 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.854755 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:15.058619 (+203864us) log.cc:844] Serialized 14 byte log entry
0709 12:17:15.756991 (+698372us) log.cc:844] Serialized 14 byte log entry
0709 12:17:15.757204 (+   213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:15.757256 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:15.757308 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.759497 (+  2189us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.759662 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":212908,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":85,"raft.queue_time_us":7124,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":147,"spinlock_wait_cycles":4944128,"thread_start_us":838838,"threads_started":2,"wal-append.queue_time_us":693305}
I20260709 12:17:15.907127 24197 raft_consensus.cc:740] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:15.908028 24197 consensus_queue.cc:260] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:15.908829 22475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1164) took 2021 ms. Trace:
I20260709 12:17:15.909682 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:15.905933 24091 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:15.920110 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41028 (request call id 266) took 1104 ms. Trace:
I20260709 12:17:15.920614 23124 rpcz_store.cc:276] 0709 12:17:14.815491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.821580 (+  6089us) service_pool.cc:224] Handling call
0709 12:17:15.904472 (+1082892us) spinlock_profiling.cc:243] Waited 8.61 ms on lock 0x7b58001c5698. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:17:15.919543 (+ 15071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:15.919749 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:15.919783 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:15.919831 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:15.919865 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.919928 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.920043 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19800832}
I20260709 12:17:15.909325 24197 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:15.924073 24067 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:15.924424 23955 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:15.924651 24101 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.925112 24101 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:15.926613 22368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.031s	user 0.012s	sys 0.002s
W20260709 12:17:15.926927 22368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.012s	sys 0.002s
I20260709 12:17:15.927119 24101 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:15.931274 24197 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:15.899950 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:15.931792 24197 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:15.932838 22366 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:15.933887 24112 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:15.934283 24112 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.934603 24112 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.935943 23751 raft_consensus.cc:359] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:15.936818 23751 raft_consensus.cc:740] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:17:15.936245 23932 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:15.938148 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:15.938331 24195 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:15.938513 23932 consensus_queue.cc:1059] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:15.899777 24127 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:15.939828 24172 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:15.940018 23130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34092 (request call id 185) took 1488 ms. Trace:
I20260709 12:17:15.940418 23130 rpcz_store.cc:276] 0709 12:17:14.451341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.451638 (+   297us) service_pool.cc:224] Handling call
0709 12:17:15.939718 (+1488080us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b58001c5698. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:17:15.939963 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10928000}
I20260709 12:17:15.941176 24067 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:15.942408 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:15.943147 24067 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:15.937495 23751 consensus_queue.cc:260] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:15.944586 22400 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:15.945184 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1128) took 1537 ms. Trace:
I20260709 12:17:15.945266 23751 ts_tablet_manager.cc:1434] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.091s	user 0.005s	sys 0.000s
I20260709 12:17:15.946197 23526 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.946681 23526 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:15.947190 24067 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:15.947736 24067 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:15.949570 24067 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:15.940907 24127 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:15.950769 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:17:15.951370 22476 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1346) took 2014 ms (client timeout 1903 ms). Trace:
W20260709 12:17:15.951772 22476 rpcz_store.cc:269] 0709 12:17:13.937182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.058660 (+121478us) service_pool.cc:224] Handling call
0709 12:17:15.951189 (+1892529us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54000dfcd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:15.951308 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3238232448}
I20260709 12:17:15.952885 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:15.909210 22475 rpcz_store.cc:276] 0709 12:17:13.887468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.687404 (+799936us) service_pool.cc:224] Handling call
0709 12:17:14.687734 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:14.872014 (+184280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:14.872043 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:14.897564 (+ 25521us) log.cc:844] Serialized 26 byte log entry
0709 12:17:15.551601 (+654037us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:15.736728 (+185127us) log.cc:844] Serialized 14 byte log entry
0709 12:17:15.736970 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.737055 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:15.908628 (+171573us) raft_consensus.cc:1685] finished
0709 12:17:15.908647 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.908775 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":187582,"prepare.queue_time_us":266187,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":184456,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":25980,"thread_start_us":641966,"threads_started":2,"wal-append.queue_time_us":637301}
I20260709 12:17:15.954553 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:17:15.956764 24143 log.cc:927] Time spent T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 2.059s	user 0.006s	sys 0.010s
I20260709 12:17:15.947052 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34092 (request call id 182) took 2479 ms. Trace:
I20260709 12:17:15.957723 23123 rpcz_store.cc:276] 0709 12:17:13.467289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.515740 (+ 48451us) service_pool.cc:224] Handling call
0709 12:17:13.941320 (+425580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.870369 (+929049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.946824 (+1076455us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54004ced50. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:15.946971 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":798336768}
I20260709 12:17:15.949826 23128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34092 (request call id 183) took 1506 ms. Trace:
I20260709 12:17:15.960963 23128 rpcz_store.cc:276] 0709 12:17:14.443916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.444262 (+   346us) service_pool.cc:224] Handling call
0709 12:17:15.651163 (+1206901us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b58001c5698. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:17:15.651391 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:15.738051 (+ 86660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:15.738086 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:15.738131 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:15.738161 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.949594 (+211433us) spinlock_profiling.cc:243] Waited 86.4 ms on lock 0x7b54000424d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:15.949643 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.949752 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208160512}
I20260709 12:17:15.962405 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:15.930950 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1012) took 3170 ms. Trace:
I20260709 12:17:15.963158 24105 consensus_queue.cc:1059] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:15.963690 22548 rpcz_store.cc:276] 0709 12:17:12.760494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.074812 (+314318us) service_pool.cc:224] Handling call
0709 12:17:13.075142 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.655864 (+1580722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.930695 (+1274831us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54004150d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:15.930863 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3543177472}
I20260709 12:17:15.964195 24060 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:15.967804 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:15.967729 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1345) took 2034 ms. Trace:
I20260709 12:17:15.969597 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:15.970424 22549 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:15.972549 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:15.972798 22469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1320) took 2544 ms (client timeout 1800 ms). Trace:
I20260709 12:17:15.973368 22550 raft_consensus.cc:2393] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 2: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:15.973709 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49290 (request call id 87) took 2585 ms. Trace:
I20260709 12:17:15.974776 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:15.969357 22471 rpcz_store.cc:276] 0709 12:17:13.933139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.818098 (+1884959us) service_pool.cc:224] Handling call
0709 12:17:15.818446 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:15.818836 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:15.818862 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:15.825875 (+  7013us) log.cc:844] Serialized 26 byte log entry
0709 12:17:15.965897 (+140022us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:15.966781 (+   884us) log.cc:844] Serialized 14 byte log entry
0709 12:17:15.967453 (+   672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.967522 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:15.967560 (+    38us) raft_consensus.cc:1685] finished
0709 12:17:15.967570 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.967677 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":179,"prepare.queue_time_us":427,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":7218,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":211,"thread_start_us":120569,"threads_started":1,"wal-append.queue_time_us":112102}
I20260709 12:17:15.978322 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:17:15.978895 24061 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.004s	sys 0.008s
W20260709 12:17:15.979242 24061 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.004s	sys 0.008s
I20260709 12:17:15.979501 24061 raft_consensus.cc:697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:15.980216 24059 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:15.975539 22549 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:15.974109 22547 rpcz_store.cc:276] 0709 12:17:13.388150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.388282 (+   132us) service_pool.cc:224] Handling call
0709 12:17:13.388632 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:13.388990 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:13.389019 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:13.389596 (+   577us) log.cc:844] Serialized 52 byte log entry
0709 12:17:13.553555 (+163959us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:13.593132 (+ 39577us) log.cc:844] Serialized 14 byte log entry
0709 12:17:13.622985 (+ 29853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.623074 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:14.527489 (+904415us) spinlock_profiling.cc:243] Waited 8.92 ms on lock 0x7b18002b2fa0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a67522 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:17:15.956221 (+1428732us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:15.973491 (+ 17270us) raft_consensus.cc:1685] finished
0709 12:17:15.973511 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.973641 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37458,"prepare.queue_time_us":34492,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":36658,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":10609,"spinlock_wait_cycles":36288256,"thread_start_us":163565,"threads_started":1,"wal-append.queue_time_us":500152}
W20260709 12:17:15.978411 24162 log.cc:927] Time spent T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 1.455s	user 0.001s	sys 0.024s
I20260709 12:17:15.982944 23803 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:15.984675 22473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1339) took 2250 ms. Trace:
I20260709 12:17:15.985028 22473 rpcz_store.cc:276] 0709 12:17:13.868228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.868373 (+   145us) service_pool.cc:224] Handling call
0709 12:17:13.868732 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:13.932958 (+ 64226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:13.932994 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:13.950777 (+ 17783us) log.cc:844] Serialized 52 byte log entry
0709 12:17:14.190636 (+239859us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:14.257086 (+ 66450us) log.cc:844] Serialized 14 byte log entry
0709 12:17:14.855185 (+598099us) log.cc:844] Serialized 14 byte log entry
0709 12:17:14.855373 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:14.855441 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:15.177870 (+322429us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4800128058. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fda7daa1 00007fb4fda74b37 00007fb4fda749ca 00007fb4fdb6c26f 00007fb4fdb6bf37 00007fb4fdb8055c 00007fb4fdb80508 00007fb4fdb80488 00007fb4fdb80443 00007fb4fdb7f6ec 00007fb4fcaa9a96
0709 12:17:15.977821 (+799951us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:15.984441 (+  6620us) raft_consensus.cc:1685] finished
0709 12:17:15.984465 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.984614 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":631189,"prepare.queue_time_us":149849,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":712377,"raft.run_cpu_time_us":23800,"raft.run_wall_time_us":1248138,"spinlock_wait_cycles":90200448,"thread_start_us":244429,"threads_started":2,"wal-append.queue_time_us":558673}
I20260709 12:17:15.987238 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:15.988315 24034 raft_consensus.cc:3055] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:15.988770 24034 raft_consensus.cc:740] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:15.980497 24061 consensus_queue.cc:237] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:15.989364 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:17:15.990890 24121 consensus_queue.cc:1175] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8c3bcfa13ca74a24ab8999a408532932" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 12:17:15.945549 22400 rpcz_store.cc:276] 0709 12:17:14.408233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.944108 (+1535875us) service_pool.cc:224] Handling call
0709 12:17:15.944413 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:15.944961 (+   548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.945132 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:15.996740 23131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41028 (request call id 263) took 1581 ms. Trace:
I20260709 12:17:15.997268 23131 rpcz_store.cc:276] 0709 12:17:14.415734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.415857 (+   123us) service_pool.cc:224] Handling call
0709 12:17:14.416135 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.620296 (+204161us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:14.784961 (+164665us) log.cc:844] Serialized 14 byte log entry
0709 12:17:14.865656 (+ 80695us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:14.865847 (+   191us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:14.865892 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.996446 (+1130554us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540018e2d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:15.996505 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.996654 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":596,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":9460,"spinlock_wait_cycles":469055744,"thread_start_us":79084,"threads_started":1,"wal-append.queue_time_us":389572}
I20260709 12:17:15.997445 24197 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:15.993271 24060 consensus_queue.cc:1059] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:17:16.000010 24060 raft_consensus.cc:3055] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:16.000368 24060 raft_consensus.cc:740] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:16.002449 22396 raft_consensus.cc:1240] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:15.978586 24161 log.cc:927] Time spent T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 1.450s	user 0.011s	sys 0.018s
I20260709 12:17:16.004336 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1340) took 2128 ms. Trace:
I20260709 12:17:16.004729 22474 rpcz_store.cc:276] 0709 12:17:13.876035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.876190 (+   155us) service_pool.cc:224] Handling call
0709 12:17:13.876526 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:14.008430 (+131904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:14.008464 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:14.020037 (+ 11573us) log.cc:844] Serialized 26 byte log entry
0709 12:17:14.146789 (+126752us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b4800128058. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fda7daa1 00007fb4fda74b37 00007fb4fda749ca 00007fb4fdb6c26f 00007fb4fdb6bf37 00007fb4fdb8055c 00007fb4fdb80508 00007fb4fdb80488 00007fb4fdb80443 00007fb4fdb7f6ec 00007fb4fcaa9a96
0709 12:17:14.177969 (+ 31180us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:14.178009 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:14.178078 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:15.978044 (+1799966us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:16.004117 (+ 26073us) raft_consensus.cc:1685] finished
0709 12:17:16.004138 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:16.004264 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":706871,"raft.queue_time_us":118148,"raft.run_cpu_time_us":1060,"raft.run_wall_time_us":151923,"spinlock_wait_cycles":47441408,"thread_start_us":289007,"threads_started":2,"wal-append.queue_time_us":469348}
I20260709 12:17:16.006830 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.007011 24194 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:16.007848 24185 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.769s	user 0.003s	sys 0.014s
I20260709 12:17:16.007596 24194 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.005012 22472 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:16.009251 22544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1391) took 1568 ms. Trace:
W20260709 12:17:16.009402 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.009733 24194 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:16.008625 24060 consensus_queue.cc:260] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:16.010300 24194 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:16.011034 22470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1324) took 2554 ms (client timeout 2228 ms). Trace:
I20260709 12:17:16.010782 24194 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:16.011418 22470 rpcz_store.cc:269] 0709 12:17:13.456207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.688763 (+232556us) service_pool.cc:224] Handling call
0709 12:17:16.010808 (+2322045us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400046d54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:16.010973 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3499175808}
I20260709 12:17:16.012442 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:16.009282 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1181) took 1990 ms. Trace:
I20260709 12:17:16.012840 24194 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:16.010979 24060 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:16.013357 22472 rpcz_store.cc:276] 0709 12:17:14.019018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.860393 (+1841375us) service_pool.cc:224] Handling call
0709 12:17:15.865374 (+  4981us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:16.004796 (+139422us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b540011b0a0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8acbdc0 00007fb4f8b561c0 00007fb4f8b57231 00007fb4f8b53d8f 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c
0709 12:17:16.009024 (+  4228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:16.009232 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49651584}
I20260709 12:17:16.014400 24194 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.014668 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.014873 24194 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.015769 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:16.016899 24194 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:16.017916 24194 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.018368 24194 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.019012 24115 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:16.019471 24115 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.020946 24194 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:16.021818 22441 connection.cc:256] RPC call timeout handler was delayed by -1.1513231950000318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
W20260709 12:17:16.022665 24200 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.266s	user 0.002s	sys 0.000s
I20260709 12:17:16.002347 22543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1387) took 1593 ms. Trace:
I20260709 12:17:16.023329 22543 rpcz_store.cc:276] 0709 12:17:14.409397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.409518 (+   121us) service_pool.cc:224] Handling call
0709 12:17:14.449215 (+ 39697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.546939 (+ 97724us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:14.650972 (+104033us) log.cc:844] Serialized 14 byte log entry
0709 12:17:14.852236 (+201264us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:14.852286 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:14.852328 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:16.002131 (+1149803us) spinlock_profiling.cc:243] Waited 97.5 ms on lock 0x7b540040f954. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:16.002174 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:16.002288 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1980,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":224219904,"thread_start_us":198729,"threads_started":1,"wal-append.queue_time_us":218443,"wal-append.run_cpu_time_us":951,"wal-append.run_wall_time_us":1001048}
I20260709 12:17:16.026412 24189 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:16.028334 22487 tablet_copy_service.cc:342] P 25ebf14868c042dca42f54b3e251e1b2: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-b42c69680a57493c942307ff09185b72 received from {username='slave'} at 127.0.0.1:43060
I20260709 12:17:16.028851 22487 tablet_copy_service.cc:434] P 25ebf14868c042dca42f54b3e251e1b2: ending tablet copy session 65951063312d4a1e9123f92354101c71-b42c69680a57493c942307ff09185b72 on tablet b42c69680a57493c942307ff09185b72 with peer 65951063312d4a1e9123f92354101c71
W20260709 12:17:16.030421 23095 leader_election.cc:336] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.094s (SENT)
I20260709 12:17:16.021832 22544 rpcz_store.cc:276] 0709 12:17:14.441163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.455874 (+ 14711us) service_pool.cc:224] Handling call
0709 12:17:14.456211 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:14.850669 (+394458us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:17:14.850701 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:14.851198 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 12:17:15.079947 (+228749us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:15.079982 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.080047 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:16.007350 (+927303us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:16.008968 (+  1618us) raft_consensus.cc:1685] finished
0709 12:17:16.008987 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:16.009193 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56135,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":85,"spinlock_wait_cycles":284820352,"thread_start_us":622483,"threads_started":2,"wal-append.queue_time_us":361743}
I20260709 12:17:16.030912 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:16.032258 23864 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:16.032438 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:15.973218 22469 rpcz_store.cc:269] 0709 12:17:13.428237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.431282 (+  3045us) service_pool.cc:224] Handling call
0709 12:17:15.972506 (+2541224us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540023fad4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:15.972685 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2716182400}
I20260709 12:17:16.034080 24194 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:16.034500 24194 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:16.034883 24194 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:16.034997 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.036100 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.033636 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.038630 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.039140 24041 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:16.039460 22468 raft_consensus.cc:2393] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 3: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:15.997345 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:16.042451 22441 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:16.042656 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.043390 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.043579 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:17:16.044139 22475 raft_consensus.cc:606] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:16.044766 22476 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:16.045365 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1183) took 2025 ms. Trace:
I20260709 12:17:16.045979 24074 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.030089 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:15.989696 24034 consensus_queue.cc:260] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:16.013227 22477 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:16.051548 22400 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:16.051688 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1165) took 2163 ms. Trace:
I20260709 12:17:16.052181 22477 rpcz_store.cc:276] 0709 12:17:13.888289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.769020 (+880731us) service_pool.cc:224] Handling call
0709 12:17:16.013041 (+1244021us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:16.049507 (+ 36466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:16.051493 (+  1986us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400046d50. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:16.051614 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2860324608}
I20260709 12:17:16.007612 22474 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:16.058933 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.059608 22474 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:16.059896 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.060464 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.061156 22474 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:16.053431 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.067549 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:16.067883 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.068305 22402 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:16.053908 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:16.069186 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:16.069914 22393 raft_consensus.cc:2393] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:16.072021 22401 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:16.067437 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1185) took 2047 ms. Trace:
I20260709 12:17:16.074124 22477 rpcz_store.cc:276] 0709 12:17:14.020050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.066630 (+2046580us) service_pool.cc:224] Handling call
0709 12:17:16.066951 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:16.067130 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:16.067156 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:16.067200 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:16.067230 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:16.067283 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:16.067380 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:16.075284 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:16.075973 22400 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:16.076694 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.048767 24034 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.084888 22366 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:16.085836 22471 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:16.086525 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1184) took 2066 ms. Trace:
I20260709 12:17:16.086846 22471 rpcz_store.cc:276] 0709 12:17:14.019793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.064554 (+2044761us) service_pool.cc:224] Handling call
0709 12:17:16.085444 (+ 20890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:16.086244 (+   800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:16.086455 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:15.947055 22516 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
W20260709 12:17:16.079768 22515 consensus_peers.cc:597] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:16.060689 22473 raft_consensus.cc:2393] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:16.092446 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:16.093341 22544 raft_consensus.cc:2393] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:16.096150 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:16.040444 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.101395 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:16.102041 22400 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:16.103761 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:16.109127 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.108971 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:16.110668 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.099792 22402 raft_consensus.cc:2410] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:16.045667 22476 rpcz_store.cc:276] 0709 12:17:14.019535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.044293 (+2024758us) service_pool.cc:224] Handling call
0709 12:17:16.044590 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:16.045145 (+   555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:16.045316 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:16.112385 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.114513 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.117885 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:16.082504 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.120571 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.122004 22473 raft_consensus.cc:2393] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:17:16.097500 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 150499us
I20260709 12:17:16.123955 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:16.125034 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:16.078747 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.128609 22475 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:16.111379 22469 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:16.129467 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:16.130383 22402 raft_consensus.cc:2410] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:16.130847 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:16.083299 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:16.131656 22546 raft_consensus.cc:2410] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:17:16.094228 23930 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.133298 22474 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:16.094276 24197 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:16.133926 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1186) took 2113 ms. Trace:
I20260709 12:17:16.134310 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.135540 22473 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:16.135718 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.136204 22473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1187) took 2115 ms. Trace:
I20260709 12:17:16.136689 23930 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.139027 22395 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:16.112402 23932 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:16.142724 23932 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:16.143280 23932 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:16.144133 22396 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:16.105698 24127 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:16.134351 22474 rpcz_store.cc:276] 0709 12:17:14.020319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.131390 (+2111071us) service_pool.cc:224] Handling call
0709 12:17:16.131701 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:16.133659 (+  1958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:16.133877 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:16.136420 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:16.147397 22474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:17:16.147969 22474 raft_consensus.cc:606] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:16.148311 22474 raft_consensus.cc:614] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:16.136365 22471 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:16.151619 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:16.152184 22472 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:16.152331 22544 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 2.
I20260709 12:17:16.153872 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:16.134598 22469 raft_consensus.cc:1240] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:16.160755 22400 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:16.149597 22473 rpcz_store.cc:276] 0709 12:17:14.020567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.134978 (+2114411us) service_pool.cc:224] Handling call
0709 12:17:16.135240 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:16.135940 (+   700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:16.136154 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:16.116146 23526 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:16.168298 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:16.094646 24194 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:16.162815 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:17:16.166731 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:16.133076 24007 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.166090 22544 raft_consensus.cc:3055] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:16.112191 24094 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:17:16.174629 22544 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:16.167532 22471 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:16.170130 22550 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:16.132114 24106 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:16.172926 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:16.145464 24127 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:16.176692 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.177392 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:16.180125 22473 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
W20260709 12:17:16.177814 24054 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.024s	sys 0.060s
I20260709 12:17:16.159670 24076 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:17:16.180678 22393 raft_consensus.cc:1240] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:16.181233 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:16.181488 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:16.206525 22550 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:16.207773 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:16.182319 22545 raft_consensus.cc:3055] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:16.208029 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:16.182510 23094 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:16.209290 22550 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:16.186026 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:16.195683 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.197165 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:16.196245 22544 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:16.195123 24054 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.024s	sys 0.060s
I20260709 12:17:16.169099 23930 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:16.160671 23931 consensus_queue.cc:1059] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:17:16.219033 22550 raft_consensus.cc:1240] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:17:16.211231 22545 raft_consensus.cc:740] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:16.173938 24067 consensus_queue.cc:1059] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:17:16.229854 22544 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.210747 22548 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:16.192289 24127 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.241647 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.249603 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:16.250067 22473 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:16.250208 22476 raft_consensus.cc:2376] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5. Re-sending same reply.
W20260709 12:17:16.228243 24155 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.705s	user 0.016s	sys 0.023s
I20260709 12:17:16.244207 22545 consensus_queue.cc:260] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:16.229739 24190 log.cc:927] Time spent T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:17:16.229472 24172 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.194880 24106 raft_consensus.cc:697] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:16.229079 22393 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:16.251116 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.249037 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.256557 22545 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.266531 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:16.267349 22473 raft_consensus.cc:2393] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:16.265648 22469 raft_consensus.cc:2376] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4. Re-sending same reply.
I20260709 12:17:16.268805 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:16.269127 24225 log.cc:927] Time spent T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:17:16.256137 24155 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.733s	user 0.016s	sys 0.024s
I20260709 12:17:16.268671 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:16.272461 22472 raft_consensus.cc:2376] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4. Re-sending same reply.
I20260709 12:17:16.274013 24230 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:16.274407 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.259864 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:16.260885 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:16.179561 24007 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.278821 24094 raft_consensus.cc:3055] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:16.279359 24094 raft_consensus.cc:740] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:16.280722 24007 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:16.283113 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:16.287936 24106 consensus_queue.cc:237] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.292992 22469 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:16.280324 24094 consensus_queue.cc:260] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.278892 22471 raft_consensus.cc:2393] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:16.303491 22545 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:16.289522 22544 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:16.305392 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:16.306696 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:16.307488 22393 raft_consensus.cc:2410] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:17:16.308377 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:16.311493 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:16.312076 22469 raft_consensus.cc:2376] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3. Re-sending same reply.
I20260709 12:17:16.313118 22393 raft_consensus.cc:2410] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:16.313825 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.316722 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.320015 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.320897 22469 raft_consensus.cc:2393] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 2: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:16.326413 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:16.327335 22401 raft_consensus.cc:2393] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:16.320303 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.329643 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.334728 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:16.336094 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:16.336768 22401 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:16.321396 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:16.311863 24197 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.338390 22296 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32988 (request call id 88) took 10866 ms. Trace:
I20260709 12:17:16.338685 24197 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.339190 22400 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:16.340198 23959 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:16.340481 22400 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:16.342835 24127 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:16.343971 22543 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:16.315591 22395 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:16.346954 22473 raft_consensus.cc:2393] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:16.347324 23959 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.350181 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:16.351434 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:16.345610 24127 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:16.356679 22398 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:16.361142 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:16.366282 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:16.367822 22551 raft_consensus.cc:3055] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:16.368220 22551 raft_consensus.cc:740] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:16.372970 22550 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:16.374105 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:16.375917 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:16.369033 22551 consensus_queue.cc:260] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:16.382927 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:16.385210 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.390913 22551 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.392232 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:16.337664 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:16.400159 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.358505 24121 raft_consensus.cc:3055] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:16.391142 23095 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:16.412971 22544 raft_consensus.cc:1240] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:16.315045 24230 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:16.341706 22400 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:16.390828 22367 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:16.424904 22549 raft_consensus.cc:3055] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:16.445405 22549 raft_consensus.cc:740] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:16.425594 22548 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:16.446384 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:16.445734 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 55006.6us
I20260709 12:17:16.447415 22367 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:16.449224 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 58152us
I20260709 12:17:16.451524 22367 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:16.425554 22401 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:16.442417 22471 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:16.444065 22551 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:16.379441 24094 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:16.455376 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.450850 23095 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:16.466529 23095 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:16.453142 22549 consensus_queue.cc:260] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.454154 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:16.467507 22400 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.463099 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:16.468503 22401 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
W20260709 12:17:16.463610 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 255674us
I20260709 12:17:16.460049 22367 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:16.471243 23095 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:16.477756 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:16.435962 24121 raft_consensus.cc:740] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:16.479163 22549 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:16.479341 22397 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:16.437173 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:16.483546 23095 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:16.484856 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:16.338909 22296 rpcz_store.cc:276] 0709 12:17:05.472429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.477889 (+  5460us) service_pool.cc:224] Handling call
0709 12:17:16.338312 (+10860423us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:11.893368 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:11.893971 (+   603us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:11.894007 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:17:11.894032 (+    25us) tablet.cc:662] Decoding operations
0709 12:17:12.182874 (+288842us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:12.194461 (+ 11587us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:12.200525 (+  6064us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:17:12.280840 (+ 80315us) tablet.cc:701] Row locks acquired
0709 12:17:12.283226 (+  2386us) write_op.cc:260] PREPARE: finished
0709 12:17:12.292789 (+  9563us) write_op.cc:270] Start()
0709 12:17:12.292921 (+   132us) write_op.cc:276] Timestamp: P: 1783599432292734 usec, L: 0
0709 12:17:12.292940 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:17:12.293578 (+   638us) log.cc:844] Serialized 2433 byte log entry
0709 12:17:13.087122 (+793544us) op_driver.cc:464] REPLICATION: finished
0709 12:17:13.906697 (+819575us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f5a4a0ac 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4fc58aef0
0709 12:17:14.187988 (+281291us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b18002f17c0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a67522 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:17:14.214985 (+ 26997us) write_op.cc:301] APPLY: starting
0709 12:17:14.246221 (+ 31236us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:14.391716 (+145495us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:14.393456 (+  1740us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:14.522086 (+128630us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:14.522324 (+   238us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:17:14.522364 (+    40us) write_op.cc:312] APPLY: finished
0709 12:17:14.522603 (+   239us) log.cc:844] Serialized 52 byte log entry
0709 12:17:16.003563 (+1480960us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f5a4a0ac 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b
0709 12:17:16.270113 (+266550us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:16.270228 (+   115us) write_op.cc:454] Released schema lock
0709 12:17:16.270277 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:16.270652 (+   375us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:16.270679 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2077298,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":1078917,"apply.run_cpu_time_us":43194,"apply.run_wall_time_us":2104316,"num_ops":6,"prepare.queue_time_us":561942,"prepare.run_cpu_time_us":16330,"prepare.run_wall_time_us":545521,"raft.queue_time_us":261391,"raft.run_cpu_time_us":18886,"raft.run_wall_time_us":972830,"replication_time_us":794050,"spinlock_wait_cycles":144692608,"thread_start_us":3464499,"threads_started":5,"wal-append.queue_time_us":2098183,"wal-append.run_cpu_time_us":15954,"wal-append.run_wall_time_us":1459348}]]}
I20260709 12:17:16.458609 24195 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.461505 24007 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:16.461115 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:16.463536 24165 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:16.490823 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:16.486018 24059 consensus_meta.cc:287] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.000s
I20260709 12:17:16.491231 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:16.470825 24085 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:16.482302 23864 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:16.478770 24202 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:16.503202 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.489989 22400 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:16.492499 24061 raft_consensus.cc:2764] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:17:16.558113 22393 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:16.459424 23932 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.556303 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:16.486482 24172 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.562084 22400 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:16.488266 24034 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:16.723810 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.576802 23932 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:16.721988 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 253043us
I20260709 12:17:16.577286 22395 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:16.559669 22394 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
W20260709 12:17:16.582806 24112 consensus_meta.cc:287] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.648s	user 0.008s	sys 0.000s
W20260709 12:17:16.580554 24041 consensus_meta.cc:287] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.001s
W20260709 12:17:16.570253 24239 log.cc:927] Time spent T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:17:16.574486 24221 log.cc:927] Time spent T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
W20260709 12:17:16.571429 24227 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:17:16.493975 24194 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:16.578711 24197 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:16.572307 24223 log.cc:927] Time spent T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:17:16.723582 24101 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:16.777796 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 284309us
W20260709 12:17:16.785080 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:16.771304 24115 consensus_meta.cc:287] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.751s	user 0.010s	sys 0.000s
I20260709 12:17:16.813257 24115 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:16.814637 22402 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:16.815843 24115 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:16.590260 24230 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.817646 24233 consensus_queue.cc:1059] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:16.818835 23526 raft_consensus.cc:3055] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:16.819223 23526 raft_consensus.cc:740] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:16.820091 23526 consensus_queue.cc:260] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.821314 23526 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.823740 24233 consensus_queue.cc:1059] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:17:16.824694 23803 consensus_meta.cc:287] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.841s	user 0.008s	sys 0.000s
I20260709 12:17:16.825176 24094 raft_consensus.cc:3055] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:16.825613 24094 raft_consensus.cc:740] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:16.827551 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:16.803378 22470 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:16.791133 24112 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.804683 24041 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:16.804877 24238 log.cc:927] Time spent T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:17:16.836299 22549 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:16.826532 24094 consensus_queue.cc:260] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.838788 24235 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:16.835639 24041 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.845965 24246 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:17:16.852399 24112 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:16.851225 24094 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:16.921921 23803 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:16.953435 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:16.919332 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.958397 22399 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:16.931402 23803 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.961966 23803 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:16.918973 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 90014.4us
I20260709 12:17:16.964412 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:17:16.892356 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:16.893194 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 127888us
W20260709 12:17:16.892030 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 431841us
I20260709 12:17:16.949911 24041 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:16.961997 24196 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.974534 24196 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.978180 24255 consensus_queue.cc:1059] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:17:16.980610 24251 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:16.981276 24251 raft_consensus.cc:697] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:16.983196 24251 consensus_queue.cc:237] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:16.994091 24253 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:17.010623 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:17.011720 23803 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:17.025547 23930 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 12:17:17.025938 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 61747us
I20260709 12:17:17.030179 23930 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:17.030683 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:17.032887 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:17.033090 23930 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:17.037372 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.049103 24007 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.050040 24007 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.052702 24007 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:17.067334 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 56959.5us
I20260709 12:17:17.067098 24230 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.071056 24230 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.073204 24230 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:17.076036 22367 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:17.067263 24166 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:17.078029 22367 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:17.081161 24007 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.088533 23803 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.103093 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:17.104164 22367 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:17.104779 22396 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:17.108240 23803 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:17.108785 23803 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:17:17.109375 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 76714.1us
I20260709 12:17:17.109211 23803 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.110431 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:17.108930 24235 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:17.112840 24106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.011s	sys 0.011s
W20260709 12:17:17.113243 24106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.011s	sys 0.011s
W20260709 12:17:17.117164 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.118315 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:17.119347 24101 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:17.119810 24101 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.120427 24094 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:17.122143 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:17.122321 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:17.125926 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:17.126142 22543 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:17.112349 23959 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.123529 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:17:17.129256 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.129657 24202 consensus_queue.cc:1059] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:17.130750 24202 raft_consensus.cc:3055] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:17.131126 24202 raft_consensus.cc:740] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:17.131925 24094 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.132187 24202 consensus_queue.cc:260] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:17.132591 24235 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:17.136132 24121 consensus_queue.cc:260] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.137341 24121 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.123858 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:17.124936 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:17.136070 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:17.151458 22548 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
W20260709 12:17:17.153487 24232 log.cc:927] Time spent T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.682s	user 0.000s	sys 0.003s
W20260709 12:17:17.156457 24228 log.cc:927] Time spent T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.810s	user 0.000s	sys 0.003s
W20260709 12:17:17.157481 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.160463 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:17.162246 23803 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.163054 22470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 1195) took 1239 ms. Trace:
I20260709 12:17:17.163537 23959 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:17.170442 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:17.171243 22545 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:17.172324 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:17.172511 24196 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.172664 24101 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:17.175208 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.140311 24202 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.170486 22550 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:17.175101 22402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 108) took 1020 ms. Trace:
I20260709 12:17:17.182066 22543 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:17.184515 24095 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:17.163480 22470 rpcz_store.cc:276] 0709 12:17:15.923328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.012209 (+ 88881us) service_pool.cc:224] Handling call
0709 12:17:17.162671 (+1150462us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b5400201cd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:17.162838 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792271104}
I20260709 12:17:17.188824 24253 raft_consensus.cc:3055] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:17.189370 24253 raft_consensus.cc:740] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:17.175066 24101 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:17.185317 23803 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.192220 22366 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:17.192392 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:17.192590 24041 consensus_queue.cc:1059] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:17.193591 24041 raft_consensus.cc:3055] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:17.193987 24041 raft_consensus.cc:740] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:17.177232 22402 rpcz_store.cc:276] 0709 12:17:16.154313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.155409 (+  1096us) service_pool.cc:224] Handling call
0709 12:17:16.155685 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:16.815033 (+659348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:17.174659 (+359626us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b54001e2b54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:17.174920 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515018624}
I20260709 12:17:17.198151 24085 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:17.198721 24085 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.199319 22441 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:17.201711 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 57608.8us
I20260709 12:17:17.203498 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:17.204602 24231 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.206607 22516 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:17.192770 22399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1117) took 2866 ms (client timeout 1823 ms). Trace:
W20260709 12:17:17.210813 22399 rpcz_store.cc:269] 0709 12:17:14.326204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.465304 (+139100us) service_pool.cc:224] Handling call
0709 12:17:17.192538 (+2727234us) spinlock_profiling.cc:243] Waited 2.36 s on lock 0x7b54002da354. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:17.192687 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5425090432}
I20260709 12:17:17.214157 24194 consensus_queue.cc:1059] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:17:17.203493 24233 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:17:17.226250 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:17.223546 22297 catalog_manager.cc:5697] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 1 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:17:17.225262 24095 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:17.237344 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 101432us
I20260709 12:17:17.235721 24041 consensus_queue.cc:260] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.243923 24041 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.245985 24199 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.246436 24076 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:17.245586 22297 catalog_manager.cc:5697] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 1 to 2, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 2 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:17.246622 24199 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:17.247292 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.249138 24199 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:17.253890 24196 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:17.254381 24196 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:17.254746 24196 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.258090 22367 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:17.260174 24254 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:17.260639 24254 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.260354 23803 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:17.261132 22366 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:17.262215 24019 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:17.262629 24019 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:17.261070 24254 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.262984 24019 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.260200 22367 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:17.267411 23803 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:17.267869 23803 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:17.268329 23803 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.268656 24253 consensus_queue.cc:260] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:17.267980 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 66435.4us
I20260709 12:17:17.266393 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:17.271733 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 66117.1us
I20260709 12:17:17.277401 22546 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:17.285113 22441 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:17.286628 22367 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:17.287859 23959 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:17.288512 22367 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:17.290002 23959 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:17.290422 23959 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.290850 23959 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:17.291503 24258 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.211s	user 0.003s	sys 0.000s
I20260709 12:17:17.293092 22367 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:17.294011 23131 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 2 LEARNER]: Advancing to term 4
I20260709 12:17:17.285537 24254 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:17.293897 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:17.298317 24254 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.298893 22516 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:17.299089 24244 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:17.303339 24244 raft_consensus.cc:697] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:17.303808 24076 raft_consensus.cc:1064] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
W20260709 12:17:17.304342 24076 raft_consensus.cc:1068] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932: Unable to promote non-voter 65951063312d4a1e9123f92354101c71: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:17:17.305292 24246 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:17.307843 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:17.300818 23959 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.309646 24246 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:17.310266 24246 raft_consensus.cc:697] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:17.302284 24253 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.311612 24246 consensus_queue.cc:237] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.304397 24244 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:17.311190 23959 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.302147 23803 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:17.300177 22367 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:17.341622 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.357156 24041 consensus_queue.cc:1059] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:17.277495 24085 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.363505 24106 raft_consensus.cc:1064] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
W20260709 12:17:17.364042 24106 raft_consensus.cc:1068] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932: Unable to promote non-voter 65951063312d4a1e9123f92354101c71: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:17:17.364953 24085 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.365940 24198 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:17.370361 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 104125us
I20260709 12:17:17.376457 22366 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:17.338369 23930 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:17.378661 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 70938.2us
W20260709 12:17:17.380295 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 143399us
I20260709 12:17:17.352981 23959 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:17:17.383553 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 98546us
I20260709 12:17:17.381733 22366 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:17.381162 24085 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:17.378254 24194 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:17.392514 22366 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:17.393811 23803 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:17.390834 24085 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.424117 24085 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:17.425815 24196 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.393837 24172 consensus_queue.cc:1059] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:17:17.398425 24254 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:17.428033 24196 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.389868 24121 raft_consensus.cc:3055] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:17.428485 24121 raft_consensus.cc:740] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:17.428769 24061 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:17.429332 24061 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.429697 24061 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.408263 24194 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:17.409965 24235 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:17.417609 24095 raft_consensus.cc:3055] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:17.432176 24095 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:17.402674 24267 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:17.430639 22441 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:17.434026 24267 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.434424 24267 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.434518 24041 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:17.434955 24041 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.435331 24041 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.433359 22442 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:17.436744 24269 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.433446 24095 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.439226 24095 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:17.439802 22442 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:17.441289 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 50561.1us
I20260709 12:17:17.441716 24269 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.442153 22441 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:17.443531 24269 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:17.443948 24269 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.444299 24269 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.445619 24041 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.447957 24041 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.448760 24271 consensus_queue.cc:1059] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:17.450359 22441 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:17.452288 22442 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:17.456288 24271 consensus_queue.cc:1243] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:17.456761 24275 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:17.456921 24271 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:17.457278 24275 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.457736 24275 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.457966 24271 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:17.459717 24271 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:17.451376 24254 raft_consensus.cc:697] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:17:17.464403 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 55165.5us
I20260709 12:17:17.429584 24121 consensus_queue.cc:260] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:17.468832 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 168761us
I20260709 12:17:17.468096 22516 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:17.478883 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:17.475925 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:17.481642 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:17.475721 24041 raft_consensus.cc:3055] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:17.484347 24041 raft_consensus.cc:740] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:17.484596 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:17.478197 24202 raft_consensus.cc:3055] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:17.485260 24202 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:17.484790 22402 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:17.485435 22397 raft_consensus.cc:2410] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:17.487054 22367 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:17.485281 24041 consensus_queue.cc:260] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.494192 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:17.494664 24041 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.495112 22396 raft_consensus.cc:2393] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:17.496438 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:17.497135 22395 raft_consensus.cc:2376] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3. Re-sending same reply.
I20260709 12:17:17.488438 24254 consensus_queue.cc:237] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.494203 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:17.498662 22398 raft_consensus.cc:2393] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 4: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:17.499552 22546 raft_consensus.cc:2393] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:17.500186 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:17.488837 24189 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:17.500975 24189 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:17.488865 24202 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:17.503376 24202 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.503762 24189 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:17.491050 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:17.492086 24121 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:17.506341 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:17.510036 24106 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.491784 24019 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.510820 24106 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:17.493362 24194 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:17.512117 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
W20260709 12:17:17.514575 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.524449 24061 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.486284 24267 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.525610 22399 raft_consensus.cc:1240] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:17.525877 24271 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:17.527325 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:17.527884 24235 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:17.528443 24235 raft_consensus.cc:697] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:17.528534 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:17.529567 23930 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.530220 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:17.531531 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:17.532069 22545 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.529471 24235 consensus_queue.cc:237] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.535367 24061 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.535672 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:17.537463 24106 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:17.538069 24106 raft_consensus.cc:697] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:17.539456 23797 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:17.539376 24106 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.540167 24267 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.554711 23797 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:17.554814 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:17.555435 22543 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.554848 22549 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:17.555359 23797 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:17.560668 23797 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:17.563664 22543 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:17.565114 24269 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.587755 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:17.588231 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:17.556000 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:17.567821 22442 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:17.573386 22399 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:17:17.517165 24019 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.525189 24085 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.574429 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:17.574707 22470 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:17.589327 22399 pending_rounds.cc:85] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 3
W20260709 12:17:17.574842 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 95066.2us
I20260709 12:17:17.575690 22476 raft_consensus.cc:1240] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:17.576015 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:17.487440 24076 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:17.577571 22545 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:17.579178 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:17.580212 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:17.580142 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:17.581642 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:17.579105 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:17.588547 24269 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.590564 22473 raft_consensus.cc:2393] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 4: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:17.590626 22397 raft_consensus.cc:2393] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:17.592618 22366 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:17.595824 22477 raft_consensus.cc:2393] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 4: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:17.596668 22471 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:17.588979 22548 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:17.597620 22366 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:17.598740 22367 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:17.599591 22394 raft_consensus.cc:2410] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:17.599916 22396 raft_consensus.cc:2393] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:17:17.602489 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 152282us
I20260709 12:17:17.594520 23959 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:17.589915 22399 pending_rounds.cc:107] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 12:17:17.600528 24059 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:17.609067 22399 raft_consensus.cc:2917] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 12:17:17.610790 22366 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:17.599924 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:17.601606 24019 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:17.612892 22399 raft_consensus.cc:2889] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:17.595245 24189 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:17:17.604274 24041 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:17.612407 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:17.638358 24271 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:17.638943 22442 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:17.639521 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.606968 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:17.643124 22367 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:17.642481 22471 raft_consensus.cc:2410] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:17.648308 22442 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:17.615149 24269 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:17:17.650082 22474 raft_consensus.cc:2393] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:17.615396 24121 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:17:17.650976 24267 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:17.651643 24267 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.652043 24267 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.650972 24269 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.615335 23803 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:17:17.655633 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.640879 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:17.649610 22442 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:17.677489 23803 raft_consensus.cc:697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:17.678581 23803 consensus_queue.cc:237] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.686470 24269 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:17.686697 22473 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.687196 24269 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:17.688205 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 45172.5us
I20260709 12:17:17.688995 22367 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:17.689352 24269 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:17.690773 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.643937 23797 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:17.691840 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:17.692008 23797 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.692269 22367 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:17.694190 22367 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:17.695027 24061 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:17.695384 22367 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:17.696033 24244 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:17.695564 24061 raft_consensus.cc:697] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:17.697055 24196 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:17.697875 24061 consensus_queue.cc:237] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.665798 24019 raft_consensus.cc:697] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:17.702539 24019 consensus_queue.cc:237] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.707485 22473 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:17.696709 22367 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:17.670353 24059 raft_consensus.cc:697] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:17.711181 24269 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:17.705837 23959 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:17.711349 24041 raft_consensus.cc:697] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:17:17.745645 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 96090.9us
I20260709 12:17:17.711472 24202 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:17.742825 24235 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:17.752846 24235 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.754405 22395 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:17.755363 24235 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:17.696698 24267 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.765239 22442 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:17.768098 22441 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:17.731894 23797 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:17.712657 24275 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.742255 23959 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:17.779562 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 82969us
I20260709 12:17:17.780283 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:17.785137 24269 raft_consensus.cc:697] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:17.786793 22473 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:17.772724 24121 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.785321 22394 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:17.773830 24085 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.795634 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:17.783335 23959 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.766844 24202 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:17.809710 22397 raft_consensus.cc:1240] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:17:17.786556 24235 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:17.823999 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:17.813133 24279 log.cc:927] Time spent T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:17:17.825814 24194 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:17.828883 24277 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.826150 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:17.831136 24267 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.798976 24121 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.850063 24276 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.850447 22396 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:17.859511 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:17.866107 22476 raft_consensus.cc:1240] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:17.786420 24269 consensus_queue.cc:237] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:17.869848 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 117871us
I20260709 12:17:17.819998 24235 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:17.935158 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 124075us
I20260709 12:17:17.867466 24196 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:17.950213 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 102876us
I20260709 12:17:17.814682 24059 consensus_queue.cc:237] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:17.958043 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 211387us
I20260709 12:17:17.845863 24041 consensus_queue.cc:237] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.941165 24198 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:17.873522 24276 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.947398 24095 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:17.949209 24061 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.972505 22441 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:17.978757 24284 log.cc:927] Time spent T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:17:17.979586 22472 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:17.980067 24121 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.980024 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:17.981042 22469 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.982802 24202 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:17.984637 23959 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.986832 24276 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.987528 22471 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:17.990592 24061 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.991160 24067 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:17.992010 24095 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.992821 24061 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.994103 24095 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.995501 24235 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:17.971141 24198 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:17.998517 24275 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:17.999094 22476 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:17:17.954305 24253 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:18.008095 24076 raft_consensus.cc:1027] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: attempt to promote peer 65951063312d4a1e9123f92354101c71: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:17:18.010816 24121 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:18.011162 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.014364 22548 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:18.017428 22469 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:18.043562 22548 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:18.045656 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:17.999902 24198 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:18.054385 22543 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:17:18.054922 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 80361.5us
I20260709 12:17:17.986832 23959 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:18.067085 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 98845.4us
I20260709 12:17:18.054024 24121 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:18.068569 24095 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:18.071020 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:18.071942 22548 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
W20260709 12:17:18.072582 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 121522us
I20260709 12:17:18.069885 24121 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:18.073621 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:18.076874 22549 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
W20260709 12:17:18.078011 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 133519us
I20260709 12:17:18.058017 24253 raft_consensus.cc:697] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:17:18.088994 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:18.101801 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.070171 24198 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:17:18.117208 24246 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.119496 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:18.122501 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:18.120185 22441 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:18.121874 22366 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:18.124612 22366 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:18.106945 22477 raft_consensus.cc:2955] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:17:18.129196 22470 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:18.138324 22516 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:18.144342 24289 consensus_queue.cc:1059] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:17:18.136225 24277 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:18.127722 24276 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.127326 24196 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:18.131637 24244 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:18.154067 24106 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:18.157624 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:18.158419 22545 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:18.164796 22402 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:18.158166 24253 consensus_queue.cc:237] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:18.180572 24198 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.181237 24198 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:18.183573 24198 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:18.187908 24289 raft_consensus.cc:3055] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:18.183574 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:18.135381 24290 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:18.189465 22442 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:18.190197 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:18.188347 24289 raft_consensus.cc:740] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:18.136014 24172 consensus_queue.cc:1059] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:17:18.167174 24244 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:18.191905 22402 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:18.185081 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:18.200573 24269 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:18.188802 24061 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.171448 24276 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:18.232597 24276 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:17:18.189754 24106 raft_consensus.cc:697] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:18.238224 24106 consensus_queue.cc:237] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:18.238938 24246 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.239477 24246 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:18.241499 24246 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:18.201467 24244 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:18.243275 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:18.244707 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:18.245316 22400 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:18.245965 24277 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:18.246567 24277 raft_consensus.cc:697] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:18.247591 24277 consensus_queue.cc:237] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:18.251221 22549 raft_consensus.cc:1240] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:18.251345 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:18.251020 24061 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:18.252893 22543 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:18.246090 24267 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:17:18.254674 24289 consensus_queue.cc:260] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:18.255966 24289 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:18.258352 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:18.258991 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:18.260265 23797 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.263566 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:18.219044 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:18.176911 24041 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.210995 22394 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.223198 24290 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:18.266124 22549 raft_consensus.cc:1275] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:18.264325 22545 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:18.267356 24202 raft_consensus.cc:3055] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:18.267906 24290 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:18.223237 24198 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:18.225327 23959 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.189253 24275 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 12:17:18.265583 24041 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:18.275173 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:18.280539 22398 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.259009 22401 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:18.276489 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:17:18.276669 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 87333.7us
I20260709 12:17:18.283138 22442 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:18.284998 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 134254us
I20260709 12:17:18.279662 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:18.285914 22546 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:18.290309 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:18.293855 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:18.253497 24061 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:18.297943 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:18.299639 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:18.300313 22550 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.301817 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:18.302450 22401 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:18.303861 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:18.304548 22401 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:18.304993 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:18.289408 22367 leader_election.cc:336] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.014s (SENT)
I20260709 12:17:18.306591 22367 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:18.305974 22366 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:18.267840 24202 raft_consensus.cc:740] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:18.269098 24172 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:18.349933 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:18.353271 22545 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:18.359824 22401 raft_consensus.cc:2393] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 3: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:18.268647 24198 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:18.366386 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:18.295305 24276 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:18.367848 22442 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:18.305977 24085 consensus_queue.cc:1048] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:17:18.342301 24189 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:18.342929 24290 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:18.375837 22442 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:18.345690 24196 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:18.380200 22550 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:18.382514 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:18.285261 23959 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:18.354858 24121 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:18.387573 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:18.402705 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:18.428663 24198 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:18.410576 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:18.349642 24294 consensus_queue.cc:1059] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:17:18.371366 23797 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:17:18.430300 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 47890.4us
I20260709 12:17:18.425580 22546 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
W20260709 12:17:18.431955 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 56184.2us
I20260709 12:17:18.442273 22442 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:18.434518 22402 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:18.443619 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:18.381938 24267 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.382741 24269 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:18.381877 24189 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.359501 24293 consensus_queue.cc:1059] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:17:18.382813 24290 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.383553 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:18.390004 24196 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.448920 22470 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:18.431864 24275 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:18.460291 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 182941us
I20260709 12:17:18.460565 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:18.358465 24172 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:18.467828 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:18.470443 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:18.471640 22398 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:18.472572 22367 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:18.448982 24269 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.475545 22477 raft_consensus.cc:2393] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:18.475603 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:18.453384 24189 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:18.455125 24290 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.411208 24276 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:18.487596 22474 raft_consensus.cc:2368] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4.
I20260709 12:17:18.437888 23803 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:17:18.465783 24275 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:18.468580 22542 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:18.446266 24121 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:18.501547 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:18.504748 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:18.469848 24106 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:17:18.507469 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:18.482573 24095 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:18.487107 24269 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.515053 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:18.508230 22398 raft_consensus.cc:2393] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:18.461938 24267 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:18.519060 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 51576.1us
I20260709 12:17:18.503499 24275 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:18.522295 22474 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:18.526665 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:18.509068 24059 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:18.534075 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:18.517530 24095 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:18.545184 22401 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:18.547771 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:18.548496 22474 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.528971 24254 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:18.551280 22543 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:18.530756 24041 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:18.533365 24303 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:18.562836 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:18.563537 22469 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:18.563794 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:18.564908 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:18.565624 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:18.566287 22469 raft_consensus.cc:2368] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5.
I20260709 12:17:18.566121 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:18.567847 22473 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.568143 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:18.569175 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:18.567085 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:18.570150 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:18.571301 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:18.572144 22471 raft_consensus.cc:2393] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:18.573179 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:18.572746 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:18.573968 22476 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:18.574863 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:18.576846 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:18.577953 22367 leader_election.cc:400] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4.
I20260709 12:17:18.580833 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:18.572928 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:18.551023 24095 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:18.586282 22547 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:18.588100 22471 raft_consensus.cc:2368] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5.
I20260709 12:17:18.592862 22549 raft_consensus.cc:2393] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 2: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:18.591986 22473 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:18.595408 22441 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:18.594775 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 152926us
I20260709 12:17:18.602762 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:18.603497 22543 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:18.604362 24315 log.cc:927] Time spent T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:18.606240 24319 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:18.606761 24319 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.607121 23930 raft_consensus.cc:1064] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:17:18.610626 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:18.611268 22471 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:18.623273 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:17:18.597056 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 70493us
I20260709 12:17:18.518349 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:17:18.627243 22542 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:18.629885 22477 raft_consensus.cc:606] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:18.630590 22477 raft_consensus.cc:614] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:18.640451 22543 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:18.629863 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:18.644598 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:17:18.647324 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 68167.3us
I20260709 12:17:18.552474 24304 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.210s
I20260709 12:17:18.650906 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:18.607120 24319 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:18.640817 23930 raft_consensus.cc:1068] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932: Unable to promote non-voter 65951063312d4a1e9123f92354101c71: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:17:18.685554 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:18.667321 24246 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:18.701992 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:18.704187 22473 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
W20260709 12:17:18.700253 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 104912us
I20260709 12:17:18.706579 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:18.713366 22393 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:18.714596 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:18.715392 24326 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.715776 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:18.716718 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:18.717093 22393 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:18.717633 24303 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:18.718146 24303 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:18.719411 24307 log.cc:927] Time spent T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:17:18.721338 22397 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:17:18.722132 24306 log.cc:927] Time spent T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:17:18.718046 24169 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.694324 24322 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.766273 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:18.718053 24313 log.cc:927] Time spent T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:17:18.768962 22397 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:18.767025 22401 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:18.727454 24085 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.728128 24325 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:18.780531 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:18.777823 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 72145.6us
I20260709 12:17:18.782953 22516 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:18.783686 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:18.782030 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 70634us
I20260709 12:17:18.763978 24246 raft_consensus.cc:697] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:18.763912 22395 raft_consensus.cc:1275] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:18.798481 24041 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:18.801316 24041 consensus_queue.cc:1059] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.802232 24041 raft_consensus.cc:3055] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:18.802585 24041 raft_consensus.cc:740] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:18.794377 22367 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:18.769634 24311 log.cc:927] Time spent T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
W20260709 12:17:18.769723 24301 log.cc:927] Time spent T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 12:17:18.817101 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:18.818632 22367 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:18.715878 24326 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:18.779454 24267 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:18.792810 24121 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:18.796669 23959 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:18.824724 22367 leader_election.cc:400] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5.
I20260709 12:17:18.902159 22367 leader_election.cc:403] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:17:18.891233 22397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:17:18.818184 24260 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:18.823534 22516 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:18.900643 22471 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:18.792241 24085 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:18.824112 24253 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:18.947475 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 123636us
I20260709 12:17:18.763573 24169 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:18.953210 22367 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:18.954236 22471 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:18.954418 22367 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:18.955600 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:18.890913 23803 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:18.769491 24322 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:18.964382 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 179478us
I20260709 12:17:18.966087 24172 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:18.966638 24316 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.149s
I20260709 12:17:18.943109 24325 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.972783 22548 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:17:18.967659 24308 log.cc:927] Time spent T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 12:17:18.981398 22471 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:18.982520 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:18.989168 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:18.969282 24235 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:18.990576 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 170808us
I20260709 12:17:19.019887 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:18.992342 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:19.021057 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 66711.8us
I20260709 12:17:18.970571 24290 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:19.000303 24293 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.005s	sys 0.000s
I20260709 12:17:18.991772 23131 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:18.989950 24327 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.979341 24189 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.035904 24326 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:18.986886 24246 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:19.051155 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:19.060003 24321 log.cc:927] Time spent T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 12:17:19.010457 24344 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:19.029382 24293 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.005s	sys 0.000s
W20260709 12:17:19.034957 24332 log.cc:927] Time spent T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:17:18.972021 24339 consensus_queue.cc:1059] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:17:19.025607 22474 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:18.972151 23803 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.031160 24338 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:19.036482 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:19.037235 24337 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:19.038867 24322 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.040344 24169 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:19.040836 24331 log.cc:927] Time spent T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:17:19.084707 24189 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.082290 24339 raft_consensus.cc:3055] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:19.085923 24339 raft_consensus.cc:740] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:19.087033 24339 consensus_queue.cc:260] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:19.088456 24339 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:19.089269 22394 consensus_meta.cc:287] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.819s	user 0.012s	sys 0.000s
I20260709 12:17:19.045209 22441 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:19.035459 22544 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:19.045087 23131 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:19.070634 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:19.095618 22545 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
W20260709 12:17:19.073889 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 54101.9us
I20260709 12:17:19.096815 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:19.098201 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:19.023190 22471 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 3: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:19.082145 24328 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5.
I20260709 12:17:19.099308 24337 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:19.100631 24253 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:19.083001 22474 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:19.064533 24327 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.103439 24041 consensus_queue.cc:260] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.104621 24041 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:19.105089 24327 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:19.105635 24172 consensus_queue.cc:1175] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "25ebf14868c042dca42f54b3e251e1b2" responder_term: 3 status { last_received { term: 3 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 3 index: 5 } }
I20260709 12:17:19.106472 22474 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:19.107218 24326 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:19.107678 24269 consensus_meta.cc:287] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.564s	user 0.004s	sys 0.004s
I20260709 12:17:19.107758 24326 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.108146 24269 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.022662 22367 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:19.097455 22473 raft_consensus.cc:1240] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:17:19.113121 22550 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:19.113996 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:19.128548 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 105959us
W20260709 12:17:19.128825 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 83730.9us
I20260709 12:17:19.119163 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:19.130056 22441 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:19.130535 22550 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:19.131260 22367 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:19.084753 24342 log.cc:927] Time spent T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:17:19.132870 24343 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:19.133214 24275 consensus_meta.cc:287] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.002s
I20260709 12:17:19.132599 22296 catalog_manager.cc:5697] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 3 to 4, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 4 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:19.128253 24253 consensus_queue.cc:1059] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:17:19.133939 24324 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:19.134377 24346 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:19.136003 24196 consensus_meta.cc:287] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.001s
I20260709 12:17:19.136615 24269 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.138003 24198 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:19.139271 24348 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:17:19.140158 22548 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:19.143401 23803 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.143908 24235 consensus_queue.cc:1059] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:18.990183 24325 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.209000 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1216) took 1376 ms. Trace:
I20260709 12:17:19.248894 24322 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:19.144312 24095 consensus_meta.cc:287] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.001s
W20260709 12:17:19.211401 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:19.211688 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 84158.5us
I20260709 12:17:19.145887 22441 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:19.146178 22367 leader_election.cc:400] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5.
I20260709 12:17:19.258175 22549 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:19.269842 22367 leader_election.cc:403] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:17:19.132628 24329 log.cc:927] Time spent T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:17:19.208410 24333 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:19.089648 22394 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:19.216045 24338 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:19.207743 24337 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:19.253552 24326 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.147214 23930 consensus_queue.cc:1059] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.155s
W20260709 12:17:19.284298 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 138283us
W20260709 12:17:19.274803 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 129252us
I20260709 12:17:19.257480 24169 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.255206 24198 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:19.288560 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:19.206043 24019 consensus_queue.cc:1059] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:17:19.312290 22441 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:19.316910 22441 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:19.248152 24275 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:19.321121 22441 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:19.255947 24196 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.305604 24343 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5.
I20260709 12:17:19.289646 24269 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:19.331174 22548 raft_consensus.cc:2393] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:19.330876 22441 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:19.334380 22441 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:19.340516 22441 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:19.341709 22367 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:19.327589 24244 consensus_meta.cc:287] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 1.084s	user 0.012s	sys 0.000s
I20260709 12:17:19.288792 23803 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:19.340394 22469 raft_consensus.cc:2393] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:19.343592 22397 raft_consensus.cc:606] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:19.287665 24095 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.317631 24338 raft_consensus.cc:697] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:19.325721 24267 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:19.328742 24121 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:19.315899 24327 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:19.335556 24326 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:19.367434 22367 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:19.349848 22397 raft_consensus.cc:614] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:19.315667 24198 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:19.354296 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 222231us
I20260709 12:17:19.347456 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:19.369323 22551 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:19.333068 24277 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:19.274471 24322 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.317003 24333 raft_consensus.cc:697] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:19.320253 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1116) took 1160 ms. Trace:
I20260709 12:17:19.328320 24169 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:19.344628 24348 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.390090 22402 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:19.381841 22476 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:19.333731 24246 consensus_queue.cc:1059] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:17:19.354175 24253 consensus_queue.cc:1243] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer b8621fa34be04d3fa2d68a300f858cd1 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:19.355073 24290 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:19.370265 24289 consensus_meta.cc:287] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 1.114s	user 0.010s	sys 0.006s
W20260709 12:17:19.402837 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 132791us
I20260709 12:17:19.396173 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:19.347769 24340 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:19.381034 24061 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.356071 24244 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.413398 22475 raft_consensus.cc:2410] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:19.387598 24121 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:19.394731 24189 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.387496 24326 raft_consensus.cc:697] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:19.361514 23803 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.395244 23797 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:19.398263 24277 raft_consensus.cc:697] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:19.465669 24277 consensus_queue.cc:237] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.466419 24169 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.386754 22394 rpcz_store.cc:276] 0709 12:17:18.145612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.183332 (+ 37720us) service_pool.cc:224] Handling call
0709 12:17:19.306049 (+1122717us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:19.396173 24269 raft_consensus.cc:697] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:19.409965 24337 raft_consensus.cc:3055] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:19.458019 24336 consensus_queue.cc:1059] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:17:19.458597 24323 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:17:19.459318 24309 log.cc:927] Time spent T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.966s	user 0.004s	sys 0.003s
I20260709 12:17:19.460367 24067 raft_consensus.cc:3055] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:19.460708 24326 consensus_queue.cc:237] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.461511 24341 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.462112 24335 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.266827 22468 rpcz_store.cc:276] 0709 12:17:17.832094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:17.845390 (+ 13296us) service_pool.cc:224] Handling call
0709 12:17:17.946526 (+101136us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:18.047450 (+100924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:18.056213 (+  8763us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:18.140199 (+ 83986us) log.cc:844] Serialized 52 byte log entry
0709 12:17:18.387012 (+246813us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:18.584562 (+197550us) log.cc:844] Serialized 14 byte log entry
0709 12:17:18.640636 (+ 56074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:18.651078 (+ 10442us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:18.722614 (+ 71536us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b180010c480. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a67522 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:17:19.124608 (+401994us) raft_consensus.cc:1685] finished
0709 12:17:19.208641 (+ 84033us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:19.208818 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45642,"prepare.queue_time_us":284141,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":142529,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":21344,"spinlock_wait_cycles":4493696,"thread_start_us":239450,"threads_started":2,"wal-append.queue_time_us":315736}
W20260709 12:17:19.463063 24350 log.cc:927] Time spent T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:17:19.455184 24061 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:19.464095 24349 log.cc:927] Time spent T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:17:19.464524 24357 raft_consensus.cc:3055] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:19.456916 23797 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:19.470917 22400 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:19.381788 24343 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:17:19.478745 22551 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
W20260709 12:17:19.479564 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 91298.7us
W20260709 12:17:19.480631 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 140196us
I20260709 12:17:19.478335 24059 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:19.479812 24067 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:19.483167 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1106) took 1368 ms. Trace:
I20260709 12:17:19.483695 24359 raft_consensus.cc:1064] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:17:19.504532 22396 rpcz_store.cc:276] 0709 12:17:18.114588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.118066 (+  3478us) service_pool.cc:224] Handling call
0709 12:17:18.148899 (+ 30833us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:18.198831 (+ 49932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:18.200878 (+  2047us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:18.233529 (+ 32651us) log.cc:844] Serialized 26 byte log entry
0709 12:17:18.355744 (+122215us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:18.362035 (+  6291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:18.378471 (+ 16436us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:19.458637 (+1080166us) spinlock_profiling.cc:243] Waited 6.3 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:19.482827 (+ 24190us) raft_consensus.cc:1685] finished
0709 12:17:19.482854 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:19.483087 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21989,"raft.queue_time_us":27826,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":147,"spinlock_wait_cycles":14495616,"thread_start_us":108514,"threads_started":1,"wal-append.queue_time_us":206736}
I20260709 12:17:19.506528 24359 consensus_queue.cc:237] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:19.508744 24196 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.513516 23803 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.515566 24061 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.498883 23797 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:19.517477 24269 consensus_queue.cc:237] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.518549 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:19.519125 23131 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:19.494365 24333 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.484184 24085 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:19.484858 24323 raft_consensus.cc:697] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:17:19.485531 24354 log.cc:927] Time spent T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:17:19.485683 24275 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:19.485714 24202 consensus_queue.cc:260] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:19.487293 22473 raft_consensus.cc:1240] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:19.396819 24348 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.468830 24244 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:19.488826 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 106530us
W20260709 12:17:19.546357 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 46805.1us
I20260709 12:17:19.547075 22441 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:19.547670 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:19.490864 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:19.473886 24337 raft_consensus.cc:740] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:19.548007 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:19.456946 24189 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:19.496518 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:19.551126 22549 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:19.501233 24059 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.490357 24335 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.494119 24357 raft_consensus.cc:740] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:19.530516 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1463) took 1227 ms. Trace:
I20260709 12:17:19.531574 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 112) took 1265 ms. Trace:
I20260709 12:17:19.539641 24267 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:19.541465 24290 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:19.541841 24364 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:19.541359 24121 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:19.541357 24348 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:19.529664 24276 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.552119 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:19.556958 22550 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:19.559230 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:19.530572 24303 consensus_meta.cc:287] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.812s	user 0.005s	sys 0.005s
I20260709 12:17:19.587672 24303 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.563406 22366 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:19.495069 22548 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:19.622656 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1403) took 1058 ms. Trace:
I20260709 12:17:19.623464 24314 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:19.624120 24314 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.564062 22547 rpcz_store.cc:276] 0709 12:17:18.303258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.303439 (+   181us) service_pool.cc:224] Handling call
0709 12:17:18.452233 (+148794us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:18.591817 (+139584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:19.530241 (+938424us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54001b9750. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:19.530404 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317672192}
I20260709 12:17:19.616811 24198 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.566090 22398 rpcz_store.cc:276] 0709 12:17:18.266339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.520106 (+253767us) service_pool.cc:224] Handling call
0709 12:17:18.532479 (+ 12373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:18.594451 (+ 61972us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:18.606082 (+ 11631us) log.cc:844] Serialized 14 byte log entry
0709 12:17:18.945117 (+339035us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:18.945184 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:18.945230 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:19.531315 (+586085us) spinlock_profiling.cc:243] Waited 56.1 ms on lock 0x7b5400225954. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:19.531364 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:19.531510 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19974,"prepare.queue_time_us":1298,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":35283,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":53,"spinlock_wait_cycles":129102080,"thread_start_us":318605,"threads_started":2,"wal-append.queue_time_us":367785}
I20260709 12:17:19.573649 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:19.574021 22402 raft_consensus.cc:1275] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:19.499519 24325 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.573307 24260 consensus_queue.cc:1059] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:17:19.577121 24361 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:19.577438 22469 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:19.578146 24059 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.578315 22401 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:19.578420 24121 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.579195 23803 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.578135 22394 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:19.573738 24246 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.579876 24365 consensus_queue.cc:1048] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:17:19.580729 22396 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:19.581852 24335 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.583657 24357 consensus_queue.cc:260] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.584647 23797 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:19.585067 24323 consensus_queue.cc:237] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.648499 24361 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:19.649694 24328 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:19.585915 24364 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:19.655669 23803 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.664983 24364 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.586720 24290 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:19.666162 23803 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.667317 24290 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:19.567238 22474 raft_consensus.cc:1275] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:19.491815 24341 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:19.588881 24294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.116s	user 0.007s	sys 0.021s
W20260709 12:17:19.592023 24319 consensus_meta.cc:287] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.893s	user 0.002s	sys 0.009s
I20260709 12:17:19.579072 22468 raft_consensus.cc:1275] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:19.662591 24328 raft_consensus.cc:697] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:19.692312 24314 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.558012 24061 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:17:19.570768 24085 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:17:19.598078 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:19.601248 24322 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.602214 24337 consensus_queue.cc:260] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:19.604234 24189 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:19.561383 24106 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:17:19.702171 24337 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:19.569669 24340 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:19.480563 24338 consensus_queue.cc:237] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:17:19.682061 24294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.212s	user 0.007s	sys 0.021s
I20260709 12:17:19.608366 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:19.706363 22470 raft_consensus.cc:2410] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:19.572265 24366 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:17:19.611486 24289 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.615041 22397 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:19.618341 24304 raft_consensus.cc:3055] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:17:19.619159 22367 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.648s (SENT) [suppressed 27 similar messages]
I20260709 12:17:19.623068 22472 rpcz_store.cc:276] 0709 12:17:18.563770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.563963 (+   193us) service_pool.cc:224] Handling call
0709 12:17:18.564286 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:18.698953 (+134667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:18.698982 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:19.109025 (+410043us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b2c00001368. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f744da11 00007fb4f745d372 00007fb4f8b8fa01 00007fb4f8b5443a 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2
0709 12:17:19.109508 (+   483us) log.cc:844] Serialized 52 byte log entry
0709 12:17:19.252392 (+142884us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:19.289042 (+ 36650us) log.cc:844] Serialized 14 byte log entry
0709 12:17:19.621889 (+332847us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b1800364fc0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f59e1c0a 00007fb4ff121219 00007fb4f5a69a40 00007fb4f5a644e4 00007fb4f5a64455 00007fb4fc54c3c7 00007fb4f8b5e9a7 00007fb4f8b6e0bf 00007fb4f8b6e038
0709 12:17:19.622106 (+   217us) log.cc:844] Serialized 14 byte log entry
0709 12:17:19.622304 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:19.622388 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:19.622429 (+    41us) raft_consensus.cc:1685] finished
0709 12:17:19.622441 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:19.622594 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":303731,"prepare.queue_time_us":50833,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":6579,"raft.queue_time_us":101585,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":17491,"spinlock_wait_cycles":38141440,"thread_start_us":276704,"threads_started":2,"wal-append.queue_time_us":210494}
W20260709 12:17:19.631516 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 68174.6us
I20260709 12:17:19.650476 24198 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:19.651404 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 95849.5us
W20260709 12:17:19.651845 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 103806us
I20260709 12:17:19.657725 22544 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:19.670095 22399 raft_consensus.cc:2368] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 3. Current term is 4.
W20260709 12:17:19.658990 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.723371 22441 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:19.670601 22398 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:19.660584 23797 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:19.687000 24095 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.687445 24319 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:19.592720 24254 raft_consensus.cc:3055] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:19.658607 24357 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:19.734810 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:19.735437 23130 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:19.738155 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:19.698338 24324 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:19.739498 24324 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:19.689574 22468 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:19.664021 24121 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.658787 24303 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:19.662187 24361 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:19.716277 24267 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:17:19.669876 24246 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.751479 24246 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:19.706401 22395 raft_consensus.cc:2410] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:19.753862 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:19.755330 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:19.755988 22395 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:19.757323 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:19.757958 24341 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.758518 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:19.759840 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:19.760036 24319 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:19.760461 22398 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:19.727674 22473 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:17:19.730422 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:19.774364 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:19.716498 24304 raft_consensus.cc:740] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:19.822602 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:19.734030 24269 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:19.823457 23130 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:17:19.824623 22393 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:19.825593 24041 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.826119 24041 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.826354 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:19.827997 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:19.828104 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:19.828533 22393 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:19.828886 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:19.731139 24254 raft_consensus.cc:740] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:19.721609 24289 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.729607 24275 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 12:17:19.758056 22394 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:19.692605 24328 consensus_queue.cc:237] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.787191 22366 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:19.830201 24269 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:19.843361 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:19.768908 24095 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:19.845250 22474 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
W20260709 12:17:19.845556 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 58473.1us
I20260709 12:17:19.843348 24041 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.852259 24275 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:19.856240 22393 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:19.858137 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:19.828778 22396 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:19.864741 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:19.777981 24319 consensus_queue.cc:1059] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:17:19.865979 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:19.866485 24319 raft_consensus.cc:3055] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:19.866887 24319 raft_consensus.cc:740] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:19.867080 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:19.867754 24319 consensus_queue.cc:260] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:19.862314 23130 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:19.868636 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:19.869010 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:19.869732 22393 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:19.869867 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:19.870525 22474 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:19.870085 24254 consensus_queue.cc:260] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.860471 24189 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:19.871125 24254 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:19.871423 24189 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:19.836311 24345 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:19.871937 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:19.872406 24345 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:19.873860 24095 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.870548 22393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:17:19.874622 24345 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.875898 24095 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:19.841128 24324 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:19.885085 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.776782 24340 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.868145 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:19.862514 22470 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:19.893244 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:19.893368 22474 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
W20260709 12:17:19.898137 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 278986us
I20260709 12:17:19.871881 24189 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:19.862383 24269 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:19.753758 24067 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.917455 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
W20260709 12:17:19.920423 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.906256 24095 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:19.927749 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1419) took 1359 ms. Trace:
I20260709 12:17:19.928030 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:19.927281 22367 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:19.906363 24293 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:19.929800 22470 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:19.918556 24260 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.918623 24067 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:19.928274 22476 rpcz_store.cc:276] 0709 12:17:18.568314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.574643 (+  6329us) service_pool.cc:224] Handling call
0709 12:17:19.927589 (+1352946us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b540030a2d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:19.927694 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1854189952}
W20260709 12:17:19.931057 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 206714us
I20260709 12:17:19.934188 22402 raft_consensus.cc:1240] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:17:19.919723 24365 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.932914 24085 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:19.930553 24095 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:19.930708 24106 raft_consensus.cc:3055] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:19.938547 24106 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:19.938828 23803 consensus_queue.cc:1059] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:19.939656 23803 raft_consensus.cc:3055] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:19.939357 24106 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.939989 23803 raft_consensus.cc:740] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:19.940804 23803 consensus_queue.cc:260] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.932782 24345 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:19.942658 23803 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:19.943336 24365 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:19.947156 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.948293 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:19.860134 24304 consensus_queue.cc:260] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.951743 22367 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:19.959388 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:17:19.960727 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:19.961237 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.955674 22367 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:19.904313 24340 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:19.966588 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:19.967932 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:19.968559 22542 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:19.971608 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:19.974124 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:19.974236 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:19.974895 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.941337 24293 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:19.984753 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:19.985368 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:19.986896 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:20.007072 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:19.981582 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:19.964841 24356 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.009689 24356 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.011826 24356 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:19.921687 24361 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.013782 22473 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:20.014258 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:20.049322 22548 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:20.050513 24361 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:20.025056 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:20.017279 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:20.018146 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:19.935832 24260 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.019871 24340 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:20.022275 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:19.983506 24304 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:19.957886 24106 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:19.977288 24059 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:19.981745 24337 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:20.023257 22393 raft_consensus.cc:606] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:20.072521 22393 raft_consensus.cc:614] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:20.023420 22472 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.025125 24293 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:20.025532 23930 raft_consensus.cc:3055] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:20.026930 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:20.074605 22543 raft_consensus.cc:2410] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:19.982983 24317 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:20.075842 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:20.028601 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:20.029224 22551 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:19.987316 24246 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:19.972877 24328 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:20.031760 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:20.079988 22398 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:20.032675 23095 leader_election.cc:400] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 3. Current term is 4.
I20260709 12:17:20.080775 23095 leader_election.cc:403] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:20.034755 22545 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:20.036680 22441 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:19.985836 24303 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:20.041594 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:19.948607 24346 consensus_queue.cc:1059] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 12:17:20.056730 23131 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 4 LEARNER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:20.057161 22399 raft_consensus.cc:2393] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 4: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:20.058604 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:20.085624 24324 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 3. Current term is 4.
I20260709 12:17:20.088328 24085 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:20.088776 24346 raft_consensus.cc:3055] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:20.068063 22548 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:20.051786 24365 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:20.078382 23122 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:20.067171 24059 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.075793 23930 raft_consensus.cc:740] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:17:20.081698 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 45110.5us
I20260709 12:17:20.057399 24345 raft_consensus.cc:697] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:17:20.084024 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 51503.8us
I20260709 12:17:20.084692 22470 raft_consensus.cc:2393] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 2: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:20.061121 22394 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:20.147516 24319 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.083243 24328 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:20.150094 24328 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:20.151872 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:20.153061 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:20.154048 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:20.154278 24355 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.683s	user 0.004s	sys 0.000s
I20260709 12:17:20.071815 24289 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:20.074932 24337 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:20.089138 24346 raft_consensus.cc:740] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:20.155571 24346 consensus_queue.cc:260] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.156147 24076 raft_consensus.cc:3055] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:20.156529 24076 raft_consensus.cc:740] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:20.156749 24346 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.089414 24340 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:20.137758 22398 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:20.158054 24340 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.158151 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1226) took 1477 ms. Trace:
I20260709 12:17:20.158841 22398 raft_consensus.cc:1240] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:20.138499 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:20.138181 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:20.160099 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:20.159803 23930 consensus_queue.cc:260] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.134927 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:20.119874 24059 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:20.160331 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:20.160491 24337 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:20.158528 22471 rpcz_store.cc:276] 0709 12:17:18.680961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.125884 (+444923us) service_pool.cc:224] Handling call
0709 12:17:19.126191 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:19.204667 (+ 78476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:19.204703 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:19.205374 (+   671us) log.cc:844] Serialized 52 byte log entry
0709 12:17:19.310341 (+104967us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:19.310382 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:19.310517 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:20.095651 (+785134us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:20.157847 (+ 62196us) raft_consensus.cc:1685] finished
0709 12:17:20.157868 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:20.158091 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":225,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":90,"spinlock_wait_cycles":9504640,"thread_start_us":104590,"threads_started":1,"wal-append.queue_time_us":181193}
W20260709 12:17:20.181785 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 206337us
I20260709 12:17:20.183600 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:20.184137 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 47599.6us
I20260709 12:17:20.184556 22471 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:20.185168 22441 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:20.185523 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:20.186024 22471 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:20.194173 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:20.194984 22469 raft_consensus.cc:2393] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:20.089586 24303 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.197037 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:20.168282 24340 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:20.084483 24317 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.199908 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:20.184751 23930 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.205489 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:20.207567 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:20.199395 22471 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:20.098908 24359 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 12:17:20.157349 24076 consensus_queue.cc:260] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:20.203542 24322 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:20.208380 24382 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 12:17:20.212769 22476 raft_consensus.cc:2376] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5. Re-sending same reply.
I20260709 12:17:20.224330 22476 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:20.213436 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:20.211509 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:20.213690 22547 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:17:20.218500 22546 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:20.234510 22476 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:17:20.235040 22476 pending_rounds.cc:85] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 2
I20260709 12:17:20.235337 22476 pending_rounds.cc:107] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:17:20.235617 22476 raft_consensus.cc:2889] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:20.241575 22471 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:20.243901 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:20.203230 24360 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:17:20.248989 24076 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:20.221371 24322 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.250370 24260 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:20.253819 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:17:20.255050 24386 log.cc:927] Time spent T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:17:20.255069 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:20.212654 24246 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:17:20.210760 24294 consensus_queue.cc:1048] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:17:20.204952 24357 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:17:20.267345 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:20.272166 22397 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:20.210196 24389 consensus_queue.cc:1059] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:17:20.289577 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:20.290686 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:20.291262 22471 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:20.279641 22468 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.292102 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:20.271361 24322 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.287384 24317 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:20.306752 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:20.307193 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.308440 22394 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
W20260709 12:17:20.309549 22576 heartbeater.cc:646] Failed to heartbeat to 127.20.191.62:37293 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.191.62:37293 timed out after 15.000s (SENT)
I20260709 12:17:20.312042 24389 raft_consensus.cc:3055] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:20.312322 24095 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:20.312785 24389 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:20.306329 22468 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:20.314121 24345 consensus_queue.cc:237] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:20.318706 22475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1400) took 1755 ms (client timeout 1934 ms). Trace:
W20260709 12:17:20.319164 22475 rpcz_store.cc:269] 0709 12:17:18.562825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.569885 (+  7060us) service_pool.cc:224] Handling call
0709 12:17:20.318467 (+1748582us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b5400395b54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:20.318630 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1930710272}
I20260709 12:17:20.320591 22475 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:20.321707 22477 raft_consensus.cc:1275] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:17:20.322085 22477 pending_rounds.cc:85] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 1
I20260709 12:17:20.322299 22477 pending_rounds.cc:107] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:20.322510 22477 raft_consensus.cc:2889] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:20.323112 22472 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:20.324111 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1418) took 1756 ms. Trace:
W20260709 12:17:20.313898 24376 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.579s	user 0.000s	sys 0.002s
I20260709 12:17:20.324469 22477 rpcz_store.cc:276] 0709 12:17:18.568038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.904127 (+336089us) service_pool.cc:224] Handling call
0709 12:17:20.321366 (+1417239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:20.322878 (+  1512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:20.323944 (+  1066us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400395b50. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:20.324060 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3258664320}
I20260709 12:17:20.313891 24389 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.330912 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:20.331681 22543 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:20.332083 24389 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:20.332647 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:20.324307 22472 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:20.333470 22475 raft_consensus.cc:1240] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:20.334730 22470 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:17:20.275279 24391 log.cc:927] Time spent T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:17:20.340068 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:20.351640 22551 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.353302 24269 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.354038 22472 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:20.342033 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:20.354648 22401 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:20.343143 22477 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:20.344816 23095 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:20.356679 23095 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:20.345242 22442 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:20.350076 22367 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:20.349742 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.341564 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:20.353801 22402 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:20.373332 22442 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:20.285359 24328 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.378553 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:20.380309 24061 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:20.380681 24061 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.381006 24061 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:20.380965 22367 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:20.377477 24395 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:20.382360 24395 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.382699 24395 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:20.370915 24392 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:20.385922 24335 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:20.387600 22367 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:20.388278 22442 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:20.394687 24198 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:20.401270 22442 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:20.402683 22442 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:20.403968 22442 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:20.407435 24371 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:20.407657 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:20.408408 24327 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:20.408951 24327 raft_consensus.cc:697] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:20.409176 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:20.409394 24333 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:20.407915 24371 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.413352 22442 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:20.416518 22367 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:20.395850 24275 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:20.404623 24374 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:20.423614 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:20.405913 24392 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.414188 24371 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.446683 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:20.447597 22393 raft_consensus.cc:2410] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:20.426302 24363 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:20.450229 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1121) took 2277 ms. Trace:
I20260709 12:17:20.428833 24276 consensus_queue.cc:1059] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:20.454555 22401 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
W20260709 12:17:20.432682 22297 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50176 (request call id 183) took 15318 ms (client timeout 15000 ms). Trace:
I20260709 12:17:20.438488 22296 catalog_manager.cc:5697] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 2 to 4, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 4 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:20.405824 24095 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:20.443364 22543 raft_consensus.cc:2368] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
I20260709 12:17:20.442355 24374 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:20.444337 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.444989 24392 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:20.449580 22393 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:17:20.450629 22400 rpcz_store.cc:276] 0709 12:17:18.172696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.411746 (+239050us) service_pool.cc:224] Handling call
0709 12:17:18.450170 (+ 38424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:19.496787 (+1046617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:20.449998 (+953211us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540005d7d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:20.450173 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2342945536}
I20260709 12:17:20.456127 22401 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:20.474953 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:20.457048 22296 catalog_manager.cc:5697] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:20.477682 22296 catalog_manager.cc:5697] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:20.412835 24189 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:20.469758 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 53346.8us
I20260709 12:17:20.405592 24290 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:17:20.466163 22551 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:20.484511 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:20.484992 22393 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:17:20.488673 22393 pending_rounds.cc:85] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 2
I20260709 12:17:20.488922 22393 pending_rounds.cc:107] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:17:20.489137 22393 raft_consensus.cc:2889] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:20.469337 24374 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:20.486971 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.470544 24346 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:20.486989 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:20.468441 24303 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:20.486282 22401 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:17:20.495906 22401 pending_rounds.cc:85] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 2
I20260709 12:17:20.496188 22401 pending_rounds.cc:107] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:17:20.496407 22401 raft_consensus.cc:2889] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:20.492859 23128 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:20.479303 22296 catalog_manager.cc:5697] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 1 to 3, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 3 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:20.473420 24341 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:20.458724 24337 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.500809 22396 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:17:20.498831 22296 catalog_manager.cc:5697] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 2 to 3, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 3 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:20.502226 22367 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:20.495253 24085 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:17:20.527972 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:20.455830 22297 rpcz_store.cc:269] 0709 12:17:05.114174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.114326 (+   152us) service_pool.cc:224] Handling call
0709 12:17:20.432577 (+15318251us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:17.388689 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:17.419840 (+ 31151us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:17.419894 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:17:17.419929 (+    35us) tablet.cc:662] Decoding operations
0709 12:17:17.420523 (+   594us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:17.420624 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:17.420656 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:17:17.421039 (+   383us) tablet.cc:701] Row locks acquired
0709 12:17:17.421088 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:17:17.421300 (+   212us) write_op.cc:270] Start()
0709 12:17:17.421480 (+   180us) write_op.cc:276] Timestamp: P: 1783599437421236 usec, L: 0
0709 12:17:17.421529 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 12:17:17.486141 (+ 64612us) log.cc:844] Serialized 979 byte log entry
0709 12:17:17.834469 (+348328us) op_driver.cc:464] REPLICATION: finished
0709 12:17:18.141499 (+307030us) write_op.cc:301] APPLY: starting
0709 12:17:18.141603 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:18.141740 (+   137us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:18.141924 (+   184us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:18.142409 (+   485us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:18.142711 (+   302us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:17:18.142783 (+    72us) write_op.cc:312] APPLY: finished
0709 12:17:18.143052 (+   269us) log.cc:844] Serialized 28 byte log entry
0709 12:17:18.143225 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:18.143308 (+    83us) write_op.cc:454] Released schema lock
0709 12:17:18.143358 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:18.143722 (+   364us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:18.143754 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":376553,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":297345,"apply.run_cpu_time_us":2224,"apply.run_wall_time_us":2225,"num_ops":2,"prepare.queue_time_us":137373,"prepare.run_cpu_time_us":16404,"prepare.run_wall_time_us":216702,"raft.queue_time_us":184701,"raft.run_cpu_time_us":68650,"raft.run_wall_time_us":130683,"replication_time_us":412775,"thread_start_us":438830,"threads_started":4,"wal-append.queue_time_us":151887,"wal-append.run_cpu_time_us":12328,"wal-append.run_wall_time_us":1560386}]]}
I20260709 12:17:20.522804 22296 catalog_manager.cc:5697] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 2 to 4, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:20.534744 22542 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:20.528716 22551 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:20.537501 22296 catalog_manager.cc:5697] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 1 to 3, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 3 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:20.539731 22296 catalog_manager.cc:5697] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 1 to 4, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 4 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
W20260709 12:17:20.531528 24314 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.021s	sys 0.024s
I20260709 12:17:20.528591 24246 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:20.521219 24346 raft_consensus.cc:697] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:17:20.547772 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 45693.6us
I20260709 12:17:20.541815 22296 catalog_manager.cc:5697] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:20.511376 23803 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:17:20.536124 24338 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:20.523461 24322 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:20.550681 24314 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.022s	sys 0.024s
I20260709 12:17:20.584183 22471 raft_consensus.cc:2393] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 4: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:20.529444 24327 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.559034 24328 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:20.553197 22296 catalog_manager.cc:5697] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 1 to 4, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 4 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:20.573167 24235 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:20.576370 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 153309us
I20260709 12:17:20.573376 24269 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:20.604905 24235 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.607229 24235 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:20.601869 22296 catalog_manager.cc:5697] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index -1 to 3, term changed from 2 to 4, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3), NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 4 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:17:20.609429 22542 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:17:20.610636 24106 consensus_meta.cc:287] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.538s	user 0.007s	sys 0.003s
I20260709 12:17:20.611413 22550 raft_consensus.cc:2368] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6.
I20260709 12:17:20.556617 24007 consensus_queue.cc:1048] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:17:20.543286 24363 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:20.596583 24341 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:20.599002 24371 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:20.600310 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.576880 24338 raft_consensus.cc:697] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:20.555438 24246 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.559199 24198 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:17:20.556492 24061 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.639390 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:20.639806 24061 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:20.640091 23130 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:20.641593 24246 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:20.642320 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:17:20.648453 24303 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:20.649089 24303 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:20.651345 24303 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:20.653949 24328 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:20.654480 24328 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:20.656585 24328 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:20.665089 22468 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:20.665563 24202 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:20.681180 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.683754 24235 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:20.685261 24235 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:20.687652 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:20.634981 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:20.696173 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.577044 24340 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.698630 24340 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:20.699299 24253 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:20.699898 24253 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.703629 24253 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:20.695020 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:20.705405 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:20.707566 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 103727us
I20260709 12:17:20.717882 22547 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:20.718094 22442 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:20.630128 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 78384.3us
I20260709 12:17:20.684654 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:20.690711 22366 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:20.729319 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 87082.3us
I20260709 12:17:20.635699 24341 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:20.750277 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 59625.6us
I20260709 12:17:20.751204 22366 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:20.753224 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:20.754163 22477 raft_consensus.cc:2368] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6.
I20260709 12:17:20.755223 22476 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:20.756930 22477 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:20.764544 22366 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:20.773691 22477 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:20.708966 24267 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:20.773449 22367 leader_election.cc:400] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6.
I20260709 12:17:20.632712 24395 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:20.714404 24269 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:20.766201 24061 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:20.747645 24363 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.748837 24253 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:20.778870 22367 leader_election.cc:403] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:17:20.823143 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 49841.9us
I20260709 12:17:20.824156 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:20.824755 22398 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.784313 22550 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:20.826076 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:20.783432 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:20.729039 24189 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:20.791108 22543 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:20.788964 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:20.789902 24254 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:20.840227 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 56866.7us
I20260709 12:17:20.792838 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:20.794502 24337 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:20.772820 24095 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:20.789800 24267 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:20.853049 22401 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:20.855847 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:20.852372 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:20.854034 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:20.858109 22400 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.858233 22397 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:17:20.855324 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 285500us
I20260709 12:17:20.795325 24338 consensus_queue.cc:237] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:20.800207 22394 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:20.780045 24290 consensus_queue.cc:1059] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:17:20.783802 24366 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 12:17:20.802704 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.780393 24289 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:17:20.780288 24406 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:17:20.805796 24392 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:20.808202 24395 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:20.791850 24412 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:20.705361 24346 consensus_queue.cc:237] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.809990 24269 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:20.851992 24095 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.813752 22545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1482) took 1263 ms. Trace:
W20260709 12:17:20.817494 24059 consensus_meta.cc:287] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.634s	user 0.008s	sys 0.002s
I20260709 12:17:20.757071 22395 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:20.777031 24041 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:20.947690 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:20.819047 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:20.949923 22546 raft_consensus.cc:2393] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:20.777788 24409 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:20.821063 24169 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.776928 24389 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:17:20.785566 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:20.843442 22441 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:20.975787 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 132440us
I20260709 12:17:20.856427 22402 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:20.851372 24402 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.276s	user 0.003s	sys 0.001s
I20260709 12:17:20.879639 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:20.979020 22475 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:20.979888 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:20.877911 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:20.889336 22516 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:20.848902 24407 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.212s	user 0.003s	sys 0.000s
W20260709 12:17:20.891739 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 103038us
W20260709 12:17:20.852603 24403 log.cc:927] Time spent T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.248s	user 0.001s	sys 0.003s
W20260709 12:17:20.852733 24404 log.cc:927] Time spent T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.135s	user 0.000s	sys 0.003s
I20260709 12:17:20.896524 22398 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
W20260709 12:17:20.853247 24410 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.077s	user 0.005s	sys 0.004s
I20260709 12:17:20.891237 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1424) took 1064 ms. Trace:
I20260709 12:17:20.945247 24059 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:20.849174 24253 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:20.812391 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1143) took 1035 ms. Trace:
I20260709 12:17:20.989920 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:20.991288 22396 rpcz_store.cc:276] 0709 12:17:19.777246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.909796 (+132550us) service_pool.cc:224] Handling call
0709 12:17:19.910136 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:20.509071 (+598935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:20.812133 (+303062us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b540006ed54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:20.812331 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1357930240}
I20260709 12:17:20.991981 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:20.992538 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:20.993075 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:20.993323 22396 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 4: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:20.849377 23803 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:17:20.939451 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:20.938031 22545 rpcz_store.cc:276] 0709 12:17:19.550137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.558939 (+  8802us) service_pool.cc:224] Handling call
0709 12:17:20.813548 (+1254609us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54003ca5d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:20.813672 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1054296832}
I20260709 12:17:20.994872 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:20.853708 24007 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:17:20.853785 23930 consensus_queue.cc:1059] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:17:20.852106 24106 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:17:20.904336 24198 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:20.969184 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:21.003034 22548 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.970292 22550 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:20.976830 22441 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:20.909744 24412 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:20.917541 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:20.977797 24169 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:20.987846 23094 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:20.974949 24409 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:21.013283 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 49600.5us
I20260709 12:17:20.945191 24041 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.990583 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:20.851783 24414 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.987584 24327 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:20.995394 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:20.967730 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1140) took 1199 ms. Trace:
I20260709 12:17:20.943161 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:20.995455 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:20.997370 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:20.998205 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:21.020666 22396 raft_consensus.cc:2410] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:20.990008 22469 rpcz_store.cc:276] 0709 12:17:19.826333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.195540 (+369207us) service_pool.cc:224] Handling call
0709 12:17:20.208873 (+ 13333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:20.212190 (+  3317us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:20.241900 (+ 29710us) log.cc:844] Serialized 14 byte log entry
0709 12:17:20.467896 (+225996us) log.cc:844] Serialized 14 byte log entry
0709 12:17:20.675541 (+207645us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b18000b43a0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a49e07 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a64455 00007fb4f8b4c060 00007fb4f8b5e716 00007fb4f8b6f287 00007fb4f8b6f208
0709 12:17:20.890903 (+215362us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:20.890952 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:20.890992 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:20.891060 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:20.891178 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11054,"prepare.queue_time_us":26126,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":74,"raft.queue_time_us":74570,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":11158,"spinlock_wait_cycles":3393280,"thread_start_us":422436,"threads_started":2,"wal-append.queue_time_us":278614}
I20260709 12:17:21.020684 22399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:17:21.021374 22399 raft_consensus.cc:606] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:20.946753 24061 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:21.006765 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 117517us
I20260709 12:17:21.026463 22401 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:21.026422 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:21.029050 22516 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:21.007452 22543 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:21.008231 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:21.001868 24253 raft_consensus.cc:697] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:21.014875 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:21.015573 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1096) took 1038 ms. Trace:
I20260709 12:17:21.019933 22549 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.022791 22399 raft_consensus.cc:614] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:21.023895 22476 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:21.013382 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:20.989668 24267 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:21.007429 24198 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.072264 24198 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.074110 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:21.034420 22396 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:21.076138 23129 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:21.036625 22441 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:21.078263 24267 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.033550 24389 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:21.079205 22441 leader_election.cc:400] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
I20260709 12:17:21.079507 22441 leader_election.cc:403] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:21.079622 23803 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:21.011044 22550 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:21.080575 24059 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:21.080346 23803 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:21.047308 22542 rpcz_store.cc:276] 0709 12:17:19.977083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.610406 (+633323us) service_pool.cc:224] Handling call
0709 12:17:20.610668 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:20.610858 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:20.611132 (+   274us) log.cc:844] Serialized 14 byte log entry
0709 12:17:21.015137 (+404005us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:21.015301 (+   164us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:21.015343 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:21.015403 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:21.015519 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2662,"prepare.queue_time_us":1224,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":2784,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":6357,"thread_start_us":400874,"threads_started":1}
I20260709 12:17:21.011600 24095 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.040192 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:20.970111 24235 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:17:21.013820 24067 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.097584 24067 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.099674 24067 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:21.027729 24411 consensus_queue.cc:1059] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:17:21.101816 24411 raft_consensus.cc:3055] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:21.088737 24267 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
I20260709 12:17:21.026710 23123 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:21.063702 23930 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:21.064038 22401 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:21.019770 24327 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:21.067911 24246 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:21.013252 24337 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.010454 24412 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.019374 24336 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:21.134222 22543 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:21.039057 22545 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:17:21.080467 22441 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:21.137874 22545 pending_rounds.cc:85] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 3
I20260709 12:17:21.090327 22550 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:21.138154 22545 pending_rounds.cc:107] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:17:21.091434 22548 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:21.138387 22545 raft_consensus.cc:2889] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:20.911780 24326 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.128s
I20260709 12:17:21.096621 22542 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:17:21.063731 23122 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 4 LEARNER]: Advancing to term 5
W20260709 12:17:21.105852 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.107864 22549 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:21.113909 24327 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:21.126581 24374 consensus_meta.cc:287] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.000s
I20260709 12:17:21.019646 22395 rpcz_store.cc:276] 0709 12:17:19.756682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.694391 (+937709us) service_pool.cc:224] Handling call
0709 12:17:20.956444 (+262053us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:21.082962 24421 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.078598 24409 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:21.102154 24411 raft_consensus.cc:740] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:21.019300 24041 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:21.139240 22542 pending_rounds.cc:85] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 3
W20260709 12:17:21.145668 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 65273.9us
I20260709 12:17:21.170828 22542 pending_rounds.cc:107] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:17:21.171181 22542 raft_consensus.cc:2889] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:21.171653 22441 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:21.131119 24333 raft_consensus.cc:3055] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:21.111423 23930 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:21.082129 24341 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.027227 24414 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:21.157303 22549 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:21.174841 22441 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:21.069530 22400 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:21.189499 22402 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:21.157828 24314 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:21.225319 22398 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:17:21.226063 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 51324us
I20260709 12:17:21.156237 24374 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.228497 22441 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:21.236197 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:21.236805 24341 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:21.231638 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.238965 22441 leader_election.cc:400] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6.
I20260709 12:17:21.239266 22441 leader_election.cc:403] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:21.158820 24290 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:17:21.223965 24415 log.cc:927] Time spent T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:17:21.176903 24333 raft_consensus.cc:740] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:21.224293 23930 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.223812 24366 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:21.266155 22475 raft_consensus.cc:1240] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:21.224290 24202 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.229847 24421 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:21.238117 24314 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:21.242621 24106 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.244959 24267 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:21.231478 24414 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:21.181876 24409 consensus_queue.cc:1059] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 12:17:21.250527 24340 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6.
W20260709 12:17:21.264808 24413 log.cc:927] Time spent T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 12:17:21.156894 24246 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:21.261999 24269 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:21.268401 24366 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:21.271456 24254 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.276592 24314 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.272375 24421 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:21.275779 24406 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.286126 24366 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:21.314169 24371 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:21.280561 24267 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:21.235077 24253 consensus_queue.cc:237] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.229346 24411 consensus_queue.cc:260] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.269106 24290 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.275556 24326 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:17:21.274866 24202 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:21.280428 24106 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.297809 24421 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.320245 24067 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.323263 23803 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:21.295769 24254 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:21.350387 22551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.013s	sys 0.015s
W20260709 12:17:21.361119 22551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.013s	sys 0.015s
W20260709 12:17:21.375664 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 346670us
I20260709 12:17:21.376114 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1093) took 1405 ms. Trace:
I20260709 12:17:21.377784 22551 rpcz_store.cc:276] 0709 12:17:19.971041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.548847 (+577806us) service_pool.cc:224] Handling call
0709 12:17:20.573552 (+ 24705us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:20.573961 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:20.844206 (+270245us) log.cc:844] Serialized 14 byte log entry
0709 12:17:21.375642 (+531436us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:21.375787 (+   145us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:21.375851 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:21.375927 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:21.376061 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22024,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"thread_start_us":766713,"threads_started":2}
I20260709 12:17:21.320164 24406 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.324894 24267 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.376575 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:21.340418 24322 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:21.361351 24411 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:21.404309 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 180431us
W20260709 12:17:21.405537 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 163024us
I20260709 12:17:21.410728 22516 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:21.359397 24067 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:21.410475 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 372719us
I20260709 12:17:21.414875 22366 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:21.401047 24235 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:21.422616 22441 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:21.423718 22441 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:21.428916 22441 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:21.413990 24374 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:21.464349 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:21.422180 23803 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:21.410463 24337 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 12:17:21.472707 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 43870.4us
W20260709 12:17:21.486835 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 76284us
I20260709 12:17:21.434002 24371 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:17:21.465715 24425 log.cc:927] Time spent T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:17:21.427798 24340 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:17:21.433692 24275 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:17:21.469542 23803 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:21.460575 24059 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:17:21.462504 24007 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:17:21.513301 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:21.518225 24424 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:17:21.519255 23122 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 5 LEARNER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:17:21.468219 24346 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
W20260709 12:17:21.522568 24428 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:17:21.524479 24327 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:21.503149 24371 raft_consensus.cc:697] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:21.501248 24322 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 12:17:21.532280 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.502939 24374 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:21.558845 22471 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:21.563611 24276 raft_consensus.cc:3055] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:21.564005 24371 consensus_queue.cc:237] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.566515 24445 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:21.530781 24336 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:21.499593 24436 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:21.514765 23803 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.533697 23122 pending_rounds.cc:85] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71: Aborting all ops after (but not including) 3
I20260709 12:17:21.550370 24254 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:21.533533 24290 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:21.551828 24431 log.cc:927] Time spent T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:17:21.552316 24198 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:21.567643 22473 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:21.543041 24438 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 12:17:21.468794 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 63458.5us
I20260709 12:17:21.530469 24289 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:21.573323 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1494) took 1352 ms. Trace:
I20260709 12:17:21.574747 22402 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:21.576357 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:21.601920 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:21.537741 24246 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:21.561616 24061 consensus_meta.cc:287] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.000s
I20260709 12:17:21.582219 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:21.582233 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:21.583062 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:21.584002 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 96236us
I20260709 12:17:21.583185 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:21.665349 23131 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:21.614102 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:21.667354 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 84396.3us
I20260709 12:17:21.587028 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:21.619730 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:21.665614 22474 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.570044 24374 raft_consensus.cc:697] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:21.568885 24235 raft_consensus.cc:697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:21.564052 24276 raft_consensus.cc:740] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:21.607654 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:21.569145 24106 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:21.670239 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:21.537170 24412 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.704888 22544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1493) took 1491 ms. Trace:
I20260709 12:17:21.706030 22393 raft_consensus.cc:2393] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 4: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:21.706378 22550 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:21.710681 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:21.670095 22542 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:21.581755 23122 pending_rounds.cc:107] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:17:21.711151 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:21.716475 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:21.712538 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:21.714905 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 45048.1us
I20260709 12:17:21.722528 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:21.723171 22546 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:21.713343 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:21.709440 24061 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6.
I20260709 12:17:21.721144 22549 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:21.605079 22547 rpcz_store.cc:276] 0709 12:17:20.220683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.731891 (+511208us) service_pool.cc:224] Handling call
0709 12:17:20.732233 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:20.759715 (+ 27482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:20.759935 (+   220us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:20.779259 (+ 19324us) log.cc:844] Serialized 26 byte log entry
0709 12:17:21.002142 (+222883us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:21.002182 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:21.002244 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:21.573117 (+570873us) raft_consensus.cc:1685] finished
0709 12:17:21.573137 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:21.573266 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30685,"raft.queue_time_us":41889,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":6514,"thread_start_us":203183,"threads_started":1,"wal-append.queue_time_us":425379}
I20260709 12:17:21.736135 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:21.602203 24427 log.cc:927] Time spent T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:17:21.597365 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:21.603704 24436 raft_consensus.cc:697] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:21.603545 24202 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:21.597747 24067 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:21.603272 24406 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:21.596910 22395 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:21.742075 22400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:17:21.759967 22400 raft_consensus.cc:606] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:21.586174 24395 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.165s
I20260709 12:17:21.702845 24338 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:21.715690 22544 rpcz_store.cc:276] 0709 12:17:20.213104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.745521 (+532417us) service_pool.cc:224] Handling call
0709 12:17:20.778173 (+ 32652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:20.778534 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:20.778560 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:20.790607 (+ 12047us) log.cc:844] Serialized 26 byte log entry
0709 12:17:21.006894 (+216287us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:21.006937 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:21.007008 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:21.703977 (+696969us) raft_consensus.cc:1685] finished
0709 12:17:21.704012 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:21.704819 (+   807us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90,"raft.queue_time_us":1843,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":6951,"thread_start_us":208337,"threads_started":1,"wal-append.queue_time_us":522125}
I20260709 12:17:21.701269 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:21.586510 24421 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.744575 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:17:21.604087 24449 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.155s
I20260709 12:17:21.727689 22366 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:21.599416 24041 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.771322 22474 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:17:21.743759 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:21.603591 24267 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.598685 24095 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:21.734347 23122 raft_consensus.cc:2889] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 5 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:21.780726 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 53115.1us
I20260709 12:17:21.768235 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:21.787331 24067 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:21.713965 24435 consensus_queue.cc:1059] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:17:21.779572 24406 consensus_queue.cc:1059] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:17:21.800168 24067 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:21.804095 24067 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.805171 24449 raft_consensus.cc:3055] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:21.805590 24449 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:21.806409 24449 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:21.807652 24041 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:21.808488 22472 raft_consensus.cc:2393] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 3: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:21.809113 22442 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:21.811517 24441 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:21.812069 24441 raft_consensus.cc:697] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:21.793879 24254 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:21.813004 24441 consensus_queue.cc:237] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:21.791850 24433 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 12:17:21.770018 24409 consensus_queue.cc:1059] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:17:21.753924 24366 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.801548 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:21.850245 22544 raft_consensus.cc:2410] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:21.790943 24446 consensus_queue.cc:1059] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:21.844527 22475 raft_consensus.cc:2393] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 5: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:21.813550 24254 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.850754 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:17:21.855890 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 125635us
I20260709 12:17:21.801441 24322 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:21.854825 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:21.857813 24254 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.776233 24276 consensus_queue.cc:260] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.860360 24322 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:21.867174 24314 consensus_meta.cc:287] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.001s
W20260709 12:17:21.881825 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 104449us
I20260709 12:17:21.795266 24374 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.880092 24322 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:21.879443 22544 raft_consensus.cc:2955] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:17:21.867385 24085 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:17:21.874488 24269 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:21.874301 24458 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:17:21.931715 24198 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:21.804119 24235 consensus_queue.cc:237] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.885697 22441 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:21.887665 24314 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.979849 22470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1450) took 1226 ms. Trace:
W20260709 12:17:21.982539 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.983834 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:21.855686 24436 consensus_queue.cc:237] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:21.985652 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:21.986994 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:22.014325 22550 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.016091 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:22.017174 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:21.980247 22470 rpcz_store.cc:276] 0709 12:17:20.753166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.753901 (+   735us) service_pool.cc:224] Handling call
0709 12:17:20.784859 (+ 30958us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:20.785223 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:20.785253 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:20.785726 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 12:17:21.328444 (+542718us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:21.328496 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:21.328567 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:21.979646 (+651079us) raft_consensus.cc:1685] finished
0709 12:17:21.979675 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:21.979794 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":29705,"thread_start_us":476059,"threads_started":1,"wal-append.queue_time_us":594295}
I20260709 12:17:22.034143 24412 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:22.038393 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:22.040035 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:22.012342 24395 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:22.026526 24462 consensus_queue.cc:1059] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
W20260709 12:17:22.088168 23123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41028 (request call id 293) took 2316 ms (client timeout 2993 ms). Trace:
I20260709 12:17:22.090750 22477 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:17:22.042882 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:22.101336 22470 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
W20260709 12:17:22.049692 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:22.089380 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 105606us
W20260709 12:17:22.111064 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 68291.9us
I20260709 12:17:22.111630 22516 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:22.115854 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:22.090296 24470 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
I20260709 12:17:21.987087 24269 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:22.104991 24007 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.106537 24106 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:22.130681 24462 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:22.105953 24411 consensus_meta.cc:287] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.701s	user 0.014s	sys 0.000s
I20260709 12:17:22.116950 24448 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:22.017884 24067 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:22.177121 24253 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:22.136690 24267 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:22.112666 24469 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:22.117458 24412 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.186462 24366 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:22.185232 24169 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:22.112838 24395 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:22.191656 24448 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.181816 24007 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:22.112066 24459 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:22.117691 24451 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:22.185024 24460 log.cc:927] Time spent T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 12:17:22.132181 24392 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:17:22.192008 22550 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:22.221853 23130 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:22.222855 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:22.191951 24106 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:22.226962 24106 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:22.227897 24457 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:22.211800 23930 consensus_meta.cc:287] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.938s	user 0.010s	sys 0.003s
W20260709 12:17:22.112217 23123 rpcz_store.cc:269] 0709 12:17:19.771693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.773358 (+  1665us) service_pool.cc:224] Handling call
0709 12:17:22.087944 (+2314586us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54005f0354. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:22.088080 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2656458496}
I20260709 12:17:22.221508 24451 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:22.225102 24392 consensus_queue.cc:1243] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer b8621fa34be04d3fa2d68a300f858cd1 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:22.225801 24395 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:22.206409 24469 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:22.226195 24007 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:22.209240 24412 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:22.231403 22550 raft_consensus.cc:2393] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 6: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:17:22.231969 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 346343us
I20260709 12:17:22.219466 24448 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.210498 24421 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:22.205933 24253 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:22.229709 24106 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:22.264886 23130 raft_consensus.cc:2410] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:17:22.265384 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:22.293674 24254 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:22.249987 23930 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:22.296518 24469 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:22.299489 24327 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:22.299852 23930 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:22.300222 24451 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:22.294777 24465 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:17:22.309614 24303 raft_consensus.cc:3055] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:22.270237 24314 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:22.310307 24303 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:22.310051 24421 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:22.312740 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:22.296298 24432 log.cc:927] Time spent T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.770s	user 0.001s	sys 0.002s
I20260709 12:17:22.306107 23095 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:22.293458 24095 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:22.316629 23095 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:22.296185 24253 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:22.320544 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:22.323405 22474 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:22.321164 24169 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.322355 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:22.311350 24303 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:22.328207 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:22.328675 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:22.300222 24412 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:22.330317 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:22.325620 23803 consensus_meta.cc:287] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.721s	user 0.008s	sys 0.003s
I20260709 12:17:22.334882 22471 raft_consensus.cc:1240] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:22.317212 24421 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:22.336388 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:22.325467 24395 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:22.339689 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:22.340447 22471 raft_consensus.cc:2393] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:22.340209 24333 consensus_queue.cc:260] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:22.341163 24333 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.344003 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:22.331605 24253 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.350656 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:22.351557 24466 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:22.352135 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:22.352479 24322 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:22.352942 24466 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:22.353325 22441 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:22.354113 24466 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:22.356400 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:17:22.338425 24421 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:22.362639 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.364176 24392 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:22.364745 24392 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.348060 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:22.368571 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:22.346829 24303 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.372133 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1259) took 1474 ms. Trace:
I20260709 12:17:22.376394 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1454) took 1622 ms. Trace:
I20260709 12:17:22.376893 22472 rpcz_store.cc:276] 0709 12:17:20.754308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.754558 (+   250us) service_pool.cc:224] Handling call
0709 12:17:22.376107 (+1621549us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b54003e1f54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:22.376311 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1916136832}
I20260709 12:17:22.377254 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:22.378229 22476 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:22.379966 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:22.381074 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:22.386603 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1507) took 1400 ms. Trace:
I20260709 12:17:22.387249 22546 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:22.389592 24067 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:22.392190 24254 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:22.339118 23803 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:22.402235 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1264) took 1457 ms. Trace:
I20260709 12:17:22.402694 22469 rpcz_store.cc:276] 0709 12:17:20.944459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.098659 (+154200us) service_pool.cc:224] Handling call
0709 12:17:21.098915 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:21.181679 (+ 82764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:21.181714 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:21.181803 (+    89us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:21.181842 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:22.401956 (+1220114us) spinlock_profiling.cc:243] Waited 82.5 ms on lock 0x7b54003093d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:22.402007 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:22.402170 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189862272}
I20260709 12:17:22.404412 22397 raft_consensus.cc:2410] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:22.404982 22469 raft_consensus.cc:1240] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:22.403501 23803 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:22.365471 24253 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:22.409164 24253 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:22.366550 24269 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:22.413444 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:22.414362 23124 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.415360 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:22.423870 22471 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:22.387054 22548 rpcz_store.cc:276] 0709 12:17:20.986563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.157174 (+170611us) service_pool.cc:224] Handling call
0709 12:17:21.175669 (+ 18495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:21.318434 (+142765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:21.318467 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:21.318512 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:21.318543 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:22.386352 (+1067809us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400136354. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:22.386399 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:22.386540 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327827712}
I20260709 12:17:22.367416 24392 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.433409 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:22.438256 22469 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:22.439167 22441 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:22.441162 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:22.442107 22548 raft_consensus.cc:2393] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:22.463681 24466 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:22.372596 22468 rpcz_store.cc:276] 0709 12:17:20.897944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.072064 (+174120us) service_pool.cc:224] Handling call
0709 12:17:21.072436 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:21.072835 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:21.072866 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:21.073373 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:17:21.325334 (+251961us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:21.325375 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:21.325451 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:22.295652 (+970201us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:22.367663 (+ 72011us) raft_consensus.cc:1685] finished
0709 12:17:22.369969 (+  2306us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:22.372054 (+  2085us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4689,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":129,"spinlock_wait_cycles":7337728,"thread_start_us":251554,"threads_started":1,"wal-append.queue_time_us":361544}
I20260709 12:17:22.466054 24322 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:22.518510 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:22.468264 23130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41028 (request call id 300) took 1444 ms (client timeout 1542 ms). Trace:
I20260709 12:17:22.520272 22544 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:22.469470 24169 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:22.443907 24472 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:17:22.521324 24169 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:22.471282 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 355459us
W20260709 12:17:22.482168 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 364108us
I20260709 12:17:22.482391 22548 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:22.460289 23124 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:22.496675 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:22.465467 24421 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:22.491567 23123 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:22.448499 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:22.521580 22544 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:17:22.519789 23130 rpcz_store.cc:269] 0709 12:17:21.023882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.023998 (+   116us) service_pool.cc:224] Handling call
0709 12:17:22.015983 (+991985us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b58001c5698. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2ff8c 00007fb4f5a2fef6 000000000036eb39 00007fb4fdaa31e0 00007fb4fdb6c0c4 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:22.468024 (+452041us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54005f0fd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:22.468176 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480686208}
I20260709 12:17:22.540261 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:22.522066 23129 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:22.524112 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:22.541244 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 92846.2us
I20260709 12:17:22.528327 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:22.542145 22397 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:22.537333 24335 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:22.535224 24169 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:22.541673 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:22.544693 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:22.545246 22544 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.545756 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:22.547559 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:22.548161 22548 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:22.548873 24435 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:22.549747 24169 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:22.551007 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:22.553424 22397 raft_consensus.cc:2393] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 4: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:22.552060 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:22.551419 24322 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:22.557334 23930 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:22.558188 22394 pending_rounds.cc:85] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 4
I20260709 12:17:22.558553 22394 pending_rounds.cc:107] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:17:22.558689 24469 consensus_queue.cc:1059] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:22.557317 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:22.551836 24067 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:22.561617 23930 raft_consensus.cc:3055] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:22.563099 23930 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:22.552080 24451 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:22.563941 23930 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:22.554446 24335 raft_consensus.cc:697] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:22.557451 24322 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:22.565547 23930 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:22.561143 22472 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:22.558836 22394 raft_consensus.cc:2889] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:22.567443 24322 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:22.550215 24478 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:22.570174 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:22.573110 22548 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:22.579856 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:22.543973 24466 raft_consensus.cc:697] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:22.586906 24453 raft_consensus.cc:993] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:17:22.596760 22544 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:22.590989 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:22.565591 24335 consensus_queue.cc:237] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:22.597218 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:22.597441 22471 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:22.601585 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:22.602160 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:22.602665 22469 raft_consensus.cc:2393] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:22.600481 22367 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:22.605383 24438 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:22.605863 24438 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.606928 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:22.615059 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:22.596213 24414 raft_consensus.cc:3055] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:22.595162 24392 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:22.618537 24346 raft_consensus.cc:1081] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:17:22.588815 24067 consensus_queue.cc:1059] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:17:22.614058 24412 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:22.651382 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:22.636266 24445 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:22.650566 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:22.622627 24438 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.668172 23129 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:22.623754 24414 raft_consensus.cc:740] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:22.686017 23131 raft_consensus.cc:2393] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
W20260709 12:17:22.687976 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 137427us
I20260709 12:17:22.654587 24463 raft_consensus.cc:3055] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:22.652091 24421 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:22.668072 24445 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:22.689157 24304 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.000s	sys 0.017s
I20260709 12:17:22.707240 24275 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:22.709698 22367 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:22.711383 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:22.712069 22469 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:22.715915 22367 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:22.716617 24275 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:22.695749 24463 raft_consensus.cc:740] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:22.667145 24448 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:22.686388 24472 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260709 12:17:22.717300 24437 log.cc:927] Time spent T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 1.087s	user 0.000s	sys 0.006s
I20260709 12:17:22.714430 24445 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:22.816267 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 100431us
I20260709 12:17:22.817481 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:22.836491 22469 raft_consensus.cc:2393] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:22.689446 24395 raft_consensus.cc:697] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:17:22.711673 24304 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.000s	sys 0.017s
I20260709 12:17:22.838223 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:22.735677 24189 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:22.870631 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1258) took 1979 ms. Trace:
I20260709 12:17:22.714993 24411 consensus_queue.cc:1059] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.129s
I20260709 12:17:22.871073 22476 rpcz_store.cc:276] 0709 12:17:20.891276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.071020 (+179744us) service_pool.cc:224] Handling call
0709 12:17:22.377974 (+1306954us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:22.381720 (+  3746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:22.870382 (+488662us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54003e1f50. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:22.870562 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3005043968}
I20260709 12:17:22.823669 24269 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.871893 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:22.878897 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:22.880152 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:22.880825 22476 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:22.816900 24485 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:22.860682 24412 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.817960 24275 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:17:22.890056 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:22.887668 23122 raft_consensus.cc:2368] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5.
I20260709 12:17:22.866119 24254 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:22.701372 24466 consensus_queue.cc:237] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:22.882601 24441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.017s	sys 0.005s
W20260709 12:17:22.904732 24441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.018s	sys 0.006s
I20260709 12:17:22.822041 24414 consensus_queue.cc:260] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:22.886298 24453 consensus_queue.cc:1059] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:17:22.885070 24269 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:22.923817 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 491012us
I20260709 12:17:22.895107 24412 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:22.916283 24395 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:22.935708 22542 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:22.932489 24303 consensus_meta.cc:287] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.004s
I20260709 12:17:22.928200 24392 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:22.983464 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.976836 23129 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:22.995445 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1274) took 1013 ms. Trace:
W20260709 12:17:22.987226 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.015973 22477 rpcz_store.cc:276] 0709 12:17:21.982303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.041346 (+ 59043us) service_pool.cc:224] Handling call
0709 12:17:22.090501 (+ 49155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:22.110747 (+ 20246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:22.995241 (+884494us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b5400394750. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:22.995386 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112137984}
I20260709 12:17:22.993544 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:22.937261 24414 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:22.996744 22474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.009s	sys 0.011s
W20260709 12:17:23.013739 24483 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
W20260709 12:17:22.917973 23127 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.023s	sys 0.039s
W20260709 12:17:23.019328 22474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.012s	sys 0.012s
W20260709 12:17:23.019618 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.931715 24492 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:17:23.020597 24340 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.026s	sys 0.016s
I20260709 12:17:22.960922 22468 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:17:22.952744 24490 log.cc:927] Time spent T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:17:22.951478 24448 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:23.023273 23127 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.023s	sys 0.039s
W20260709 12:17:23.043824 24340 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.026s	sys 0.016s
W20260709 12:17:23.087756 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 507939us
I20260709 12:17:23.111387 22473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1272) took 1129 ms. Trace:
I20260709 12:17:23.111850 22473 rpcz_store.cc:276] 0709 12:17:21.981721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.026657 (+ 44936us) service_pool.cc:224] Handling call
0709 12:17:22.045866 (+ 19209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:22.046313 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:22.046342 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:22.096668 (+ 50326us) log.cc:844] Serialized 556 byte log entry
0709 12:17:22.497623 (+400955us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:22.497659 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:22.497723 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:23.111145 (+613422us) raft_consensus.cc:1685] finished
0709 12:17:23.111168 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:23.111321 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":400678,"threads_started":1,"wal-append.queue_time_us":589576}
I20260709 12:17:23.032310 24447 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:17:23.114332 24487 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
W20260709 12:17:23.117594 24435 consensus_meta.cc:287] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.568s	user 0.017s	sys 0.002s
I20260709 12:17:23.110136 24448 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:23.109510 24412 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:23.105337 24495 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:23.179847 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 314582us
W20260709 12:17:23.124619 24489 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
W20260709 12:17:23.151750 24289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.029s	sys 0.051s
W20260709 12:17:23.190749 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 261435us
I20260709 12:17:23.156975 24435 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:23.083289 24492 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:23.195425 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.123497 24340 raft_consensus.cc:3055] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:23.207654 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:23.208285 22397 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:23.194656 24289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.030s	sys 0.052s
I20260709 12:17:23.217173 22397 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:23.122231 24438 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.218088 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:23.219098 22543 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:17:23.182493 24448 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:23.221455 22543 pending_rounds.cc:85] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 2
I20260709 12:17:23.223335 22543 pending_rounds.cc:107] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:17:23.223594 22543 raft_consensus.cc:2889] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:23.220397 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:23.221544 22551 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:23.149560 24447 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:23.226768 24494 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:23.227371 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.228292 22543 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:23.203686 24340 raft_consensus.cc:740] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:23.242936 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:23.244661 22399 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.192468 24254 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:17:23.215269 24346 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.214773 24411 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.251485 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:23.252290 22543 raft_consensus.cc:2368] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5.
I20260709 12:17:23.202740 24485 consensus_queue.cc:1059] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:17:23.220832 24504 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:23.259970 22551 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:23.243225 24494 raft_consensus.cc:697] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:23.266419 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.267096 22543 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:23.258277 24447 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:23.270186 22545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1121) took 1492 ms. Trace:
I20260709 12:17:23.270994 22545 rpcz_store.cc:276] 0709 12:17:21.778142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.227723 (+449581us) service_pool.cc:224] Handling call
0709 12:17:22.228160 (+   437us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:22.228790 (+   630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:22.228835 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:22.229847 (+  1012us) log.cc:844] Serialized 52 byte log entry
0709 12:17:22.603700 (+373853us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:22.622686 (+ 18986us) log.cc:844] Serialized 14 byte log entry
0709 12:17:22.623096 (+   410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:22.623264 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:23.269954 (+646690us) raft_consensus.cc:1685] finished
0709 12:17:23.269975 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:23.270127 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8,"prepare.queue_time_us":19011,"raft.queue_time_us":399,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":18938,"spinlock_wait_cycles":37104768,"thread_start_us":340956,"threads_started":1,"wal-append.queue_time_us":641614}
I20260709 12:17:23.267128 24504 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:23.274324 24505 log.cc:927] Time spent T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 12:17:23.278842 24502 log.cc:927] Time spent T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:17:23.279158 24504 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:23.279934 24500 log.cc:927] Time spent T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.173s	user 0.001s	sys 0.002s
I20260709 12:17:23.280910 22399 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:23.284454 24412 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.284900 24007 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:23.285509 24007 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.287537 24007 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:23.255656 24411 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.254726 24346 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.292616 22442 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:23.294152 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:23.285051 24412 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.295063 23129 raft_consensus.cc:2410] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:17:23.281515 24499 log.cc:927] Time spent T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:17:23.284677 24335 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.289638 24447 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.284377 24254 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:23.300732 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:23.291040 24466 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:23.311414 24254 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.300216 24371 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:23.308846 24328 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.317387 24328 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.314931 24389 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:23.318492 24389 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.320463 24389 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:23.321079 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.321903 22551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54496
I20260709 12:17:23.322149 22543 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:23.322525 22551 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:23.322907 22551 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:23.323904 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 121912us
I20260709 12:17:23.327077 24304 consensus_queue.cc:1059] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:23.328390 24067 raft_consensus.cc:3055] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:23.328500 24453 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.328859 24067 raft_consensus.cc:740] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:23.329391 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1518) took 1452 ms. Trace:
I20260709 12:17:23.275713 24340 consensus_queue.cc:260] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:23.329732 24067 consensus_queue.cc:260] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.330826 24067 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:23.332954 24445 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.333424 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1516) took 1514 ms. Trace:
I20260709 12:17:23.334095 22547 rpcz_store.cc:276] 0709 12:17:21.818738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.378344 (+559606us) service_pool.cc:224] Handling call
0709 12:17:22.424939 (+ 46595us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:22.425395 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:22.425423 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:22.431365 (+  5942us) log.cc:844] Serialized 26 byte log entry
0709 12:17:22.930787 (+499422us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:22.930830 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:22.930904 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:23.333220 (+402316us) raft_consensus.cc:1685] finished
0709 12:17:23.333239 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:23.333372 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":1978,"thread_start_us":498058,"threads_started":1,"wal-append.queue_time_us":583850}
I20260709 12:17:23.335206 24445 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:23.335878 22544 raft_consensus.cc:1240] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:23.329743 22546 rpcz_store.cc:276] 0709 12:17:21.876563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.387920 (+511357us) service_pool.cc:224] Handling call
0709 12:17:22.994940 (+607020us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b5800010b98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:17:22.995149 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:22.995355 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:22.995640 (+   285us) log.cc:844] Serialized 14 byte log entry
0709 12:17:23.329075 (+333435us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:23.329127 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:23.329166 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:23.329224 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:23.329338 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98166,"prepare.queue_time_us":5138,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":100997,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":84306816,"thread_start_us":234845,"threads_started":1,"wal-append.queue_time_us":266089}
I20260709 12:17:23.336519 24453 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.304159 24335 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.304224 24494 consensus_queue.cc:237] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:23.342301 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.314249 24466 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.344372 24466 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:23.344974 24446 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:23.345585 24446 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.346251 24303 consensus_queue.cc:1059] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:23.307021 24438 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:23.347738 24446 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:23.330725 24340 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:23.348768 24440 raft_consensus.cc:3055] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:23.349212 24440 raft_consensus.cc:740] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:23.350183 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.349992 24440 consensus_queue.cc:260] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.351235 24440 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.352840 22476 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:17:23.353260 22476 pending_rounds.cc:85] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 1
I20260709 12:17:23.353466 22476 pending_rounds.cc:107] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:23.353699 22476 raft_consensus.cc:2889] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:23.354596 24508 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:23.355027 24508 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:23.355880 24508 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.357122 24508 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:23.321444 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.363103 22545 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
W20260709 12:17:23.368659 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.365809 22551 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:23.382759 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.383462 22545 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:23.372335 24254 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:23.387393 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.389954 22545 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:23.393195 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.395413 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.396050 22542 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:23.396508 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.397176 22549 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:23.398149 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.305395 24447 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.400687 24447 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:23.401181 24449 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:23.404247 24337 raft_consensus.cc:2955] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:23.405377 24492 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:23.406893 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:23.407104 24328 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:23.407934 22397 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:23.412285 22551 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:23.413116 24521 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:23.413698 24521 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.418993 22366 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:23.416352 24328 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:23.425292 24522 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:23.425951 24522 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.428301 24522 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:23.431195 24521 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:23.433164 24522 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:23.433561 24189 raft_consensus.cc:3055] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:23.434072 24189 raft_consensus.cc:740] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:23.434922 24189 consensus_queue.cc:260] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.435276 24521 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:23.436133 24189 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:23.437304 22366 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:23.438167 24521 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:23.438551 24521 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.438880 24521 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:23.445014 23095 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:23.445355 22366 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:23.446142 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:23.446357 22366 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:23.449966 22367 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:23.460333 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.461869 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.466246 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.467531 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.471671 22545 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:23.471385 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.478650 22441 leader_election.cc:400] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5.
I20260709 12:17:23.482182 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.481915 22441 leader_election.cc:403] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:17:23.484272 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:23.490763 22441 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:23.491601 22551 raft_consensus.cc:2393] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 5: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:23.471529 24495 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:23.470846 24254 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:17:23.466452 24522 consensus_queue.cc:1175] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8c3bcfa13ca74a24ab8999a408532932" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:17:23.478364 24061 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:23.424105 24328 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.493618 24289 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.495654 24275 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:23.496803 24198 raft_consensus.cc:2764] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:17:23.494990 24371 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:23.490562 24466 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:17:23.501832 24495 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.482669 24521 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:23.567284 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 140186us
I20260709 12:17:23.536330 24254 raft_consensus.cc:697] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:23.542361 24371 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:23.565722 24495 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.548310 24275 raft_consensus.cc:697] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:23.576608 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:23.577731 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.575201 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.570257 24473 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:23.582460 24473 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:23.579641 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 84254.9us
I20260709 12:17:23.584637 24473 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:23.585317 24473 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:23.586103 24473 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.575734 24371 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.580169 24448 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:23.602432 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.589169 24523 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.620723 24269 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:23.623979 24498 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.668s	user 0.000s	sys 0.002s
I20260709 12:17:23.639129 24441 consensus_queue.cc:1059] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:23.648252 24412 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:23.614418 24061 raft_consensus.cc:697] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:23.617081 24198 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:23.668104 24198 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.668886 24303 raft_consensus.cc:3055] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:23.669340 24303 raft_consensus.cc:740] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:23.670514 24521 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:23.671160 24521 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:23.671684 24497 log.cc:927] Time spent T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.721s	user 0.000s	sys 0.003s
I20260709 12:17:23.672103 24531 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:23.659714 24524 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 12:17:23.673215 23122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41012 (request call id 196) took 1348 ms (client timeout 1525 ms). Trace:
W20260709 12:17:23.673658 23122 rpcz_store.cc:269] 0709 12:17:22.324533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.325404 (+   871us) service_pool.cc:224] Handling call
0709 12:17:23.672962 (+1347558us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b5400660154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:23.673149 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1235782912}
W20260709 12:17:23.660581 24529 log.cc:927] Time spent T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:23.659796 24275 consensus_queue.cc:237] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:23.672712 24531 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:23.678928 24530 log.cc:927] Time spent T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:17:23.679600 24531 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:23.684525 24328 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:23.613911 24523 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.687709 24523 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:23.670229 24303 consensus_queue.cc:260] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:23.688848 24303 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.612483 24254 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.648773 24412 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.659714 24061 consensus_queue.cc:237] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.695609 22477 raft_consensus.cc:1240] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:23.701571 22471 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:23.700347 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:23.659941 24535 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:17:23.703395 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:23.677402 24341 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:23.706888 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.712875 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:23.713342 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:23.713948 22469 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:23.714412 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 129739us
I20260709 12:17:23.724689 22469 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
W20260709 12:17:23.725533 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 274089us
I20260709 12:17:23.727846 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:23.728545 22469 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.732354 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:23.733057 22471 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:23.735132 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 121190us
I20260709 12:17:23.671722 24521 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.740854 22475 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:17:23.741734 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.736021 22472 raft_consensus.cc:2955] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:23.745040 22398 raft_consensus.cc:1240] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:23.704259 24412 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.746152 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.747102 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:23.748694 22397 raft_consensus.cc:2410] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:23.716751 24341 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.750701 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:23.751258 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:23.750077 22469 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:23.752023 22393 raft_consensus.cc:2410] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:23.753397 22393 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:23.721168 24466 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:17:23.765552 22477 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:23.766873 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:23.769582 22471 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:23.767614 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:23.768435 22394 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:23.774112 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:23.773887 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:23.777554 23095 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:23.778980 23095 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:23.779755 24169 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:23.780371 24455 consensus_queue.cc:1059] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:23.780862 24392 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:23.781623 24455 consensus_queue.cc:1243] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:23.782150 24455 raft_consensus.cc:3055] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:23.782444 24455 raft_consensus.cc:740] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:23.730000 23122 raft_consensus.cc:2955] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:23.784372 22516 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:23.785784 22441 leader_election.cc:400] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5.
I20260709 12:17:23.786152 22441 leader_election.cc:403] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:17:23.787299 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1276) took 1198 ms. Trace:
I20260709 12:17:23.787714 22468 rpcz_store.cc:276] 0709 12:17:22.588755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.593007 (+  4252us) service_pool.cc:224] Handling call
0709 12:17:22.605067 (+ 12060us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:23.081614 (+476547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:23.765662 (+684048us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b5400201cd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:23.784871 (+ 19209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":765624064}
I20260709 12:17:23.780927 24341 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:23.789078 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:23.790535 24473 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:23.792114 24454 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:23.792634 24454 raft_consensus.cc:697] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:23.793483 24454 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:23.799089 22366 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:23.772521 24466 consensus_queue.cc:1243] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:23.790452 24289 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5.
I20260709 12:17:23.794847 24436 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:23.813457 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:23.815873 22367 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:23.819432 23095 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:23.834187 23095 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:23.824251 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.824261 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.836166 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.836818 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.826030 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.826404 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.837898 22476 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:23.796186 24169 raft_consensus.cc:697] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:23.803340 24492 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:23.843207 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.829728 22548 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:23.763767 24438 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:17:23.830185 22366 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:23.845530 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.845666 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:23.839213 22477 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:23.837441 22469 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:23.827946 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.842022 22401 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:23.777745 24106 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:17:23.846364 22399 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:23.848327 22366 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:23.846678 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.850328 22548 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:23.827222 24447 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5.
I20260709 12:17:23.783165 24455 consensus_queue.cc:260] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.856927 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:23.854468 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:23.856174 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.836490 24494 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:23.854841 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.854809 22366 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:23.837522 24523 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:23.860009 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.863814 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:23.845295 24542 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:23.867349 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.870962 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.871198 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:23.871946 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.804248 24473 consensus_queue.cc:1059] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:17:23.764134 24541 consensus_queue.cc:1059] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 12:17:23.872018 22550 raft_consensus.cc:2410] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:23.872072 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:23.855103 24341 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:23.916750 22366 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:23.920542 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:23.914775 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.864044 24523 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.924674 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.923635 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.926646 22542 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:23.928965 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.930207 22475 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:23.933168 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.917928 22476 raft_consensus.cc:1240] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:23.943558 24463 consensus_queue.cc:260] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:23.944850 24463 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:23.949240 24494 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:23.950201 24495 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:23.952649 24449 consensus_meta.cc:287] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.551s	user 0.006s	sys 0.006s
I20260709 12:17:23.953558 22544 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:17:23.953953 22544 pending_rounds.cc:85] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 6
I20260709 12:17:23.954161 22544 pending_rounds.cc:107] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:17:23.954380 22544 raft_consensus.cc:2889] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:23.924288 24341 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:23.955137 24341 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:23.956959 24481 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.957823 24169 consensus_queue.cc:237] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:23.927596 24523 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:23.927709 24490 log.cc:927] Time spent T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:17:23.872911 24548 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:23.962962 24496 log.cc:927] Time spent T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.716s	user 0.004s	sys 0.000s
I20260709 12:17:23.964176 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1465) took 1630 ms. Trace:
I20260709 12:17:23.919445 24455 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:23.964614 22474 rpcz_store.cc:276] 0709 12:17:22.333989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.334492 (+   503us) service_pool.cc:224] Handling call
0709 12:17:22.344215 (+  9723us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:22.346187 (+  1972us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:22.346220 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:22.346635 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 12:17:23.023442 (+676807us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:23.023494 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:23.023557 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:23.962434 (+938877us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:23.963834 (+  1400us) raft_consensus.cc:1685] finished
0709 12:17:23.963863 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:23.964108 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1600,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":2490,"spinlock_wait_cycles":6809344,"thread_start_us":586959,"threads_started":1,"wal-append.queue_time_us":810653}
I20260709 12:17:23.963012 24548 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.968680 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:23.970140 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.977897 22544 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
W20260709 12:17:23.979281 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 62635.2us
W20260709 12:17:23.980772 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.987679 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:23.921401 24550 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:24.008330 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:24.008278 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:24.009096 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:24.008669 24542 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:24.027498 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:23.942885 24412 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:23.964249 24510 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:24.009615 24550 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:24.028425 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:24.034157 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:24.039184 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:24.039849 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.040009 22548 raft_consensus.cc:2410] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:24.034497 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:23.986135 24548 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.957482 24481 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:24.044925 22400 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:24.050239 24328 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.043792 24550 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:24.058853 24328 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.060102 23123 raft_consensus.cc:1240] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:24.061101 24328 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:24.065410 24276 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:24.067729 24495 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:24.069890 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.074288 24254 raft_consensus.cc:3055] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:24.074796 24254 raft_consensus.cc:740] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:24.054275 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:24.034796 24521 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:24.054431 24449 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:24.080036 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.988252 24448 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:17:24.108901 22546 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:17:24.111492 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 54152.5us
W20260709 12:17:24.047894 24487 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:17:23.985545 24494 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:24.134709 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:24.134691 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 153292us
I20260709 12:17:24.140548 22542 pending_rounds.cc:85] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 1
I20260709 12:17:24.141677 22400 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:24.141953 24548 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.142776 24340 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:17:24.149884 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:24.164300 22393 raft_consensus.cc:3055] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:24.164685 22393 raft_consensus.cc:740] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:24.152215 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:24.153033 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:24.156693 22542 pending_rounds.cc:107] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:17:24.161037 22367 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:24.167483 22542 raft_consensus.cc:2889] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:24.132755 24371 consensus_meta.cc:287] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.003s
I20260709 12:17:24.169644 22367 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:24.171758 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:24.172654 22398 raft_consensus.cc:2393] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:17:24.133265 24545 log.cc:927] Time spent T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.273s	user 0.001s	sys 0.004s
I20260709 12:17:24.166337 22366 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:24.175992 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:24.146476 24546 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.111s	user 0.000s	sys 0.005s
W20260709 12:17:24.159133 24556 log.cc:927] Time spent T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.128s	user 0.000s	sys 0.005s
I20260709 12:17:24.073247 24341 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.165465 22393 consensus_queue.cc:260] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:24.186143 22393 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:24.134922 24449 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.178923 22402 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:24.113286 24411 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:24.179544 22367 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:24.181854 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:24.180150 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:24.178798 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:24.034192 24510 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:24.260968 22400 raft_consensus.cc:2368] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5.
I20260709 12:17:24.261050 22398 raft_consensus.cc:2393] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:24.189699 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:24.193154 24494 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:24.180251 24541 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:24.256178 22393 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:24.178226 24542 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:24.176694 24472 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 12:17:24.184751 24303 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.244197 22397 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:24.185159 24521 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:24.257527 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 223827us
I20260709 12:17:24.262336 22396 raft_consensus.cc:1240] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:24.262042 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:24.075671 24254 consensus_queue.cc:260] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.164608 24550 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.257098 22543 raft_consensus.cc:2410] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:24.268072 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:24.268741 24555 log.cc:927] Time spent T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:17:24.268184 24542 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:24.268070 24552 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:17:24.270933 24548 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:24.273202 24557 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:24.179934 24371 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.277968 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:24.175599 24531 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
W20260709 12:17:24.283408 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.283439 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:24.321221 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:24.322198 22547 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:24.263952 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:24.324987 22402 raft_consensus.cc:2368] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7.
I20260709 12:17:24.298379 24521 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:24.301798 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:24.302991 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:24.303332 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:24.329834 22394 raft_consensus.cc:2393] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 5: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:24.325845 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:24.298444 22393 raft_consensus.cc:2410] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:24.278735 24459 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.300948 24542 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:24.329893 22398 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:24.262606 24565 consensus_queue.cc:1059] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:17:24.336719 22393 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:24.332057 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:24.331193 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.307142 24557 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:24.339432 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:24.335777 22397 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:24.341061 22400 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:24.335726 22471 raft_consensus.cc:2410] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:24.297725 24303 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.330307 24254 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:24.333300 24521 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:24.356303 22400 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:17:24.334430 24340 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.335011 24106 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:24.359764 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 180283us
I20260709 12:17:24.362805 22367 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:24.342676 24557 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.350732 24333 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.379122 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:24.414690 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 51969us
I20260709 12:17:24.415649 22367 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:24.424546 22400 raft_consensus.cc:2368] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5.
W20260709 12:17:24.371402 24554 log.cc:927] Time spent T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:17:24.435299 22367 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:24.436061 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:24.353242 24459 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.377591 24463 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.437475 22367 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:24.376820 24504 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:24.439373 22400 raft_consensus.cc:2393] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:24.451215 22367 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:24.451478 24573 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.452041 24573 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:24.452682 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:24.453524 22400 raft_consensus.cc:2393] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:24.369243 24106 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.456758 22367 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:24.457830 24541 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:24.412712 24333 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.455778 24573 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:24.459997 22400 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:24.438086 24412 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:24.459899 24463 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:24.474114 24563 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:17:24.474840 24568 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:24.486720 24371 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:24.435809 24494 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.366186 24340 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:24.490331 22469 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:24.491859 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:24.523459 22367 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:24.493328 22442 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:24.527027 22476 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:24.494278 24333 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:24.497808 22395 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:24.490269 24341 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:24.457160 24548 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:24.455336 24560 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:24.458956 24574 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:24.434254 24523 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.487452 24510 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:24.506908 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:24.457098 24449 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:24.510278 24569 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.519570 24454 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:24.532147 24371 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:24.495893 24565 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:24.527745 22442 leader_election.cc:400] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7.
I20260709 12:17:24.545261 22442 leader_election.cc:403] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:24.530151 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:24.532478 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:24.528205 24328 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:24.534756 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.534948 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:24.526862 24550 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:24.542327 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:24.546293 22477 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:17:24.550416 22400 raft_consensus.cc:2410] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:24.552044 22442 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:24.556510 22442 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:24.550347 22401 raft_consensus.cc:2393] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 6: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:24.535979 24303 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:24.529783 24494 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:24.538165 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:24.578043 24472 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:24.575186 24454 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.580533 24436 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:24.584695 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:24.586678 22393 raft_consensus.cc:2376] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5. Re-sending same reply.
I20260709 12:17:24.588217 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:24.590469 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:24.548327 24565 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:24.599452 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:24.600399 22475 raft_consensus.cc:2393] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 2: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:24.572948 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:24.607847 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:24.608522 22393 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:24.609457 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:24.610262 22393 raft_consensus.cc:2393] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 2: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:24.530017 24568 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:24.536423 24560 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:24.576807 24106 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:24.597151 24570 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:24.615790 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:24.548818 24569 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.619376 24573 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:24.620901 24560 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:24.626784 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:24.622972 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:24.624019 22393 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:24.582723 24543 consensus_queue.cc:1059] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:17:24.627966 22548 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:24.603298 24565 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:24.626027 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:24.628536 22397 raft_consensus.cc:2376] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2. Re-sending same reply.
I20260709 12:17:24.629617 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:24.631868 22475 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:24.630311 22397 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:24.638931 22477 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:24.612632 23123 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:24.641011 22393 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:17:24.643206 22516 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:24.630836 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:24.640326 24560 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:24.644363 24523 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:24.619405 24463 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:24.630693 24579 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.622355 24531 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:24.645988 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:24.647534 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:24.640921 24333 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7.
I20260709 12:17:24.654999 22515 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:24.640201 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:24.631458 24573 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.633270 24449 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:17:24.653055 24340 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:24.647261 24560 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:24.680967 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:24.642803 24106 consensus_queue.cc:1059] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 12:17:24.658181 24455 consensus_meta.cc:287] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.693s	user 0.008s	sys 0.003s
W20260709 12:17:24.807643 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 233454us
I20260709 12:17:24.657845 24542 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.822196 22399 raft_consensus.cc:2410] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 12:17:24.827152 24587 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:17:24.828269 22442 leader_election.cc:400] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5.
I20260709 12:17:24.834826 22442 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:24.836272 22442 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:24.778376 22468 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:24.821583 24303 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:24.791368 24581 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.820739 24254 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:17:24.866994 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.828760 24560 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:24.840967 24543 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:24.864066 24346 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:24.877841 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:24.882910 22542 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:24.880100 24586 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:24.880348 24573 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:24.876452 24560 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.654237 24579 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.863965 24303 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:24.871129 24581 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:24.868115 24590 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:17:24.885973 24521 consensus_meta.cc:287] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.519s	user 0.000s	sys 0.009s
W20260709 12:17:24.886670 24582 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
W20260709 12:17:25.089902 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.833793 24340 consensus_queue.cc:1059] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:17:24.871872 24494 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:25.120100 24568 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:25.121080 24445 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:25.121692 24445 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.123943 24445 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:25.124810 24569 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:25.126245 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:24.907243 24328 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:24.872656 24254 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:24.918730 24303 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:24.918457 24586 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.105651 24412 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.126259 24454 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:25.136135 24568 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.089743 24521 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:25.167501 24557 consensus_meta.cc:287] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.747s	user 0.007s	sys 0.003s
I20260709 12:17:25.136122 24586 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:25.168701 24340 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:25.169059 24494 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.136341 24328 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:25.190550 24542 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:25.174252 24412 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.212543 24521 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:25.216657 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 379213us
I20260709 12:17:25.192574 24568 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.193147 24557 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.199890 24340 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.209365 24581 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:25.201519 24494 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:25.241787 22398 raft_consensus.cc:2393] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:25.225633 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:17:25.291500 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 55674.1us
W20260709 12:17:25.309535 22516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.018s	sys 0.039s
W20260709 12:17:25.310976 22516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.018s	sys 0.039s
W20260709 12:17:25.311578 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 630699us
I20260709 12:17:25.229838 24521 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.242528 24579 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:25.340982 22516 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:25.342284 22516 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:25.309271 24543 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:17:25.338899 24472 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.041s	sys 0.051s
W20260709 12:17:25.343438 22514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.000s	sys 0.019s
I20260709 12:17:25.352447 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1203) took 1094 ms. Trace:
W20260709 12:17:25.351495 24472 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.041s	sys 0.051s
I20260709 12:17:25.353067 22393 rpcz_store.cc:276] 0709 12:17:24.258419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.649574 (+391155us) service_pool.cc:224] Handling call
0709 12:17:24.649887 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.650084 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:25.190079 (+539995us) log.cc:844] Serialized 14 byte log entry
0709 12:17:25.352020 (+161941us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:25.352084 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:25.352141 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.352220 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:25.352374 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":525315,"prepare.queue_time_us":541296,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":114,"thread_start_us":161473,"threads_started":1}
I20260709 12:17:25.357636 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.358789 22393 raft_consensus.cc:2410] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:17:25.352337 22514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.000s	sys 0.020s
I20260709 12:17:25.341955 24254 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:25.361212 22397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1202) took 1103 ms. Trace:
I20260709 12:17:25.363055 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:25.361866 22397 rpcz_store.cc:276] 0709 12:17:24.258173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.646028 (+387855us) service_pool.cc:224] Handling call
0709 12:17:24.646409 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.646606 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:25.175764 (+529158us) log.cc:844] Serialized 14 byte log entry
0709 12:17:25.360803 (+185039us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:25.360915 (+   112us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:25.360955 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.361017 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:25.361158 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10258,"prepare.queue_time_us":543756,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"thread_start_us":184322,"threads_started":1}
I20260709 12:17:25.346220 24579 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:25.347608 24581 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:25.335592 24595 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
W20260709 12:17:25.358314 24106 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.006s	sys 0.019s
I20260709 12:17:25.346714 24453 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:25.340231 24521 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.370194 22397 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:25.342676 24389 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:17:25.370918 22393 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:25.374719 22397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1207) took 1066 ms. Trace:
I20260709 12:17:25.357879 24543 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:25.368927 24573 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.400271 22397 rpcz_store.cc:276] 0709 12:17:24.308117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.369485 (+1061368us) service_pool.cc:224] Handling call
0709 12:17:25.369829 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:25.374104 (+  4275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.374656 (+   552us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:25.402859 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1206) took 1103 ms. Trace:
W20260709 12:17:25.373509 24106 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.006s	sys 0.019s
I20260709 12:17:25.366714 24335 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:25.433143 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.421271 22393 rpcz_store.cc:276] 0709 12:17:24.296983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.370145 (+1073162us) service_pool.cc:224] Handling call
0709 12:17:25.370645 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:25.400038 (+ 29393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.400438 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:25.399730 24593 log.cc:927] Time spent T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:17:25.425506 22397 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:25.372851 24598 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:25.433650 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.371979 24600 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:25.440976 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.420403 24328 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:25.443388 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.424414 23127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41028 (request call id 305) took 3010 ms. Trace:
I20260709 12:17:25.370795 24594 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:25.450474 24592 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:17:25.455989 24565 consensus_meta.cc:287] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.816s	user 0.008s	sys 0.001s
I20260709 12:17:25.435560 24568 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:25.442399 24597 log.cc:927] Time spent T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 12:17:25.460335 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:25.446578 24494 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:25.505563 22397 raft_consensus.cc:2376] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6. Re-sending same reply.
I20260709 12:17:25.440150 24557 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:25.522859 24604 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.437495 24510 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:25.426153 24573 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.523655 24604 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:25.525600 24573 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:25.502138 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:25.507001 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:25.511379 24601 log.cc:927] Time spent T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:17:25.441928 24600 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:25.512291 22516 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.1:37927 timed out after 2.187s (SENT) [suppressed 15 similar messages]
I20260709 12:17:25.513142 24412 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:25.514413 24503 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.448625 24340 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:25.448963 23127 rpcz_store.cc:276] 0709 12:17:22.413618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.413801 (+   183us) service_pool.cc:224] Handling call
0709 12:17:22.414190 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:23.101057 (+686867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:23.111565 (+ 10508us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:23.186474 (+ 74909us) log.cc:844] Serialized 26 byte log entry
0709 12:17:23.296190 (+109716us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:23.299618 (+  3428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:23.303886 (+  4268us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:25.373973 (+2070087us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b2400303c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f58ed9c4 00007fb4f58ebacb 00007fb4f5aa6dc9 00007fb4f5aa6a55 00007fb4f5aa5fb0 00007fb4f871c488 00007fb4f871cbe8 00007fb4f86f4398 00007fb4f86ef76a 00007fb4f86eebb6
0709 12:17:25.419878 (+ 45905us) raft_consensus.cc:1685] finished
0709 12:17:25.419900 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:25.424311 (+  4411us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138587,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":87,"spinlock_wait_cycles":15600896,"thread_start_us":765706,"threads_started":2,"wal-append.queue_time_us":116992}
I20260709 12:17:25.461059 24521 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:25.536630 24604 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:25.533448 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.536787 22470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1485) took 2070 ms. Trace:
I20260709 12:17:25.545737 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.546850 22397 raft_consensus.cc:2393] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 5: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:25.545928 22393 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:25.540256 22470 rpcz_store.cc:276] 0709 12:17:23.466097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.466279 (+   182us) service_pool.cc:224] Handling call
0709 12:17:23.482270 (+ 15991us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:23.499837 (+ 17567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:23.499871 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:24.644496 (+1144625us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b2c00001368. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f744da11 00007fb4f745d372 00007fb4f8b8fa01 00007fb4f8b5443a 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2
0709 12:17:24.647297 (+  2801us) log.cc:844] Serialized 52 byte log entry
0709 12:17:24.979308 (+332011us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:24.979354 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.979432 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:25.536403 (+556971us) raft_consensus.cc:1685] finished
0709 12:17:25.536421 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:25.536718 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3737,"raft.queue_time_us":34368,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":10299,"spinlock_wait_cycles":7379840,"thread_start_us":330280,"threads_started":1,"wal-append.queue_time_us":519521}
I20260709 12:17:25.523818 24510 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:25.555527 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.504791 24565 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.565605 22296 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32988 (request call id 89) took 7984 ms. Trace:
W20260709 12:17:25.566123 23095 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.731s	user 0.019s	sys 0.082s
W20260709 12:17:25.567806 23095 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.733s	user 0.019s	sys 0.082s
W20260709 12:17:25.568464 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 1.73424e+06us
W20260709 12:17:25.569031 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 56950us
I20260709 12:17:25.572609 22397 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:25.573320 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:25.549028 24604 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:25.576161 22473 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:25.482928 24594 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.578148 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:25.578773 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.580168 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:25.580549 22470 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:25.580734 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.580785 22477 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:25.566759 22296 rpcz_store.cc:276] 0709 12:17:17.580990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:17.581239 (+   249us) service_pool.cc:224] Handling call
0709 12:17:17.679693 (+ 98454us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b540038b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abe090 00007fb4f8b5cf3a 00007fb4fe912e9c 00007fb4fea1104e 00007fb4fced22a4 00007fb4fced2232 00007fb4fced2161 00007fb4fced20dc 00007fb4fced1392 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:25.565464 (+7885771us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:21.126146 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:21.126690 (+   544us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:21.126728 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:17:21.126748 (+    20us) tablet.cc:662] Decoding operations
0709 12:17:21.129148 (+  2400us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:21.129257 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:21.129305 (+    48us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:17:21.275610 (+146305us) tablet.cc:701] Row locks acquired
0709 12:17:21.277971 (+  2361us) write_op.cc:260] PREPARE: finished
0709 12:17:21.286390 (+  8419us) write_op.cc:270] Start()
0709 12:17:21.792614 (+506224us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b540038afa8. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fef109e1 00007fb4fef0f64c 00007fb4fc59f624 00007fb4fc58a286 00007fb4fc589d58 00007fb4fc58e9f1 00007fb4fc58e9a9 00007fb4fc58e939 00007fb4fc58e901 00007fb4fc58db2d 0000000000388634
0709 12:17:21.792825 (+   211us) write_op.cc:276] Timestamp: P: 1783599441285005 usec, L: 0
0709 12:17:21.792852 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:17:21.865754 (+ 72902us) log.cc:844] Serialized 4899 byte log entry
0709 12:17:22.931513 (+1065759us) op_driver.cc:464] REPLICATION: finished
0709 12:17:23.271381 (+339868us) write_op.cc:301] APPLY: starting
0709 12:17:23.277404 (+  6023us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:23.303591 (+ 26187us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:23.304177 (+   586us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:23.328837 (+ 24660us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:23.329078 (+   241us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:17:23.329123 (+    45us) write_op.cc:312] APPLY: finished
0709 12:17:23.329448 (+   325us) log.cc:844] Serialized 88 byte log entry
0709 12:17:23.329608 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:23.329755 (+   147us) write_op.cc:454] Released schema lock
0709 12:17:23.376407 (+ 46652us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:23.380183 (+  3776us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:23.380217 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1991376,"reported_tablets":17,"spinlock_wait_cycles":41407360,"child_traces":[["op",{"apply.queue_time_us":333004,"apply.run_cpu_time_us":3693,"apply.run_wall_time_us":110789,"num_ops":12,"prepare.queue_time_us":488954,"prepare.run_cpu_time_us":15330,"prepare.run_wall_time_us":849413,"raft.queue_time_us":658087,"raft.run_cpu_time_us":32770,"raft.run_wall_time_us":300731,"replication_time_us":1125678,"spinlock_wait_cycles":70186752,"thread_start_us":906469,"threads_started":4,"wal-append.queue_time_us":317781,"wal-append.run_cpu_time_us":45045,"wal-append.run_wall_time_us":2141599}]]}
I20260709 12:17:25.578773 22473 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:25.582933 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.539108 24503 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:25.586458 24598 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:25.587594 24600 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:25.594897 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.594813 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.596143 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.596568 22393 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:25.597169 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.597664 22393 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:25.598553 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.599766 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.600477 22393 raft_consensus.cc:2393] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:25.589442 24565 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:25.601598 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:25.575059 24573 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:25.603621 22468 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.606802 24528 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.609738 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:25.602160 24586 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:25.614950 24303 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.616285 24543 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:25.616673 24606 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.573087 24494 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:17:25.604708 22397 raft_consensus.cc:2955] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:25.623323 24594 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:25.623962 24412 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.624500 24412 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.593954 24510 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:25.604507 24007 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.615549 24586 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:25.581351 24604 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.617213 24606 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.622267 24528 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.645867 22468 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:25.608099 24598 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.622367 24573 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:25.650517 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:25.655241 24602 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
I20260709 12:17:25.656023 24573 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:25.634727 24007 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.662796 24604 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:25.663481 24503 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:25.663704 24007 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:25.650687 24447 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.664692 24598 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:25.665199 24447 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:25.667966 24447 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:25.650434 24528 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:25.641182 24412 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:25.679755 22476 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:25.681654 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1517) took 1151 ms. Trace:
I20260709 12:17:25.682051 22476 rpcz_store.cc:276] 0709 12:17:24.530387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.531742 (+  1355us) service_pool.cc:224] Handling call
0709 12:17:24.531997 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:25.680182 (+1148185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.681391 (+  1209us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400161554. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:25.681583 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2638843264}
I20260709 12:17:25.686625 24606 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:25.687049 24558 log.cc:927] Time spent T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 1.310s	user 0.015s	sys 0.055s
I20260709 12:17:25.688884 23094 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:25.691672 24566 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:25.692121 24566 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.692503 24566 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.696259 24598 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:25.696461 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:25.697166 23122 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:25.696938 24598 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.699406 24598 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:25.700852 23129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34092 (request call id 238) took 1723 ms. Trace:
I20260709 12:17:25.702255 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.701246 23129 rpcz_store.cc:276] 0709 12:17:23.977049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.977722 (+   673us) service_pool.cc:224] Handling call
0709 12:17:23.978017 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.182850 (+204833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:24.182910 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:24.182956 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:24.182987 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.700601 (+1517614us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54000424d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:25.700646 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:25.700769 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470646016}
I20260709 12:17:25.704520 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.704787 24337 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.705160 22397 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:25.705258 24337 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.704546 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:25.706620 24537 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.710597 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.711347 22397 raft_consensus.cc:2393] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:25.717089 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.717396 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:25.717941 22545 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:25.703378 24581 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.716580 24586 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:25.721710 24198 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:25.721630 24581 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:25.707532 24337 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:25.723615 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.724418 22397 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:25.727027 24581 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:25.727689 24586 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.729367 24459 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:25.725378 23094 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:25.729737 24586 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:25.732842 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:25.706787 23127 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:25.707120 24537 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:25.744323 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1178) took 1594 ms. Trace:
I20260709 12:17:25.744735 22396 rpcz_store.cc:276] 0709 12:17:24.150085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.153532 (+  3447us) service_pool.cc:224] Handling call
0709 12:17:24.153893 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.290027 (+136134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.744084 (+1454057us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54000b63d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:25.744259 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248928128}
I20260709 12:17:25.737855 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:25.750486 22545 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:25.737910 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:25.752604 23129 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:25.740360 23803 raft_consensus.cc:3055] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:25.737089 24503 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:25.838096 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:25.841216 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 103182us
I20260709 12:17:25.842144 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.804507 24537 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:25.795305 22515 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:25.727623 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:25.806937 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:25.846164 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 50991.1us
I20260709 12:17:25.847811 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.850579 22396 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:25.850817 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.849022 22515 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:25.858148 23123 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 5: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:25.837376 24573 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:25.859414 24573 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:25.860599 24610 log.cc:927] Time spent T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:17:25.859918 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:25.863476 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:25.865370 23122 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:25.865854 24594 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:25.837580 23803 raft_consensus.cc:740] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:25.867363 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1301) took 1900 ms. Trace:
I20260709 12:17:25.848994 23094 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:25.807601 24522 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:25.871120 22397 raft_consensus.cc:2393] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:25.837908 24503 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:25.878993 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.846381 24303 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:25.893184 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 44309us
I20260709 12:17:25.894140 22474 rpcz_store.cc:276] 0709 12:17:23.966949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.969038 (+  2089us) service_pool.cc:224] Handling call
0709 12:17:24.007528 (+ 38490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:24.034951 (+ 27423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:24.034984 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:24.036277 (+  1293us) log.cc:844] Serialized 26 byte log entry
0709 12:17:25.603176 (+1566899us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b1800274e40. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a49e07 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b 00007fb4f86f3d23 00007fb4f86f40d1 00007fb4f8b0fa0f
0709 12:17:25.631388 (+ 28212us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:25.631439 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.631510 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:25.867063 (+235553us) raft_consensus.cc:1685] finished
0709 12:17:25.867083 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:25.867301 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26959,"raft.queue_time_us":27064,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":9984,"spinlock_wait_cycles":5734272,"thread_start_us":27603,"threads_started":1,"wal-append.queue_time_us":1604102}
I20260709 12:17:25.895884 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:25.895884 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:25.900362 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:25.900776 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:25.881865 23095 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:25.905648 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.869887 24599 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:25.910176 23803 consensus_queue.cc:260] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:25.912091 22396 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:17:25.917852 22399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1212) took 1930 ms (client timeout 2165 ms). Trace:
W20260709 12:17:25.941422 22399 rpcz_store.cc:269] 0709 12:17:23.987322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.987442 (+   120us) service_pool.cc:224] Handling call
0709 12:17:25.917599 (+1930157us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b5400037ad4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:25.917753 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1917196160}
I20260709 12:17:25.943248 22399 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:25.918651 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1509) took 1883 ms. Trace:
I20260709 12:17:25.944525 22471 rpcz_store.cc:276] 0709 12:17:24.035551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.035837 (+   286us) service_pool.cc:224] Handling call
0709 12:17:25.918459 (+1882622us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b5400329454. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:25.918588 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587278720}
W20260709 12:17:25.920084 22543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1540) took 2527 ms (client timeout 1739 ms). Trace:
W20260709 12:17:25.925041 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.926451 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1503) took 2002 ms. Trace:
I20260709 12:17:25.928763 24492 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:25.930220 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:25.935809 24481 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:25.939277 22401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1209) took 2087 ms (client timeout 2187 ms). Trace:
I20260709 12:17:25.963714 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:25.965001 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:25.939860 22402 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:25.861629 24573 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:25.946201 22469 rpcz_store.cc:276] 0709 12:17:23.924313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.924445 (+   132us) service_pool.cc:224] Handling call
0709 12:17:25.926244 (+2001799us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b5400160b54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:25.926379 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1299435392}
W20260709 12:17:25.945734 22543 rpcz_store.cc:269] 0709 12:17:23.392211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.397891 (+  5680us) service_pool.cc:224] Handling call
0709 12:17:25.919824 (+2521933us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b5400179154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:25.919971 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1951974144}
I20260709 12:17:25.909353 24608 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:25.968412 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:25.896500 24594 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:25.963609 22401 rpcz_store.cc:269] 0709 12:17:23.852104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.853126 (+  1022us) service_pool.cc:224] Handling call
0709 12:17:25.929629 (+2076503us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b5400037fd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:25.939206 (+  9577us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1590059392}
I20260709 12:17:25.971402 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:25.977025 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:25.977181 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:25.977725 22473 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:25.906932 24510 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:25.906932 24494 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:25.974542 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:25.969663 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:25.907281 24503 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:25.980211 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:25.940310 24599 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.980922 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:25.913450 24566 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:25.981317 23803 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.003741 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.053465 22543 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
W20260709 12:17:25.996228 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.017390 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:26.020098 22544 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:26.022805 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:26.023355 22548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49290 (request call id 133) took 1488 ms (client timeout 1775 ms). Trace:
I20260709 12:17:26.055380 22547 raft_consensus.cc:2410] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:17:26.055668 22548 rpcz_store.cc:269] 0709 12:17:24.534590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.534715 (+   125us) service_pool.cc:224] Handling call
0709 12:17:26.023187 (+1488472us) spinlock_profiling.cc:243] Waited 79.6 ms on lock 0x7b54001e9954. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:26.023295 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183108992}
I20260709 12:17:26.056850 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.057533 22548 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:26.058390 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.059069 22548 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:25.973716 24459 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:26.024636 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:26.030516 22476 raft_consensus.cc:2393] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 5: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:26.006747 22475 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:26.033452 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:26.067166 22474 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:26.033836 22473 raft_consensus.cc:2393] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:26.035175 24599 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:26.040160 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:26.040937 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:25.981597 24594 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.974081 24371 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:26.041807 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:26.042475 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:26.030326 24494 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.907260 24522 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.048851 24508 raft_consensus.cc:3055] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:17:26.050335 22398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1208) took 1715 ms (client timeout 1884 ms). Trace:
W20260709 12:17:26.079334 22398 rpcz_store.cc:269] 0709 12:17:24.334762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.339174 (+  4412us) service_pool.cc:224] Handling call
0709 12:17:26.050096 (+1710922us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b54000a8f54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:26.050258 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2073235840}
I20260709 12:17:26.051682 22394 raft_consensus.cc:1240] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 6. Ops: []
I20260709 12:17:25.973932 24606 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:26.023713 22515 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:17:26.085209 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 61557.2us
I20260709 12:17:26.059954 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.086874 22548 raft_consensus.cc:2410] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:17:26.087992 22548 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:26.055331 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.089154 22544 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:26.069535 24603 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:26.095144 24522 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:26.082876 24508 raft_consensus.cc:740] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:26.096266 24566 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:26.096832 24604 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:26.070372 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.073633 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:26.097381 24604 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:26.084041 24371 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.099397 24604 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:26.099890 24371 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:26.101085 22472 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:26.075235 24459 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.102687 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:26.077262 22468 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:26.076841 22469 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:26.074682 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:26.076946 23129 raft_consensus.cc:2393] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:26.081883 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.106266 22547 raft_consensus.cc:2410] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:26.083424 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:26.084385 22470 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 5: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:26.077510 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:26.083877 24494 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:26.105316 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.975217 24466 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:26.096477 24508 consensus_queue.cc:260] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.101316 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:26.146045 22474 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
W20260709 12:17:26.132361 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 46288.3us
I20260709 12:17:26.150944 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:26.154085 22398 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:26.152231 23131 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:26.155539 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
W20260709 12:17:26.168407 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.232458 24371 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:26.232789 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:26.233367 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:26.233654 22395 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 5: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:26.234560 24537 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:26.235041 24371 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:26.235536 24371 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.236637 24508 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:26.158201 22516 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:26.241684 24253 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:26.243685 22393 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:17:26.164713 23131 raft_consensus.cc:1240] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:17:26.245954 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1181) took 2095 ms. Trace:
W20260709 12:17:26.245265 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 87140.9us
I20260709 12:17:26.248203 22394 rpcz_store.cc:276] 0709 12:17:24.150920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.336898 (+185978us) service_pool.cc:224] Handling call
0709 12:17:26.051476 (+1714578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:26.080512 (+ 29036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:26.245715 (+165203us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54000a8f50. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:26.245884 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3899094272}
I20260709 12:17:26.103749 24459 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:26.232280 22366 connection.cc:256] RPC call timeout handler was delayed by -1.2130305829998633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
I20260709 12:17:26.252496 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:26.145248 24333 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:26.146119 24583 raft_consensus.cc:3055] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:26.142755 24303 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:17:26.247998 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 93956us
I20260709 12:17:26.131316 24604 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:26.278887 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:26.249078 24253 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:26.283171 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:26.142742 24603 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:26.246980 24473 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.108716 24606 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.158370 24389 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:26.244029 24371 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:26.155915 24466 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:26.343039 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.347026 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.358824 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:26.355276 22547 raft_consensus.cc:1240] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:26.280126 24061 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:26.348178 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.418224 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:26.397928 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 491877us
I20260709 12:17:26.418965 22550 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.282128 24438 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:26.309167 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:26.266780 24537 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.420256 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:17:26.284535 24571 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.351101 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1146) took 2903 ms. Trace:
I20260709 12:17:26.417423 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:26.424996 24600 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:26.339383 24576 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:26.425468 24600 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:26.426486 24600 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.362251 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1560) took 2042 ms. Trace:
I20260709 12:17:26.265344 24436 raft_consensus.cc:3055] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:26.417320 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:26.430691 22544 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:26.284301 24189 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.420591 22548 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 5: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:26.282301 24459 consensus_queue.cc:1059] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.141s
I20260709 12:17:26.278546 24583 raft_consensus.cc:740] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:26.297881 24481 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:26.290201 24253 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:26.423707 22549 rpcz_store.cc:276] 0709 12:17:23.447340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.447458 (+   118us) service_pool.cc:224] Handling call
0709 12:17:25.920772 (+2473314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:25.921118 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:25.921146 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:25.921187 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:25.921222 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.921277 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:26.350858 (+429581us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b5400179150. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:26.350997 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3324,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":5687431040}
I20260709 12:17:26.283627 24333 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:26.364282 24463 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:26.358112 24560 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:26.428464 22546 rpcz_store.cc:276] 0709 12:17:24.320234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.326406 (+  6172us) service_pool.cc:224] Handling call
0709 12:17:24.326686 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.326877 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:24.337141 (+ 10264us) log.cc:844] Serialized 14 byte log entry
0709 12:17:26.361580 (+2024439us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b18003a2dc0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f86fc4bc 00007fb4f5a4a48b 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b 00007fb4f86f3d23 00007fb4f86f423a
0709 12:17:26.361835 (+   255us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:26.361892 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:26.361954 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:26.362036 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:26.362177 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73251,"prepare.queue_time_us":12546,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":1424,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":7088384,"thread_start_us":80936,"threads_started":1,"wal-append.queue_time_us":126623,"wal-append.run_cpu_time_us":1122,"wal-append.run_wall_time_us":1009803}
I20260709 12:17:26.415269 24603 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:26.435503 22550 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:26.501384 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:26.501969 22550 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:26.425329 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.336877 24473 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.474645 22544 raft_consensus.cc:2410] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:26.423434 24438 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:26.504590 24438 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:26.297143 24303 raft_consensus.cc:697] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:26.429867 24061 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:26.425913 24576 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:26.431299 24571 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.356026 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:26.295821 24604 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.428740 24596 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:26.488355 24253 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:26.421603 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 112519us
I20260709 12:17:26.495716 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:26.447968 24189 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:26.430301 24436 raft_consensus.cc:740] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:26.486855 24481 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:26.522421 24481 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:26.506613 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:26.525305 24604 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:26.505986 24473 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:26.418304 24389 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:26.513809 22543 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:26.509910 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.516284 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:26.529482 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.529632 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:26.530869 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:26.540232 22550 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
W20260709 12:17:26.540830 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.514897 24596 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:26.595222 24626 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:26.595758 24596 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:26.595903 24626 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:26.556296 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:26.598647 24626 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:26.599304 24626 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:26.600200 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.599869 24626 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.545850 24568 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:26.545666 24560 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.543815 24598 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:26.572867 22543 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:26.578737 24594 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:26.580089 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.605438 22548 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
W20260709 12:17:26.589439 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 322351us
I20260709 12:17:26.549357 24303 consensus_queue.cc:237] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:26.576356 24466 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:26.514557 24576 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:26.577152 24606 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:26.602749 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 321053us
I20260709 12:17:26.591777 24333 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:26.579628 24371 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:26.591538 24537 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:26.612401 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:26.614701 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:26.607900 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 365145us
I20260709 12:17:26.598903 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.602100 24568 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:26.623905 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:26.628548 22473 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:26.629848 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:26.630393 23130 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:26.631429 22366 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:26.634850 22544 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:26.606559 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.636168 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.652961 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:26.655241 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.656039 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:26.611531 24598 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:26.658607 22441 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:26.660072 24371 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:26.660698 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:26.635977 24333 raft_consensus.cc:3055] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:26.675215 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.675861 22441 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:26.661509 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:26.655295 24568 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:26.635550 22442 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:26.667850 22548 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:26.670343 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.677012 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:26.677503 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:26.656934 24573 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:26.678093 22468 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:26.674221 24571 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:26.666397 24061 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:26.690850 22544 raft_consensus.cc:2393] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 4: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:17:26.691529 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 56062.4us
I20260709 12:17:26.691692 22441 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:26.683022 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.667860 24603 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:26.693198 22548 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:26.673178 24598 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:26.674551 24333 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:26.679467 24626 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:26.684568 24466 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:26.700434 24623 log.cc:927] Time spent T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:17:26.713330 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:26.714401 22468 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:17:26.693444 24627 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:26.694442 24571 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:26.679661 24371 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:26.719575 22442 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:26.721511 24624 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:26.722332 24630 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.722821 22441 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:26.723345 24606 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:26.739500 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 197926us
I20260709 12:17:26.705384 24625 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:26.701325 24061 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:26.710630 24466 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:26.688745 24573 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:26.710286 24389 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:26.746105 22516 leader_election.cc:336] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Timed out: RequestConsensusVote RPC to 127.20.191.1:37927 timed out after 1.918s (SENT)
I20260709 12:17:26.750111 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:26.713680 24628 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:26.750648 24627 raft_consensus.cc:697] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:26.742059 24603 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:26.739892 24624 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:26.770431 24632 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.803097 23803 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.746483 24061 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:26.782792 24508 consensus_meta.cc:287] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.002s
I20260709 12:17:26.748629 24600 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:26.749588 24466 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:26.777339 24628 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:26.792474 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 138322us
I20260709 12:17:26.751955 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:26.817982 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 66102.4us
I20260709 12:17:26.818748 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:26.819896 22516 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:26.776738 24449 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:26.803859 23803 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:26.781170 24481 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.781283 24253 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.752403 24633 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:26.824962 22366 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:26.745599 24630 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:26.825204 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:26.833660 22544 raft_consensus.cc:2393] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 5: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:26.835364 22366 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:26.803097 22367 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:26.802287 24624 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.827790 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:26.811394 24061 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.742657 24571 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.814459 24594 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:26.750007 24333 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:26.839932 24494 consensus_meta.cc:287] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.664s	user 0.009s	sys 0.001s
I20260709 12:17:26.841887 23803 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:26.844802 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 101114us
W20260709 12:17:26.845237 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 102669us
I20260709 12:17:26.813644 24636 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:26.849291 24333 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:26.847082 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:26.823325 24579 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:26.847766 22547 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:26.851722 23803 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:26.830101 24337 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:26.830578 24067 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:26.855051 22516 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:26.862068 22546 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:26.827389 24628 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:26.811527 24632 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.904819 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:26.835126 24625 raft_consensus.cc:697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:17:26.941995 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 91256.3us
I20260709 12:17:26.942006 24438 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.852387 24636 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.944212 23094 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:26.943385 22442 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:26.945786 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:26.946350 23131 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.931146 24630 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:26.931663 24571 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:26.932394 24481 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:26.932830 24573 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:26.832893 24446 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:17:26.936751 24627 consensus_queue.cc:237] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:26.941944 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 86210.3us
I20260709 12:17:26.971621 22441 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:26.943528 24625 consensus_queue.cc:237] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.924369 22549 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:17:26.971953 24459 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:17:26.974287 22546 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:26.972110 24606 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:17:26.970654 24571 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.976313 24571 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.844074 24633 raft_consensus.cc:697] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:26.947678 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:17:26.847263 24631 log.cc:927] Time spent T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 12:17:26.950337 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:26.952426 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 97456.6us
W20260709 12:17:26.853255 24503 consensus_meta.cc:287] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.810s	user 0.007s	sys 0.004s
I20260709 12:17:26.843852 24508 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:26.963445 22442 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:26.961019 24246 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:26.968087 24253 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:26.966316 22545 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:26.966899 24600 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:26.849316 24494 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:26.959465 24337 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:26.968617 24371 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:26.852931 24449 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:26.867369 24594 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:26.945454 24560 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:26.961185 24644 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:26.978615 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 129953us
I20260709 12:17:26.980152 22516 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:26.966114 23131 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:26.961722 24566 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:26.966045 24438 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:26.951956 24596 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:26.993695 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 190689us
W20260709 12:17:27.088137 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 108056us
I20260709 12:17:27.088887 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:27.089650 24446 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:27.090188 24446 raft_consensus.cc:697] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:27.090631 24253 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:27.086542 24632 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:27.090992 24446 consensus_queue.cc:237] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:27.092242 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.092574 24632 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.093134 24481 consensus_queue.cc:1059] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:27.093416 24246 raft_consensus.cc:476] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 12:17:27.093863 24624 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.094303 24454 raft_consensus.cc:3055] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:27.094720 24454 raft_consensus.cc:740] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:27.096035 24624 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:27.095563 24454 consensus_queue.cc:260] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:26.990089 24634 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.091125 24466 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.097879 24253 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:27.098791 24449 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:27.098897 24466 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:27.100421 22366 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:27.102843 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:27.103605 24565 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:27.103806 23803 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:27.104118 24565 raft_consensus.cc:697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:27.022269 24633 consensus_queue.cc:237] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.105316 24565 consensus_queue.cc:237] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.105850 24522 raft_consensus.cc:1064] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:17:27.037997 24061 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:27.054579 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 71373.7us
I20260709 12:17:27.101478 24449 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:27.111447 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.112329 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:26.868367 24638 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:27.113379 22366 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:27.122386 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:27.002803 22442 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:27.124660 22441 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:27.137080 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:27.135087 22366 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:27.109376 24337 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:26.989382 24636 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:27.143428 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:27.148620 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:27.043697 24599 consensus_meta.cc:287] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.968s	user 0.007s	sys 0.003s
I20260709 12:17:27.143746 22441 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:27.032239 23123 raft_consensus.cc:1240] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:27.143828 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 141101us
I20260709 12:17:27.001154 24640 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.135183 22367 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:27.153100 22402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1180) took 2995 ms. Trace:
I20260709 12:17:27.093061 24632 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.145586 24275 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:27.021221 24568 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.135757 24647 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:17:27.172441 24568 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:27.153985 24253 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:27.173211 24632 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:27.154171 24638 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:27.173996 24638 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:27.161938 24371 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.174875 24371 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:27.147981 24644 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:27.176245 24644 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:27.176647 24644 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.177114 24371 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:27.178738 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:27.153694 24561 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:27.036449 24494 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:27.149966 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:27.120546 24463 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:27.010993 24603 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:27.135751 24566 raft_consensus.cc:697] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:27.023038 24571 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:27.163115 22442 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:27.162683 22402 rpcz_store.cc:276] 0709 12:17:24.150663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.331242 (+180579us) service_pool.cc:224] Handling call
0709 12:17:25.939680 (+1608438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:25.965995 (+ 26315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.145901 (+1179906us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400037fd0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:27.146050 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3698429696}
I20260709 12:17:27.010272 24598 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.166497 22546 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:27.164448 24652 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:27.142109 24646 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:27.168599 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:27.142307 24594 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:27.169698 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:27.174392 24638 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:27.158571 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:27.184895 22367 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:27.146186 24303 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:27.186158 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:27.187006 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:27.188009 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:27.188068 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:27.188633 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:27.189198 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:27.209582 22476 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.194274 24253 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:27.208683 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:27.216966 22546 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:27.198447 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:26.991405 24459 consensus_queue.cc:1059] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.176s
I20260709 12:17:26.988618 24503 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:27.200001 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:27.245746 22551 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:27.037459 24642 consensus_queue.cc:1059] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.156s
I20260709 12:17:27.042100 24576 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.184376 24636 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:27.208357 22470 raft_consensus.cc:1240] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:27.249519 24576 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:27.249663 22470 raft_consensus.cc:1240] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:27.210531 22549 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:27.211090 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:27.211345 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:27.211664 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:27.206373 24652 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:27.264508 24652 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:27.215196 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:27.265194 22474 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:27.107870 24522 consensus_queue.cc:237] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:27.218708 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:27.270961 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 52324.4us
I20260709 12:17:27.196568 24603 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:27.221949 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:27.272207 22469 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:27.224056 24646 raft_consensus.cc:697] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:27.224200 24596 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:27.243280 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:27.221329 24253 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:27.251075 24583 consensus_queue.cc:260] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.257838 24337 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.258416 24459 raft_consensus.cc:3055] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:27.243930 24571 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:27.259341 24642 raft_consensus.cc:3055] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:27.260563 23126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41028 (request call id 317) took 1094 ms. Trace:
I20260709 12:17:27.166941 24640 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.165598 24599 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:27.217624 24061 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:27.201104 24628 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.224828 24438 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:27.275573 24303 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:27.278818 24598 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:27.272957 24603 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.282950 24253 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:27.216202 24566 consensus_queue.cc:237] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:27.284600 24459 raft_consensus.cc:740] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:27.290618 24640 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:27.284510 24576 consensus_queue.cc:1059] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:17:27.285753 24642 raft_consensus.cc:740] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:27.295058 24646 consensus_queue.cc:237] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.220942 22367 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:27.225747 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:27.213425 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:27.221256 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 58244.6us
I20260709 12:17:27.243016 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:27.269347 22476 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:27.276788 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:27.286741 23126 rpcz_store.cc:276] 0709 12:17:26.166089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.233106 (+ 67017us) service_pool.cc:224] Handling call
0709 12:17:27.168446 (+935340us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b58001c5698. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:27.260491 (+ 92045us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26433280}
I20260709 12:17:27.285429 23124 raft_consensus.cc:1240] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:27.509109 24061 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.510459 24061 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.510462 22471 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:27.290318 24189 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:27.514138 24061 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:27.388381 22298 catalog_manager.cc:5697] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 2 to 3, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 3 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:27.520720 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 307259us
W20260709 12:17:27.475759 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.522984 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:27.523404 24061 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:27.517797 22442 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:27.441480 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1568) took 1085 ms. Trace:
I20260709 12:17:27.525413 22547 rpcz_store.cc:276] 0709 12:17:26.355738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.503408 (+147670us) service_pool.cc:224] Handling call
0709 12:17:26.503683 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:26.853184 (+349501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.440878 (+587694us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b540042c054. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:27.441298 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":790897920}
I20260709 12:17:27.526590 22442 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:27.431430 22545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1571) took 1074 ms. Trace:
I20260709 12:17:27.517174 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41028 (request call id 314) took 1354 ms. Trace:
I20260709 12:17:27.493419 23130 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:17:27.372195 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 237005us
I20260709 12:17:27.529610 24067 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:27.469798 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41012 (request call id 200) took 1591 ms. Trace:
W20260709 12:17:27.443852 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:27.362914 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.527678 22545 rpcz_store.cc:276] 0709 12:17:26.366926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.524215 (+157289us) service_pool.cc:224] Handling call
0709 12:17:26.524556 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:26.990167 (+465611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.430673 (+440506us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54003ca5d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:27.431195 (+   522us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":999892736}
I20260709 12:17:27.290947 24337 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:27.546625 24599 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:27.290832 24503 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:27.550247 24447 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:27.305904 24561 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:27.419646 22542 raft_consensus.cc:1240] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:27.545642 24627 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:27.530211 24067 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:27.539866 23123 rpcz_store.cc:276] 0709 12:17:25.878251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.885837 (+  7586us) service_pool.cc:224] Handling call
0709 12:17:25.909641 (+ 23804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:27.166962 (+1257321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.469132 (+302170us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54005a14d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:27.469566 (+   434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2564461824}
I20260709 12:17:27.549255 24333 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.553960 24537 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.529523 23124 rpcz_store.cc:276] 0709 12:17:26.162663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.232538 (+ 69875us) service_pool.cc:224] Handling call
0709 12:17:26.232919 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:27.515952 (+1283033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.516707 (+   755us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400650254. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:27.516964 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2410326784}
I20260709 12:17:27.558082 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:27.561909 24269 raft_consensus.cc:3055] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:27.562493 24269 raft_consensus.cc:740] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:27.563980 24269 consensus_queue.cc:260] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.566764 24632 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:27.566196 22298 catalog_manager.cc:5697] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 3, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 3 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:27.567545 24632 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.567695 24459 consensus_queue.cc:260] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.568207 22298 catalog_manager.cc:5697] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 3, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 3 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:17:27.556250 24067 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:27.550748 22366 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:27.585688 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:27.586856 24269 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:27.306483 24579 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.566316 24625 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:27.543744 24642 consensus_queue.cc:260] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.571007 24459 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:27.593521 24571 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:27.586253 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 365256us
I20260709 12:17:27.594554 24571 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.317713 24628 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:27.320478 24634 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:27.598652 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 283941us
I20260709 12:17:27.324103 24652 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.603307 24436 consensus_queue.cc:260] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.562637 24606 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:27.598912 22298 catalog_manager.cc:5697] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 2 to 3, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 3 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:27.292063 24644 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:27.562175 24333 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:27.605365 24652 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:27.595745 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:27.327833 24638 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:27.619148 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 88738.1us
I20260709 12:17:27.606292 24454 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:27.614334 24561 consensus_queue.cc:1059] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:27.623844 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:27.630872 24561 raft_consensus.cc:3055] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:27.625376 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:27.626211 22471 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:27.631350 24561 raft_consensus.cc:740] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:27.626852 24638 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:27.627980 24253 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.629858 24583 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:27.611814 24644 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:27.642791 24628 consensus_queue.cc:1059] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:27.643378 24253 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:27.644264 24606 raft_consensus.cc:3055] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:27.621640 22366 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:27.627875 24333 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:27.646652 24565 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:27.632766 24561 consensus_queue.cc:260] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.630089 24655 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:27.654310 24655 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:27.654723 24655 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:27.653836 24561 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:27.647437 24606 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:27.638396 22298 catalog_manager.cc:5697] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 3, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 3 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:27.666217 22515 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:27.673966 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:27.675055 22394 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:27.675145 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:27.676048 22397 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 1.
I20260709 12:17:27.676477 24579 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:27.676986 24579 raft_consensus.cc:697] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:27.677289 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:27.677791 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:27.677985 22393 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:27.678785 24599 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:27.679469 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:27.680575 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:27.671947 22298 catalog_manager.cc:5697] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:27.681116 24473 consensus_queue.cc:1059] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:17:27.678742 23123 raft_consensus.cc:2393] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 4: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:27.674464 24436 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:27.694705 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:27.699832 22471 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:27.701683 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:27.702808 22550 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:27.706905 24638 consensus_queue.cc:1059] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:17:27.713927 24473 consensus_queue.cc:1243] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:17:27.717847 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:27.715833 22468 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:27.705811 22298 catalog_manager.cc:5697] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 3, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 3 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:27.745117 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:27.713581 24603 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:27.750247 24603 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:27.750888 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.751161 22475 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:27.723449 24571 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:27.752501 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:27.753366 22469 raft_consensus.cc:2393] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:17:27.753427 24662 log.cc:927] Time spent T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:17:27.753878 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 112637us
I20260709 12:17:27.754827 22367 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:27.755934 24571 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:27.698817 24606 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.758958 24606 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.758783 24640 consensus_queue.cc:1059] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:27.759859 24640 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:27.761390 24640 raft_consensus.cc:3055] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:27.761749 24640 raft_consensus.cc:740] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:27.775321 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:27.765441 24579 consensus_queue.cc:237] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:27.778472 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:27.779320 22477 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:27.779546 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.780905 22544 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:27.757365 22367 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:27.771974 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:27.770915 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:27.770372 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:27.687809 24565 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.780906 22547 pending_rounds.cc:85] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 2
I20260709 12:17:27.789700 22469 raft_consensus.cc:2368] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6.
I20260709 12:17:27.792336 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:27.793468 22475 raft_consensus.cc:2393] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:17:27.795933 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.796991 22548 raft_consensus.cc:2393] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:27.790282 22547 pending_rounds.cc:107] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:17:27.773500 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:27.775202 24640 consensus_queue.cc:260] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:27.804044 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 46804.4us
I20260709 12:17:27.798125 22547 raft_consensus.cc:2889] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:27.814221 22476 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.817966 22550 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:27.818662 24646 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:27.819283 24646 raft_consensus.cc:697] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:27.820526 24646 consensus_queue.cc:237] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.821237 22367 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:27.823669 22367 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:27.819053 23803 raft_consensus.cc:3055] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:27.824517 23803 raft_consensus.cc:740] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:27.824966 24253 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:27.825973 22473 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:27.826171 24571 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:27.826891 24571 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:27.827308 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1170) took 1896 ms. Trace:
I20260709 12:17:27.828353 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:27.827709 22542 rpcz_store.cc:276] 0709 12:17:25.930912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.932929 (+  2017us) service_pool.cc:224] Handling call
0709 12:17:25.933260 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:27.570926 (+1637666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.827033 (+256107us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54004209d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:27.827230 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3416974080}
I20260709 12:17:27.828794 23803 consensus_queue.cc:260] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:27.829615 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:27.830168 23803 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:27.830615 24067 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.831957 22549 raft_consensus.cc:1240] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:27.825784 24253 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.833705 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:27.818022 24636 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:27.844643 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:27.845175 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:27.846102 24473 raft_consensus.cc:3055] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:27.846519 24473 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:27.847438 24473 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.848621 23123 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:27.848773 24473 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.835112 24565 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:27.838606 24253 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:27.846117 22396 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:27.851058 24642 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:27.811137 24632 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:27.836161 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:27.828217 22367 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:27.859300 22397 raft_consensus.cc:1240] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:27.859944 22477 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:27.834036 24067 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:27.862375 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 62754.4us
I20260709 12:17:27.867856 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:27.870047 24276 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:27.874467 24454 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.875151 24454 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.875590 22516 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:27.874804 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 46752.6us
I20260709 12:17:27.865178 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:27.869565 22441 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:27.878454 22476 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:27.880452 22475 raft_consensus.cc:2393] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 4: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:27.886966 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:27.889894 24627 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:27.890442 24627 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:27.890837 24627 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:27.883580 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:27.890405 22398 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:27.893138 22441 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:27.903144 22549 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:27.890761 24454 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:27.891381 24253 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:27.890118 24640 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.916349 24625 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:27.931337 24269 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:27.931881 24269 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:27.932252 24269 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:27.958128 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:27.963551 24595 consensus_queue.cc:1059] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:27.963727 24642 consensus_queue.cc:1059] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:27.964540 24644 consensus_queue.cc:1059] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:27.964802 24642 consensus_queue.cc:1059] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:27.965438 24644 consensus_queue.cc:1059] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:27.965695 24642 raft_consensus.cc:3055] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:17:27.976624 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 101127us
I20260709 12:17:27.977798 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:27.975348 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:27.982378 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:27.966383 24624 raft_consensus.cc:3055] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:27.966429 24644 raft_consensus.cc:3055] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:27.986685 22542 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:27.988878 22548 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.973697 24642 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:27.991214 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:27.994027 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:27.982651 24333 raft_consensus.cc:3055] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:27.984493 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:27.994813 23095 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:27.995874 24492 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:27.997176 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:17:27.998698 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:27.999249 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:28.001849 23126 raft_consensus.cc:2393] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 5: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:27.994870 24333 raft_consensus.cc:740] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:28.004118 24333 consensus_queue.cc:260] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.005398 24333 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:28.006517 24503 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:28.010869 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:28.014027 22549 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:27.990177 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:28.027590 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:28.028600 24067 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:28.031759 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:28.032505 22550 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:28.034651 24579 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:28.035454 24579 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:27.987263 24624 raft_consensus.cc:740] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:28.038210 24067 consensus_queue.cc:1059] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:28.038856 24624 consensus_queue.cc:260] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.039835 24576 raft_consensus.cc:3055] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:28.040288 24576 raft_consensus.cc:740] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:28.040411 24624 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:27.989251 24644 raft_consensus.cc:740] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:28.041446 24576 consensus_queue.cc:260] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:28.027220 24655 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.045976 22398 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:27.997342 24494 consensus_queue.cc:1059] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:28.042323 22367 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:28.059856 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.060576 22394 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:28.009446 24522 consensus_queue.cc:1059] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:17:28.070163 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:28.070919 22546 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:28.043030 24269 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.082891 24269 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:28.082564 24642 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.083667 24642 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:28.088496 22545 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:28.096515 24644 consensus_queue.cc:260] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:28.110030 24522 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:28.110265 24668 raft_consensus.cc:3055] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:28.110651 24668 raft_consensus.cc:740] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:28.111532 24668 consensus_queue.cc:260] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.112994 24668 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:28.114241 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:28.114810 22399 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:28.115070 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.115900 22402 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:28.045534 24606 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:28.117190 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:28.117304 24606 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.109375 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:28.119457 22394 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:28.115904 22398 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:28.045426 24579 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:28.128672 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 86953.5us
I20260709 12:17:28.119529 24606 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:28.155871 22367 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:28.162290 22549 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:28.162761 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:28.160559 22548 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:28.164387 22401 raft_consensus.cc:2393] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:28.165975 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:28.170672 24579 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:28.171334 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:28.171967 22546 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:28.173208 24606 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:28.173748 24606 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:28.177126 24606 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:17:28.154701 24576 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:28.180310 24449 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.180905 24449 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:28.183111 24449 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:28.170825 22477 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:28.194144 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:28.191885 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.169552 24522 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:28.159795 24503 raft_consensus.cc:697] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:28.229552 22367 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:28.230697 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.108057 24627 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:28.235965 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:28.241954 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 73885.3us
I20260709 12:17:28.230250 24522 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.247061 22367 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:28.247964 22546 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:28.249085 22397 raft_consensus.cc:2410] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:28.249131 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:28.251452 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:28.252151 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 203578us
I20260709 12:17:28.251508 24644 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:28.251340 24646 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:28.264456 22545 raft_consensus.cc:2393] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:28.252395 24522 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:28.268245 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.258679 24640 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:28.273104 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.275871 24655 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:28.276542 24655 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.245012 24494 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:17:28.265838 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.277319 22366 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:28.277441 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.281495 22395 raft_consensus.cc:2410] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:17:28.277098 24655 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.271799 24646 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:28.290658 24669 log.cc:927] Time spent T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.256s	user 0.000s	sys 0.004s
I20260709 12:17:28.279660 24640 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.307377 22394 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:28.308053 23803 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:28.318751 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.318881 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.297714 24646 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:28.309233 24640 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:28.327256 22395 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
W20260709 12:17:28.334947 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.326720 24253 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:28.342510 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:28.349902 22395 raft_consensus.cc:2410] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:28.332733 24565 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:28.360447 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:28.360754 23803 consensus_queue.cc:1059] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:28.361996 22547 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:28.363301 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.365208 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:28.365754 22548 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:28.363695 22441 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:28.367841 22545 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:17:28.368888 22395 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:28.369805 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:28.370501 22550 raft_consensus.cc:2393] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:17:28.371755 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.373229 24504 raft_consensus.cc:3055] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:28.373649 24504 raft_consensus.cc:740] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:28.373795 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:28.374410 22546 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:28.370572 22516 leader_election.cc:400] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6.
I20260709 12:17:28.374974 22516 leader_election.cc:403] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:17:28.377723 23131 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:28.311841 24503 consensus_queue.cc:237] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:28.377622 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:28.382743 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:28.387223 22396 raft_consensus.cc:2410] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:28.394411 22516 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:28.387251 22441 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:28.387950 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:28.399899 22547 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:28.399497 22549 raft_consensus.cc:1240] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:28.400688 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.381789 24627 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:28.404838 22441 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:28.381743 24606 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:28.403765 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:28.412648 22550 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:28.414988 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.410444 24627 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:28.419466 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:28.423583 22547 raft_consensus.cc:2393] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:28.395329 23126 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 5 LEARNER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:28.423179 24627 raft_consensus.cc:697] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:28.373667 24061 consensus_queue.cc:1059] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:17:28.411160 24579 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6.
I20260709 12:17:28.431795 24627 consensus_queue.cc:237] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:17:28.432566 24670 log.cc:927] Time spent T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.399s	user 0.001s	sys 0.002s
I20260709 12:17:28.432940 24583 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:28.437615 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 65274.8us
W20260709 12:17:28.440641 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 46317.3us
I20260709 12:17:28.441394 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:28.416163 24606 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:28.444280 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:28.445405 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.445497 22397 raft_consensus.cc:2410] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:17:28.445971 22399 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:28.449635 22546 raft_consensus.cc:1240] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:28.453969 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:28.434974 24269 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:28.455538 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:28.457995 22396 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:28.374639 24504 consensus_queue.cc:260] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:28.461333 23803 raft_consensus.cc:3055] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:28.461630 23803 raft_consensus.cc:740] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:28.462607 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:28.439476 24655 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:28.465234 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.465500 22395 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:28.468770 24677 log.cc:927] Time spent T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.138s	user 0.002s	sys 0.000s
I20260709 12:17:28.469605 24253 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:17:28.471534 22544 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:28.475028 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:28.476266 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:28.464483 24106 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:28.477955 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:28.483866 22545 raft_consensus.cc:2410] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:28.447438 24606 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:28.477116 24636 raft_consensus.cc:3055] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:28.463826 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:28.484397 22396 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:28.484982 22395 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:28.490377 22548 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:17:28.491029 22547 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:28.492265 24106 raft_consensus.cc:697] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:28.493250 24106 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.494294 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:28.498052 24504 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:28.497861 22399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "277d262725804effb16ede64e81d19c8"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:17:28.499260 22399 raft_consensus.cc:606] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:28.499620 22399 raft_consensus.cc:614] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:28.498081 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.502372 24579 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:28.503099 24579 raft_consensus.cc:697] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:28.504057 24579 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.455910 24269 raft_consensus.cc:697] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:28.507037 23803 consensus_queue.cc:260] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:28.523581 22366 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:28.525949 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:28.531214 23803 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:28.526706 22476 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:28.490859 24636 raft_consensus.cc:740] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:28.542975 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:28.543560 22395 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:28.548192 24689 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:17:28.549022 24679 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:17:28.550262 22471 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:28.551676 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:28.558318 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:28.559185 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:28.559893 22468 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:28.560870 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:28.561529 22474 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:28.536041 24603 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:17:28.546026 24655 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:28.581171 22395 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:28.588558 22477 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:28.590880 22395 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:17:28.602623 22476 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:28.592773 22395 pending_rounds.cc:85] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 5
I20260709 12:17:28.605048 22395 pending_rounds.cc:107] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:17:28.606199 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:28.605885 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:28.615319 22473 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:28.606621 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:28.607406 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 80389.6us
I20260709 12:17:28.616931 22441 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:28.587177 24655 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:28.604193 24624 consensus_meta.cc:287] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.002s
I20260709 12:17:28.617193 22395 raft_consensus.cc:2889] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:28.604961 24269 consensus_queue.cc:237] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.621392 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:28.612093 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:28.621682 24644 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:28.626189 24640 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.670300 22400 raft_consensus.cc:2393] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:28.629880 24642 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:28.630630 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:28.672758 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:17:28.630952 24668 consensus_meta.cc:287] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.003s
I20260709 12:17:28.631662 24576 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:28.618044 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:28.637745 22396 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:28.645380 22471 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:28.656754 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.619410 24655 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:28.667210 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.670686 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:28.674052 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 150562us
W20260709 12:17:28.681746 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 47491.8us
W20260709 12:17:28.677924 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 58078.5us
I20260709 12:17:28.682807 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:28.684288 22401 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:28.685760 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.681746 22397 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
W20260709 12:17:28.670964 24691 log.cc:927] Time spent T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:17:28.699869 22397 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:28.672012 24642 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:28.705192 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.705554 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:28.707608 22399 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:28.694684 24579 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:28.713871 24579 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:28.716645 24579 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:28.715549 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.719470 24522 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:28.723120 24640 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:28.723730 22394 raft_consensus.cc:1240] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:28.704830 24668 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:28.725859 24579 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.713382 22441 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:28.728783 24579 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:28.723604 22366 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:28.729880 24583 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:28.730683 22366 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:28.731220 24642 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:28.708897 22401 raft_consensus.cc:2376] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5. Re-sending same reply.
I20260709 12:17:28.733522 22366 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:28.693261 24106 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:28.613629 24636 consensus_queue.cc:260] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:28.736970 22516 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:28.732420 24473 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:28.741608 23803 consensus_queue.cc:1059] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:28.741276 24583 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.744639 23803 raft_consensus.cc:3055] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:28.745048 23803 raft_consensus.cc:740] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:28.744763 24583 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.745862 23803 consensus_queue.cc:260] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:28.747145 23803 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:28.742897 24697 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:28.750533 24697 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.750874 24697 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:28.735524 24668 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:28.735280 24106 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.764463 24106 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:28.764271 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:28.758641 23803 consensus_queue.cc:1059] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:28.762151 24703 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.739306 24576 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:28.762950 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:28.763655 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:28.740505 24644 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:28.770932 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:28.753324 24636 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:28.774513 22473 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 12:17:28.741463 24333 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:28.776863 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:28.785811 23803 consensus_queue.cc:1059] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:28.778184 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:28.782966 24646 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.787716 22472 raft_consensus.cc:2393] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:28.758970 24668 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.783823 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:28.784302 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:28.764235 24253 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:28.743361 24473 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:28.747172 24583 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:28.760982 24522 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:28.737030 24640 consensus_queue.cc:1059] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:17:28.794831 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:17:28.801664 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.801110 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:28.807947 22468 raft_consensus.cc:2393] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:28.787753 24565 raft_consensus.cc:3055] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:28.785548 24061 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.803982 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.803480 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:28.788122 24644 raft_consensus.cc:697] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:28.808583 22471 raft_consensus.cc:1240] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:28.811805 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:28.796830 24668 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:28.818912 22469 raft_consensus.cc:2393] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:28.795323 22470 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:28.821641 22401 raft_consensus.cc:2376] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5. Re-sending same reply.
I20260709 12:17:28.804289 24473 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:28.803236 24690 raft_consensus.cc:3055] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:28.826270 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:28.826634 22393 raft_consensus.cc:2393] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:17:28.827032 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.803164 24253 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:28.810781 24565 raft_consensus.cc:740] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:28.836428 24579 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:28.838119 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.838559 22476 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:17:28.839141 22442 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:28.840494 22472 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:28.839036 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:28.873668 22473 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:28.850464 22474 raft_consensus.cc:1240] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:28.806567 24576 raft_consensus.cc:697] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:28.834369 23095 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:28.875830 24494 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:28.833562 22516 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:28.852442 22550 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:28.876963 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 43495.6us
I20260709 12:17:28.877435 24269 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.877972 24269 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.880116 24269 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:28.880658 24583 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:28.853008 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.794848 24333 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.883637 24333 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:28.884500 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:28.885121 22470 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:28.864591 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:28.886014 22477 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:28.886689 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:28.888298 22550 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:28.781143 24703 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:17:28.876153 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 53859.1us
W20260709 12:17:28.863399 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.895746 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.852242 24690 raft_consensus.cc:740] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:28.900763 22401 raft_consensus.cc:2393] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 6: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:28.902462 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.898202 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:28.825416 24061 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:28.926036 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:28.911151 24576 consensus_queue.cc:237] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.918219 24644 consensus_queue.cc:237] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.919315 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.930651 22393 raft_consensus.cc:2393] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:28.919497 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:28.920580 24706 log.cc:927] Time spent T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:17:28.860847 24253 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:28.924360 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:28.924563 22473 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:28.928035 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:28.947183 22549 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:28.954835 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:28.955160 22472 raft_consensus.cc:1240] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:28.955796 22469 raft_consensus.cc:2410] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:28.856173 24697 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:28.956063 22397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:17:28.956729 22366 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:28.957594 22402 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:28.958813 22397 raft_consensus.cc:606] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:28.921427 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:28.959178 22397 raft_consensus.cc:614] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:28.959275 23803 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:28.918290 24703 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:28.927340 24579 raft_consensus.cc:697] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:28.961490 24494 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:28.975237 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:17:29.002259 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 163245us
I20260709 12:17:28.945098 24333 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:29.003057 22394 raft_consensus.cc:2393] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:29.003052 22442 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:29.005301 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:29.005959 22469 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:29.011516 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 92098.9us
I20260709 12:17:29.034853 23803 raft_consensus.cc:697] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:29.005208 24333 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:29.043498 23803 consensus_queue.cc:237] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:29.043977 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 83958.6us
I20260709 12:17:29.021934 24703 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:29.050199 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:29.052430 22549 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:29.049484 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:29.055740 22441 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:29.053907 22547 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:29.066718 23095 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:29.039032 24646 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.041642 24333 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:28.970511 24565 consensus_queue.cc:260] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.071051 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:29.067854 22441 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:29.071858 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:29.072774 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:29.005306 24690 consensus_queue.cc:260] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.033919 24606 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.078399 22472 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:29.056671 24703 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:29.083685 24646 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:29.085707 24606 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.087399 24696 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:29.088397 24690 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:29.098634 24522 raft_consensus.cc:3055] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:29.104725 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:29.042712 24106 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.106798 24061 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:29.107295 24655 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.111908 22544 raft_consensus.cc:2410] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
W20260709 12:17:29.113036 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.116130 22469 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:29.129698 22367 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:29.073321 24679 raft_consensus.cc:2764] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:17:29.134943 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 131970us
I20260709 12:17:29.081529 24603 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:29.138314 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.126060 24703 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.132611 24522 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:29.142807 24106 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:29.148531 22442 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:29.130299 24696 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.160347 23803 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:29.167973 22367 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:29.169448 22472 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:29.183051 22367 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:29.144479 24603 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:29.069595 24579 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:29.194131 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 45697.2us
I20260709 12:17:29.166471 24696 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:29.193302 24718 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:29.164991 24473 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.178107 24061 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.163992 24494 consensus_queue.cc:1059] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:17:29.188495 24606 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:29.150938 24253 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.192652 24603 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:29.202402 24724 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:29.207563 24697 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.218256 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:29.207477 24655 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.224534 22471 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:29.226861 22442 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:29.228286 24646 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:29.229060 24713 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:29.223240 24718 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.205058 24642 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.230116 24718 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:29.231936 24642 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.232438 24718 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:29.233206 22442 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:29.234699 22367 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:29.235069 23129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41028 (request call id 323) took 1185 ms. Trace:
I20260709 12:17:29.235473 23129 rpcz_store.cc:276] 0709 12:17:28.049634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.108936 (+ 59302us) service_pool.cc:224] Handling call
0709 12:17:29.234845 (+1125909us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b54005f0fd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:29.234988 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1616857984}
I20260709 12:17:29.236187 24718 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:29.236577 24718 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.236924 24718 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:29.221422 24061 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.237634 24522 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.238785 24522 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:29.239811 24061 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.216168 24606 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:29.235870 22367 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:29.246598 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 178811us
I20260709 12:17:29.214107 24721 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:29.244761 24642 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:29.256456 24713 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:29.255025 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:29.256636 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:29.258190 24333 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:29.260710 24473 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.260924 24713 consensus_queue.cc:1059] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:29.262295 24473 raft_consensus.cc:3055] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:29.262686 24473 raft_consensus.cc:740] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:29.263592 24473 consensus_queue.cc:260] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.265600 24473 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:29.268959 22550 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:29.266599 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:29.280872 23803 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:29.283011 23803 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:29.283474 23803 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:29.282313 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 237672us
I20260709 12:17:29.284425 22543 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:29.288544 24253 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:29.253937 24606 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:29.290769 22367 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:29.289853 22366 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:29.303651 24696 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.305857 24696 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.306381 24333 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:29.308568 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.281283 24644 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:29.312296 22398 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
W20260709 12:17:29.312809 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 69863.9us
I20260709 12:17:29.300720 22441 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:29.314352 22441 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:29.296103 24504 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:29.317236 24731 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:29.317884 24624 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:29.318044 24731 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:29.318462 24624 raft_consensus.cc:697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:29.319415 24624 consensus_queue.cc:237] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.266598 24668 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.315311 24333 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:29.296964 24522 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:17:29.317502 24504 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:29.326076 24504 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.327325 24668 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.323625 24333 raft_consensus.cc:697] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:29.336442 24333 consensus_queue.cc:237] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.345920 22543 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:17:29.347105 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 242436us
I20260709 12:17:29.348093 22516 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:29.350257 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:29.317041 24603 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:29.368115 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 54620.5us
I20260709 12:17:29.377099 22442 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:29.375264 23803 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:29.380722 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 90974us
I20260709 12:17:29.389420 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:29.390059 22545 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:29.414038 24722 consensus_queue.cc:1059] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:29.418238 24722 consensus_queue.cc:1243] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:17:29.419344 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 63659.3us
I20260709 12:17:29.414752 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:29.413919 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 63721.3us
I20260709 12:17:29.422358 22546 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:29.423120 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
W20260709 12:17:29.424340 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 337420us
I20260709 12:17:29.428156 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:29.412635 22367 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:29.376412 24644 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.414083 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:29.416999 23803 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.413511 24603 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.429538 22367 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:29.429930 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:29.428812 22547 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:29.430941 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:29.434845 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:29.323516 24703 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.433835 22472 raft_consensus.cc:2393] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 5: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:29.414885 24594 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:29.436131 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:29.440425 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:29.414167 24579 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:29.440788 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:29.437835 22367 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:29.410156 24473 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:29.441304 22544 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:29.389089 24718 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.440608 23129 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:29.446450 22551 raft_consensus.cc:2393] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:29.433873 24492 raft_consensus.cc:3055] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:29.433043 24721 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:29.431629 24737 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.436632 24713 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:29.452611 22549 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:29.440212 24642 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:29.456916 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:29.442806 24594 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:29.439023 24690 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:29.445981 24722 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:17:29.466010 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.426182 24732 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:17:29.465648 22548 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:29.472942 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:29.447667 24253 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:29.477883 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:29.478830 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:29.436484 24644 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.449740 24492 raft_consensus.cc:740] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:29.482645 23803 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:29.487363 23803 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.488312 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:29.488569 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:29.489303 22548 raft_consensus.cc:2410] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:29.474956 24594 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:29.447680 24473 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.462819 24583 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:17:29.493896 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:29.497754 22551 raft_consensus.cc:2393] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:29.495029 22393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:17:29.474843 24721 raft_consensus.cc:697] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:29.469115 24642 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:29.496081 23803 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:29.496323 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 119323us
I20260709 12:17:29.483203 24722 raft_consensus.cc:697] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:29.498229 22393 raft_consensus.cc:606] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:29.469496 24737 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.521740 24722 consensus_queue.cc:237] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.523905 24737 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.500599 24642 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:29.523947 24741 log.cc:927] Time spent T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.086s	user 0.002s	sys 0.000s
I20260709 12:17:29.526806 24703 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.506234 24718 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.509119 24565 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:29.498744 24690 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.530279 24690 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.530704 24606 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.532510 24690 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.532712 24606 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.536636 22550 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:29.512002 24644 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.514243 24473 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.480037 24454 consensus_queue.cc:1059] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:17:29.499804 22442 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:29.515333 24721 consensus_queue.cc:237] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.516006 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:29.502111 23094 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:17:29.542193 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 109580us
I20260709 12:17:29.542892 22550 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:29.543602 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:29.543774 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:29.544441 22547 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:29.546149 24454 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:29.546597 24454 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:17:29.547879 24727 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:17:29.547470 24454 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.548583 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:29.548772 24454 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:29.550156 24503 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:29.538156 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:29.550549 24503 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:29.550927 24503 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:29.539548 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.479843 24730 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:17:29.553000 24492 consensus_queue.cc:260] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:29.554391 24492 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:29.542014 24640 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:17:29.558652 22366 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:29.566138 24640 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:29.566606 24640 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.566931 24640 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:29.567019 24740 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.129s	user 0.000s	sys 0.002s
I20260709 12:17:29.539896 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:29.571938 22546 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:29.490962 24724 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:29.514231 22441 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:17:29.572593 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 58440.1us
I20260709 12:17:29.572882 22545 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:29.575816 22547 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:29.576855 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:29.577445 22471 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:29.579349 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:29.580065 22399 raft_consensus.cc:2393] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:29.580881 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:29.581247 22394 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:29.585266 22471 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:29.571103 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:29.586591 22397 raft_consensus.cc:1275] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:29.586819 22544 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:29.587087 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:29.587757 22550 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:29.590209 22441 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:29.591387 22367 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:29.592864 22367 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:29.594118 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:29.594889 22471 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:29.595844 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:29.597530 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:29.598160 22469 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:29.598464 22367 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:29.599153 23803 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:17:29.599583 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 162872us
I20260709 12:17:29.599362 22367 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:29.600878 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:29.601483 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:29.602885 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:29.603536 22472 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:29.605862 22393 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:29.608291 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:29.609105 22476 raft_consensus.cc:2410] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:29.599251 22366 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:29.610242 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:29.613214 22401 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:29.613456 22399 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:29.618575 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:29.620260 22469 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:29.621706 23803 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:29.622121 23803 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.622417 23803 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:29.611063 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:29.623796 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:29.620919 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:29.590009 24606 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:29.628693 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:29.591171 24583 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:29.597198 24696 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.632550 22474 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:29.604372 24644 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:29.628304 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:29.644400 22441 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:29.605093 24565 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:29.620518 24718 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:29.654655 22550 raft_consensus.cc:2368] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5.
I20260709 12:17:29.620039 24473 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:29.604247 24724 raft_consensus.cc:697] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:29.657191 23803 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:29.663329 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 163618us
I20260709 12:17:29.628350 24730 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.624606 24713 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:29.665205 22473 raft_consensus.cc:1240] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:29.664271 22298 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50166 (request call id 206) took 22324 ms (client timeout 15000 ms). Trace:
I20260709 12:17:29.633265 24579 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:17:29.672946 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.646379 24583 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.681064 23803 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.662125 24718 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:29.643098 24522 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:17:29.664662 24576 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:29.697154 22473 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:29.664383 24655 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:29.654537 24253 consensus_queue.cc:1048] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:17:29.672358 24606 raft_consensus.cc:697] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:29.654852 24632 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:17:29.722282 24724 consensus_queue.cc:237] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.713882 24748 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.723739 24748 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:29.725452 24748 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:29.731401 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 118206us
I20260709 12:17:29.733246 22367 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:29.738508 22299 catalog_manager.cc:5697] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 2 to 4, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 4 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:17:29.740144 22299 catalog_manager.cc:5697] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:29.742321 22474 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:29.751549 24594 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:29.754648 24503 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:29.755812 24253 consensus_queue.cc:1059] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:29.756820 24503 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.682917 24583 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:29.674696 24565 raft_consensus.cc:697] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:29.663180 24696 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.717542 22442 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:29.718104 24333 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:29.719343 24606 consensus_queue.cc:237] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.721859 24720 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 12:17:29.716696 24655 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.717312 24576 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:29.702231 24269 consensus_queue.cc:1059] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:17:29.758560 24732 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:29.769114 24744 raft_consensus.cc:2764] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:17:29.777458 24269 raft_consensus.cc:3055] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:29.777989 24269 raft_consensus.cc:740] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:29.778906 24269 consensus_queue.cc:260] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.775446 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:29.780892 22542 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:29.773995 24722 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:29.784781 22393 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:17:29.758347 24644 raft_consensus.cc:697] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:29.793955 24644 consensus_queue.cc:237] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.795629 24565 consensus_queue.cc:237] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:29.669986 22298 rpcz_store.cc:269] 0709 12:17:07.330589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.330923 (+   334us) service_pool.cc:224] Handling call
0709 12:17:07.819868 (+488945us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b540038b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abe090 00007fb4f8b5cf3a 00007fb4fe912e9c 00007fb4fea1104e 00007fb4fced22a4 00007fb4fced2232 00007fb4fced2161 00007fb4fced20dc 00007fb4fced1392 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:29.654389 (+21834521us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:28.034586 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:28.035360 (+   774us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:28.035427 (+    67us) write_op.cc:435] Acquired schema lock
0709 12:17:28.035472 (+    45us) tablet.cc:662] Decoding operations
0709 12:17:28.036526 (+  1054us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:28.036623 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:28.036654 (+    31us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:17:28.037454 (+   800us) tablet.cc:701] Row locks acquired
0709 12:17:28.037511 (+    57us) write_op.cc:260] PREPARE: finished
0709 12:17:28.037735 (+   224us) write_op.cc:270] Start()
0709 12:17:28.103775 (+ 66040us) write_op.cc:276] Timestamp: P: 1783599448037652 usec, L: 0
0709 12:17:28.107648 (+  3873us) op_driver.cc:348] REPLICATION: starting
0709 12:17:28.275189 (+167541us) log.cc:844] Serialized 2844 byte log entry
0709 12:17:28.704456 (+429267us) op_driver.cc:464] REPLICATION: finished
0709 12:17:28.850017 (+145561us) write_op.cc:301] APPLY: starting
0709 12:17:28.850139 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:28.850358 (+   219us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:28.850521 (+   163us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:28.906130 (+ 55609us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:28.906459 (+   329us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:17:28.906504 (+    45us) write_op.cc:312] APPLY: finished
0709 12:17:28.906807 (+   303us) log.cc:844] Serialized 58 byte log entry
0709 12:17:28.906995 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:28.907106 (+   111us) write_op.cc:454] Released schema lock
0709 12:17:28.907165 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:28.907550 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:28.907577 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":23,"spinlock_wait_cycles":487879040,"child_traces":[["op",{"apply.queue_time_us":117692,"apply.run_cpu_time_us":3776,"apply.run_wall_time_us":57559,"num_ops":7,"prepare.queue_time_us":197408,"prepare.run_cpu_time_us":34287,"prepare.run_wall_time_us":423854,"raft.queue_time_us":108300,"raft.run_cpu_time_us":4851,"raft.run_wall_time_us":120690,"replication_time_us":574450,"thread_start_us":389727,"threads_started":4,"wal-append.queue_time_us":181119}]]}
I20260709 12:17:29.756628 24715 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:29.759244 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:29.803156 22550 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:29.675231 24603 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.760957 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:29.761111 22543 raft_consensus.cc:1240] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:29.675100 24730 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.700321 24718 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:29.694427 24579 raft_consensus.cc:697] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:29.784165 24732 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.726730 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:29.727607 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:29.815886 22473 raft_consensus.cc:2393] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:29.769135 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:29.816373 23129 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:29.772164 22470 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:29.770123 22367 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:29.817857 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 47818.9us
I20260709 12:17:29.818847 22367 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:29.770149 22441 leader_election.cc:400] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5.
I20260709 12:17:29.819445 22441 leader_election.cc:403] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:17:29.741634 22299 catalog_manager.cc:5697] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:29.787720 22474 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:29.728708 24640 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:29.788726 22542 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:17:29.791564 24655 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:29.797158 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.785176 22393 pending_rounds.cc:85] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 3
I20260709 12:17:29.801151 24696 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.802529 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:29.767505 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 50035.7us
I20260709 12:17:29.808668 24603 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.811687 24728 consensus_queue.cc:1059] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:17:29.832710 24732 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:29.822999 24731 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:29.824453 24576 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:29.824882 22367 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:29.830775 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 60773.4us
I20260709 12:17:29.831333 24333 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5.
I20260709 12:17:29.867048 22442 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:29.832706 23803 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:29.836084 22550 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:29.836501 22547 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:29.876963 22366 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:29.839267 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:29.839681 22393 pending_rounds.cc:107] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:17:29.878154 22393 raft_consensus.cc:2889] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:29.813024 24579 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.837169 22472 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:29.866359 24743 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:29.869234 22299 catalog_manager.cc:5697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 1 to 4, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 4 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:29.869947 24594 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:29.860986 24737 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.850379 24522 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:29.805693 24642 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:29.873358 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 48553.1us
I20260709 12:17:29.885462 23129 raft_consensus.cc:2393] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 4: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
W20260709 12:17:29.884891 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 79840.4us
I20260709 12:17:29.881279 23094 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:29.887264 22442 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:29.895768 23803 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.899444 23803 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.899755 22299 catalog_manager.cc:5697] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 3 to 4, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 4 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:29.901444 23803 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.901880 24473 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.902070 24739 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:29.885481 24061 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:29.883387 24655 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:29.904356 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:29.905927 22547 raft_consensus.cc:2410] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:29.902390 24473 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.908733 24473 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.905375 24739 raft_consensus.cc:697] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:29.910027 24061 raft_consensus.cc:697] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:29.915609 24603 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:29.915876 24061 consensus_queue.cc:237] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:29.867516 24744 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:17:29.895102 24492 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:29.937104 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:29.938230 22516 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:29.892352 24757 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:29.897490 24713 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:29.918700 24333 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:29.889034 24737 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:29.905141 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:29.958317 22472 raft_consensus.cc:1275] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:29.898871 24594 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:17:29.965878 22473 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:29.952149 24449 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.952267 24715 raft_consensus.cc:2764] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
W20260709 12:17:29.975693 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 372838us
I20260709 12:17:29.953506 24492 raft_consensus.cc:697] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:29.953729 24720 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:17:30.026376 22299 catalog_manager.cc:5697] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:30.037029 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 163290us
I20260709 12:17:30.033517 22299 catalog_manager.cc:5697] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 1 to 4, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 4 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:17:30.038337 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:30.081488 23803 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.082136 23803 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:29.960309 24713 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:30.085071 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:30.089957 22472 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:30.085654 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:30.005978 24449 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:30.087842 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 203145us
I20260709 12:17:30.088930 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:30.092845 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:30.094146 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:30.131906 22547 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:30.013891 24503 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:17:30.130498 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:30.093184 22299 catalog_manager.cc:5697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 2 to 3, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 3 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:29.915716 24739 consensus_queue.cc:237] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:30.017119 24454 consensus_queue.cc:1048] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 12:17:30.135236 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:30.140139 23803 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:29.957422 24757 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:30.083998 24522 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:30.086915 24744 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:30.031749 24724 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 12:17:30.147477 22476 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:30.194633 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:30.149235 23803 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:30.195304 22471 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:30.200155 22472 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:30.195359 23803 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:30.195570 22299 catalog_manager.cc:5697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 1 to 3, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 3 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:17:30.094832 24333 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 12:17:30.146875 24690 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:30.135661 24730 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:30.094203 24747 consensus_queue.cc:1059] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.134s
I20260709 12:17:30.336994 22471 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
W20260709 12:17:30.341885 24761 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:17:30.343134 24504 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.343729 24504 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:30.346357 24760 log.cc:927] Time spent T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.257s	user 0.000s	sys 0.000s
W20260709 12:17:30.373510 24762 log.cc:927] Time spent T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:17:30.226155 24642 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:30.415725 24730 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:30.423535 24766 log.cc:927] Time spent T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:17:30.149137 24678 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.182s
I20260709 12:17:30.441844 24449 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:30.220220 24492 consensus_queue.cc:237] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:30.215057 24522 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:30.336654 24744 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:30.545253 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 452481us
I20260709 12:17:30.375846 24640 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:30.327639 24690 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:30.583767 24583 consensus_meta.cc:287] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.826s	user 0.011s	sys 0.000s
I20260709 12:17:30.584132 24715 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:30.604314 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:30.605747 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:30.570382 24731 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:30.632306 22402 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
W20260709 12:17:30.648132 24732 consensus_meta.cc:287] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.767s	user 0.009s	sys 0.000s
I20260709 12:17:30.632284 22393 raft_consensus.cc:2376] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4. Re-sending same reply.
I20260709 12:17:30.470484 24730 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:30.670522 23803 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:30.615803 24504 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:30.649838 24718 consensus_meta.cc:287] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.824s	user 0.003s	sys 0.007s
I20260709 12:17:30.608023 24744 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:30.641810 24737 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:30.649049 24732 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:30.668756 24640 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:17:30.692227 22366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.010s	sys 0.015s
I20260709 12:17:30.670872 24731 raft_consensus.cc:697] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:30.693444 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:30.692804 22366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.010s	sys 0.015s
I20260709 12:17:30.641826 24583 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:30.696683 24583 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:30.707965 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:30.705650 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:30.712093 22551 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:30.707582 22546 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:17:30.698835 24751 sasl_common.cc:323] Time spent creating new SASL kudu client: real 0.258s	user 0.000s	sys 0.002s
I20260709 12:17:30.649755 24715 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:30.687628 24718 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:30.719453 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:30.713923 23095 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:30.700287 24061 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.010s	sys 0.017s
I20260709 12:17:30.759157 24583 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:30.759845 24576 raft_consensus.cc:3055] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:30.760497 24576 raft_consensus.cc:740] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:30.761418 24576 consensus_queue.cc:260] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:30.759809 24583 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:30.764182 24583 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:30.764698 24713 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:30.765380 24731 consensus_queue.cc:237] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:30.766582 24690 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:30.767295 24777 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:30.768213 24774 log.cc:927] Time spent T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:17:30.767874 24777 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:30.769717 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1298) took 1013 ms. Trace:
I20260709 12:17:30.771106 24718 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:30.770120 22401 rpcz_store.cc:276] 0709 12:17:29.756647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.757031 (+   384us) service_pool.cc:224] Handling call
0709 12:17:29.757368 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:29.757732 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:29.939233 (+181501us) log.cc:844] Serialized 14 byte log entry
0709 12:17:30.187877 (+248644us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:30.194733 (+  6856us) log.cc:844] Serialized 26 byte log entry
0709 12:17:30.194881 (+   148us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:30.194919 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.194991 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:30.769513 (+574522us) raft_consensus.cc:1685] finished
0709 12:17:30.769532 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.769660 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40919,"prepare.queue_time_us":152769,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":1539,"raft.queue_time_us":436921,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":8224,"spinlock_wait_cycles":1135744,"thread_start_us":360492,"threads_started":2,"wal-append.queue_time_us":420306}
I20260709 12:17:30.773238 24734 raft_consensus.cc:3055] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:30.773909 24734 raft_consensus.cc:740] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:30.774830 24734 consensus_queue.cc:260] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:30.780292 24730 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:30.782022 22542 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:30.783275 22543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49290 (request call id 160) took 1363 ms. Trace:
I20260709 12:17:30.785425 22551 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:30.707526 24778 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.714758 24565 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:30.715579 24757 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:30.697809 24640 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:30.913051 24747 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:30.925290 24747 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.925748 24747 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.929818 24786 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.918843 24777 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:30.927587 24690 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.716609 24492 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:30.924170 22543 rpcz_store.cc:276] 0709 12:17:29.419906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.420138 (+   232us) service_pool.cc:224] Handling call
0709 12:17:29.420458 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.804362 (+383904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.783040 (+978678us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54001b8d54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:30.783215 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783036672}
W20260709 12:17:30.753394 24061 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.010s	sys 0.017s
I20260709 12:17:30.821496 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:30.937614 23129 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:30.820966 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:30.951435 23124 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 5 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:30.952206 24785 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:30.952791 24785 raft_consensus.cc:697] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 4 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:30.885434 24776 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.928542 24732 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:30.953743 24785 consensus_queue.cc:237] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:30.962201 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 248347us
I20260709 12:17:30.931469 24565 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:30.955588 24061 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.961383 24777 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:30.936641 24690 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:30.937237 24492 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:31.084560 24061 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:31.091231 24783 log.cc:927] Time spent T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:17:31.083552 24715 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:31.078622 24787 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:30.932062 24778 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.093545 24777 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:30.937685 24786 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:30.962246 24776 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.116279 22545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:17:31.118489 24730 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:31.119089 24561 raft_consensus.cc:3055] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:31.122442 24747 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:31.126106 22545 raft_consensus.cc:606] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:31.127449 22545 raft_consensus.cc:614] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:31.129699 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1289) took 1550 ms. Trace:
I20260709 12:17:31.130157 22398 rpcz_store.cc:276] 0709 12:17:29.577412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.577530 (+   118us) service_pool.cc:224] Handling call
0709 12:17:31.127721 (+1550191us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54000b6dd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:31.127844 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238900608}
I20260709 12:17:31.126986 24561 raft_consensus.cc:740] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:17:31.141353 24780 log.cc:927] Time spent T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:17:31.142160 24776 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:31.143775 24778 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:31.150584 24640 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:31.151667 24786 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:31.152207 24786 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:31.152669 24786 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:31.156384 24777 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:31.156893 24492 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:31.158499 24522 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:31.105515 24787 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:31.161655 24787 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:31.129494 24730 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.164156 24730 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:31.166041 24061 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:31.154265 24561 consensus_queue.cc:260] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.170008 24561 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:31.173189 24744 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:31.174305 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 1.02535e+06us
I20260709 12:17:31.179754 22442 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:31.185395 24721 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:31.194058 24721 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.195225 24778 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.195569 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:31.196127 24721 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:31.195752 24778 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:31.197991 24778 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:31.131464 24473 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:17:31.138496 24731 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.221109 23803 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.222399 23803 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.224886 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:31.225346 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 45694.2us
I20260709 12:17:31.225740 22401 raft_consensus.cc:2393] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 4: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:31.226230 22442 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:31.226585 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:31.228116 23129 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:31.210940 24473 consensus_queue.cc:1243] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:31.200353 24061 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.233883 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1579) took 1146 ms. Trace:
I20260709 12:17:31.221423 24737 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.235957 22442 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:31.236099 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:31.235447 23803 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:31.221861 24696 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.229700 24731 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.238646 22468 rpcz_store.cc:276] 0709 12:17:30.086421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.086539 (+   118us) service_pool.cc:224] Handling call
0709 12:17:30.142099 (+ 55560us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:30.142502 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:30.142532 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:30.768696 (+626164us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b2c00001368. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f744da11 00007fb4f745d372 00007fb4f8b8fa01 00007fb4f8b5443a 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2
0709 12:17:30.769096 (+   400us) log.cc:844] Serialized 26 byte log entry
0709 12:17:30.923070 (+153974us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:31.083123 (+160053us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.228873 (+145750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.228949 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:31.228990 (+    41us) raft_consensus.cc:1685] finished
0709 12:17:31.232627 (+  3637us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:31.232760 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":138572,"prepare.queue_time_us":204029,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":1177672,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":2519,"spinlock_wait_cycles":4196608,"thread_start_us":300484,"threads_started":2,"wal-append.queue_time_us":155976}
I20260709 12:17:31.221691 24703 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:31.229478 24778 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:31.290614 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 54728.5us
W20260709 12:17:31.252434 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.221580 24777 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:31.289675 23803 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.287416 22397 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:31.292375 23803 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.292531 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:31.293287 22398 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:17:31.233379 24769 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:31.235406 24757 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:31.235679 24576 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.286898 24721 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:31.301015 24627 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.290374 24696 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.289116 24061 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.330991 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:31.302596 24744 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:31.291244 24522 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:31.293717 24703 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.289613 24737 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.343089 24731 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:31.343742 24737 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:31.289245 24748 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:17:31.301340 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.294915 24778 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.345221 24720 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.345705 24720 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.346495 24778 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:31.313205 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:31.350708 22397 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:31.338260 23803 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:31.339643 24795 log.cc:927] Time spent T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:17:31.337478 24678 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:31.341039 24522 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:31.324606 24503 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:31.297726 24777 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.344219 24747 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:31.383750 24806 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:31.383630 24720 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:31.384686 24777 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:31.384325 24806 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:31.375258 24061 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:31.345185 24730 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:31.390976 24730 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.393386 24744 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.393958 24744 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.380154 24678 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:31.395298 24678 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:31.381191 24503 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:31.338297 24627 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.390429 24703 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:31.335443 24721 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:31.406775 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:31.488317 24777 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:31.832062 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.502929 24778 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:31.794480 22366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.015s	sys 0.029s
I20260709 12:17:32.143137 24778 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:32.144717 24744 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:32.145455 24744 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:32.146113 23095 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.135s (SENT) [suppressed 12 similar messages]
I20260709 12:17:32.146544 24696 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:31.510840 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:32.147781 22394 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:31.394984 24786 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:32.148974 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:31.490726 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.502142 24732 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:31.655121 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:31.522246 22397 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 7.
I20260709 12:17:31.407111 24739 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:32.152454 22366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.024s	user 0.032s	sys 0.059s
I20260709 12:17:32.152194 24739 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:32.146553 24565 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:32.152813 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 1.03867e+06us
I20260709 12:17:32.141182 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:32.154330 22396 raft_consensus.cc:2393] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 4: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:31.477844 24061 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:32.155469 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:32.156253 22396 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:32.155351 24061 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:32.157166 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:32.157644 24503 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:32.151425 22395 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:32.142668 24777 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:32.159487 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:32.159768 24721 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:31.458364 24737 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:31.734393 22400 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:17:32.161350 22400 pending_rounds.cc:85] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 4
I20260709 12:17:32.158087 24061 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:31.394846 24748 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.160271 22395 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.149617 22394 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:32.154422 24739 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:31.458825 24784 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:32.162426 22396 raft_consensus.cc:2393] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:32.163405 24732 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:32.161621 22400 pending_rounds.cc:107] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.5
I20260709 12:17:32.164952 22398 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 7.
I20260709 12:17:32.165431 24565 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.166046 22366 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:32.230861 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 64886.3us
I20260709 12:17:32.231854 22366 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:31.945703 24644 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.146085 24744 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:32.229686 22400 raft_consensus.cc:2917] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Aborting config change with OpId 5.5: Aborted: Op aborted by new leader
I20260709 12:17:32.167721 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:32.240890 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.245266 22395 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:32.181486 24723 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.183934 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:32.187078 24703 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:32.188930 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.251896 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:32.191468 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.252314 22473 raft_consensus.cc:2393] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 5: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:32.252693 22472 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:17:32.192205 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.253593 22476 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:32.192962 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.195215 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.196798 24776 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:32.198105 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:32.253955 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:32.254807 22475 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:32.254618 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:32.204999 24679 consensus_queue.cc:1059] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:32.160811 24737 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:31.973819 24717 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:17:32.216257 24721 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.220532 24449 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:31.476192 24769 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:32.227658 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 81565.9us
I20260709 12:17:32.236317 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:32.226055 24812 log.cc:927] Time spent T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.074s	user 0.001s	sys 0.001s
I20260709 12:17:32.246878 22394 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
W20260709 12:17:31.976177 24678 consensus_meta.cc:287] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.000s
I20260709 12:17:32.239460 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:32.250058 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:32.221828 24522 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:32.251032 22400 raft_consensus.cc:2889] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:32.251466 22402 raft_consensus.cc:2393] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 4: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:31.899998 24743 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.206384 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:32.214335 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:32.334452 22543 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:32.255663 22547 raft_consensus.cc:2393] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:17:32.256700 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.257831 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:32.259791 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:32.262530 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:32.336498 22396 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:32.263384 22551 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:32.265445 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:32.269927 22542 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:32.338799 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:32.239729 24061 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:32.339649 24061 raft_consensus.cc:697] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:32.340610 24061 consensus_queue.cc:237] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:32.230434 24765 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:32.342139 24765 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:32.344707 24765 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:32.347628 22551 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:17:32.273229 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.257292 24718 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:32.226045 24748 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:32.277240 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:32.332237 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1302) took 1080 ms. Trace:
I20260709 12:17:32.265514 24730 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:32.256268 24583 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.274401 22474 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 1.
I20260709 12:17:32.332249 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:32.363227 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:32.363565 23128 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 5 LEARNER]: Advancing to term 6
I20260709 12:17:32.363806 22394 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:32.364925 22394 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:32.365890 24603 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:32.366446 24603 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:32.368434 24603 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:32.360983 24743 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:32.350186 22545 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:32.370689 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:32.350721 22399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 168) took 1114 ms. Trace:
I20260709 12:17:32.371646 22399 rpcz_store.cc:276] 0709 12:17:31.236029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.236140 (+   111us) service_pool.cc:224] Handling call
0709 12:17:31.236436 (+   296us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:31.287728 (+ 51292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:31.287758 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:31.291437 (+  3679us) log.cc:844] Serialized 52 byte log entry
0709 12:17:31.550243 (+258806us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:31.550285 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.550357 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:32.350516 (+800159us) raft_consensus.cc:1685] finished
0709 12:17:32.350535 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:32.350666 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34214,"raft.queue_time_us":56287,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":7991,"thread_start_us":243693,"threads_started":1,"wal-append.queue_time_us":855827}
I20260709 12:17:32.352104 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:32.374284 23131 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:32.374437 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:32.375730 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:32.353246 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:32.377203 22546 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:32.377337 24744 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:32.354036 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:32.378558 22547 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:32.382128 24822 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:32.382804 24822 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:32.385054 24743 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:32.386060 22399 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:32.386623 24737 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:32.387316 22399 raft_consensus.cc:1240] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:32.261570 24703 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:32.389652 24703 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:32.390990 24269 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:32.392112 23131 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:32.393075 24703 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:32.393613 24703 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:32.395659 24703 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:32.396286 24703 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.396718 24703 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:32.398821 24703 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:32.399660 24737 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:32.400157 24737 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:32.402072 24737 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:32.403888 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.404073 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.405795 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.407557 22470 raft_consensus.cc:1275] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:32.408764 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.409611 22470 raft_consensus.cc:2393] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:32.412851 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.413103 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:32.228883 24784 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:32.356189 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:32.277201 22550 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:32.260349 24723 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:32.248973 24565 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:32.355229 22393 rpcz_store.cc:276] 0709 12:17:31.194595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.196122 (+  1527us) service_pool.cc:224] Handling call
0709 12:17:31.196427 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:31.223333 (+ 26906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:31.223373 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:31.233652 (+ 10279us) log.cc:844] Serialized 26 byte log entry
0709 12:17:31.550634 (+316982us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:31.652306 (+101672us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.652577 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:32.166717 (+514140us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b180002bc60. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a67522 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:17:32.173710 (+  6993us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b180002bc60. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a352a6 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419
0709 12:17:32.215520 (+ 41810us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b54000b5ed4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:32.215574 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:32.274712 (+ 59138us) raft_consensus.cc:1685] finished
0709 12:17:32.274731 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:32.274858 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22343,"prepare.queue_time_us":101456,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":31171,"raft.queue_time_us":39178,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":83330,"spinlock_wait_cycles":322697216,"thread_start_us":258122,"threads_started":1,"wal-append.queue_time_us":856924}
I20260709 12:17:32.360955 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:32.255419 24644 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:32.266213 24776 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:32.272233 24721 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:32.271631 24449 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:32.415750 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.756803 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:32.757421 22546 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.746032 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:32.759034 22399 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:32.742699 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 68574.3us
I20260709 12:17:32.759876 22477 raft_consensus.cc:2410] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:32.558779 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:32.761587 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:32.762220 22547 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:32.758234 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:32.520150 22396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:17:32.764756 22396 raft_consensus.cc:606] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:32.765202 22396 raft_consensus.cc:614] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:17:32.746577 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.758051 22402 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.713867 22401 raft_consensus.cc:1240] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:32.764781 22394 raft_consensus.cc:2393] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:32.458289 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:32.633124 22400 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:32.784405 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1271) took 1254 ms. Trace:
I20260709 12:17:32.755801 22297 catalog_manager.cc:5697] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 2 to 5, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 5 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.807147 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:32.798264 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:32.829893 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.800609 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:32.831023 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.831046 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.831583 22550 raft_consensus.cc:2393] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:17:32.827441 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 369203us
I20260709 12:17:32.834650 22393 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
W20260709 12:17:32.666611 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.836989 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:32.837924 22395 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:32.356765 24718 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:32.827880 22400 rpcz_store.cc:276] 0709 12:17:31.530030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.361441 (+831411us) service_pool.cc:224] Handling call
0709 12:17:32.603875 (+242434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:32.784110 (+180235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:32.784345 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:32.715734 24680 raft_consensus.cc:3055] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:32.603370 24640 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.604282 24655 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.841552 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:32.839272 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:32.758944 24627 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:32.846730 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.785432 24579 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:32.332561 24678 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:32.717655 24778 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:32.715459 24822 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:32.848235 22393 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:32.849380 22395 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:32.781638 24820 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:32.795161 24813 log.cc:927] Time spent T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.444s	user 0.000s	sys 0.000s
I20260709 12:17:32.850138 22549 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:32.933261 22468 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
W20260709 12:17:32.913978 22475 consensus_meta.cc:287] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.000s
I20260709 12:17:32.889299 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:32.928599 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:32.850267 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:32.927610 22398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58054 (request call id 170) took 1528 ms (client timeout 1520 ms). Trace:
W20260709 12:17:32.935745 22398 rpcz_store.cc:269] 0709 12:17:31.399211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.399345 (+   134us) service_pool.cc:224] Handling call
0709 12:17:32.927345 (+1528000us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b54001e2b54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:32.927509 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51617152}
W20260709 12:17:32.913384 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.633543 24668 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:32.938441 22475 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:32.943274 22550 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:32.944221 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:32.944984 22550 raft_consensus.cc:2410] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:32.875265 22297 catalog_manager.cc:5697] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.565840 24583 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:32.925558 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.839272 24796 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:32.942397 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.963588 22475 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 3.
I20260709 12:17:32.965034 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:32.969940 22477 raft_consensus.cc:2393] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 2: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:32.865180 23124 raft_consensus.cc:2410] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:17:32.934794 22401 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:32.964603 24668 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:32.970427 22399 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:32.845319 22367 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:32.973093 24583 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:32.973248 24778 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:32.973724 24668 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:32.871381 24655 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:32.871138 24449 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:32.902801 24640 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:32.975806 22546 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:32.976063 24655 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:32.976651 24640 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:32.976929 22542 raft_consensus.cc:2410] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:32.977360 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.977732 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:32.978462 23122 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:32.977892 22468 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:32.980232 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.981074 22468 raft_consensus.cc:2393] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:32.968868 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.984767 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.982514 22396 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:17:32.986379 22396 pending_rounds.cc:85] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 3
I20260709 12:17:32.986815 22396 pending_rounds.cc:107] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:17:32.987072 22396 raft_consensus.cc:2889] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:32.843149 24718 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:32.840344 24737 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:32.847443 24680 raft_consensus.cc:740] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:32.867177 24732 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:32.990552 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 145308us
I20260709 12:17:33.172762 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.122123 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:33.044582 22546 raft_consensus.cc:1275] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:33.097489 23128 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 6 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:33.172801 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.190248 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.192297 22367 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:32.988824 22547 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:33.158780 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.193531 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:33.113408 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.201575 22399 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:33.178083 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.206732 22393 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:33.206244 22550 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:33.212349 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.213645 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.214247 22476 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:33.215080 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.216167 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.217207 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:32.978462 24821 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:17:33.118033 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.219190 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.224920 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.225543 22549 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:33.222182 22401 raft_consensus.cc:2410] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:33.190826 22546 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:33.228351 22399 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:17:33.228814 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.229535 22394 raft_consensus.cc:1240] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:33.171715 24828 log.cc:927] Time spent T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:17:33.093226 23127 raft_consensus.cc:2368] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7.
W20260709 12:17:33.171308 24824 log.cc:927] Time spent T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:17:33.231689 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:32.982627 24806 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:33.234835 22476 raft_consensus.cc:2410] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:17:33.223300 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 223134us
I20260709 12:17:33.221060 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.255177 22393 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:33.235872 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:33.244449 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.251756 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.122620 24449 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:33.266968 24449 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:33.267660 24718 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:33.268821 22395 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:33.269249 24449 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:33.270349 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.271723 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:32.991842 24796 raft_consensus.cc:697] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 7 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:17:33.253275 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 131550us
I20260709 12:17:33.274376 24776 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:33.275182 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:33.275051 24796 consensus_queue.cc:237] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:33.155962 24784 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:33.121148 24679 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.133s
I20260709 12:17:33.219028 24826 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:33.277469 24826 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:33.279707 24826 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:17:33.251394 24723 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:33.280226 22469 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
W20260709 12:17:33.262686 24831 log.cc:927] Time spent T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:17:32.950124 24820 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:33.266248 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.290442 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.263336 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:33.291277 22398 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.942680 24579 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:33.219099 24731 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:33.265558 24269 consensus_meta.cc:287] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.874s	user 0.008s	sys 0.001s
I20260709 12:17:33.221488 24737 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:33.291203 22401 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:33.224179 24565 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:33.205809 24817 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:17:33.303947 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.304795 22546 raft_consensus.cc:2393] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:33.296339 22544 pending_rounds.cc:85] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 1
I20260709 12:17:33.306568 22544 pending_rounds.cc:107] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:17:33.306846 22544 raft_consensus.cc:2889] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:33.237722 24644 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:33.290619 22400 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:33.232223 24832 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.302624 22399 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:33.335641 22398 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 7.
I20260709 12:17:33.364079 22442 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:33.375597 22475 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:33.230158 24640 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:17:33.379422 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:33.383977 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 175668us
I20260709 12:17:33.385812 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:33.297612 22366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.008s	sys 0.030s
I20260709 12:17:33.386111 22442 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:33.282172 24721 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:33.388675 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.396005 22393 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:17:33.386459 22366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.009s	sys 0.030s
I20260709 12:17:33.388307 22396 raft_consensus.cc:2376] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7. Re-sending same reply.
I20260709 12:17:33.398367 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.399063 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:33.401618 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 149276us
W20260709 12:17:33.402580 22402 consensus_meta.cc:287] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.635s	user 0.005s	sys 0.003s
I20260709 12:17:33.402913 22402 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:33.403375 22402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1279) took 1224 ms. Trace:
W20260709 12:17:33.376084 24828 log.cc:927] Time spent T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:17:33.405412 22400 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:33.295699 24739 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:33.403668 22402 rpcz_store.cc:276] 0709 12:17:32.179004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.355963 (+176959us) service_pool.cc:224] Handling call
0709 12:17:33.403317 (+1047354us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:33.399778 22546 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:33.404426 24269 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
W20260709 12:17:33.407905 24812 log.cc:927] Time spent T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:17:33.411191 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:33.413549 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.414242 22401 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:33.419544 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.420724 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.421744 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.433534 22547 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:33.422137 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.434913 22549 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:33.422416 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.426924 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:17:33.440698 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:33.441788 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.389314 24769 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:33.385219 24757 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:33.490839 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 63980.6us
I20260709 12:17:33.493628 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.495837 22546 raft_consensus.cc:2410] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:33.394960 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41028 (request call id 334) took 1187 ms. Trace:
I20260709 12:17:33.498816 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43060 (request call id 155) took 1314 ms. Trace:
I20260709 12:17:33.500460 22441 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:33.405679 24644 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:33.526618 24644 raft_consensus.cc:697] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:33.527413 24690 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:33.527573 24644 consensus_queue.cc:237] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:33.512885 24732 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:33.528666 22543 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:33.280733 24680 consensus_queue.cc:260] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:33.514503 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.530478 22543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1273) took 1254 ms. Trace:
I20260709 12:17:33.530930 22543 rpcz_store.cc:276] 0709 12:17:32.276223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.350191 (+ 73968us) service_pool.cc:224] Handling call
0709 12:17:33.528334 (+1178143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:33.529071 (+   737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.530264 (+  1193us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54003c9bd0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:33.530421 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2692144000}
I20260709 12:17:33.531826 24732 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:33.532177 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.533002 22543 raft_consensus.cc:2393] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 6: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:33.532693 24732 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:33.533948 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.534520 22543 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:33.535283 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.536489 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.537464 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.493108 24806 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:17:33.516964 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.517899 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:17:33.491322 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.543422 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1642) took 1278 ms. Trace:
I20260709 12:17:33.424360 24739 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:33.519841 24269 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:33.498268 24744 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:33.502912 23124 rpcz_store.cc:276] 0709 12:17:32.207195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.213994 (+  6799us) service_pool.cc:224] Handling call
0709 12:17:33.394732 (+1180738us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b540012b454. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:33.394896 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128773376}
I20260709 12:17:33.504106 22471 rpcz_store.cc:276] 0709 12:17:32.184356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.189431 (+  5075us) service_pool.cc:224] Handling call
0709 12:17:32.189781 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:32.190128 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:32.190153 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:32.190668 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 12:17:32.762868 (+572200us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:32.762913 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:32.763014 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:33.498615 (+735601us) raft_consensus.cc:1685] finished
0709 12:17:33.498633 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:33.498759 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4218,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":87,"thread_start_us":361060,"threads_started":1,"wal-append.queue_time_us":790389}
I20260709 12:17:33.522929 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.540664 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.531515 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.543824 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.544334 22542 rpcz_store.cc:276] 0709 12:17:32.275403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.338528 (+ 63125us) service_pool.cc:224] Handling call
0709 12:17:33.528221 (+1189693us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54003c9bd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:33.543335 (+ 15114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465661184}
I20260709 12:17:33.549607 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43060 (request call id 158) took 1352 ms. Trace:
I20260709 12:17:33.563205 22475 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:33.564639 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.563999 22474 rpcz_store.cc:276] 0709 12:17:32.185238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.192691 (+  7453us) service_pool.cc:224] Handling call
0709 12:17:33.537880 (+1345189us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b54003e2954. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:33.537989 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45776768}
I20260709 12:17:33.565825 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.566167 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.566624 22475 raft_consensus.cc:2410] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:33.530426 24680 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:33.563180 22547 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:33.563485 22477 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:33.570994 22477 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:33.577525 24718 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:33.577798 24737 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:33.578154 24769 consensus_queue.cc:1059] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:17:33.579231 24737 raft_consensus.cc:3055] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:33.579592 24737 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:33.503072 24757 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:33.555171 24744 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.545470 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:33.586975 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.587638 22471 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:33.590807 22477 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:17:33.592005 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 91616us
I20260709 12:17:33.594240 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.594465 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.595101 22475 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:33.588424 24744 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:33.601266 22543 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:33.601579 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:33.602662 22474 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:17:33.603041 22474 pending_rounds.cc:85] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 4
I20260709 12:17:33.603266 22474 pending_rounds.cc:107] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:17:33.603487 22474 raft_consensus.cc:2889] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:33.607182 24843 log.cc:927] Time spent T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 12:17:33.608093 23131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34092 (request call id 285) took 1246 ms. Trace:
I20260709 12:17:33.608474 23131 rpcz_store.cc:276] 0709 12:17:32.361945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.607297 (+1245352us) service_pool.cc:224] Handling call
0709 12:17:33.607615 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:33.607790 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:33.607814 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:33.607863 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:33.607892 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.607941 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:33.608041 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:33.613221 22475 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:33.614217 23127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41012 (request call id 216) took 1375 ms. Trace:
I20260709 12:17:33.624634 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1385) took 1208 ms. Trace:
W20260709 12:17:33.627516 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 84420.4us
I20260709 12:17:33.599844 24817 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:17:33.620819 23127 rpcz_store.cc:276] 0709 12:17:32.238669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.240546 (+  1877us) service_pool.cc:224] Handling call
0709 12:17:33.613989 (+1373443us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54005b0ed4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:33.614153 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414971136}
I20260709 12:17:33.646626 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1388) took 1132 ms. Trace:
I20260709 12:17:33.647305 24806 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:33.647097 22468 rpcz_store.cc:276] 0709 12:17:32.514543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.272584 (+758041us) service_pool.cc:224] Handling call
0709 12:17:33.272921 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:33.274238 (+  1317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:33.274269 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:33.274733 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:17:33.559213 (+284480us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:33.559254 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.559322 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:33.646362 (+ 87040us) raft_consensus.cc:1685] finished
0709 12:17:33.646387 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:33.646533 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":771,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":95,"thread_start_us":280918,"threads_started":1,"wal-append.queue_time_us":350311}
I20260709 12:17:33.586432 24737 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:33.662932 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 56167.1us
I20260709 12:17:33.665810 24748 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:33.667157 22442 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:33.667284 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:33.673259 24820 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:33.663890 24737 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:33.679272 24757 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:33.679510 24678 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:33.682541 24818 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:33.683073 24818 raft_consensus.cc:697] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:33.684546 24818 consensus_queue.cc:237] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:33.685019 23122 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:33.688351 23126 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 7 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:33.689143 23126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41012 (request call id 221) took 1278 ms. Trace:
I20260709 12:17:33.669269 24644 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:33.625058 22472 rpcz_store.cc:276] 0709 12:17:32.415940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.417726 (+  1786us) service_pool.cc:224] Handling call
0709 12:17:32.831384 (+413658us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:32.842504 (+ 11120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:32.842536 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:32.865631 (+ 23095us) log.cc:844] Serialized 52 byte log entry
0709 12:17:32.991991 (+126360us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:33.289108 (+297117us) log.cc:844] Serialized 14 byte log entry
0709 12:17:33.293596 (+  4488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.293679 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:33.624396 (+330717us) raft_consensus.cc:1685] finished
0709 12:17:33.624418 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:33.624573 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10703,"prepare.queue_time_us":606087,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":810,"raft.queue_time_us":18937,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":55517,"spinlock_wait_cycles":723968,"thread_start_us":343701,"threads_started":2,"wal-append.queue_time_us":700133}
I20260709 12:17:33.695518 22297 catalog_manager.cc:5697] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 2 to 5, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:33.689503 23126 rpcz_store.cc:276] 0709 12:17:32.411085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.687744 (+1276659us) service_pool.cc:224] Handling call
0709 12:17:33.688151 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:33.688849 (+   698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.689082 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:33.698832 24777 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:33.702594 23130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34092 (request call id 283) took 1452 ms. Trace:
I20260709 12:17:33.703253 23130 rpcz_store.cc:276] 0709 12:17:32.250430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.250604 (+   174us) service_pool.cc:224] Handling call
0709 12:17:33.701799 (+1451195us) spinlock_profiling.cc:243] Waited 921 us on lock 0x7b58001c5698. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:17:33.702018 (+   219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:33.702228 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:33.702256 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:33.702306 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:33.702343 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.702400 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:33.702524 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2119040}
I20260709 12:17:33.703399 22470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1588) took 1291 ms. Trace:
I20260709 12:17:33.704530 22470 rpcz_store.cc:276] 0709 12:17:32.411495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.411604 (+   109us) service_pool.cc:224] Handling call
0709 12:17:32.411874 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:32.843057 (+431183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:32.843099 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:32.843141 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:32.843175 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.703176 (+860001us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b5400328a54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:33.703220 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:33.703340 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1257,"raft.queue_time_us":57804,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":38456,"spinlock_wait_cycles":988004096}
I20260709 12:17:33.704162 22545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1279) took 1019 ms. Trace:
I20260709 12:17:33.706545 22545 rpcz_store.cc:276] 0709 12:17:32.685414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.685546 (+   132us) service_pool.cc:224] Handling call
0709 12:17:32.685896 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:32.842535 (+156639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:32.842565 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:32.842605 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:32.842633 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.703954 (+861321us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54001b9754. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:33.703995 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:33.704105 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359803136}
W20260709 12:17:33.730314 22368 connection.cc:256] RPC call timeout handler was delayed by -1.6139958530000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:17:33.731689 24776 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:33.732244 24776 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:33.734084 24777 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.734377 23095 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:33.734768 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.735033 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.735492 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:33.736301 22400 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:33.736650 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:33.737222 22397 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:33.733592 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:33.737843 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.738543 22402 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:33.731913 22398 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:33.736243 22399 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:33.740336 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.741087 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.741830 22398 raft_consensus.cc:2393] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 6: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:17:33.755954 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.669438 24852 consensus_queue.cc:1059] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 12:17:33.757635 24838 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:33.758234 24838 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:33.758606 24838 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:33.762279 22400 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:33.763002 24269 raft_consensus.cc:3055] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:33.763393 24269 raft_consensus.cc:740] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:33.764215 24269 consensus_queue.cc:260] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:33.767135 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.767453 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34092 (request call id 284) took 1496 ms. Trace:
I20260709 12:17:33.739471 24680 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:33.739302 24797 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:33.769160 24680 raft_consensus.cc:697] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 7 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:33.770237 24680 consensus_queue.cc:237] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:33.767939 23125 rpcz_store.cc:276] 0709 12:17:32.270655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.349717 (+ 79062us) service_pool.cc:224] Handling call
0709 12:17:33.422943 (+1073226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:33.502956 (+ 80013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:33.538466 (+ 35510us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:33.543267 (+  4801us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:33.543326 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.549887 (+  6561us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:33.767166 (+217279us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540012b450. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:33.767291 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2392077568}
I20260709 12:17:33.771133 24739 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:33.773351 24777 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:33.744441 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.774789 24579 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:33.776031 22402 raft_consensus.cc:2393] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:33.775712 22393 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:33.768136 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.778820 22398 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:33.767472 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:33.790454 24846 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.791069 24846 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:33.793223 24846 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:33.793347 24820 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.793951 24820 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:33.795249 22297 catalog_manager.cc:5697] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:33.765558 24269 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:33.769223 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.746485 22399 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:33.746868 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:33.799930 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 189957us
W20260709 12:17:33.804626 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.804544 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.805972 22394 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:33.801275 22397 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
W20260709 12:17:33.807309 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 140362us
I20260709 12:17:33.795032 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:33.810602 22400 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:33.810745 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:33.702654 24744 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:33.814278 22366 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:33.816277 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:33.768786 24797 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:33.819389 22366 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:33.822361 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:33.823716 24640 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:33.824137 24640 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.824265 22366 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:33.824541 24640 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:33.825083 24731 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:33.825937 24690 consensus_queue.cc:1048] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:33.826478 23125 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:33.826890 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.827185 24731 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:33.810250 24800 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:33.827594 24731 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.828024 24731 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:33.828153 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:33.796934 24734 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:33.831081 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:33.829319 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.833078 22546 raft_consensus.cc:2410] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:33.829456 24744 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:33.829825 24776 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:33.830068 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.834220 22516 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:33.834544 22545 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:33.831684 24579 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.835518 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.835839 22550 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:33.838032 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.827955 24800 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:33.820096 24832 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:33.839391 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:33.820641 24846 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:33.830575 24723 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.831482 24797 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:33.849385 22545 raft_consensus.cc:2410] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:33.846486 22366 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:33.854708 22442 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:33.812762 24858 consensus_queue.cc:1059] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:17:33.870442 22516 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:33.874732 22442 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:33.876616 22442 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:33.877306 24748 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:33.881297 24748 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.881745 24748 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:33.878001 24854 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:33.885234 24854 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:33.878949 24644 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:33.886031 24644 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:33.886469 24644 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:33.879711 24858 raft_consensus.cc:3055] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:33.890323 24858 raft_consensus.cc:740] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:33.891295 24858 consensus_queue.cc:260] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:33.892535 24858 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:33.885648 24854 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.894519 24854 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:33.904294 24748 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:33.918202 24852 consensus_queue.cc:1059] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:33.847595 24583 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:33.855500 24832 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.848140 24800 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:33.826655 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:33.928772 22297 catalog_manager.cc:5697] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 1 to 6, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 6 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:33.942440 24777 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:33.943341 22299 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50158 (request call id 188) took 15708 ms (client timeout 15000 ms). Trace:
I20260709 12:17:33.845696 24847 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.111s
W20260709 12:17:33.949009 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.057408 22297 catalog_manager.cc:5697] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 1 to 6, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 6 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:33.921608 24718 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:33.949729 22399 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:17:33.856819 24579 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:33.953346 24820 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:33.845537 24806 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:17:33.845396 24739 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 12:17:33.957240 23129 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:33.870968 24723 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:34.073901 23129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41028 (request call id 333) took 1868 ms (client timeout 1923 ms). Trace:
I20260709 12:17:34.074067 24494 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:34.074317 23129 rpcz_store.cc:269] 0709 12:17:32.205985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.206122 (+   137us) service_pool.cc:224] Handling call
0709 12:17:34.073676 (+1867554us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54005f1c54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:34.073828 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3730618624}
I20260709 12:17:34.074595 24494 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:34.070315 24817 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:17:33.961066 24797 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:34.078194 24579 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:34.061301 24718 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.078994 24718 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.079249 24797 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:33.978222 24763 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:33.834954 24859 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 12:17:33.862143 24846 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:34.057304 22299 rpcz_store.cc:269] 0709 12:17:18.234571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.234831 (+   260us) service_pool.cc:224] Handling call
0709 12:17:33.943224 (+15708393us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:30.935443 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:30.945777 (+ 10334us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:30.945818 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:17:30.945837 (+    19us) tablet.cc:662] Decoding operations
0709 12:17:30.946859 (+  1022us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:30.946926 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:30.946955 (+    29us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:17:30.947687 (+   732us) tablet.cc:701] Row locks acquired
0709 12:17:30.947707 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:17:30.947881 (+   174us) write_op.cc:270] Start()
0709 12:17:30.948016 (+   135us) write_op.cc:276] Timestamp: P: 1783599450947819 usec, L: 0
0709 12:17:30.948036 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:17:30.948794 (+   758us) log.cc:844] Serialized 3618 byte log entry
0709 12:17:31.239701 (+290907us) op_driver.cc:464] REPLICATION: finished
0709 12:17:31.241408 (+  1707us) write_op.cc:301] APPLY: starting
0709 12:17:31.241505 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:31.241946 (+   441us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:31.290190 (+ 48244us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:31.390469 (+100279us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:31.390687 (+   218us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:17:31.390734 (+    47us) write_op.cc:312] APPLY: finished
0709 12:17:31.390994 (+   260us) log.cc:844] Serialized 70 byte log entry
0709 12:17:31.391782 (+   788us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:31.391908 (+   126us) write_op.cc:454] Released schema lock
0709 12:17:31.391953 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:31.488348 (+ 96395us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:31.489715 (+  1367us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":150756,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":1434,"apply.run_cpu_time_us":4118,"apply.run_wall_time_us":199163,"num_ops":9,"prepare.queue_time_us":513057,"prepare.run_cpu_time_us":48669,"prepare.run_wall_time_us":163689,"raft.queue_time_us":80113,"raft.run_cpu_time_us":11408,"raft.run_wall_time_us":49151,"replication_time_us":291492,"thread_start_us":537204,"threads_started":4,"wal-append.queue_time_us":179352,"wal-append.run_cpu_time_us":18998,"wal-append.run_wall_time_us":1268673}]]}
I20260709 12:17:33.994822 24776 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:34.008801 24838 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:34.020661 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 353425us
W20260709 12:17:34.045931 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 213650us
W20260709 12:17:34.047034 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 176664us
I20260709 12:17:33.864671 22366 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:34.085630 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.094833 22400 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 7.
I20260709 12:17:34.085976 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:34.096293 22395 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:34.097308 24777 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:34.097714 24777 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.098084 24777 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:34.099220 24723 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:34.084146 24846 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:34.085755 24748 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:34.061934 24640 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:34.087597 24776 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:34.103451 24776 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:34.104166 24640 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:34.092372 22398 raft_consensus.cc:2393] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 8: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:17:34.091974 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 227349us
I20260709 12:17:34.106627 22366 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:34.047552 24868 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:34.064213 22297 catalog_manager.cc:5697] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 4 to 5, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 5 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:17:34.056983 24832 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:34.105216 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:34.108790 24690 raft_consensus.cc:2764] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:17:34.089653 24838 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:34.110190 24867 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:34.111414 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:34.111028 22297 catalog_manager.cc:5697] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 4 to 7, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 7 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:34.093037 22441 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:34.115484 22395 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:17:34.115265 22366 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:34.127137 22441 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:34.047354 24644 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:34.048805 24731 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:34.143137 24718 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:34.120970 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:34.132599 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:34.148147 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:34.063943 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 183130us
I20260709 12:17:34.090795 24858 raft_consensus.cc:3055] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:34.139781 24847 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:34.143260 24800 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:34.156759 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:34.144182 24723 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:34.145072 24731 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:34.145424 24854 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:34.129992 23095 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:34.146409 24820 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:34.150743 22442 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:34.254488 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 103826us
I20260709 12:17:34.253044 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:34.253701 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 70391.8us
I20260709 12:17:34.256927 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:34.257490 22367 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:34.258229 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:34.258433 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:34.259066 22542 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:34.259936 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:34.260958 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:34.203313 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:34.261510 22542 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:34.194569 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:34.193212 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:34.204551 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:34.264494 22550 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:34.264941 22543 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:34.267145 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 138233us
I20260709 12:17:34.148430 24859 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:34.155351 24838 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:34.268047 23095 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:34.255281 22442 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:34.286237 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:34.287341 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:34.290144 22549 raft_consensus.cc:2393] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:34.276779 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:34.157874 24792 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:34.157600 24858 raft_consensus.cc:740] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:34.121672 24655 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.132s
W20260709 12:17:34.294337 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 99842.1us
I20260709 12:17:34.261343 24868 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:34.301807 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:34.313309 22549 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:34.164988 24806 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:34.296836 24792 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.116242 24814 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:17:34.259807 24583 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:34.301134 22550 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
W20260709 12:17:34.270995 24874 log.cc:927] Time spent T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:17:34.252135 24565 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:34.330572 24565 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:34.311372 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 56179us
I20260709 12:17:34.332260 24858 consensus_queue.cc:260] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:34.333236 24565 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:34.333487 24858 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.333940 24565 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:34.335915 24800 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:34.324856 24792 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:34.339248 24776 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:34.340344 22401 raft_consensus.cc:1240] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:34.340838 24851 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:34.341246 24851 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.341575 24851 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.297897 24797 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:34.346100 24797 raft_consensus.cc:697] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:34.254092 24820 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:34.253443 24494 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:34.321394 22543 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:34.284981 24859 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.319883 24806 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.321858 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:34.271018 24680 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:34.183638 24739 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.128s
I20260709 12:17:34.327498 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:34.295151 24732 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:34.287894 24838 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:34.329068 24814 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:34.329492 24583 raft_consensus.cc:697] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:34.326984 24744 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:17:34.332290 22442 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:34.399220 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 67012.2us
I20260709 12:17:34.253434 24715 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:17:34.306521 24822 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:34.312180 24868 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.413753 24868 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:34.414440 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.305492 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:34.403815 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:34.367846 24820 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.406144 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.419409 22402 raft_consensus.cc:2368] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8.
I20260709 12:17:34.406632 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.387349 24859 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:34.271201 24690 consensus_queue.cc:1048] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:17:34.323196 22441 leader_election.cc:400] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7.
I20260709 12:17:34.404618 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.347002 24869 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:34.415536 22397 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:34.368319 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:34.420352 22393 raft_consensus.cc:2393] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:34.420374 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.413642 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:34.394363 24806 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:34.398712 24838 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:34.422567 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.489234 22401 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:34.489853 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:34.442447 22441 leader_election.cc:403] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:17:34.434548 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 181580us
I20260709 12:17:34.490585 22397 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:34.443099 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:34.483544 22400 raft_consensus.cc:2376] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6. Re-sending same reply.
I20260709 12:17:34.487164 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:34.488032 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 286296us
I20260709 12:17:34.492040 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:34.483834 22398 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
W20260709 12:17:34.492678 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 169618us
I20260709 12:17:34.494410 22441 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:34.498703 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:34.492141 22394 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:34.500568 22394 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:17:34.498221 22366 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:34.505609 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:34.417474 24732 raft_consensus.cc:697] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:34.418200 24852 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:34.508821 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:34.509001 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:34.417388 24748 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 12:17:34.510841 24846 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:34.483122 24822 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:34.367216 24797 consensus_queue.cc:237] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:34.513238 22549 raft_consensus.cc:2393] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 6: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:34.513204 22550 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:34.507607 22477 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:34.515167 22398 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:34.523762 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:34.519850 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:34.520500 23095 leader_election.cc:336] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.513s (SENT)
I20260709 12:17:34.520826 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:34.526711 22473 raft_consensus.cc:2368] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 5. Current term is 6.
W20260709 12:17:34.528082 23095 leader_election.cc:336] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.135s (SENT)
I20260709 12:17:34.525178 22397 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
W20260709 12:17:34.518870 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 243129us
W20260709 12:17:34.525976 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 268564us
I20260709 12:17:34.533519 22367 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:34.491437 24757 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:34.516983 24865 log.cc:927] Time spent T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:17:34.434132 24826 consensus_queue.cc:1059] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 12:17:34.539815 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.543066 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.544463 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.546170 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:34.518491 24860 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:34.551262 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.549585 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:34.550527 22367 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:34.558429 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.560902 24826 raft_consensus.cc:3055] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:34.538206 24822 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:34.548748 22474 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:34.566253 22471 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:34.566706 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.535097 24881 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:34.569509 22367 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:34.558301 24876 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:17:34.581115 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.584205 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:34.513828 24852 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:34.599350 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:34.599351 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 79587.3us
I20260709 12:17:34.552712 24718 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:34.568265 24655 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:34.552335 24644 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:34.599833 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.568527 24826 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:34.600582 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:34.600306 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:34.548708 24884 raft_consensus.cc:2764] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:17:34.592622 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:34.609174 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:34.614897 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:34.616030 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:34.584983 24881 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:34.596223 24877 log.cc:927] Time spent T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:17:34.620131 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.621239 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.617666 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:34.666730 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:34.667479 22550 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:34.625945 22471 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:34.606137 24852 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.601356 24854 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:34.712006 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.552552 24583 consensus_queue.cc:237] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:34.612697 24690 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:34.712726 22471 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:34.607537 24579 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:34.718228 22366 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:34.724007 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 106398us
I20260709 12:17:34.722919 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:34.665185 24723 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:34.710103 24876 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:17:34.625679 24881 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:34.724759 22516 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:34.622141 24776 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:34.724759 22366 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:34.726912 22542 raft_consensus.cc:2393] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:34.728088 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.750471 22471 raft_consensus.cc:2410] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:34.668133 24655 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:17:34.667853 24721 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:34.726410 24763 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:34.621670 24883 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:34.758903 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.756819 22366 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:34.771926 22471 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:34.761359 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:34.673103 24891 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:34.731050 24884 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:34.738032 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:34.778815 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:34.781666 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.781937 22542 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.759624 24776 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:34.789448 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.768374 24827 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:34.762198 24690 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:34.714128 24732 consensus_queue.cc:237] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:34.797488 24894 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:34.789963 24884 raft_consensus.cc:697] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:34.802667 24884 consensus_queue.cc:237] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:34.810155 24883 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:34.810374 24822 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:34.810662 24883 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:34.811084 24883 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:34.812700 22470 raft_consensus.cc:2410] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:17:34.762948 24579 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:17:34.813817 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:34.809576 24832 consensus_meta.cc:287] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.681s	user 0.006s	sys 0.000s
W20260709 12:17:34.825716 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 89421.9us
W20260709 12:17:34.811159 24885 log.cc:927] Time spent T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 12:17:34.827975 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.831238 22471 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:34.828044 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.791245 24827 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:34.755573 24826 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:34.793016 24776 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:34.842736 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:34.836853 24827 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.814010 24690 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:34.857394 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.851970 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:34.851082 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.855651 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.827144 24832 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:34.847859 24889 log.cc:927] Time spent T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
W20260709 12:17:34.847546 24898 log.cc:927] Time spent T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:17:34.860253 22471 raft_consensus.cc:2393] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:17:34.862498 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 264707us
I20260709 12:17:34.863250 22367 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:34.865368 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:34.866283 24655 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:34.866696 24655 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.867087 24655 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:34.858518 24851 consensus_meta.cc:287] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.516s	user 0.006s	sys 0.003s
I20260709 12:17:34.869936 24851 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:34.872328 22400 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:17:34.882947 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.883620 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.885279 22367 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:34.886716 22468 raft_consensus.cc:2410] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:34.886828 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:34.889215 22471 raft_consensus.cc:2368] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8.
W20260709 12:17:34.868948 24792 consensus_meta.cc:287] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
W20260709 12:17:34.865657 24777 consensus_meta.cc:287] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.767s	user 0.010s	sys 0.000s
I20260709 12:17:34.894687 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.895342 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.895465 22399 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:34.898062 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.901376 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.902217 22397 raft_consensus.cc:2393] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:34.902238 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.902086 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.907428 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.908178 22468 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:34.908739 24734 consensus_queue.cc:1059] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:34.909658 24734 raft_consensus.cc:3055] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:34.910023 24734 raft_consensus.cc:740] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:34.910607 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.911228 22474 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:34.909044 24887 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:34.908788 24904 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:17:34.910830 24734 consensus_queue.cc:260] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:34.912142 24887 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:34.914129 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.884502 24894 raft_consensus.cc:697] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:34.924642 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.924825 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.925204 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.927070 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.927775 22471 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:34.928833 24734 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:34.940812 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.941116 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.945932 22397 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:34.946941 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.888309 24879 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:17:34.970235 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.923092 24851 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:34.936480 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:34.966125 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.968034 24859 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:34.938473 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.972098 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:34.923851 24731 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:34.973614 24895 log.cc:927] Time spent T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:17:34.975960 22395 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:34.902767 24777 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:34.983498 24901 log.cc:927] Time spent T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:17:34.984431 24832 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:34.984781 24887 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:34.902462 24792 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:34.986748 24868 consensus_meta.cc:287] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.000s
I20260709 12:17:34.986984 24792 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:34.987197 24868 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:34.987871 24494 consensus_queue.cc:1059] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:34.988969 22544 raft_consensus.cc:2368] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8.
W20260709 12:17:34.990360 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 53931.9us
I20260709 12:17:34.991546 22516 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:34.993733 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:34.994670 22397 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:34.996889 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:34.998921 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:35.003980 23095 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.005425 22542 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:35.006476 22366 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:35.010149 24822 raft_consensus.cc:2764] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:17:35.011893 24859 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:35.015360 24899 log.cc:927] Time spent T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 12:17:35.016477 24907 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:17:35.020807 22475 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:17:34.993721 24820 consensus_meta.cc:287] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.003s
I20260709 12:17:35.026610 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:35.032640 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:35.034049 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:35.034886 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:35.036288 22367 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:34.993578 24757 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7.
W20260709 12:17:35.042130 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.042047 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:35.028438 24817 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:35.052920 22472 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 7.
I20260709 12:17:35.054540 22543 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:35.052664 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:35.055326 22476 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:35.048991 22367 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.026180 24847 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:35.056043 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:35.057686 22548 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:35.026427 24723 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:35.060917 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:35.062242 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:35.038516 24800 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:35.062834 22471 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:35.063823 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.066275 22441 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:35.072748 22441 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:35.074407 22441 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:35.058532 24777 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:35.077021 24897 log.cc:927] Time spent T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:17:35.079298 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:35.080034 22394 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:17:35.081971 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.057353 24847 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:35.082516 24847 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:35.082872 22471 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
W20260709 12:17:35.083346 24916 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:17:35.083776 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:35.084359 22471 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:35.084710 24908 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:35.085191 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:35.082162 24910 log.cc:927] Time spent T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:17:35.090663 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:35.071429 24680 consensus_meta.cc:287] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.673s	user 0.008s	sys 0.003s
I20260709 12:17:35.088070 22441 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:35.092494 22394 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:17:35.100227 22548 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:35.070520 24776 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:35.093963 22476 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:35.111447 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:35.098644 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:35.075351 24806 consensus_meta.cc:287] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.004s
I20260709 12:17:35.039683 24820 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:35.073508 24854 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:35.086234 24800 raft_consensus.cc:697] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:17:35.107268 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 58381.9us
I20260709 12:17:35.067378 24739 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:35.124783 22367 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.086639 24748 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:35.095692 24731 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:35.129352 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:35.129565 22542 raft_consensus.cc:1240] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:35.130573 22468 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:35.095175 24644 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:35.093171 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:35.124185 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:35.131743 22477 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:35.113314 22476 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:35.104470 24769 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:35.104452 24680 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:35.112484 24732 raft_consensus.cc:2764] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:17:35.136741 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:35.142845 24640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.014s	sys 0.015s
I20260709 12:17:35.038400 24894 consensus_queue.cc:237] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:35.148052 24640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.014s	sys 0.015s
I20260709 12:17:35.114609 24868 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:35.121246 24854 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:35.120982 24806 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:35.071801 24881 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:35.149655 24854 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:35.151221 22551 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:35.152896 24806 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:35.153622 22468 raft_consensus.cc:1240] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:17:35.151387 24881 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:35.145375 22367 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:35.158768 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 70773.1us
I20260709 12:17:35.159775 22441 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:35.161085 22441 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:35.127226 24748 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:35.168078 22367 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.166163 24868 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.129642 24884 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:17:35.138327 24776 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:35.167163 24806 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:35.174970 24918 log.cc:927] Time spent T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:35.175599 24769 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:35.175472 24846 consensus_meta.cc:287] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.000s
I20260709 12:17:35.176542 24908 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:35.170962 24800 consensus_queue.cc:237] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:35.180253 24883 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:35.169968 24748 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:35.170408 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.182473 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:35.184587 24911 log.cc:927] Time spent T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:17:35.201668 24919 log.cc:927] Time spent T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:17:35.214895 22402 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:35.196468 24868 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:35.165403 22477 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:35.217880 24806 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:35.181120 24655 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:35.199370 24769 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:35.209331 22442 leader_election.cc:400] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8.
W20260709 12:17:35.198050 24838 consensus_meta.cc:287] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.692s	user 0.005s	sys 0.005s
I20260709 12:17:35.157588 24854 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:35.210325 24757 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:35.233953 24757 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:35.235960 24757 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:35.236315 24917 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:17:35.223019 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:35.207376 24776 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:35.228682 22442 leader_election.cc:403] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:35.230265 24925 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.231163 24883 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:35.240136 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:35.209478 24846 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:35.405642 22398 raft_consensus.cc:1240] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:17:35.408437 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 168350us
I20260709 12:17:35.409332 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:35.226604 24731 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:35.481127 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 271911us
I20260709 12:17:35.482074 22442 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:35.472265 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 63013.3us
W20260709 12:17:35.482874 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 314838us
I20260709 12:17:35.484341 22367 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.483217 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:35.488200 22367 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.238020 24769 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:35.492213 22442 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.403581 24723 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:35.499064 22367 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:35.514973 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 303571us
I20260709 12:17:35.483557 24715 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.212441 24847 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:35.488186 24891 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:35.487749 24867 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:35.514051 22442 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.494405 24757 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:35.241372 24838 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:35.502709 24776 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:35.499960 24894 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:35.504621 24846 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:35.529439 22442 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.532068 22367 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.508988 24868 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:35.521586 24820 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:35.514804 24723 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:35.573945 24723 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:35.577278 23131 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:35.582535 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.542225 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1328) took 1134 ms. Trace:
I20260709 12:17:35.471918 24925 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:35.555876 22399 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:17:35.557430 24913 log.cc:927] Time spent T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:17:35.557988 24928 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8.
I20260709 12:17:35.558430 24847 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:35.564230 24734 consensus_meta.cc:287] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.614s	user 0.008s	sys 0.000s
I20260709 12:17:35.564461 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:17:35.565001 24923 log.cc:927] Time spent T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.328s	user 0.000s	sys 0.000s
I20260709 12:17:35.600847 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:35.575019 24854 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:35.532256 24715 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:35.603425 24715 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:35.607209 24925 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:35.568116 24838 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:35.569111 24721 consensus_meta.cc:287] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.799s	user 0.016s	sys 0.003s
I20260709 12:17:35.570439 24927 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:35.565253 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:35.572443 23124 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: []
W20260709 12:17:35.592862 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 60940.5us
I20260709 12:17:35.620743 22367 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.541320 24757 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:35.594062 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:35.542095 24846 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:35.622457 24846 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:35.626011 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 142879us
I20260709 12:17:35.599596 24737 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:35.609021 23095 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.610378 24888 consensus_queue.cc:1059] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:17:35.611423 24936 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:35.612259 24904 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:17:35.614439 24852 consensus_meta.cc:287] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.894s	user 0.011s	sys 0.001s
I20260709 12:17:35.616748 23129 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:35.617492 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:35.584156 22400 rpcz_store.cc:276] 0709 12:17:34.407526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.491907 (+ 84381us) service_pool.cc:224] Handling call
0709 12:17:34.512859 (+ 20952us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:34.872779 (+359920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.541980 (+669201us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b540006f254. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:35.542166 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826183424}
I20260709 12:17:35.620433 24721 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:35.627314 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:35.633685 23095 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:35.646637 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 117639us
I20260709 12:17:35.633103 22367 leader_election.cc:400] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8.
I20260709 12:17:35.650621 22551 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:17:35.653734 22367 leader_election.cc:403] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:17:35.654393 24894 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8.
I20260709 12:17:35.654495 22367 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.655656 23094 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:35.656605 24894 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:35.655678 22367 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.658787 22442 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:35.623427 24757 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:35.664507 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:35.665174 22402 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:35.665745 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:35.639727 24927 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:35.640723 24737 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:35.672955 22442 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.650036 24784 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:35.680505 22402 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:17:35.685366 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:35.676047 24937 consensus_queue.cc:1059] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:17:35.667312 24936 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:35.658106 24888 consensus_queue.cc:1243] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 65951063312d4a1e9123f92354101c71 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:17:35.691095 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 151331us
I20260709 12:17:35.694217 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:35.695029 22402 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:17:35.696012 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:35.667972 24757 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:35.673682 24925 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:35.698657 22402 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:35.699848 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:35.681972 24940 consensus_queue.cc:1059] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:17:35.676618 24928 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:35.682369 24868 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:35.686393 24737 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:35.704186 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:35.861935 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:35.862671 22402 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:35.658181 24852 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:35.688481 24784 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:35.702019 24925 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:17:35.864269 22544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1679) took 1672 ms (client timeout 2228 ms). Trace:
I20260709 12:17:35.873258 24925 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:35.873310 22544 rpcz_store.cc:269] 0709 12:17:34.191689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.191801 (+   112us) service_pool.cc:224] Handling call
0709 12:17:35.864090 (+1672289us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b540008c5d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:35.864213 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1608748416}
I20260709 12:17:35.658311 24904 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:35.881881 24723 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:35.887440 22474 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:35.866827 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 179194us
I20260709 12:17:35.682708 24851 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:17:35.683790 24734 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 12:17:35.870489 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 185201us
W20260709 12:17:35.890888 23095 leader_election.cc:336] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.793s (SENT)
I20260709 12:17:35.714906 24938 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:35.691571 24859 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:35.714694 24868 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:35.684497 24748 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:35.875049 24935 log.cc:927] Time spent T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 12:17:35.959657 22366 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:35.870615 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 178503us
I20260709 12:17:35.872030 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:35.872303 24784 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:35.860694 24936 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:35.875818 24494 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:35.868891 24940 raft_consensus.cc:3055] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:17:35.895321 24827 consensus_meta.cc:287] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 1.028s	user 0.011s	sys 0.000s
I20260709 12:17:35.928503 24820 raft_consensus.cc:3055] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:35.931106 24956 consensus_queue.cc:1059] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:35.931296 24928 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.934872 24852 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:35.931367 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:36.016031 22396 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:35.937520 22470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43060 (request call id 163) took 1416 ms (client timeout 1513 ms). Trace:
W20260709 12:17:36.018007 22470 rpcz_store.cc:269] 0709 12:17:34.520831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.539573 (+ 18742us) service_pool.cc:224] Handling call
0709 12:17:35.937274 (+1397701us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54002b3754. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:35.937456 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607879936}
I20260709 12:17:35.938153 22469 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
W20260709 12:17:35.952971 22477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.003s	sys 0.018s
I20260709 12:17:36.019294 22469 pending_rounds.cc:85] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 6
W20260709 12:17:36.019392 22477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.003s	sys 0.018s
I20260709 12:17:35.956773 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:35.961073 22366 leader_election.cc:400] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8.
I20260709 12:17:36.020026 22469 pending_rounds.cc:107] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:17:36.020339 22469 raft_consensus.cc:2889] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:35.960909 22441 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:35.967701 24941 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:17:35.967932 24922 consensus_queue.cc:1059] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:35.973356 22471 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:35.974498 24748 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:35.976080 23126 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:35.967571 24894 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:17:35.953797 24949 log.cc:927] Time spent T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.066s	user 0.003s	sys 0.000s
I20260709 12:17:35.965408 24723 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:36.002842 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 130880us
I20260709 12:17:35.965405 24859 raft_consensus.cc:697] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:35.956795 24868 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:36.021800 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 60959.9us
I20260709 12:17:36.021744 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:36.180603 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:36.020598 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 59666.8us
I20260709 12:17:35.985958 24940 raft_consensus.cc:740] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:36.184888 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:36.185607 22468 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:17:36.006536 24820 raft_consensus.cc:740] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:36.006624 24494 raft_consensus.cc:697] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:36.015079 24891 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:36.023103 24732 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:36.205518 22468 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:17:36.175623 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:36.209352 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:36.212296 23130 raft_consensus.cc:1275] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:36.070255 24956 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:36.182045 24894 raft_consensus.cc:697] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:36.186659 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:36.228714 22516 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:36.195222 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:36.178644 22396 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:36.197499 22476 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:17:36.149564 24852 raft_consensus.cc:3055] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:36.146456 24679 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:36.197609 24748 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:36.002501 24827 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:36.230257 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:36.030793 24936 raft_consensus.cc:3055] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:36.216205 24723 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:36.212277 24904 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:36.232925 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 383344us
I20260709 12:17:36.023938 24928 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:36.234537 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:36.235463 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:36.222018 24583 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:36.221314 24937 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.017s	sys 0.029s
I20260709 12:17:36.211679 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:36.267691 24928 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:36.267906 24269 consensus_queue.cc:1059] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:36.268684 24269 consensus_queue.cc:1243] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:17:36.269476 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.270259 24827 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:36.270606 24784 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:36.273310 24784 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:36.274000 24494 consensus_queue.cc:237] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:36.250346 24859 consensus_queue.cc:237] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:36.277426 24961 raft_consensus.cc:1064] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:17:36.241969 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1342) took 1276 ms. Trace:
I20260709 12:17:36.278280 22393 rpcz_store.cc:276] 0709 12:17:34.965129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.182277 (+217148us) service_pool.cc:224] Handling call
0709 12:17:35.182632 (+   355us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:35.467845 (+285213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:35.467881 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:35.468522 (+   641us) log.cc:844] Serialized 52 byte log entry
0709 12:17:35.633655 (+165133us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:35.919523 (+285868us) log.cc:844] Serialized 14 byte log entry
0709 12:17:35.920568 (+  1045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.920655 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:36.241704 (+321049us) raft_consensus.cc:1685] finished
0709 12:17:36.241726 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:36.241903 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25636,"prepare.queue_time_us":351029,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":23,"raft.queue_time_us":21471,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":30059,"thread_start_us":653677,"threads_started":3,"wal-append.queue_time_us":193745}
I20260709 12:17:36.280576 22393 raft_consensus.cc:1240] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: []
W20260709 12:17:36.280737 24769 consensus_meta.cc:287] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.777s	user 0.008s	sys 0.000s
I20260709 12:17:36.280385 24961 consensus_queue.cc:237] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:36.281133 24769 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:36.222235 24957 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:36.226217 24888 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:36.205590 24891 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.248082 22472 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:36.247107 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:36.236096 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:36.236861 24852 raft_consensus.cc:740] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:36.232087 24847 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:36.259117 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:36.247097 24940 consensus_queue.cc:260] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:36.260134 24962 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:36.262482 24965 consensus_queue.cc:1059] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:17:36.263063 24947 log.cc:927] Time spent T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:17:36.247905 24903 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:36.244616 24723 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.321637 24903 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:36.321820 24723 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:36.322216 24903 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:36.273933 24583 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:36.231422 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:36.287710 24922 consensus_queue.cc:1059] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:17:36.243201 24936 raft_consensus.cc:740] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:17:36.298906 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 62892.2us
I20260709 12:17:36.301126 22394 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:36.287447 24957 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:36.303284 24721 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:36.296733 24891 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:36.305212 24920 log.cc:927] Time spent T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 1.118s	user 0.003s	sys 0.008s
I20260709 12:17:36.305277 24847 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:36.306489 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:36.308848 22297 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32988 (request call id 90) took 6966 ms. Trace:
I20260709 12:17:36.061533 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:36.310252 24959 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:17:36.310899 24887 raft_consensus.cc:3055] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:36.299510 24888 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:36.311399 24956 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.310534 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1324) took 1270 ms. Trace:
I20260709 12:17:36.378162 22542 rpcz_store.cc:276] 0709 12:17:35.039718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.039890 (+   172us) service_pool.cc:224] Handling call
0709 12:17:35.040199 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:35.130153 (+ 89954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.310273 (+1180120us) spinlock_profiling.cc:243] Waited 89.1 ms on lock 0x7b540008d9d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:36.310470 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205037952}
I20260709 12:17:36.313431 24769 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:36.314679 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43060 (request call id 171) took 1761 ms. Trace:
I20260709 12:17:36.315373 24928 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.312253 24963 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.354799 22516 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:36.361357 22394 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:36.362664 24957 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:36.367774 22472 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:36.317442 24894 consensus_queue.cc:237] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:36.322237 24737 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:36.347278 24940 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:36.380951 24846 consensus_meta.cc:287] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.756s	user 0.008s	sys 0.002s
I20260709 12:17:36.380664 22469 rpcz_store.cc:276] 0709 12:17:34.553810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.553934 (+   124us) service_pool.cc:224] Handling call
0709 12:17:35.937751 (+1383817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:36.020817 (+ 83066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.314487 (+293670us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54002b3750. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:36.314623 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3159417088}
W20260709 12:17:36.367841 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 136637us
I20260709 12:17:36.384898 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:36.438711 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:36.439047 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:36.438711 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:36.441684 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:36.443545 24784 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:36.442070 22469 raft_consensus.cc:2393] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:36.453246 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:36.383795 24928 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:36.369029 22297 rpcz_store.cc:276] 0709 12:17:29.342465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.343240 (+   775us) service_pool.cc:224] Handling call
0709 12:17:36.308749 (+6965509us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:34.537471 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:34.562389 (+ 24918us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:34.562424 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:17:34.562437 (+    13us) tablet.cc:662] Decoding operations
0709 12:17:34.781200 (+218763us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:34.786279 (+  5079us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:34.789757 (+  3478us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:17:34.812982 (+ 23225us) tablet.cc:701] Row locks acquired
0709 12:17:34.813002 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:17:34.813152 (+   150us) write_op.cc:270] Start()
0709 12:17:34.813264 (+   112us) write_op.cc:276] Timestamp: P: 1783599454813101 usec, L: 0
0709 12:17:34.813286 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:17:34.848697 (+ 35411us) log.cc:844] Serialized 3317 byte log entry
0709 12:17:35.241235 (+392538us) op_driver.cc:464] REPLICATION: finished
0709 12:17:35.882318 (+641083us) write_op.cc:301] APPLY: starting
0709 12:17:35.882408 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:35.882607 (+   199us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:35.882745 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:35.975017 (+ 92272us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:35.975247 (+   230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:17:35.975288 (+    41us) write_op.cc:312] APPLY: finished
0709 12:17:35.975544 (+   256us) log.cc:844] Serialized 64 byte log entry
0709 12:17:35.975721 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:35.975834 (+   113us) write_op.cc:454] Released schema lock
0709 12:17:35.975874 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:35.976262 (+   388us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:35.976304 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1195556,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":480180,"apply.run_cpu_time_us":3286,"apply.run_wall_time_us":93903,"num_ops":8,"prepare.queue_time_us":361932,"prepare.run_cpu_time_us":14622,"prepare.run_wall_time_us":399192,"raft.queue_time_us":117365,"raft.run_cpu_time_us":44253,"raft.run_wall_time_us":493938,"replication_time_us":405737,"thread_start_us":565224,"threads_started":4,"wal-append.queue_time_us":116557}]]}
I20260709 12:17:36.460320 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1422) took 1492 ms. Trace:
I20260709 12:17:36.377749 24887 raft_consensus.cc:740] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:17:36.459046 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 223617us
I20260709 12:17:36.459414 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:17:36.454195 24925 consensus_meta.cc:287] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
I20260709 12:17:36.368655 24852 consensus_queue.cc:260] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:36.384863 24721 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:36.506352 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:36.491869 22477 rpcz_store.cc:276] 0709 12:17:34.967705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.217312 (+249607us) service_pool.cc:224] Handling call
0709 12:17:35.217639 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:35.218016 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:35.218044 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:35.218504 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 12:17:36.019832 (+801328us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:36.019873 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.019965 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:36.460070 (+440105us) raft_consensus.cc:1685] finished
0709 12:17:36.460093 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:36.460256 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":686,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":52608,"thread_start_us":800953,"threads_started":1,"wal-append.queue_time_us":796301}
I20260709 12:17:36.507300 22472 raft_consensus.cc:2393] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:36.507628 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:36.508986 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:36.454989 24583 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:36.438385 24846 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:36.513453 22477 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:36.514816 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:36.387030 24963 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:36.518386 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:36.517585 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:36.523600 22469 raft_consensus.cc:2376] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8. Re-sending same reply.
I20260709 12:17:36.493449 24579 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:36.381687 24956 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:36.495605 24734 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:17:36.514846 23127 raft_consensus.cc:1240] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:36.529469 22472 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:17:36.532907 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 178206us
I20260709 12:17:36.534375 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:36.511782 24925 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:36.546568 24925 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:36.532303 24579 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:36.552764 24723 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:36.540177 24887 consensus_queue.cc:260] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:36.509740 24868 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:36.555655 22516 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:36.436611 24936 consensus_queue.cc:260] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:36.579728 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:36.581398 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:36.583802 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:36.560983 23095 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:36.537914 24721 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:36.542120 24583 consensus_queue.cc:1059] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:17:36.579608 24977 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.571216 24579 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:36.571766 24847 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:36.574585 24757 consensus_meta.cc:287] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.868s	user 0.010s	sys 0.000s
I20260709 12:17:36.595106 24956 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:36.576098 24737 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:36.560518 24715 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:36.596973 24715 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:36.598248 24731 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:36.598774 24731 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:36.599206 24715 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:36.579552 24903 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:36.601457 24903 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:36.594831 24757 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:36.594033 24579 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:36.582722 24827 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:36.543708 24784 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:17:36.580451 24952 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:36.584478 24763 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:17:36.617250 22397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1333) took 1678 ms (client timeout 1995 ms). Trace:
I20260709 12:17:36.586290 24936 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:36.591315 24734 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:17:36.620668 22397 rpcz_store.cc:269] 0709 12:17:34.938941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.946645 (+  7704us) service_pool.cc:224] Handling call
0709 12:17:36.617053 (+1670408us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b540006fc54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:36.617175 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108239616}
I20260709 12:17:36.616077 24977 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:36.630970 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:36.631625 22542 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:36.623694 24690 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:36.624648 24757 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:36.625437 22399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1330) took 1687 ms (client timeout 1502 ms). Trace:
W20260709 12:17:36.656140 22399 rpcz_store.cc:269] 0709 12:17:34.938081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.938204 (+   123us) service_pool.cc:224] Handling call
0709 12:17:36.625157 (+1686953us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b540006f754. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:36.625340 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1327900032}
I20260709 12:17:36.626722 24906 raft_consensus.cc:3055] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:36.627328 22402 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:36.633980 22550 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:36.635706 22543 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:36.666129 24739 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:36.666859 24739 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:36.721392 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:36.740042 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.858176 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:17:36.860728 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.862771 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1339) took 1922 ms. Trace:
I20260709 12:17:36.863221 22398 rpcz_store.cc:276] 0709 12:17:34.940323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.054086 (+113763us) service_pool.cc:224] Handling call
0709 12:17:35.054425 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:35.406127 (+351702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.862486 (+1456359us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54000b59d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:36.862705 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":807202560}
W20260709 12:17:36.866084 22470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.009s	sys 0.008s
W20260709 12:17:36.866544 22470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.009s	sys 0.008s
W20260709 12:17:36.870133 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.622169 24888 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:36.873974 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1419) took 1941 ms. Trace:
I20260709 12:17:36.969624 22474 rpcz_store.cc:276] 0709 12:17:34.932951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.133993 (+201042us) service_pool.cc:224] Handling call
0709 12:17:35.134280 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:35.894993 (+760713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.873726 (+978733us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b5400328f54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:36.873917 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1728802688}
I20260709 12:17:36.885089 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:36.972350 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:36.983182 22542 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:36.993359 22474 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:36.994841 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 411097us
I20260709 12:17:36.786615 24977 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:36.658393 24906 raft_consensus.cc:740] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:36.971009 24952 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.998342 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1326) took 2589 ms. Trace:
I20260709 12:17:36.999192 24963 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:36.999902 22474 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:37.002913 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 190) took 1333 ms. Trace:
I20260709 12:17:37.005065 22543 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:37.004617 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:37.006475 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:37.013447 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:37.012081 22395 rpcz_store.cc:276] 0709 12:17:35.669424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.669557 (+   133us) service_pool.cc:224] Handling call
0709 12:17:35.669886 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:35.889785 (+219899us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:36.013326 (+123541us) log.cc:844] Serialized 14 byte log entry
0709 12:17:36.221849 (+208523us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:36.221904 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:36.221953 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.002708 (+780755us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54000a9e54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:37.002749 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.002860 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":306,"prepare.queue_time_us":95471,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":4224,"raft.queue_time_us":283,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":8327,"spinlock_wait_cycles":505129216,"thread_start_us":331344,"threads_started":2,"wal-append.queue_time_us":318192}
W20260709 12:17:37.000360 24978 log.cc:927] Time spent T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.379s	user 0.000s	sys 0.000s
I20260709 12:17:37.017061 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:37.017618 23131 raft_consensus.cc:1240] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:37.020534 22545 raft_consensus.cc:1275] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:37.020483 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:37.021183 22474 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:37.010360 22401 rpcz_store.cc:276] 0709 12:17:34.406572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.489940 (+ 83368us) service_pool.cc:224] Handling call
0709 12:17:34.514967 (+ 25027us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:35.402674 (+887707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:35.402707 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:35.471429 (+ 68722us) log.cc:844] Serialized 52 byte log entry
0709 12:17:35.629614 (+158185us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:35.921401 (+291787us) log.cc:844] Serialized 14 byte log entry
0709 12:17:35.922299 (+   898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.972464 (+1050165us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54002305d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:36.972519 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:36.972573 (+    54us) raft_consensus.cc:1685] finished
0709 12:17:36.995554 (+ 22981us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:36.995693 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12219,"prepare.queue_time_us":355251,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":16315,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":240985,"spinlock_wait_cycles":1625526016,"thread_start_us":377743,"threads_started":2,"wal-append.queue_time_us":366402}
I20260709 12:17:37.022239 23131 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:37.001906 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:37.026027 22477 raft_consensus.cc:1240] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:36.862532 24957 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:37.027493 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:37.026115 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:37.029946 22477 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:37.006058 24763 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:37.029870 23131 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:37.032420 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:37.032629 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:37.033913 24891 consensus_meta.cc:287] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.000s
I20260709 12:17:37.034382 24891 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.034963 24985 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:37.035495 24985 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.036607 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1339) took 1143 ms. Trace:
I20260709 12:17:37.036998 22393 rpcz_store.cc:276] 0709 12:17:35.893248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.283759 (+390511us) service_pool.cc:224] Handling call
0709 12:17:36.284105 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:36.284580 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:36.284608 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:36.285182 (+   574us) log.cc:844] Serialized 52 byte log entry
0709 12:17:36.505871 (+220689us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:36.519801 (+ 13930us) log.cc:844] Serialized 14 byte log entry
0709 12:17:36.520658 (+   857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.520746 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:37.036399 (+515653us) raft_consensus.cc:1685] finished
0709 12:17:37.036422 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.036550 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13365,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":5248,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":13900,"thread_start_us":220238,"threads_started":1,"wal-append.queue_time_us":293633}
I20260709 12:17:37.038483 24763 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:37.040992 23130 raft_consensus.cc:1240] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:37.007778 24888 consensus_queue.cc:1059] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:17:37.015358 24846 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:37.033679 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:37.049083 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:37.018085 24748 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:37.058789 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:37.058962 24868 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:37.009938 24731 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.059260 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:37.060019 24748 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:37.060674 24732 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:37.061179 24732 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:37.058454 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:37.062644 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:37.063336 22543 raft_consensus.cc:2393] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:37.064179 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:37.064741 22543 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:37.040536 24763 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:37.066121 24757 consensus_queue.cc:1059] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:37.016618 24952 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.068171 24748 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:37.068476 24737 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:37.068727 24952 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:37.065567 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:37.070995 23129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41028 (request call id 344) took 1512 ms. Trace:
I20260709 12:17:37.071574 23129 rpcz_store.cc:276] 0709 12:17:35.558859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.564233 (+  5374us) service_pool.cc:224] Handling call
0709 12:17:37.070840 (+1506607us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b5400650254. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:37.070938 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8697728}
I20260709 12:17:37.066982 24757 raft_consensus.cc:3055] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:37.073606 22474 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:37.074841 22515 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:37.078241 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:37.079111 22477 raft_consensus.cc:2393] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:37.059580 24891 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:37.083576 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.083118 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:37.074239 24822 raft_consensus.cc:3055] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:37.093624 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:37.087323 22477 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:37.093568 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:37.096647 22366 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:37.077059 24757 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:37.084493 24868 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.084860 24888 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:37.086277 24723 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:37.084079 24957 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:37.086223 24894 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:37.089326 24731 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:37.051898 24906 consensus_queue.cc:260] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.126220 22543 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:37.095114 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:37.108695 22366 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:37.129536 22474 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:37.097072 24822 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:37.095976 24952 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:37.079464 24579 consensus_queue.cc:1059] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:17:37.079975 24763 consensus_queue.cc:1059] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:17:37.119042 22477 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:37.105530 24838 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:37.151458 24838 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:37.151295 24952 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.152038 24838 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.110415 22516 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:37.151468 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:37.154865 24579 raft_consensus.cc:3055] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:37.155280 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:37.155902 22477 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:37.133731 24894 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.158484 24952 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:37.158663 24903 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:37.159199 24903 raft_consensus.cc:697] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:37.159623 24757 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.160096 24903 consensus_queue.cc:237] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.160969 24757 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:37.162685 24732 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.155319 24579 raft_consensus.cc:740] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:37.093899 24985 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:37.128875 24987 consensus_queue.cc:1059] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:17:37.106678 24888 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:37.132102 24936 consensus_meta.cc:287] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.506s	user 0.001s	sys 0.008s
I20260709 12:17:37.135897 24731 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:37.113138 24922 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 12:17:37.144469 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.109107 24690 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:17:37.107251 24868 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.147095 24822 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.148108 24906 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:37.158041 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 47707.2us
W20260709 12:17:37.186116 22516 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.1:37927 timed out after 1.502s (SENT) [suppressed 41 similar messages]
I20260709 12:17:37.165045 22551 raft_consensus.cc:1240] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:37.109490 24891 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:37.187733 24891 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:37.172712 22474 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:37.189136 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:37.189932 22474 raft_consensus.cc:2393] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:37.190757 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:37.130219 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:37.193818 22543 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:37.195914 22543 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:37.197891 22474 raft_consensus.cc:2393] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:37.211547 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:37.213006 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:37.213721 22474 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
W20260709 12:17:37.154152 24940 consensus_meta.cc:287] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.003s
I20260709 12:17:37.178036 24732 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:37.221750 24868 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:37.181262 24731 raft_consensus.cc:697] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:37.223603 24731 consensus_queue.cc:237] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.214248 24891 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.174311 22477 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:37.164283 24579 consensus_queue.cc:260] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:37.175806 24888 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:37.233981 22475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 1407) took 2327 ms (client timeout 1862 ms). Trace:
W20260709 12:17:37.234432 22475 rpcz_store.cc:269] 0709 12:17:34.906779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.907073 (+   294us) service_pool.cc:224] Handling call
0709 12:17:37.233707 (+2326634us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b5400160154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:37.233877 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217534848}
I20260709 12:17:37.235900 22475 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:37.236975 22475 raft_consensus.cc:3055] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:37.237294 22475 raft_consensus.cc:740] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:37.238118 22473 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:17:37.271085 24887 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:37.179340 24985 raft_consensus.cc:3055] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:37.271744 24985 raft_consensus.cc:740] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:37.272598 24985 consensus_queue.cc:260] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.273403 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:37.219624 22551 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:37.273625 24985 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:37.274026 23128 raft_consensus.cc:2376] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5. Re-sending same reply.
I20260709 12:17:37.274926 22551 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:37.275200 22542 raft_consensus.cc:1275] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:17:37.155932 24763 consensus_queue.cc:1243] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 65951063312d4a1e9123f92354101c71 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:17:37.225503 24838 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:37.277870 24655 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:37.279726 22441 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:37.227460 22477 raft_consensus.cc:1240] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:37.280849 24757 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:37.281421 24757 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.218184 22543 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:37.281909 24757 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:37.283437 24655 consensus_queue.cc:1059] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:37.284283 24655 raft_consensus.cc:3055] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:37.219368 24822 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:37.284690 24655 raft_consensus.cc:740] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:37.282909 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:37.286135 24655 consensus_queue.cc:260] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.287367 24655 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:37.280915 22441 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:37.240331 22475 consensus_queue.cc:260] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.294888 22475 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:37.296216 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:37.303752 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:37.304356 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.307569 22366 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:37.308163 22474 raft_consensus.cc:1240] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:37.294437 24937 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:37.405081 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:37.403954 22473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1645) took 2436 ms. Trace:
I20260709 12:17:37.353804 22402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1335) took 1461 ms. Trace:
I20260709 12:17:37.394472 22546 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:37.402514 22472 raft_consensus.cc:1240] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:37.374347 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:37.427507 23130 raft_consensus.cc:1240] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:37.364622 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43060 (request call id 179) took 1171 ms. Trace:
I20260709 12:17:37.374675 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:37.407878 22475 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:17:37.429749 22544 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:37.372797 23095 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:37.392946 22442 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:37.409114 22471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 1415) took 2480 ms (client timeout 1995 ms). Trace:
I20260709 12:17:37.344398 22469 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:37.356681 22551 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:37.384145 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:37.342418 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.544399 22550 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:37.544553 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:37.545135 22396 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:37.508424 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.543982 22468 rpcz_store.cc:276] 0709 12:17:36.192883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.213428 (+ 20545us) service_pool.cc:224] Handling call
0709 12:17:36.214503 (+  1075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:36.254060 (+ 39557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:36.254094 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:36.254137 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:36.254170 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.364302 (+1110132us) spinlock_profiling.cc:243] Waited 39.3 ms on lock 0x7b5400395154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:37.364360 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.364546 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90493312}
I20260709 12:17:37.547001 22395 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:37.543735 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1661) took 1043 ms. Trace:
W20260709 12:17:37.543430 22471 rpcz_store.cc:269] 0709 12:17:34.928554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.092938 (+164384us) service_pool.cc:224] Handling call
0709 12:17:37.408902 (+2315964us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b5400396054. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:37.409029 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1935691648}
I20260709 12:17:37.543340 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:37.549678 22398 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:37.472357 22402 rpcz_store.cc:276] 0709 12:17:35.892082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.892207 (+   125us) service_pool.cc:224] Handling call
0709 12:17:36.627139 (+734932us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:36.658690 (+ 31551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.353593 (+694903us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b540006f750. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:37.353725 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1689381632}
I20260709 12:17:37.550371 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:37.551601 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:37.547812 22472 rpcz_store.cc:276] 0709 12:17:36.500488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.401987 (+901499us) service_pool.cc:224] Handling call
0709 12:17:37.402342 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:37.543511 (+141169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.543684 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:37.552817 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:37.553061 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:37.552256 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:37.545606 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:37.554936 22471 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:37.472136 22473 rpcz_store.cc:276] 0709 12:17:34.967265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.183461 (+216196us) service_pool.cc:224] Handling call
0709 12:17:37.237868 (+2054407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:37.238582 (+   714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.403692 (+165110us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b5400160150. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:37.403852 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4723897088}
I20260709 12:17:37.558920 22468 raft_consensus.cc:1240] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:17:37.559077 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:37.562525 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 376424us
I20260709 12:17:37.562644 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:37.563324 22398 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:37.566812 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:37.569392 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:37.556591 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:37.373095 24988 log.cc:927] Time spent T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 12:17:37.556268 22475 pending_rounds.cc:85] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 2
W20260709 12:17:37.596892 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 224163us
I20260709 12:17:37.556263 22472 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:37.590950 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1663) took 1009 ms. Trace:
I20260709 12:17:37.569932 22402 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:37.547883 22441 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:37.400328 24852 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:37.370832 24494 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.582713 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1659) took 1082 ms. Trace:
I20260709 12:17:37.570443 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:37.309612 24938 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:37.369671 24826 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:37.542574 24838 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:37.629923 22551 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:37.633415 22367 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:37.312572 24971 consensus_queue.cc:1059] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.354s
I20260709 12:17:37.294193 24690 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.261s
W20260709 12:17:37.633904 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 241090us
I20260709 12:17:37.344369 24757 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.635371 22475 pending_rounds.cc:107] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:17:37.689383 22475 raft_consensus.cc:2889] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:37.636576 22472 raft_consensus.cc:3055] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:37.689546 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:37.689908 22472 raft_consensus.cc:740] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:37.695611 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:37.696285 22393 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:37.690780 22472 consensus_queue.cc:260] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:37.699997 22472 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:37.683362 24269 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:37.734215 24269 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.734689 24269 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:37.735085 24984 log.cc:927] Time spent T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.665s	user 0.000s	sys 0.003s
I20260709 12:17:37.644285 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:37.736223 22394 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:37.737228 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:37.644737 22400 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:37.636960 22468 rpcz_store.cc:276] 0709 12:17:36.581884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.551269 (+969385us) service_pool.cc:224] Handling call
0709 12:17:37.551535 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:37.590686 (+ 39151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.590898 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:37.347308 23127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41012 (request call id 230) took 1134 ms. Trace:
I20260709 12:17:37.335470 24894 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:37.341970 24737 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:37.378789 24928 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:37.667121 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:37.750175 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.427765 24827 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.421594 24579 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:37.629407 22473 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:37.310369 24936 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:37.407783 24739 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:37.411015 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:37.338820 24891 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:37.306828 24922 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.285s
W20260709 12:17:37.359561 23126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41028 (request call id 341) took 1801 ms (client timeout 2095 ms). Trace:
I20260709 12:17:37.392515 24847 raft_consensus.cc:3055] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:37.668814 22401 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:37.671995 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:37.781317 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:37.781744 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.672732 24583 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.453519 24993 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:37.294709 24806 consensus_queue.cc:1059] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.339s
I20260709 12:17:37.328605 24748 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:37.673535 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 124921us
I20260709 12:17:37.671271 22469 rpcz_store.cc:276] 0709 12:17:36.499985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.343708 (+843723us) service_pool.cc:224] Handling call
0709 12:17:37.344062 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:37.543221 (+199159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.575954 (+ 32733us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:37.677052 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:37.811725 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:37.812403 22546 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:37.409678 24832 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.351904 24679 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.754019 24737 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.559758 24854 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.353021 23124 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
W20260709 12:17:37.576061 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.668192 24859 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:17:37.425143 24976 log.cc:927] Time spent T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.857s	user 0.003s	sys 0.008s
I20260709 12:17:37.646906 24965 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:37.591014 24906 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.312870 24972 consensus_queue.cc:1059] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.359s
I20260709 12:17:37.687031 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:37.687110 22442 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:37.634755 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:37.830693 22398 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:37.310029 24961 consensus_queue.cc:1059] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.360s
I20260709 12:17:37.633929 24867 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.631382 25001 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:37.633502 24937 raft_consensus.cc:697] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:37.706305 22549 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:37.381492 24820 consensus_queue.cc:260] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:37.716025 24757 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:37.683233 24763 consensus_queue.cc:1059] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:17:37.728160 24882 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.731393 23128 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 6 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:37.732086 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:37.732909 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:37.733330 24888 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:37.738603 22475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1432) took 1421 ms. Trace:
I20260709 12:17:37.740833 22468 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:37.743423 22547 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:17:37.865015 22475 rpcz_store.cc:276] 0709 12:17:36.316670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.236591 (+919921us) service_pool.cc:224] Handling call
0709 12:17:37.236857 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:37.738319 (+501462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.738526 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:37.743821 22396 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:37.866716 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:37.867357 22396 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:37.737867 22394 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:37.869904 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:37.870635 22394 raft_consensus.cc:2393] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:17:37.777796 23126 rpcz_store.cc:269] 0709 12:17:35.558004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.586392 (+ 28388us) service_pool.cc:224] Handling call
0709 12:17:37.359313 (+1772921us) spinlock_profiling.cc:243] Waited 7.9 ms on lock 0x7b54001315d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:37.359472 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18172800}
I20260709 12:17:37.754249 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:37.756397 22397 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:37.653182 22402 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:37.874717 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:37.870328 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:37.875463 22402 raft_consensus.cc:2410] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:17:37.731719 24655 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.758352 22472 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
W20260709 12:17:37.745956 24946 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:17:37.679517 24494 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:37.688351 24838 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.787022 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:37.766433 24928 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.803755 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:37.783716 24977 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.010s	sys 0.031s
I20260709 12:17:37.679886 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:37.780956 24731 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:17:37.819037 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.780313 24847 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:37.832420 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:37.768775 24827 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:37.740505 23127 rpcz_store.cc:276] 0709 12:17:36.212565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.216156 (+  3591us) service_pool.cc:224] Handling call
0709 12:17:36.257328 (+ 41172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:36.544031 (+286703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.347031 (+803000us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54005f1c54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:37.347236 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497666944}
I20260709 12:17:37.817924 24679 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:37.790614 24891 consensus_queue.cc:1059] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:17:37.874075 24858 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:37.821023 24739 raft_consensus.cc:3055] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:17:37.846079 22545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.027s	sys 0.039s
W20260709 12:17:37.904174 22545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.027s	sys 0.039s
I20260709 12:17:37.845038 24867 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:37.804695 24583 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.875988 22472 pending_rounds.cc:85] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 6
I20260709 12:17:37.905930 22472 pending_rounds.cc:107] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:17:37.906283 22472 raft_consensus.cc:2889] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:37.907786 22472 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:37.875965 22546 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:37.903947 24739 raft_consensus.cc:740] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:37.855773 25001 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:37.885912 24928 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.820364 24832 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.813663 24748 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:37.827955 24854 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.894228 22544 raft_consensus.cc:1240] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 12:17:37.895859 24827 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:37.842136 22551 raft_consensus.cc:1240] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:37.833676 24906 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:37.883227 24977 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.010s	sys 0.032s
I20260709 12:17:37.877593 24887 raft_consensus.cc:3055] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:37.804503 24993 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.885738 24655 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:37.874647 24882 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:37.930642 25005 log.cc:927] Time spent T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:17:37.904670 24757 consensus_queue.cc:1059] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:17:37.911873 24879 raft_consensus.cc:3055] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:37.931906 25001 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:37.932710 25007 log.cc:927] Time spent T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:17:37.903637 24847 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.941326 24887 raft_consensus.cc:740] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:37.916024 24937 consensus_queue.cc:237] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.986267 24879 raft_consensus.cc:740] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:37.995049 24737 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:38.005391 24879 consensus_queue.cc:260] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:37.999580 24847 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:37.979818 24739 consensus_queue.cc:260] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.011615 24888 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:38.020115 25008 log.cc:927] Time spent T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:17:38.032487 24993 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:38.060813 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 427193us
I20260709 12:17:38.063179 22367 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:37.872437 22398 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:37.752938 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:38.066082 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.888168 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:38.066852 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:37.897456 22441 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:37.878360 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:37.882628 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:38.069674 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 172176us
I20260709 12:17:38.069231 22396 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:37.873932 22400 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:38.073155 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:37.864245 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 177207us
I20260709 12:17:37.876189 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:37.894413 22469 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:37.878130 22473 raft_consensus.cc:2410] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:37.880193 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1658) took 1380 ms. Trace:
I20260709 12:17:37.871423 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:38.074410 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:38.069240 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:38.080714 22400 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.080838 22401 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.082500 22468 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:38.085182 22442 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:38.071123 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.071062 22476 raft_consensus.cc:2410] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:38.068528 22393 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:38.066744 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:38.087105 22474 rpcz_store.cc:276] 0709 12:17:36.499745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.327880 (+828135us) service_pool.cc:224] Handling call
0709 12:17:37.359491 (+ 31611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:37.839944 (+480453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:37.839973 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:37.840013 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:37.840054 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.880014 (+ 39960us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b540037fd54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:37.880051 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.880146 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104489728}
W20260709 12:17:38.088495 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.086469 22402 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
W20260709 12:17:38.089259 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 337298us
I20260709 12:17:38.074875 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:38.088754 22398 raft_consensus.cc:2393] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 6: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:38.092005 22396 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:17:38.094199 22396 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:38.074658 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43060 (request call id 181) took 1575 ms. Trace:
I20260709 12:17:38.096716 22477 rpcz_store.cc:276] 0709 12:17:36.499494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.283277 (+783783us) service_pool.cc:224] Handling call
0709 12:17:37.283562 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:37.283872 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:37.283896 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:37.284330 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 12:17:37.463245 (+178915us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:37.463291 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.463371 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:38.074111 (+610740us) raft_consensus.cc:1685] finished
0709 12:17:38.074153 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.074429 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2654,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":91,"thread_start_us":171910,"threads_started":1,"wal-append.queue_time_us":469271}
I20260709 12:17:38.099244 22402 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:38.097302 22396 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:38.110507 22402 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:17:38.119125 22402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b42c69680a57493c942307ff09185b72"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48918
I20260709 12:17:38.119911 22396 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:38.120538 22402 raft_consensus.cc:606] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Received request to transfer leadership
I20260709 12:17:38.121090 22402 raft_consensus.cc:614] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:38.121697 22442 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:38.125067 22442 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:38.127053 24494 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:38.131935 24757 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:38.133134 24655 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:38.021804 24938 raft_consensus.cc:697] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:38.102630 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:38.073472 22441 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:38.014961 24838 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:38.149956 22401 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:17:38.141849 24757 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.160408 22400 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:38.165896 24858 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:38.169718 24859 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:38.172465 24739 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:38.015923 24887 consensus_queue.cc:260] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:38.173950 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.161576 24806 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:17:38.175671 24583 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:38.176623 22394 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 12:17:38.178078 24961 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:38.178882 24961 raft_consensus.cc:697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:17:38.179701 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.180402 24961 consensus_queue.cc:237] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:38.182520 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 119698us
I20260709 12:17:38.186796 24690 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:38.187388 24690 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:38.187530 24748 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:38.187922 24690 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.188206 24867 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:38.188953 25012 consensus_queue.cc:1059] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:38.157341 24928 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:38.160358 24757 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:38.214453 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 141204us
I20260709 12:17:38.194762 22366 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:38.169518 24832 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:38.192792 24269 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.189680 24906 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:38.212699 24718 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.231459 24806 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:38.191679 24882 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:38.192173 25015 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:38.235561 24269 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:38.235873 24718 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.169581 24827 consensus_queue.cc:1059] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 12:17:38.238408 24718 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:38.223137 22367 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:38.193575 24922 raft_consensus.cc:3055] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:38.191488 25023 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:38.246974 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:38.247196 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 122387us
I20260709 12:17:38.233925 24806 raft_consensus.cc:697] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:38.241889 24922 raft_consensus.cc:740] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:38.213748 24731 consensus_queue.cc:1059] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:17:38.253137 25013 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:38.253453 24732 raft_consensus.cc:3055] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:38.253909 24838 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:38.255743 24938 consensus_queue.cc:237] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:38.256536 24806 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.191074 24993 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:17:38.213080 25001 consensus_queue.cc:1059] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 12:17:38.260864 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 66301.7us
W20260709 12:17:38.263089 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 160691us
I20260709 12:17:38.264595 23129 raft_consensus.cc:2393] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 4: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:38.264927 22441 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:38.258096 24732 raft_consensus.cc:740] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:38.255905 24731 consensus_queue.cc:1243] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:17:38.273952 22470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.005s	sys 0.021s
I20260709 12:17:38.282541 22442 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:38.270256 25015 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:38.284749 22476 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1647) took 2074 ms (client timeout 1776 ms). Trace:
I20260709 12:17:38.284931 24269 consensus_queue.cc:1059] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:38.285463 24946 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:38.286636 22516 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:38.287294 24579 consensus_meta.cc:287] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.519s	user 0.013s	sys 0.005s
I20260709 12:17:38.288123 22550 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:38.286654 24827 consensus_queue.cc:1059] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:38.290688 24827 raft_consensus.cc:3055] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:38.292798 24732 consensus_queue.cc:260] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:38.285267 22476 rpcz_store.cc:269] 0709 12:17:36.209992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.306203 (+ 96211us) service_pool.cc:224] Handling call
0709 12:17:38.284472 (+1978269us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54003e3354. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:38.284644 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3912446208}
W20260709 12:17:38.297212 22347 auto_rebalancer.cc:893] Removing replace marker failed: Replica b8621fa34be04d3fa2d68a300f858cd1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:17:38.319226 25015 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:38.297009 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 111267us
I20260709 12:17:38.278581 22366 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:38.314365 24922 consensus_queue.cc:260] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.320451 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:38.321249 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 49510.9us
W20260709 12:17:38.321708 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.321609 24993 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:38.322177 25015 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:38.323079 25015 raft_consensus.cc:697] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:38.323364 24922 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:38.323938 24985 raft_consensus.cc:3055] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:38.297730 24854 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:38.291100 24827 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:38.325996 24827 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.328040 24827 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:38.330425 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:38.319820 22347 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:17:38.332880 22347 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 12:17:38.337797 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.338306 24937 consensus_queue.cc:1059] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
W20260709 12:17:38.275915 25026 log.cc:927] Time spent T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:17:38.329406 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34092 (request call id 300) took 1273 ms. Trace:
W20260709 12:17:38.346272 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 59802.3us
I20260709 12:17:38.294080 24732 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:38.340448 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.313326 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.348209 22547 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
W20260709 12:17:38.350991 22470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.005s	sys 0.021s
I20260709 12:17:38.352461 24957 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:38.353405 24888 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:38.353904 24888 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:38.354337 24888 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:38.339555 24847 raft_consensus.cc:3055] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:38.354800 24847 raft_consensus.cc:740] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:38.355451 24879 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:38.342994 24985 raft_consensus.cc:740] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:38.356525 24718 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:38.324573 25015 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.299185 24851 raft_consensus.cc:3055] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:38.299553 24852 raft_consensus.cc:3055] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:38.359330 24820 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:38.360172 24887 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:38.359738 24985 consensus_queue.cc:260] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:38.363076 24851 raft_consensus.cc:740] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:38.364562 22544 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:38.355952 24847 consensus_queue.cc:260] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.365590 24832 raft_consensus.cc:3055] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:38.366201 24832 raft_consensus.cc:740] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:38.366626 24847 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:38.367460 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.368381 22543 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:17:38.369007 24832 consensus_queue.cc:260] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.346242 23124 rpcz_store.cc:276] 0709 12:17:37.055460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.058514 (+  3054us) service_pool.cc:224] Handling call
0709 12:17:38.328978 (+1270464us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54000424d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:38.329170 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675000192}
I20260709 12:17:38.370997 24269 raft_consensus.cc:3055] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:38.371469 24269 raft_consensus.cc:740] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:17:38.370337 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 87998us
I20260709 12:17:38.378261 24946 raft_consensus.cc:697] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:38.370201 25029 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:38.361567 24985 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:38.378703 22442 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:38.340250 24906 raft_consensus.cc:3055] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:38.379604 24946 consensus_queue.cc:237] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.403966 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:38.404753 23129 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:38.348621 24993 consensus_queue.cc:1059] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:17:38.406466 24993 raft_consensus.cc:3055] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:38.406867 24993 raft_consensus.cc:740] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:17:38.406925 25003 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.590s	user 0.007s	sys 0.006s
I20260709 12:17:38.407807 24993 consensus_queue.cc:260] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.359766 24852 raft_consensus.cc:740] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:38.410370 24852 consensus_queue.cc:260] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.411576 24852 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:38.379522 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:38.413618 23124 raft_consensus.cc:2410] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:17:38.416415 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:38.416862 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:38.420007 24832 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:38.420269 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.423878 24748 raft_consensus.cc:3055] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:38.424530 24748 raft_consensus.cc:740] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:38.372529 24269 consensus_queue.cc:260] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:38.426328 24748 consensus_queue.cc:260] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:38.425987 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.391362 24906 raft_consensus.cc:740] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:38.428246 24748 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:38.429333 24906 consensus_queue.cc:260] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:38.351625 24838 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:38.453455 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.453751 22550 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:38.458274 24977 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:38.443200 24928 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:38.458451 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 79950.7us
I20260709 12:17:38.459532 24928 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.466511 22442 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:38.481894 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.470079 24937 consensus_queue.cc:1059] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:38.471253 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.471796 24851 consensus_queue.cc:260] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.472507 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:38.473663 24679 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:38.474529 24881 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:38.441107 24993 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.309068 24690 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:38.489961 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 93899us
I20260709 12:17:38.485584 24937 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:38.494103 24881 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.475368 24269 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:38.495939 23125 raft_consensus.cc:2368] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7.
I20260709 12:17:38.478221 22544 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:38.496429 24881 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:38.490768 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 48589.5us
I20260709 12:17:38.497396 22547 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:38.498387 24679 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:38.499646 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41028 (request call id 350) took 1566 ms. Trace:
I20260709 12:17:38.500051 23125 rpcz_store.cc:276] 0709 12:17:36.933272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.995774 (+ 62502us) service_pool.cc:224] Handling call
0709 12:17:37.410813 (+415039us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b58001c5698. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:38.497630 (+1086817us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54001315d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:38.499582 (+  1952us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1670375680}
I20260709 12:17:38.500560 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:38.395326 22470 raft_consensus.cc:2955] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:38.493976 22550 raft_consensus.cc:2410] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:17:38.494356 24851 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:38.492102 24977 raft_consensus.cc:3055] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:38.498909 24957 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:38.475198 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.454607 24906 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:38.508278 22545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1706) took 1416 ms. Trace:
I20260709 12:17:38.501950 24718 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:38.489959 25013 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:38.518738 22547 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:38.492278 24928 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:38.518498 24957 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:38.514621 24679 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:38.530109 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 45643.8us
I20260709 12:17:38.531368 22442 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:38.532466 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.532691 24690 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:38.533317 24852 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:38.536829 24938 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:38.537480 24938 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.538636 22394 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:17:38.509521 24977 raft_consensus.cc:740] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:38.545310 22515 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:38.582187 25023 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:38.546422 24957 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:38.574096 23094 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:17:38.547427 24826 consensus_meta.cc:287] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.862s	user 0.010s	sys 0.012s
I20260709 12:17:38.547844 22296 catalog_manager.cc:5697] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 1 to 4, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 4 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:17:38.583069 25023 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:38.550412 22442 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:38.583299 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 96905.7us
I20260709 12:17:38.583699 24769 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.584131 23094 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:38.584259 24769 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.584765 22442 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:38.584455 22296 catalog_manager.cc:5697] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:38.554723 24721 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.585949 24826 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:38.586047 24721 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:38.586705 24826 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:38.587147 22296 catalog_manager.cc:5697] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:17:38.587795 22442 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:38.588442 24769 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:38.588640 24826 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:38.589391 22475 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:38.590656 24679 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:38.591118 24679 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.591401 22442 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:38.589246 24826 raft_consensus.cc:697] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:17:38.582705 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 64258.4us
I20260709 12:17:38.592468 22548 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:38.592823 22515 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:38.592811 24826 consensus_queue.cc:237] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.594856 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49290 (request call id 195) took 1583 ms. Trace:
I20260709 12:17:38.595571 24827 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:38.510450 22545 rpcz_store.cc:276] 0709 12:17:37.092229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.272246 (+180017us) service_pool.cc:224] Handling call
0709 12:17:37.272568 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:37.272772 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:37.342279 (+ 69507us) log.cc:844] Serialized 14 byte log entry
0709 12:17:38.281802 (+939523us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b18003a3180. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f59e1c0a 00007fb4ff121219 00007fb4f5a69a40 00007fb4f5a644e4 00007fb4f5a64455 00007fb4fc54c3c7 00007fb4f8b5e9a7 00007fb4f8b6e0bf 00007fb4f8b6e038
0709 12:17:38.507248 (+225446us) log.cc:844] Serialized 14 byte log entry
0709 12:17:38.507583 (+   335us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:38.507659 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:38.507762 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.507868 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.508057 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75743,"prepare.queue_time_us":448673,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":111,"raft.queue_time_us":7350,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":3440,"spinlock_wait_cycles":2500992,"thread_start_us":783506,"threads_started":2,"wal-append.queue_time_us":641819}
I20260709 12:17:38.562331 24757 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.564358 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:38.568291 22399 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:38.568940 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:38.568362 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:38.569833 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:38.574195 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:38.533484 24690 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.595366 22548 rpcz_store.cc:276] 0709 12:17:37.011789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.270456 (+258667us) service_pool.cc:224] Handling call
0709 12:17:37.270778 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.592872 (+1322094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.594597 (+  1725us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54001e9954. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:38.594787 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3038392576}
I20260709 12:17:38.599303 22397 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:38.589147 22296 catalog_manager.cc:5697] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
W20260709 12:17:38.618465 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.619143 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.620080 22547 raft_consensus.cc:2393] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:38.596056 24827 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.591486 24679 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:38.591751 24721 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:38.631026 24757 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:38.618000 24847 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:38.633430 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.635713 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.636085 22395 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
W20260709 12:17:38.637275 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 113587us
I20260709 12:17:38.637460 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.639451 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:38.640553 24847 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:38.640802 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:38.641435 24985 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:38.637306 24690 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.582515 24977 consensus_queue.cc:260] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.596436 25023 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:17:38.644179 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.645392 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.624369 24957 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:38.647897 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.649549 24784 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:38.650858 24925 consensus_queue.cc:1059] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:38.651192 22296 catalog_manager.cc:5697] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:17:38.695758 24925 raft_consensus.cc:3055] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:38.696251 22296 catalog_manager.cc:5697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 1 to 3, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 3 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:38.655198 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.643566 22441 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:38.665231 24718 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.666221 24957 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.666600 24887 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:38.666035 24977 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:38.666143 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.704524 22397 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 7.
I20260709 12:17:38.660074 24832 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.628376 24827 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:38.671476 24891 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:38.670639 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1355) took 1258 ms. Trace:
I20260709 12:17:38.658459 25013 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.671365 24690 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:38.713518 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.678782 24888 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.662240 25023 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:38.683184 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:38.683786 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:38.684036 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:38.684557 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.687147 22366 leader_election.cc:400] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7.
I20260709 12:17:38.692407 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:38.693783 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:38.698927 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:38.696221 24925 raft_consensus.cc:740] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:38.701467 24718 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.702103 24985 raft_consensus.cc:697] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:38.699198 22296 catalog_manager.cc:5697] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 5 to 6, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 6 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:38.705647 23095 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:38.702260 24957 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:38.708439 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:38.714787 24748 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:38.716517 22545 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:17:38.716749 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 88257.7us
I20260709 12:17:38.719290 22366 leader_election.cc:403] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:17:38.722318 22542 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:38.727653 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.728574 22551 raft_consensus.cc:1240] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:38.729887 24718 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:38.733242 24732 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:38.722838 22470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1652) took 2499 ms. Trace:
I20260709 12:17:38.708547 22546 rpcz_store.cc:276] 0709 12:17:37.412528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.915198 (+502670us) service_pool.cc:224] Handling call
0709 12:17:37.915517 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:37.915723 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:38.451295 (+535572us) log.cc:844] Serialized 14 byte log entry
0709 12:17:38.658241 (+206946us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:38.670153 (+ 11912us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:38.670250 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.670331 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.670486 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":379003,"prepare.queue_time_us":367669,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":69,"raft.queue_time_us":4891,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":328201,"threads_started":2,"wal-append.queue_time_us":200074}
I20260709 12:17:38.716298 24832 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:38.733223 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.736529 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.737164 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.718920 24891 raft_consensus.cc:697] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:38.738008 22470 rpcz_store.cc:276] 0709 12:17:36.220701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.973277 (+752576us) service_pool.cc:224] Handling call
0709 12:17:36.973871 (+   594us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:17:36.974491 (+   620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:37.001060 (+ 26569us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:17:37.427102 (+426042us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b2c00001368. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f744da11 00007fb4f745d372 00007fb4f8b8fa01 00007fb4f8b5443a 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2
0709 12:17:37.428156 (+  1054us) log.cc:844] Serialized 608 byte log entry
0709 12:17:38.395017 (+966861us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:38.703704 (+308687us) log.cc:844] Serialized 14 byte log entry
0709 12:17:38.705867 (+  2163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.714053 (+  8186us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:38.714100 (+    47us) raft_consensus.cc:1685] finished
0709 12:17:38.717654 (+  3554us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.720000 (+  2346us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14366,"raft.queue_time_us":5048,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":25963,"spinlock_wait_cycles":5751680,"thread_start_us":922849,"threads_started":1,"wal-append.queue_time_us":830294}
I20260709 12:17:38.714258 24946 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:38.742089 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:38.750938 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.742619 24832 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:38.737015 24732 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:38.721021 24938 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:38.759924 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 72965.9us
W20260709 12:17:38.754850 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 48987us
I20260709 12:17:38.759618 24721 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:38.759902 24718 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7.
I20260709 12:17:38.760743 22544 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:38.741997 24887 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:38.765197 24732 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:38.766551 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.774086 22296 catalog_manager.cc:5697] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:17:38.726609 25013 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.806368 22547 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
W20260709 12:17:38.807216 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.810652 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.808583 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.810451 22296 catalog_manager.cc:5697] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 3 to 5, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 5 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:38.819169 22545 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:38.831629 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.832578 22551 raft_consensus.cc:2410] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:38.831040 22366 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:38.807179 24721 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:38.816615 24925 consensus_queue.cc:260] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:38.871495 24925 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.871176 24721 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.817209 24757 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:38.874110 24757 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:38.845366 22550 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
W20260709 12:17:38.876034 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.847489 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:38.848318 24718 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:17:38.852389 25043 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:17:38.858100 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:38.823625 24838 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:17:38.862265 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.863049 24891 consensus_queue.cc:237] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.891557 22549 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:38.863518 24679 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:38.866667 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:38.823980 24732 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:17:38.869064 25013 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:38.869838 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:38.901489 22470 raft_consensus.cc:2410] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:17:38.876515 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:38.902097 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.890702 23094 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:38.893756 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 54824.9us
W20260709 12:17:38.895941 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.861274 24957 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:38.899538 22547 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:38.878492 24718 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:38.913988 24965 consensus_queue.cc:1175] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "25ebf14868c042dca42f54b3e251e1b2" responder_term: 7 status { last_received { term: 7 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 7 index: 7 } }
I20260709 12:17:38.914678 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:38.914947 24946 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.915560 24946 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.915689 24851 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:38.916954 24851 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:38.918044 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:38.918736 22476 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:38.919214 24851 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:38.899158 24867 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.920948 24867 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:38.923430 24867 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:38.925972 24847 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.926612 24847 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.928784 24847 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:38.929999 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 63470us
I20260709 12:17:38.888736 24985 consensus_queue.cc:237] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.932127 22366 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:38.888486 24826 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.896656 24748 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.930819 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:38.930747 22296 catalog_manager.cc:5697] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 2 to 4, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 4 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:17:38.937870 22551 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:38.942281 23130 raft_consensus.cc:2393] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:38.945574 23122 raft_consensus.cc:1240] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:38.946184 24748 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:38.948611 24748 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:38.933312 24820 raft_consensus.cc:2764] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:17:38.961114 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.959936 22542 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 7.
I20260709 12:17:38.979478 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:38.934643 24946 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:38.998755 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 91824.7us
I20260709 12:17:38.993309 22545 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
W20260709 12:17:38.960085 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 204127us
I20260709 12:17:38.979365 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:39.003069 22475 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:38.934221 24718 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:39.005827 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:39.007959 22547 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:39.006580 22296 catalog_manager.cc:5697] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:17:39.015503 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:39.018085 22400 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:39.019553 22471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:17:39.020112 22471 raft_consensus.cc:606] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:39.020365 22471 raft_consensus.cc:614] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:38.954808 24832 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:17:39.003023 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.022353 22401 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:38.959106 24888 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:39.024892 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:39.025125 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:38.936167 24827 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:39.036007 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:39.039865 24838 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:39.040472 24838 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:39.041663 24679 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:39.042775 24981 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:39.043311 24679 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.043862 24679 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:39.021813 24757 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:17:39.046887 24957 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:39.022044 24832 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:39.047889 24832 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:39.051748 24827 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:39.053035 25047 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:17:39.057608 22548 raft_consensus.cc:2393] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:38.994863 25023 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:39.065442 25023 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:39.066444 22470 raft_consensus.cc:1275] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:17:39.068871 22296 catalog_manager.cc:5697] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 4 to 5, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 5 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:39.019352 24867 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:38.979054 24690 consensus_queue.cc:1059] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:17:39.071277 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:39.036907 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:39.092836 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:38.977027 24826 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:39.089959 22296 catalog_manager.cc:5697] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 1 to 4, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 4 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:17:39.104956 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:39.106329 22551 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:17:39.091238 25045 log.cc:927] Time spent T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:17:39.099947 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:39.112335 22401 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
W20260709 12:17:39.256922 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.203466 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:39.238118 22542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:17:39.149420 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:39.273138 24269 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.273664 24269 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:39.274293 22399 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:39.234097 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.198006 24757 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:39.086019 24867 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:39.148427 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:39.116585 22396 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:39.286298 22545 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:39.148523 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 112453us
I20260709 12:17:39.139204 22400 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:39.174288 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:39.282337 24269 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:39.164222 22296 catalog_manager.cc:5697] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 1 to 2, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:17:39.289422 22402 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
W20260709 12:17:39.215062 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.118376 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:39.271027 22542 raft_consensus.cc:606] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:39.171743 24957 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.288518 22366 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:39.204380 24946 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:39.190107 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:39.096835 24887 raft_consensus.cc:697] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 7 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:39.206522 25013 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:39.294977 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:39.295363 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:39.163288 24906 raft_consensus.cc:3055] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:39.277974 24757 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:39.202245 24832 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:39.098467 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:39.114805 25001 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:39.298243 22516 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:39.237795 24732 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:17:39.300052 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.341903 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:39.343006 22442 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:39.300566 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:39.220387 25023 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:39.254073 24731 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:39.302266 22401 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:39.296738 24938 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:39.307260 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.284139 24981 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:39.287977 24867 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:39.308734 22396 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:39.316993 24826 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:39.374397 24847 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:39.390754 24847 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:39.322471 24679 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:39.395243 22401 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:17:39.404872 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.328717 22400 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:39.272773 22471 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:39.297537 24957 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:39.338456 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.364460 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:39.429688 22395 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:17:39.368006 24938 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:39.431085 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 139076us
I20260709 12:17:39.367398 22470 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:39.370162 24269 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:39.434840 24269 raft_consensus.cc:697] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:39.297040 24820 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.309504 24906 raft_consensus.cc:740] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:39.350112 23122 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:39.385190 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:39.439101 24269 consensus_queue.cc:237] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:39.439893 22397 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:39.387835 24887 consensus_queue.cc:237] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:39.377164 22544 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:39.450510 24721 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:39.396054 25001 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:39.451171 24721 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:39.453058 24721 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:39.453789 24906 consensus_queue.cc:260] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:39.454885 24906 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:39.455528 24832 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:39.365248 25013 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:39.458340 22542 raft_consensus.cc:614] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:39.458645 25013 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:39.459246 22393 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:39.462433 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:39.462829 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.365056 24732 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:39.463347 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.464013 22516 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:39.464782 24732 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:39.438143 24820 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:39.466763 24757 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:39.468146 24820 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:39.435057 24993 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.469178 24993 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:39.471154 24993 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:39.472184 24957 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:39.337337 24946 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:39.440002 23125 raft_consensus.cc:2393] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:39.443635 24838 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:39.375753 25023 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:39.445963 24888 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:39.347195 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:39.369050 24731 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:39.548187 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:39.542181 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.620609 22397 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:39.485697 22545 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
W20260709 12:17:39.542239 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 249631us
W20260709 12:17:39.640676 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 268598us
I20260709 12:17:39.628885 22470 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:39.641824 22401 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:17:39.461670 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:39.489471 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.645236 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:39.647526 22442 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:39.616570 22548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4e53d64761746008e02335e67f74c08"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:17:39.487546 22399 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9.
I20260709 12:17:39.646762 22393 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:17:39.649699 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:39.650453 22542 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:39.648540 22548 raft_consensus.cc:606] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:39.653728 22548 raft_consensus.cc:614] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:39.654348 22442 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:39.655469 22544 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
W20260709 12:17:39.654394 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.435794 24938 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:39.428372 24981 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:39.869053 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.838368 23094 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:39.887044 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:39.903882 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 247676us
I20260709 12:17:39.742465 24922 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:39.905232 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:39.837750 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 86797.8us
I20260709 12:17:39.580458 24827 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:17:39.866714 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 221535us
W20260709 12:17:39.910439 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 72172.9us
I20260709 12:17:39.648908 24757 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.846390 22470 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:17:39.913738 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 52175.2us
I20260709 12:17:39.909147 23095 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:39.716193 22401 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:39.914603 22441 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:39.905061 22442 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:39.747838 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.740846 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:39.717411 22397 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:39.668642 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:39.674532 22398 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:39.648957 24820 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:39.915884 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.453075 25001 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:39.766232 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:39.924750 22469 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:39.922465 22515 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:39.716527 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:39.931118 22394 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:39.893838 24965 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.910228 24851 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:17:39.932931 22473 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:39.933683 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:39.934870 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:39.938380 25049 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:17:39.940917 24718 consensus_meta.cc:287] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.913s	user 0.010s	sys 0.000s
I20260709 12:17:39.956813 24718 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:39.959136 24718 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:39.902029 24732 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:39.959803 24732 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:39.959940 24867 consensus_meta.cc:287] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.002s
I20260709 12:17:39.960251 24732 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:39.960660 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:39.961277 22473 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:39.941834 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:39.741446 24838 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:39.917490 24748 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:17:39.943961 25068 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.927501 24679 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:39.928941 24690 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:17:39.947674 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:39.979416 22399 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:39.979281 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:39.661921 24977 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:39.743355 24946 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:39.951678 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:39.952363 24269 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:39.953969 22396 raft_consensus.cc:2393] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:39.983570 24269 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:39.983980 24269 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:39.984169 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:39.985206 23130 raft_consensus.cc:2393] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:39.831919 24847 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:39.953159 22474 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:39.929944 24757 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:39.952819 22401 raft_consensus.cc:2368] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7.
I20260709 12:17:39.986176 22469 raft_consensus.cc:2393] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:39.980113 25049 raft_consensus.cc:697] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 9 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:39.988406 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:39.981489 24977 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:39.989157 24977 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:39.982534 25068 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:39.993963 25063 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.994328 24847 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.994583 25063 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:39.995322 25068 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:39.997898 24981 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:39.998553 24847 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.000918 24847 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:40.001621 24847 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:39.667968 24721 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.002633 24721 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.004595 24721 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:39.974740 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:40.005877 22473 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:39.701570 24888 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:39.855280 24731 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:39.986699 24946 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:39.654198 24826 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.293s
I20260709 12:17:39.965435 23094 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:40.032516 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 67165us
I20260709 12:17:39.721058 25023 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.005653 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:40.034365 24269 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:40.044855 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.047554 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:40.048251 22544 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:39.989071 25049 consensus_queue.cc:237] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:40.056933 23124 consensus_meta.cc:287] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.502s	user 0.001s	sys 0.005s
I20260709 12:17:39.983263 24938 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:40.059000 24906 consensus_meta.cc:287] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.000s
I20260709 12:17:40.006558 24847 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.059799 24847 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:40.059947 24938 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.061420 22395 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:40.009857 24977 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.063982 24977 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.064168 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:40.065062 22548 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 6: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:40.066227 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:40.067095 22476 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:39.985570 24679 raft_consensus.cc:697] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:40.057873 24957 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:40.068163 24957 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:39.973595 24838 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:39.979041 24867 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:40.070051 25065 log.cc:927] Time spent T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.329s	user 0.002s	sys 0.000s
I20260709 12:17:39.978892 24965 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:40.068598 24957 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:40.072662 24965 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.073457 22471 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:40.074043 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:40.074246 24269 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.074692 22401 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:40.074788 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:40.075222 22468 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:40.075595 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:40.075841 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:40.076206 22401 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:40.076907 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:40.076972 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:40.067761 25067 log.cc:927] Time spent T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.326s	user 0.002s	sys 0.000s
I20260709 12:17:40.080355 22401 raft_consensus.cc:2393] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:39.984256 24718 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:40.082490 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 177605us
I20260709 12:17:40.057472 23124 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
W20260709 12:17:40.084327 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 163233us
I20260709 12:17:40.084834 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:40.088021 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:40.090267 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.089318 22442 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:40.088532 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 174029us
I20260709 12:17:40.092214 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:40.092221 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:40.092897 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:40.092942 22471 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:40.093820 22468 raft_consensus.cc:2410] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:40.093035 22548 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:17:40.091847 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:40.095557 22472 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:40.097638 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:40.097886 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:40.098346 22475 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:40.101151 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:40.101469 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:40.099561 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 173450us
I20260709 12:17:40.102171 22544 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:40.106421 22399 raft_consensus.cc:1240] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:40.106434 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:40.108197 22475 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:40.109786 23094 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:17:40.112185 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.087302 24718 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.115231 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:40.118826 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:17:40.119787 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.120697 22399 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:17:40.123101 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.124330 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:40.125069 22551 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
W20260709 12:17:40.127503 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 55729.7us
I20260709 12:17:40.128067 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:40.135416 22543 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:17:40.115727 24981 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:40.115739 24938 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.145005 22399 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:17:40.144797 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:40.120060 24906 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.145996 22550 raft_consensus.cc:2393] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 6: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:40.143834 22366 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:40.121017 24731 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.160490 22470 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:40.134541 25068 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.141287 24925 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:40.163038 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.123083 24827 raft_consensus.cc:697] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:40.173743 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:40.165524 22471 raft_consensus.cc:2393] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:40.150544 25015 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.151402 24981 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.183396 24718 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.186086 24888 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:40.186733 24888 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.177536 24867 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:40.187209 24888 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.189483 24888 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:40.189841 25072 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.169700 24906 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.169876 24731 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.120170 24679 consensus_queue.cc:237] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:40.190541 25081 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.175617 24838 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.179930 24925 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:40.169992 24690 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:40.204223 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:40.160897 24938 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.171773 25082 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:40.214758 22548 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:40.176267 25068 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.213508 22473 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
W20260709 12:17:40.269455 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.205075 24981 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:40.189178 24957 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:40.228555 25062 log.cc:927] Time spent T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.574s	user 0.002s	sys 0.000s
I20260709 12:17:40.231029 22399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:17:40.234984 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:40.320397 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:40.328158 22547 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:40.321424 22542 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:40.320971 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:40.330067 22546 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 6: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:17:40.321970 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:40.226522 22296 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.019s	sys 0.011s
I20260709 12:17:40.204725 25015 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:40.332397 22296 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.026s	sys 0.027s
I20260709 12:17:40.335569 22399 raft_consensus.cc:606] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:40.336323 22399 raft_consensus.cc:614] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:40.233700 24906 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.324743 22366 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:40.390513 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 65846us
I20260709 12:17:40.390823 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:40.392104 22366 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:40.339035 25015 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.212183 24757 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.340305 25084 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:40.340559 25063 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.210078 25080 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.150s
I20260709 12:17:40.398061 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:40.398695 22543 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:40.318179 25081 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.399325 24922 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:40.399770 24922 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.400118 24922 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:40.401213 25081 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.401993 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34092 (request call id 312) took 1304 ms. Trace:
I20260709 12:17:40.320035 25082 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.341992 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:40.343940 22393 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:40.349119 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 259881us
W20260709 12:17:40.350028 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 258252us
I20260709 12:17:40.406417 22441 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:40.233621 24732 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:40.350560 24269 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:40.408461 24269 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.351150 25083 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:40.362622 24827 consensus_queue.cc:237] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.317378 25072 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:17:40.369611 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.369746 23094 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:40.372121 24957 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.384137 22547 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
W20260709 12:17:40.384718 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.230350 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:40.426625 22550 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:40.268839 24690 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:17:40.339794 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 104910us
W20260709 12:17:40.397115 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.401805 25049 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:40.340798 24731 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.397759 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:40.420403 25083 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:40.408875 24269 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:40.403896 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:40.405635 22442 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:40.408782 22546 raft_consensus.cc:2410] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:40.402420 23124 rpcz_store.cc:276] 0709 12:17:39.097407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.098172 (+   765us) service_pool.cc:224] Handling call
0709 12:17:40.401792 (+1303620us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54000424d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:40.401929 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":400621952}
I20260709 12:17:40.396350 24906 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:17:40.424345 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 54672.7us
I20260709 12:17:40.436019 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:40.458184 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:40.231391 24847 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:40.436260 25080 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:40.460882 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:17:40.436501 24690 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:40.463568 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:40.464887 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:40.469601 25023 consensus_queue.cc:1059] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:40.470907 25023 consensus_queue.cc:1059] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:40.472065 25085 raft_consensus.cc:3055] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:40.472458 25085 raft_consensus.cc:740] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:40.473387 25085 consensus_queue.cc:260] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.474934 25085 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:40.476006 25072 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:40.478597 22551 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:40.448452 22442 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:40.423441 24757 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:40.490417 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:40.500645 24269 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:40.504671 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.507328 22550 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:40.460948 25080 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.516183 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:40.516916 22548 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:40.454571 25083 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:40.523141 24269 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.492385 25076 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:40.494727 24946 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:40.521678 25080 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:40.506439 24748 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:40.502974 25063 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:40.506716 24906 raft_consensus.cc:697] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:40.537926 24906 consensus_queue.cc:237] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.491524 24826 consensus_queue.cc:1059] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:17:40.542157 24832 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.542717 24832 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.544888 24832 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.546545 25082 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:40.546841 22402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1383) took 1250 ms. Trace:
I20260709 12:17:40.547600 24732 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:40.547261 22402 rpcz_store.cc:276] 0709 12:17:39.296706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.303047 (+  6341us) service_pool.cc:224] Handling call
0709 12:17:39.334965 (+ 31918us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:39.385483 (+ 50518us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:39.387508 (+  2025us) log.cc:844] Serialized 14 byte log entry
0709 12:17:39.604846 (+217338us) log.cc:844] Serialized 14 byte log entry
0709 12:17:39.668131 (+ 63285us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:39.914613 (+246482us) log.cc:844] Serialized 26 byte log entry
0709 12:17:39.914757 (+   144us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:39.914788 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.914846 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:40.227921 (+313075us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:40.546569 (+318648us) raft_consensus.cc:1685] finished
0709 12:17:40.546592 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:40.546727 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71698,"prepare.queue_time_us":347,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":81,"raft.queue_time_us":290742,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":21163,"spinlock_wait_cycles":641175808,"thread_start_us":44849,"threads_started":1,"wal-append.queue_time_us":161013}
W20260709 12:17:40.534947 25091 log.cc:927] Time spent T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:17:40.536496 24748 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.506141 25084 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:17:40.566274 24826 raft_consensus.cc:3055] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:40.533073 25076 raft_consensus.cc:697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:40.567683 25076 consensus_queue.cc:237] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.566759 24826 raft_consensus.cc:740] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:40.570405 24826 consensus_queue.cc:260] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.571662 24826 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:40.558981 24748 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:40.570425 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:40.574545 22402 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:17:40.574828 24925 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:40.578962 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:40.589876 22548 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
W20260709 12:17:40.592712 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:40.618271 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 160180us
I20260709 12:17:40.600739 24925 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:17:40.618945 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 170584us
I20260709 12:17:40.622253 22442 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:40.625187 24269 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:40.625799 24269 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.626119 24269 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:40.626725 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:40.625250 22515 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:40.620573 24925 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.624858 23125 raft_consensus.cc:1240] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:17:40.632054 24925 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:40.629029 25084 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:40.633211 25084 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:40.633591 25084 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:40.635814 24847 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:40.631035 22442 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:40.630409 22441 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:40.646435 22543 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:40.647902 24269 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.671417 24269 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.652501 25072 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:40.646556 24938 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:40.679286 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 48968.7us
I20260709 12:17:40.680711 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:40.681458 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:40.685422 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:40.686110 22394 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:40.686934 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:40.687567 22397 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:40.688679 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:40.688966 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:40.674772 25063 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:40.689495 22397 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:40.690023 22398 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:40.695288 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:40.696408 22396 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:17:40.739315 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 54140.9us
I20260709 12:17:40.739609 25105 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.740289 25105 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.641754 24981 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:40.682170 24757 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:40.651826 24690 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.644369 24925 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:40.745308 24269 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:40.742467 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:40.663543 24922 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.664544 25083 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:40.755612 22397 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:17:40.677708 24732 consensus_queue.cc:1059] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:17:40.672291 25099 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:17:40.689812 25079 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.686993 25072 raft_consensus.cc:697] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:40.743564 25063 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:40.671214 25084 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.769078 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:40.770092 22398 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:40.756564 25055 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.743422 24957 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:17:40.760299 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:40.784521 22399 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
W20260709 12:17:40.789435 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 68896.8us
W20260709 12:17:40.782322 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 93359.7us
I20260709 12:17:40.768980 25063 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:40.780139 24721 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:40.801757 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.800801 22366 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:40.803323 22399 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:40.805141 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:40.804658 22366 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:40.808045 22550 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:40.810122 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:40.810910 22473 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:17:40.813289 22366 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:40.814124 24906 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:40.769819 25079 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.817981 22366 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:40.814957 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:40.801656 23124 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:40.817152 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:40.820082 24269 raft_consensus.cc:3055] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:40.822052 24269 raft_consensus.cc:740] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:40.822134 22545 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:40.822911 24269 consensus_queue.cc:260] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.823848 24269 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:40.827037 22551 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:40.803959 24721 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:40.810389 24993 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:40.804142 25085 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:40.832934 25094 log.cc:927] Time spent T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:17:40.833029 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:40.833737 22473 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:40.809796 25104 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.833979 22442 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:40.814504 24906 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.803757 24985 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:17:40.826395 25082 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:40.815085 25013 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:40.826575 25081 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:40.828534 24732 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.794582 25055 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:40.834216 24721 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:40.847087 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.831619 25105 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.863863 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:40.871352 22473 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:17:40.874331 25106 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.874956 25106 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.877255 25106 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:40.878167 25101 log.cc:927] Time spent T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 12:17:40.890307 25102 log.cc:927] Time spent T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:17:40.892236 25107 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:40.892920 25107 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.893285 25107 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:40.828099 24832 consensus_queue.cc:1059] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:17:40.895206 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:40.895141 25079 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.896857 25083 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:40.897610 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 97837us
I20260709 12:17:40.898175 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:40.816210 25080 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:40.898641 22516 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:40.899387 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:40.899577 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:40.843446 25104 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:40.900205 22468 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:17:40.900467 25080 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.841161 25097 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.902164 25097 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:40.904470 24985 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:40.904870 25097 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:40.905151 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:40.905808 22471 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:40.909724 22473 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:17:40.895846 24981 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.898752 22470 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:40.843107 24888 raft_consensus.cc:3055] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:40.916285 24888 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:40.916929 22442 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:40.870324 25100 log.cc:927] Time spent T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:17:40.973037 22394 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:40.843379 24906 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:40.901625 25068 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.898778 24922 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:40.924530 22442 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:40.925112 25083 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:40.927721 24679 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:40.917102 24888 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.841358 24757 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:40.992780 25062 log.cc:927] Time spent T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:17:40.931639 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:40.932974 22398 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:17:40.901433 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:40.978116 22547 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:17:40.978485 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 68988.8us
I20260709 12:17:41.013751 22550 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:41.014716 22548 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:40.980747 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:40.986222 22470 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:17:40.987152 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:40.987974 23124 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:40.988276 24925 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:40.989283 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:41.032768 22397 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
W20260709 12:17:40.989780 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.990918 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:40.848697 25013 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.998116 23130 raft_consensus.cc:2393] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 4: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
W20260709 12:17:41.000489 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 76016.2us
I20260709 12:17:40.839411 25085 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.059604 22442 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:41.008399 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:41.061208 22394 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:41.008646 22544 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:40.972399 24731 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.866896 24732 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:40.930979 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:41.011888 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.973709 24851 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:40.902168 25104 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:40.972466 25081 raft_consensus.cc:697] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:41.015465 22472 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:17:41.029458 22367 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:41.033157 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:41.051543 22548 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:41.001674 24832 raft_consensus.cc:3055] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:41.052871 24690 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:41.011935 25079 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.027666 25084 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:41.053789 25013 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:41.054603 24891 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:40.998706 24847 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.003512 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:40.998338 24748 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.009083 25097 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:40.843081 25072 consensus_queue.cc:237] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:41.070768 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:41.073699 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:41.080471 22442 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:41.082186 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:41.082531 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:41.195380 22401 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
W20260709 12:17:41.053314 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 62469.8us
I20260709 12:17:41.196457 22516 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:41.075042 24888 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:41.202133 23129 raft_consensus.cc:2368] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6.
I20260709 12:17:41.164557 25120 raft_consensus.cc:2764] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:17:41.165405 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 325518us
I20260709 12:17:41.162526 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:41.071110 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:41.213991 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:41.070245 24851 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.070245 24946 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:17:41.175362 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.185494 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 156111us
I20260709 12:17:41.197356 22398 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:41.163813 24993 raft_consensus.cc:697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:41.027360 24757 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.215260 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:41.215972 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:41.214579 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:41.216282 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:41.216881 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:41.218680 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:41.155253 24832 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:41.227298 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:41.168500 24891 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.169947 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:41.174054 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:41.248219 22397 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:41.247532 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:41.235896 22470 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:41.250948 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:41.268975 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.249271 22399 raft_consensus.cc:2368] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10.
I20260709 12:17:41.247630 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:41.251111 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:41.239897 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.071841 24731 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:41.227854 25096 log.cc:927] Time spent T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:17:41.255615 22366 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:41.250761 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:41.274787 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:41.275367 22550 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:41.275484 22471 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:41.251748 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:41.277362 22476 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:41.251365 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:41.276499 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:41.254911 22367 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:41.272986 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:41.271131 22398 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9.
I20260709 12:17:41.254220 23125 raft_consensus.cc:2393] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 4: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:41.280750 22471 raft_consensus.cc:2410] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:17:41.281816 22366 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:41.254626 23124 raft_consensus.cc:2368] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8.
I20260709 12:17:41.182269 24847 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.284291 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:41.287374 22394 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:41.226970 25084 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:41.225600 24851 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:41.249719 24891 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:41.271543 25111 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:17:41.259341 25105 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.259946 25076 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:41.253697 24757 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:41.234598 24820 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:17:41.265792 24946 raft_consensus.cc:697] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:41.259578 25115 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.251912 25114 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.264169 24732 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:41.182029 25079 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.255232 25068 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
I20260709 12:17:41.252319 24993 consensus_queue.cc:237] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:41.710240 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 455400us
I20260709 12:17:41.722483 23094 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:41.437686 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:41.664171 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 583764us
I20260709 12:17:41.718396 22397 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:41.314710 22396 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:17:41.453233 22549 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:41.735172 22442 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:41.412657 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:41.729357 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:41.326656 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.737075 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.719923 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.394074 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:41.736057 22396 pending_rounds.cc:85] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 6
W20260709 12:17:41.738344 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.734349 22550 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:17:41.250818 25083 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:41.737826 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.287649 24690 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:41.476857 25063 consensus_meta.cc:287] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.661s	user 0.006s	sys 0.001s
W20260709 12:17:41.729959 24906 consensus_meta.cc:287] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.709s	user 0.009s	sys 0.001s
I20260709 12:17:41.452181 24847 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:41.454031 25082 consensus_meta.cc:287] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.607s	user 0.004s	sys 0.005s
W20260709 12:17:41.707721 25107 consensus_meta.cc:287] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.814s	user 0.004s	sys 0.007s
W20260709 12:17:41.778910 24269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.020s	sys 0.023s
I20260709 12:17:41.739208 24748 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:41.727531 24965 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:17:41.480794 24851 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.271726 24721 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.750227 22442 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:41.745056 25076 raft_consensus.cc:697] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:41.792317 22442 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:41.289223 24922 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:41.782008 25082 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:41.314738 25084 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:41.323318 25001 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:41.475328 25055 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:41.478014 24731 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:41.753399 25079 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:41.744127 24679 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:41.738478 22396 pending_rounds.cc:107] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:17:41.811045 22396 raft_consensus.cc:2889] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:41.779407 24269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.020s	sys 0.023s
I20260709 12:17:41.755833 24757 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:41.782886 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:41.325415 25085 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:41.790362 22473 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:41.473156 25013 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.749867 24690 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.757543 24827 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:41.757752 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.453702 24891 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.742178 25114 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.284833 25081 consensus_queue.cc:237] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.742599 25105 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.829732 24827 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.376436 24832 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.830549 25114 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:41.830427 22477 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:41.831835 25105 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:41.775580 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:41.752453 25063 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:41.832998 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:41.805970 25072 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.772480 25083 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.833902 25072 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:41.835572 25083 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:41.836130 25072 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:41.836463 22474 raft_consensus.cc:2393] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:41.794544 24732 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:41.837162 22395 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:41.813218 22545 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:41.838342 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:41.844848 22545 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:41.799283 24922 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:41.846316 24922 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:41.828037 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:41.850180 22398 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:41.850934 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:41.851450 24891 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:41.851608 22549 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:41.852046 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:41.853286 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:41.854326 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:41.856950 22549 raft_consensus.cc:2368] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8.
I20260709 12:17:41.858346 24721 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:41.859318 22401 raft_consensus.cc:2393] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:41.859759 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:41.860266 25013 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:41.809306 25001 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.860889 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:41.861184 25001 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:41.859333 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:41.862382 22546 raft_consensus.cc:2368] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6.
I20260709 12:17:41.862473 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:41.863145 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:41.859396 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:41.810062 25084 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:41.832019 24827 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:41.833606 22543 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:17:41.839211 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:41.810794 24748 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:41.837134 24732 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.823648 24690 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:41.776691 24906 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.842243 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:41.842622 22468 raft_consensus.cc:2410] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:41.843158 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:41.837345 22472 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:41.845695 25063 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:17:41.786803 25107 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.747440 25115 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.866547 22549 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:41.867590 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:41.869613 22542 raft_consensus.cc:2410] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:41.828243 24757 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:17:41.874666 25125 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:17:41.875550 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 139888us
I20260709 12:17:41.786154 24946 consensus_queue.cc:237] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:41.815918 24993 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.881821 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:41.874468 25076 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:41.884485 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:42.146885 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:42.130371 22545 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:42.115404 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.214303 22402 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:17:42.216184 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.133684 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:42.136690 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.186776 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:17:42.226738 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.215556 22475 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:42.231525 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:42.226675 23130 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 6 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:42.234304 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:42.235458 22551 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:42.236023 22471 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:42.235666 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:41.912180 22366 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:42.237159 22548 raft_consensus.cc:2368] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8.
I20260709 12:17:42.237257 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:42.234901 23129 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:42.237905 22545 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:41.817121 24679 raft_consensus.cc:697] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:42.237695 22544 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:41.883750 24748 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.876130 25015 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.109190 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:42.082876 24827 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.178989 24851 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:42.108067 24891 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.218s
I20260709 12:17:42.107889 24721 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.291730 22548 raft_consensus.cc:1275] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:42.475668 22549 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:42.289937 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:42.246390 22402 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:17:42.337180 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:42.470472 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 252804us
I20260709 12:17:42.445497 22545 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:41.883997 24732 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:42.441962 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 529873us
I20260709 12:17:42.478488 22367 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:42.324432 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:42.288362 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:17:42.395147 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 150377us
I20260709 12:17:42.480969 22475 raft_consensus.cc:2376] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8. Re-sending same reply.
W20260709 12:17:42.160414 25097 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.011s	sys 0.017s
I20260709 12:17:42.487102 22475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1711) took 1202 ms. Trace:
W20260709 12:17:42.486061 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 358654us
I20260709 12:17:42.490839 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1710) took 1209 ms. Trace:
I20260709 12:17:42.484972 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1411) took 1558 ms. Trace:
I20260709 12:17:42.491026 22516 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:42.487813 22366 leader_election.cc:400] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8.
I20260709 12:17:42.491871 22366 leader_election.cc:403] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:17:42.414113 25131 log.cc:927] Time spent T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:17:42.490131 22475 rpcz_store.cc:276] 0709 12:17:41.285011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.230880 (+945869us) service_pool.cc:224] Handling call
0709 12:17:42.487038 (+256158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:42.492283 22468 rpcz_store.cc:276] 0709 12:17:41.281271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.231530 (+950259us) service_pool.cc:224] Handling call
0709 12:17:42.490778 (+259248us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:42.465137 25130 log.cc:927] Time spent T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.317s	user 0.000s	sys 0.000s
I20260709 12:17:42.504633 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:42.504738 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:42.505270 22394 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:42.237614 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:42.503058 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:42.148389 24731 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:41.888417 25013 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:42.359741 25072 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:42.227492 24993 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:42.395183 25081 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:42.462018 25137 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:42.491633 22393 rpcz_store.cc:276] 0709 12:17:40.926491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.928882 (+  2391us) service_pool.cc:224] Handling call
0709 12:17:41.071491 (+142609us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:17:41.071723 (+   232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:41.072159 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:41.072190 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:41.072684 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:17:41.354192 (+281508us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:41.354235 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.354307 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:42.466068 (+1111761us) raft_consensus.cc:1685] finished
0709 12:17:42.466092 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:42.484891 (+ 18799us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4806,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":73934,"spinlock_wait_cycles":9772928,"thread_start_us":184263,"threads_started":1,"wal-append.queue_time_us":692185}
I20260709 12:17:42.537497 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:42.512881 22394 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:42.414245 25135 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:42.486801 24748 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:42.413301 25105 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:42.485320 24977 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.532060 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:42.517179 22470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1474) took 1304 ms. Trace:
I20260709 12:17:42.531062 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:42.553784 22401 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:42.553751 22470 rpcz_store.cc:276] 0709 12:17:41.213195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.227179 (+ 13984us) service_pool.cc:224] Handling call
0709 12:17:41.227460 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.267214 (+ 39754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:42.516946 (+1249732us) spinlock_profiling.cc:243] Waited 8.23 ms on lock 0x7b54002021d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:42.517124 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18935168}
I20260709 12:17:42.555774 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1713) took 1186 ms. Trace:
I20260709 12:17:42.556169 22468 rpcz_store.cc:276] 0709 12:17:41.369235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.510398 (+1141163us) service_pool.cc:224] Handling call
0709 12:17:42.555708 (+ 45310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:42.557119 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:42.557739 22468 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:42.558238 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1703) took 1308 ms. Trace:
I20260709 12:17:42.558527 22468 rpcz_store.cc:276] 0709 12:17:41.250147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.556820 (+1306673us) service_pool.cc:224] Handling call
0709 12:17:42.558186 (+  1366us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:42.533813 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 55413.7us
I20260709 12:17:42.534317 22395 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:42.560186 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:42.502847 25097 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.239s	user 0.015s	sys 0.017s
I20260709 12:17:42.539983 22393 raft_consensus.cc:2393] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 8: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:42.489678 25015 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:42.549517 22543 consensus_meta.cc:287] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.673s	user 0.006s	sys 0.001s
I20260709 12:17:42.379542 25132 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.153s
I20260709 12:17:42.487246 24827 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:42.511262 24851 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:17:42.560240 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:42.413285 25114 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 12:17:42.509127 25079 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:42.562604 23095 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.021s	sys 0.009s
W20260709 12:17:42.572680 23095 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.022s	sys 0.009s
W20260709 12:17:42.573029 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 687414us
I20260709 12:17:42.562642 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:42.574527 22394 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:42.492465 24721 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:42.581875 22394 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:42.582903 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:42.563503 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 75792.1us
I20260709 12:17:42.563985 22475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1704) took 1313 ms. Trace:
I20260709 12:17:42.565865 22543 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
W20260709 12:17:42.566442 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 61790.1us
I20260709 12:17:42.532846 25081 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:42.560941 25097 raft_consensus.cc:697] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:42.536921 24826 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:42.476164 24757 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:42.514736 24731 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:42.535651 25013 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:42.551344 25137 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:42.823549 22544 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:42.825217 22543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 1395) took 1301 ms. Trace:
I20260709 12:17:42.563604 25134 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:42.835103 22395 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:42.798169 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 307219us
I20260709 12:17:42.718511 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1401) took 1183 ms. Trace:
I20260709 12:17:42.658787 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:42.838078 22470 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:42.838943 22470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1705) took 1588 ms. Trace:
I20260709 12:17:42.638490 22401 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:17:42.826148 22394 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:17:42.839653 22544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 1390) took 1314 ms. Trace:
I20260709 12:17:42.827335 22441 leader_election.cc:400] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6.
I20260709 12:17:42.826877 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:42.718410 22515 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:42.824118 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1396) took 1290 ms. Trace:
I20260709 12:17:42.719558 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:42.574023 23095 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.565s (SENT) [suppressed 18 similar messages]
I20260709 12:17:42.847411 22366 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:42.825632 22475 rpcz_store.cc:276] 0709 12:17:41.250406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.510284 (+1259878us) service_pool.cc:224] Handling call
0709 12:17:42.563932 (+ 53648us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:42.848116 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 274101us
I20260709 12:17:42.839922 22516 leader_election.cc:400] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7.
I20260709 12:17:42.849257 22516 leader_election.cc:403] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:42.848171 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 1391) took 1329 ms. Trace:
I20260709 12:17:42.848444 22441 leader_election.cc:403] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:42.832628 22543 rpcz_store.cc:276] 0709 12:17:41.524075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.832749 (+308674us) service_pool.cc:224] Handling call
0709 12:17:42.825152 (+992403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:42.850069 23095 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:42.849812 22547 rpcz_store.cc:276] 0709 12:17:41.518968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.519808 (+   840us) service_pool.cc:224] Handling call
0709 12:17:42.719398 (+1199590us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b5800010b98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:42.848108 (+128710us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6463360}
I20260709 12:17:42.839346 22470 rpcz_store.cc:276] 0709 12:17:41.250642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.570838 (+1320196us) service_pool.cc:224] Handling call
0709 12:17:42.838880 (+268042us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:42.825804 25146 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 12:17:42.840960 22544 rpcz_store.cc:276] 0709 12:17:41.518660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.519519 (+   859us) service_pool.cc:224] Handling call
0709 12:17:41.843015 (+323496us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b5800010b98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:42.832693 (+989678us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6816128}
W20260709 12:17:42.722898 25143 log.cc:927] Time spent T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
W20260709 12:17:42.796290 24922 consensus_meta.cc:287] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.950s	user 0.006s	sys 0.002s
I20260709 12:17:42.846828 22546 rpcz_store.cc:276] 0709 12:17:41.533484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.863967 (+330483us) service_pool.cc:224] Handling call
0709 12:17:41.864278 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:41.864687 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:41.864717 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:41.865210 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 12:17:42.472318 (+607108us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:42.472400 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:42.472472 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:42.759970 (+287498us) raft_consensus.cc:1685] finished
0709 12:17:42.759990 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:42.824050 (+ 64060us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":967,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":371730,"threads_started":1,"wal-append.queue_time_us":695839}
I20260709 12:17:42.836619 22542 rpcz_store.cc:276] 0709 12:17:41.534902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.293970 (+759068us) service_pool.cc:224] Handling call
0709 12:17:42.392337 (+ 98367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:42.392554 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:42.508421 (+115867us) log.cc:844] Serialized 14 byte log entry
0709 12:17:42.718124 (+209703us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:42.718192 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:42.718233 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:42.718303 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:42.718439 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":266541,"prepare.run_cpu_time_us":9209,"prepare.run_wall_time_us":52380,"thread_start_us":305063,"threads_started":2}
I20260709 12:17:42.567653 25148 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:42.825588 25145 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
W20260709 12:17:42.790848 25001 consensus_meta.cc:287] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.929s	user 0.010s	sys 0.000s
W20260709 12:17:42.693809 25111 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:17:42.678869 24679 consensus_queue.cc:237] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:42.603111 25127 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:17:42.678788 24891 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:42.856537 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.826683 24721 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:42.889580 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.889065 22395 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:42.583226 25063 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:42.835549 25147 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 12:17:42.573089 24906 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:42.564194 24977 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:42.871013 25001 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:42.901629 25137 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:42.861708 24922 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:42.903045 25001 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:42.873910 25157 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6.
I20260709 12:17:42.904250 24731 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:42.904397 24891 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:42.904769 24922 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:42.904987 24891 raft_consensus.cc:697] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:42.905146 24721 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7.
I20260709 12:17:42.825901 25081 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:42.625926 25079 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:42.856777 24838 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:42.720259 25015 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:42.862025 22397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1416) took 1036 ms. Trace:
I20260709 12:17:42.854221 22394 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:42.797626 24827 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:42.823266 25107 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:42.851701 24690 consensus_meta.cc:287] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.791s	user 0.006s	sys 0.003s
I20260709 12:17:42.658303 25136 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:42.857594 22366 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:42.552477 25135 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:42.874883 22399 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:42.880141 22468 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
W20260709 12:17:42.882987 22471 consensus_meta.cc:287] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.000s
I20260709 12:17:42.938971 22471 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:42.932979 24977 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:42.892050 25163 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.860674 22441 leader_election.cc:400] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8.
I20260709 12:17:42.942343 22441 leader_election.cc:403] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:42.896435 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:42.942977 22475 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
W20260709 12:17:42.943447 22475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1698) took 1694 ms (client timeout 2161 ms). Trace:
W20260709 12:17:42.943785 22475 rpcz_store.cc:269] 0709 12:17:41.248603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.858911 (+1610308us) service_pool.cc:224] Handling call
0709 12:17:42.943386 (+ 84475us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:42.944657 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:42.863943 25072 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:42.899677 25153 consensus_queue.cc:1048] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:17:42.900249 24906 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:17:42.890745 25084 consensus_meta.cc:287] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.944s	user 0.006s	sys 0.004s
I20260709 12:17:42.572351 25105 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:42.874177 25162 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.827848 25149 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:17:42.922169 24838 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.922446 22397 rpcz_store.cc:276] 0709 12:17:41.825597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.825742 (+   145us) service_pool.cc:224] Handling call
0709 12:17:41.826118 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:41.874222 (+ 48104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:41.874264 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:41.874719 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 12:17:42.184520 (+309801us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:42.184576 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:42.184667 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:42.861796 (+677129us) raft_consensus.cc:1685] finished
0709 12:17:42.861817 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:42.861966 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40897,"raft.queue_time_us":249430,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":56393,"thread_start_us":309332,"threads_started":1,"wal-append.queue_time_us":596804}
W20260709 12:17:42.933537 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 368115us
I20260709 12:17:42.934942 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1778) took 1049 ms. Trace:
I20260709 12:17:42.936726 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 235) took 2027 ms. Trace:
W20260709 12:17:42.939450 22471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1697) took 1691 ms (client timeout 1782 ms). Trace:
I20260709 12:17:42.891851 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:42.956876 22470 raft_consensus.cc:2368] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7.
I20260709 12:17:42.956272 22367 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:42.957324 22470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1718) took 1134 ms. Trace:
W20260709 12:17:42.940418 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 88623.1us
W20260709 12:17:42.947173 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 87717.3us
I20260709 12:17:42.898543 25063 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:42.952484 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 102497us
I20260709 12:17:42.958724 22470 rpcz_store.cc:276] 0709 12:17:41.823488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.891566 (+1068078us) service_pool.cc:224] Handling call
0709 12:17:42.957265 (+ 65699us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:42.958807 22441 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:42.946959 25015 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:42.956089 22396 rpcz_store.cc:276] 0709 12:17:40.909249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.920138 (+ 10889us) service_pool.cc:224] Handling call
0709 12:17:40.924765 (+  4627us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.811516 (+886751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:42.936466 (+1124950us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54000b72d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:42.936661 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886632832}
I20260709 12:17:42.956028 22551 rpcz_store.cc:276] 0709 12:17:41.885614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.385582 (+499968us) service_pool.cc:224] Handling call
0709 12:17:42.472551 (+ 86969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:42.472764 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:42.547686 (+ 74922us) log.cc:844] Serialized 14 byte log entry
0709 12:17:42.934644 (+386958us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:42.934698 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:42.934748 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:42.934811 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:42.934898 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":254998,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":54451,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"thread_start_us":431589,"threads_started":3,"wal-append.queue_time_us":324828}
W20260709 12:17:42.957883 22471 rpcz_store.cc:269] 0709 12:17:41.248382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.867317 (+618935us) service_pool.cc:224] Handling call
0709 12:17:42.939396 (+1072079us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:42.967738 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:42.968353 22471 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:42.968860 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1714) took 1221 ms. Trace:
I20260709 12:17:42.969161 22471 rpcz_store.cc:276] 0709 12:17:41.747219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.967478 (+1220259us) service_pool.cc:224] Handling call
0709 12:17:42.968806 (+  1328us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:42.905975 24891 consensus_queue.cc:237] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:42.970151 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:42.980870 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1717) took 1174 ms. Trace:
I20260709 12:17:42.981258 22471 rpcz_store.cc:276] 0709 12:17:41.806292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.969886 (+1163594us) service_pool.cc:224] Handling call
0709 12:17:42.980799 (+ 10913us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:42.971747 25079 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:42.934686 24732 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:42.948642 24993 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:42.973234 25115 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:42.973904 25135 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:42.950327 25163 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:42.974645 25013 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:42.975744 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:42.994529 22476 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:42.976271 25063 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:42.976717 25105 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:42.977061 25107 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:42.977682 22472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 1472) took 1765 ms (client timeout 1915 ms). Trace:
I20260709 12:17:42.978178 25148 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8.
I20260709 12:17:42.962040 24838 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:42.979000 24748 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:42.951136 24977 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:42.982359 24269 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.017681 24269 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:42.991750 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 273487us
I20260709 12:17:42.992482 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:42.993196 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:43.047842 22470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1715) took 1268 ms. Trace:
I20260709 12:17:42.937160 24690 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:43.048538 22470 rpcz_store.cc:276] 0709 12:17:41.779974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.959583 (+1179609us) service_pool.cc:224] Handling call
0709 12:17:43.047746 (+ 88163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:43.002840 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:42.960386 24906 raft_consensus.cc:697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:43.084071 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1421) took 1154 ms. Trace:
W20260709 12:17:43.002861 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 166426us
I20260709 12:17:43.005189 22475 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:43.004750 22473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1480) took 1769 ms. Trace:
I20260709 12:17:43.005918 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:43.085542 22516 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:43.004647 22472 rpcz_store.cc:269] 0709 12:17:41.212519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.226956 (+ 14437us) service_pool.cc:224] Handling call
0709 12:17:42.977515 (+1750559us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54002b3254. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:42.977623 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1308098944}
I20260709 12:17:43.007972 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:43.086320 22551 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:43.086983 22542 raft_consensus.cc:2410] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:43.084527 22401 rpcz_store.cc:276] 0709 12:17:41.862138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.862259 (+   121us) service_pool.cc:224] Handling call
0709 12:17:43.016762 (+1154503us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b5400226d54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:43.016880 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1588280704}
I20260709 12:17:42.990372 24679 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:42.960657 25162 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:43.087883 24679 raft_consensus.cc:697] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:17:43.085565 22474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1696) took 1837 ms (client timeout 2154 ms). Trace:
I20260709 12:17:43.089332 25162 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:42.951985 25084 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:43.011860 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:42.939640 25097 consensus_queue.cc:237] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:42.998899 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:43.132725 22543 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:43.135492 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:43.136230 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.000942 22367 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:43.078428 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 57401us
I20260709 12:17:43.087276 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:42.947728 25136 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:43.090309 22544 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:43.090903 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1720) took 1008 ms. Trace:
I20260709 12:17:43.142705 22471 rpcz_store.cc:276] 0709 12:17:42.082889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.992222 (+909333us) service_pool.cc:224] Handling call
0709 12:17:43.090847 (+ 98625us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:43.092260 22474 rpcz_store.cc:269] 0709 12:17:41.248090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.250873 (+  2783us) service_pool.cc:224] Handling call
0709 12:17:43.085387 (+1834514us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b54000dfcd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:43.085512 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1296395008}
I20260709 12:17:43.004582 25107 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.000599 25015 raft_consensus.cc:697] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:43.099570 22550 raft_consensus.cc:2368] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6.
I20260709 12:17:43.085966 22473 rpcz_store.cc:276] 0709 12:17:41.235012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.237010 (+  1998us) service_pool.cc:224] Handling call
0709 12:17:41.237362 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.815298 (+577936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:43.004531 (+1189233us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b5400329954. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:43.004691 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271377792}
I20260709 12:17:43.116125 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:43.149663 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 148773us
I20260709 12:17:43.150463 22367 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:43.151549 24922 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:42.999729 25160 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:43.143419 22516 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:43.144347 22477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 1473) took 1931 ms (client timeout 1569 ms). Trace:
W20260709 12:17:43.155198 22477 rpcz_store.cc:269] 0709 12:17:41.212877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.227626 (+ 14749us) service_pool.cc:224] Handling call
0709 12:17:43.144187 (+1916561us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b5400200dd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:43.144284 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1278665472}
I20260709 12:17:43.143090 22543 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:17:43.147913 22546 raft_consensus.cc:1240] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:43.157189 22367 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:43.157099 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:43.094892 25168 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:43.148185 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:43.163494 22471 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:17:43.163059 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:43.160893 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 68611.7us
I20260709 12:17:43.132498 24993 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.164366 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:43.165081 22471 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:43.164371 22472 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:43.165792 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1702) took 1916 ms. Trace:
I20260709 12:17:43.166113 22472 rpcz_store.cc:276] 0709 12:17:41.249583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.146570 (+1896987us) service_pool.cc:224] Handling call
0709 12:17:43.165709 (+ 19139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:43.168288 22544 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:43.162410 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:43.169175 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:43.170077 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:43.170040 22474 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:43.170781 22473 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:43.088868 24679 consensus_queue.cc:237] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:43.176469 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:43.177570 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:43.181450 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:43.149115 25107 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:43.182714 22477 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:43.144245 25153 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:43.180838 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:43.187629 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:43.193274 22550 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:43.184371 22516 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:43.189630 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:43.194672 22547 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:43.182101 24993 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:43.198800 25170 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:43.199195 22367 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:43.158329 25160 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.200613 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:43.212270 22473 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 7.
I20260709 12:17:43.163578 24731 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:43.224963 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:43.216849 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:43.226624 22543 raft_consensus.cc:2368] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5.
I20260709 12:17:43.227464 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:43.228509 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:43.229182 22543 raft_consensus.cc:2393] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 8: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:43.218060 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:43.220085 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:43.230425 22542 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:43.221201 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:43.223512 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:43.231480 22547 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:43.235838 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:43.236564 22472 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:43.239144 25155 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:43.239662 25155 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:43.240056 25155 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:43.244880 25169 log.cc:927] Time spent T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:17:43.245911 25167 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.246560 25167 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:43.248926 25167 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:43.250694 22468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1712) took 1924 ms (client timeout 1978 ms). Trace:
W20260709 12:17:43.251156 22468 rpcz_store.cc:269] 0709 12:17:41.326555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.559931 (+1233376us) service_pool.cc:224] Handling call
0709 12:17:43.250517 (+690586us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54002017d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:43.250634 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":733957376}
I20260709 12:17:43.258641 22402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1424) took 1394 ms. Trace:
I20260709 12:17:43.259182 22402 rpcz_store.cc:276] 0709 12:17:41.864021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.231263 (+367242us) service_pool.cc:224] Handling call
0709 12:17:43.258367 (+1027104us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b5400037ad4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:43.258564 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32175872}
I20260709 12:17:43.260751 22516 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:43.269631 22477 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9.
I20260709 12:17:43.271373 22473 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:17:43.279141 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:43.298224 22473 raft_consensus.cc:1240] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:43.184331 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:17:43.299295 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 159801us
I20260709 12:17:43.299954 22550 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:43.301031 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:43.312407 22543 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:43.312903 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:17:43.301204 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:43.314558 22547 raft_consensus.cc:2410] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:43.303088 22476 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:43.189157 25072 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:43.188974 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:43.317256 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1719) took 1433 ms. Trace:
I20260709 12:17:43.319506 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:43.322589 22468 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:43.224471 25168 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:43.325639 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:43.224022 25120 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:43.224359 25148 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:43.332679 22476 rpcz_store.cc:276] 0709 12:17:41.884023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.975478 (+1091455us) service_pool.cc:224] Handling call
0709 12:17:43.317189 (+341711us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:43.214286 25160 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:43.342343 22477 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:43.344950 22543 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:43.307118 25099 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.219305 25153 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:43.353992 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:43.385089 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 185960us
I20260709 12:17:43.325331 25105 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:43.354759 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:43.386636 22367 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:43.388094 22516 leader_election.cc:400] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10.
I20260709 12:17:43.337378 25168 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:43.462179 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:43.325217 25173 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:43.461024 22516 leader_election.cc:403] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:43.462849 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:43.463097 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 282344us
I20260709 12:17:43.377061 22471 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:17:43.386453 22441 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:43.384377 23122 raft_consensus.cc:2393] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 7: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:43.349131 25079 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:43.473636 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 85765.8us
W20260709 12:17:43.464170 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 77620.7us
I20260709 12:17:43.215312 24906 consensus_queue.cc:237] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:43.333648 25167 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:17:43.471191 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 84809.2us
I20260709 12:17:43.476231 22367 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:43.385984 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:43.478287 22366 leader_election.cc:400] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6.
I20260709 12:17:43.493209 22366 leader_election.cc:403] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:17:43.493218 22367 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:43.461899 25105 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.495510 22367 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:43.475510 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:43.492219 22441 leader_election.cc:400] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8.
I20260709 12:17:43.498170 22367 leader_election.cc:400] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7.
I20260709 12:17:43.498489 22367 leader_election.cc:403] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:43.498445 22441 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:43.477226 25072 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10.
I20260709 12:17:43.504835 25084 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:43.506431 22367 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:43.497277 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:43.471989 25168 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:43.472929 25115 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:43.352483 24757 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.144s
I20260709 12:17:43.514983 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:43.517223 23095 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:43.493366 24731 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:43.461719 25157 consensus_queue.cc:1059] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:17:43.347558 25015 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:43.495041 24732 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:43.506920 25105 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:43.519096 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:43.354681 25099 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:43.527302 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:43.510710 24690 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:43.511260 25135 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:43.530455 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:43.511847 25079 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:43.510528 24748 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:43.535979 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:43.532342 22471 raft_consensus.cc:2376] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 7. Re-sending same reply.
I20260709 12:17:43.542344 22476 raft_consensus.cc:2376] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9. Re-sending same reply.
I20260709 12:17:43.543144 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:43.547129 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:43.516600 24993 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:43.548169 22551 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:43.504678 25167 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:43.522609 25084 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:43.522943 25106 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:43.518685 25180 raft_consensus.cc:2764] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:17:43.525439 24731 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:43.530375 25063 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.541949 25135 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.555505 22441 leader_election.cc:400] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5.
I20260709 12:17:43.560678 22441 leader_election.cc:403] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:17:43.551725 25179 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:43.562381 25179 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.562727 25179 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:43.564713 25167 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:43.565013 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:43.565446 25133 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:43.567692 25153 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:43.569794 25172 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 12:17:43.531116 25162 consensus_queue.cc:1059] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:17:43.570533 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:43.570907 25162 raft_consensus.cc:3055] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:43.562793 25166 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.219s
I20260709 12:17:43.571318 25162 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:43.573001 25136 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:43.573586 24269 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:43.573207 25162 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:43.560151 25165 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.574589 25162 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:43.576469 25180 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:43.577288 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.575109 22442 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:43.581326 22542 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:43.534786 25072 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:17:43.551928 24690 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7.
I20260709 12:17:43.555083 24993 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:43.558686 24731 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:43.563170 25134 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.596539 22442 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:43.595124 22441 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:43.579242 25135 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:43.586169 23124 raft_consensus.cc:2393] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:43.599326 22442 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:43.605306 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:43.605786 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:43.606638 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:43.607085 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:43.605490 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:43.608389 22394 raft_consensus.cc:2393] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:43.583905 24887 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:43.607399 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:43.608968 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:43.610473 22393 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:43.610790 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:43.607807 22400 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:43.609041 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:43.612509 22401 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:43.611749 22402 raft_consensus.cc:2393] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:43.558275 25106 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:43.616043 22551 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:43.617022 22397 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:43.575208 25165 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:43.619536 22396 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:43.600726 25134 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:43.598034 25126 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:43.611737 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 94583.2us
W20260709 12:17:43.625121 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 150376us
W20260709 12:17:43.614435 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 90969.9us
W20260709 12:17:43.643414 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 124007us
I20260709 12:17:43.578629 25063 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:43.646538 22397 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:43.646919 25063 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:43.638824 22472 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:17:43.601751 24757 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:43.642383 22366 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:43.629848 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 123330us
I20260709 12:17:43.611181 25153 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:43.610293 24887 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:43.598197 24946 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:17:43.648485 24269 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5.
I20260709 12:17:43.682420 25189 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:43.683010 25189 raft_consensus.cc:697] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:43.684054 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:43.683877 25189 consensus_queue.cc:237] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:43.684780 22549 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:43.643841 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:43.685510 22542 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:43.686136 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:43.686527 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:43.687209 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:43.687989 22401 raft_consensus.cc:2393] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:43.684715 22548 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:43.688804 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:43.689450 22401 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:43.633914 24721 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:43.663447 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 64204.1us
I20260709 12:17:43.664117 25104 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:43.690742 25104 raft_consensus.cc:697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:43.690836 22442 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:43.691677 25063 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:43.690975 25187 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.692668 22442 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:43.692428 25187 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:43.693756 22442 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:43.695176 25187 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:43.695640 25063 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:43.697288 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:43.697954 25136 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:43.664227 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:43.698185 22545 raft_consensus.cc:2410] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:17:43.698518 25185 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:43.698851 25136 raft_consensus.cc:697] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:43.698796 25068 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:43.700116 25185 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:43.699908 25136 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:43.700695 25185 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:43.702481 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:43.703804 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:43.704695 22401 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:43.668875 22396 raft_consensus.cc:1240] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:43.711876 25063 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:43.712488 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:43.670217 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:43.714238 22442 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:43.671555 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:43.672840 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:43.715679 22442 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:43.674326 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:43.680470 22516 connection.cc:256] RPC call timeout handler was delayed by -1.0185045819998777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
I20260709 12:17:43.721899 22399 raft_consensus.cc:2368] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7.
I20260709 12:17:43.725520 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:43.695058 25104 consensus_queue.cc:237] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:43.680035 24732 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:43.708798 25185 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:43.710768 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:43.698109 22367 connection.cc:256] RPC call timeout handler was delayed by -1.8159440029999132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
I20260709 12:17:43.648490 25126 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:17:43.726900 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 131863us
I20260709 12:17:43.755538 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:43.727293 22400 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:43.717741 22442 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:43.757266 22367 connection.cc:256] RPC call timeout handler was delayed by -1.4782491649998519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260709 12:17:43.757812 22367 connection.cc:256] RPC call timeout handler was delayed by -1.4536876910001411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 12:17:43.759256 22367 connection.cc:256] RPC call timeout handler was delayed by -1.3239409100001467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 12:17:43.724790 24891 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.666883 25105 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:43.681567 23125 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:43.681324 24887 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:43.681365 25166 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:43.742200 24732 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.681187 25153 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:43.758236 25126 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:43.794504 22367 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:43.817154 24718 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:43.728844 25063 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.064s
W20260709 12:17:43.818514 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 155046us
I20260709 12:17:43.825145 22366 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:43.820402 22367 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:43.846969 22367 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:43.852034 22367 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:43.791427 25196 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:43.792623 25099 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:43.816434 24732 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:43.915922 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 190464us
W20260709 12:17:43.918910 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 92317.2us
I20260709 12:17:43.925460 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:43.930085 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 174652us
I20260709 12:17:43.931149 22441 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:43.933156 22441 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:43.769131 25079 consensus_queue.cc:1059] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.131s
I20260709 12:17:43.937665 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:43.892798 24718 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:43.895763 25187 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:43.895133 25189 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:43.894760 25068 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:43.931154 25081 consensus_meta.cc:287] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 1.008s	user 0.010s	sys 0.001s
W20260709 12:17:43.953956 22395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1432) took 1400 ms (client timeout 1689 ms). Trace:
I20260709 12:17:43.773607 24891 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:43.917265 25001 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.937321 25157 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:43.927281 25196 raft_consensus.cc:697] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:43.814064 25166 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:43.967020 22395 rpcz_store.cc:269] 0709 12:17:42.553043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.559973 (+  6930us) service_pool.cc:224] Handling call
0709 12:17:43.953733 (+1393760us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54001e4454. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:43.953877 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605335808}
I20260709 12:17:43.961565 25187 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.967162 25068 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:43.963332 24946 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:44.019577 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:44.020728 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:43.962877 25099 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:44.023733 22395 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
W20260709 12:17:44.025206 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 131290us
I20260709 12:17:43.977751 25106 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:43.978848 25189 raft_consensus.cc:697] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:17:44.045495 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 107892us
I20260709 12:17:44.043952 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:44.050056 22395 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:17:44.050014 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:44.021922 25068 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:44.022198 24993 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:43.986388 25001 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:44.080135 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:44.080886 25084 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.000s	sys 0.011s
I20260709 12:17:44.029181 25085 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:44.042387 24690 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.019905 25187 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:44.139453 22393 consensus_meta.cc:287] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.528s	user 0.012s	sys 0.001s
I20260709 12:17:43.977836 25081 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:44.144618 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:43.980657 25157 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:44.191208 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:44.191923 22395 raft_consensus.cc:2376] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9. Re-sending same reply.
W20260709 12:17:44.192471 23094 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.043s	sys 0.044s
I20260709 12:17:44.149842 25189 consensus_queue.cc:237] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:44.145792 25084 raft_consensus.cc:697] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:44.154544 25192 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:44.197010 25192 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:44.157137 25194 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:17:44.157943 25203 log.cc:927] Time spent T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
W20260709 12:17:44.160001 25184 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.361s	user 0.000s	sys 0.001s
I20260709 12:17:44.163416 25197 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:44.169857 25209 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:44.042933 25210 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:44.147466 25195 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:44.193962 25157 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:44.147878 24993 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:44.180811 25196 consensus_queue.cc:237] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:44.182025 25105 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:44.186904 24891 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:44.188671 22393 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:17:44.029074 25188 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.117s
W20260709 12:17:44.148757 25191 log.cc:927] Time spent T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
W20260709 12:17:44.194380 23094 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.043s	sys 0.045s
W20260709 12:17:44.250650 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 592327us
I20260709 12:17:44.195451 25132 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:44.196004 25084 consensus_queue.cc:237] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:44.137740 25165 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:44.195065 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 50538.8us
I20260709 12:17:44.193892 25167 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:44.208765 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 156968us
I20260709 12:17:44.262452 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:44.175367 25208 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:44.174188 24690 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:44.233711 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 515988us
W20260709 12:17:44.252053 24922 consensus_meta.cc:287] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 1.100s	user 0.020s	sys 0.008s
I20260709 12:17:44.265353 22442 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:44.235414 23093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.000s	sys 0.005s
I20260709 12:17:44.243047 22399 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
W20260709 12:17:44.240768 24977 consensus_meta.cc:287] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 1.126s	user 0.022s	sys 0.004s
W20260709 12:17:44.259049 22402 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.001s	sys 0.011s
I20260709 12:17:44.204113 25085 consensus_queue.cc:1059] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:17:44.290230 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:44.282028 23093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.000s	sys 0.005s
I20260709 12:17:44.262059 25167 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.316485 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:44.324478 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:44.325237 22393 raft_consensus.cc:2393] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 8: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:44.326346 22393 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: []
W20260709 12:17:44.319872 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 57525.5us
I20260709 12:17:44.329025 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:44.319311 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 386214us
I20260709 12:17:44.316427 22473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1489) took 1300 ms. Trace:
I20260709 12:17:44.331943 22473 rpcz_store.cc:276] 0709 12:17:43.016013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.334111 (+318098us) service_pool.cc:224] Handling call
0709 12:17:43.334429 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:43.351238 (+ 16809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:43.351268 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:43.459547 (+108279us) log.cc:844] Serialized 26 byte log entry
0709 12:17:43.546092 (+ 86545us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:43.546135 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:43.546208 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:44.316199 (+769991us) raft_consensus.cc:1685] finished
0709 12:17:44.316220 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:44.316360 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1039,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":4102,"thread_start_us":52561,"threads_started":1,"wal-append.queue_time_us":109329}
I20260709 12:17:44.332955 22441 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:44.334796 25081 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:44.289737 24977 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8.
I20260709 12:17:44.289499 24922 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:44.290087 25001 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:44.286995 25224 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:44.369304 25219 consensus_queue.cc:1059] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.177s
I20260709 12:17:44.370725 25219 consensus_queue.cc:1243] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:44.371209 25219 raft_consensus.cc:3055] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:44.371568 25219 raft_consensus.cc:740] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:44.271384 25208 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:44.372072 25223 log.cc:927] Time spent T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:17:44.377518 25208 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:44.369232 25109 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:17:44.382736 25166 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:44.229661 25210 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:44.374222 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:17:44.388365 23095 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:44.388691 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 59752.7us
W20260709 12:17:44.383013 25179 consensus_meta.cc:287] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.819s	user 0.013s	sys 0.005s
I20260709 12:17:44.314841 25197 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:44.257093 25132 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:44.325465 25165 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:44.327061 25167 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:44.390316 23095 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:44.293025 25105 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:17:44.369521 24891 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:44.383809 25063 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:44.410625 22551 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:44.394685 25109 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.411262 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:44.312815 25215 raft_consensus.cc:2764] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:17:44.422875 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:44.431593 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:44.455634 22543 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:44.373914 24690 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:44.387359 24757 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.447410 22545 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
W20260709 12:17:44.451355 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:44.421370 24965 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:44.385454 25192 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:44.466070 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:44.478178 22542 raft_consensus.cc:2410] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:44.425845 25165 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:44.405308 25166 consensus_queue.cc:1059] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:17:44.472388 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:44.466429 25107 consensus_meta.cc:287] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 1.246s	user 0.006s	sys 0.005s
I20260709 12:17:44.478646 22366 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:44.467281 25155 consensus_meta.cc:287] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 1.227s	user 0.013s	sys 0.000s
W20260709 12:17:44.467469 25162 consensus_meta.cc:287] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.892s	user 0.008s	sys 0.003s
W20260709 12:17:44.463402 24838 consensus_meta.cc:287] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 1.379s	user 0.011s	sys 0.001s
I20260709 12:17:44.433084 25197 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:44.567577 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 110850us
I20260709 12:17:44.421983 25179 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:44.488481 24891 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:44.435103 25209 consensus_queue.cc:1059] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.135s
I20260709 12:17:44.576501 22543 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:44.466099 25063 raft_consensus.cc:697] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:17:44.488123 25160 consensus_meta.cc:287] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 1.028s	user 0.011s	sys 0.000s
I20260709 12:17:44.571473 25212 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
W20260709 12:17:44.507978 25168 consensus_meta.cc:287] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.985s	user 0.011s	sys 0.000s
I20260709 12:17:44.601337 22396 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 12:17:44.512547 25183 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.897s	user 0.004s	sys 0.000s
W20260709 12:17:44.567020 25229 log.cc:927] Time spent T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:17:44.487360 25165 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:44.515587 25180 consensus_meta.cc:287] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.939s	user 0.011s	sys 0.000s
W20260709 12:17:44.487931 24731 consensus_meta.cc:287] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.878s	user 0.010s	sys 0.006s
I20260709 12:17:44.466192 25109 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:44.604861 25233 log.cc:927] Time spent T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:17:44.606127 25132 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:44.606853 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 128310us
I20260709 12:17:44.476176 24690 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 12:17:44.513134 25068 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:44.612419 22474 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:44.509442 25210 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:44.475787 24757 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:44.601562 25126 consensus_meta.cc:287] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.768s	user 0.006s	sys 0.004s
I20260709 12:17:44.583897 24891 raft_consensus.cc:697] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:44.594277 25217 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:44.430122 25219 consensus_queue.cc:260] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:44.513517 24965 raft_consensus.cc:697] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 9 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:44.567080 25157 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:44.568987 25107 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:44.601758 25160 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:44.766391 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:44.769176 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:44.780751 22473 raft_consensus.cc:2393] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:44.769555 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:44.751572 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:17:44.677237 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 245699us
I20260709 12:17:44.574591 25155 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:44.793962 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:44.794795 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:44.607942 24993 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:44.645195 25180 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6.
I20260709 12:17:44.763207 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:44.807850 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:44.808672 25219 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:44.586342 24838 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:44.809854 22394 raft_consensus.cc:2393] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:44.811030 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:44.811446 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1410) took 1140 ms. Trace:
I20260709 12:17:44.811836 22394 rpcz_store.cc:276] 0709 12:17:43.671144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.671317 (+   173us) service_pool.cc:224] Handling call
0709 12:17:44.811235 (+1139918us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000b72d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:44.811386 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2515399424}
I20260709 12:17:44.813450 22395 raft_consensus.cc:1240] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:44.813635 22402 raft_consensus.cc:1240] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:17:44.814982 22470 raft_consensus.cc:2393] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:44.815418 22394 raft_consensus.cc:1240] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:44.816428 22476 raft_consensus.cc:2410] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:44.762405 25221 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:44.837869 22472 raft_consensus.cc:2376] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7. Re-sending same reply.
I20260709 12:17:44.839133 22401 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:44.829994 25217 raft_consensus.cc:697] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 7 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:44.801782 25126 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:44.842020 25126 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:44.762750 25232 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:44.762607 25234 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.875797 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:44.603973 25168 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:44.838557 25183 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:17:44.816756 25210 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:44.808269 25237 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:44.884205 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:44.785842 24731 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:44.838855 25215 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:17:44.873553 25195 consensus_meta.cc:287] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.000s
I20260709 12:17:44.876536 25221 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.945531 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:44.749910 25063 consensus_queue.cc:237] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:44.950639 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1418) took 1623 ms. Trace:
I20260709 12:17:44.955303 22550 rpcz_store.cc:276] 0709 12:17:43.327712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.329899 (+  2187us) service_pool.cc:224] Handling call
0709 12:17:43.330281 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:43.338915 (+  8634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:43.338935 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:43.347895 (+  8960us) log.cc:844] Serialized 26 byte log entry
0709 12:17:43.542103 (+194208us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:43.552079 (+  9976us) log.cc:844] Serialized 14 byte log entry
0709 12:17:43.552277 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:43.552349 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:44.511653 (+959304us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:44.950307 (+438654us) raft_consensus.cc:1685] finished
0709 12:17:44.950413 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:44.950568 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7493,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":15713,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":5928,"spinlock_wait_cycles":4641664,"thread_start_us":71602,"threads_started":1,"wal-append.queue_time_us":192307}
I20260709 12:17:44.949812 25195 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:44.949542 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:44.970157 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:44.878415 25234 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:44.862977 24891 consensus_queue.cc:237] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:44.935001 25085 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:44.945660 25187 consensus_meta.cc:287] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.741s	user 0.010s	sys 0.000s
I20260709 12:17:44.944363 25221 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:44.986799 22473 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:44.988298 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:44.880908 25208 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:45.002354 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.003253 22473 raft_consensus.cc:2393] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:45.006700 22476 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:17:44.920480 25210 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:45.036362 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.007481 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.038242 22477 raft_consensus.cc:2368] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6.
W20260709 12:17:45.032665 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 83204.1us
I20260709 12:17:45.039611 25244 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:44.922480 24965 consensus_queue.cc:237] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:45.039939 22441 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:44.989084 25085 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:44.988689 25187 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:45.093827 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 294778us
I20260709 12:17:45.056095 25155 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:45.050173 25244 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:45.124610 25168 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:45.037191 25234 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:45.123519 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 73224us
W20260709 12:17:45.128815 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.052521 25107 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:45.129122 22475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1716) took 3323 ms (client timeout 1751 ms). Trace:
I20260709 12:17:45.131109 25084 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.973935 25217 consensus_queue.cc:237] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:45.052910 25212 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:45.132656 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1784) took 2125 ms. Trace:
I20260709 12:17:45.131759 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:45.133900 25085 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:45.077816 25068 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:44.944031 25215 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:45.041196 25197 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:44.924889 25237 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:45.138717 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:45.139499 22367 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:45.140579 22546 rpcz_store.cc:276] 0709 12:17:42.998431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.998538 (+   107us) service_pool.cc:224] Handling call
0709 12:17:43.007962 (+  9424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:43.157570 (+149608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.122221 (+1964651us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b540042b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:45.123319 (+  1098us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321367680}
W20260709 12:17:45.132941 22475 rpcz_store.cc:269] 0709 12:17:41.793916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.944419 (+1150503us) service_pool.cc:224] Handling call
0709 12:17:45.117212 (+2172793us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b5400201cd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:45.117343 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137624448}
I20260709 12:17:45.140002 25209 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.140015 24757 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:45.128808 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:17:45.147899 25242 log.cc:927] Time spent T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:17:45.148921 24731 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:45.153403 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.122761 25236 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:45.142761 25245 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:45.150475 25135 consensus_meta.cc:287] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 1.533s	user 0.009s	sys 0.004s
W20260709 12:17:45.151836 24887 consensus_meta.cc:287] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 1.336s	user 0.010s	sys 0.002s
I20260709 12:17:45.157972 22367 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:45.161371 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:45.146081 25109 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:45.164098 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.168251 22475 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 1.
I20260709 12:17:45.170276 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:45.168970 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.172712 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 244) took 1404 ms. Trace:
I20260709 12:17:45.158241 25068 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:45.158365 25155 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:45.141850 25084 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:45.160674 23127 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 6 LEARNER]: Advancing to term 8
I20260709 12:17:45.149386 25246 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:45.175810 22395 rpcz_store.cc:276] 0709 12:17:43.768683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.232254 (+463571us) service_pool.cc:224] Handling call
0709 12:17:44.243515 (+ 11261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:44.813964 (+570449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.172466 (+358502us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b5400230fd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:45.172639 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1310329600}
I20260709 12:17:45.169207 24690 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:45.183665 22367 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:45.168529 25210 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:45.169430 24887 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:45.187479 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:45.188345 22395 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:45.188736 22367 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:45.175859 22475 raft_consensus.cc:2376] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5. Re-sending same reply.
I20260709 12:17:45.190755 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:45.189688 25256 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:45.192029 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:45.192055 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:45.190203 25155 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:45.187407 25180 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:45.194371 24832 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:45.194640 25215 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:45.192127 23095 leader_election.cc:336] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Timed out: RequestConsensusVote RPC to 127.20.191.1:37927 timed out after 1.992s (SENT)
I20260709 12:17:45.159433 25209 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:45.198362 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:45.175016 25236 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:45.167936 25135 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:45.151335 25212 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:45.190552 25165 consensus_meta.cc:287] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.004s
I20260709 12:17:45.202117 22367 leader_election.cc:400] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6.
I20260709 12:17:45.205060 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:45.214161 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:45.206943 24887 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:45.207865 25115 raft_consensus.cc:3055] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:45.202021 24690 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:45.202355 25208 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:45.209679 25134 consensus_meta.cc:287] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 1.555s	user 0.012s	sys 0.003s
I20260709 12:17:45.174279 25245 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:45.225168 25162 raft_consensus.cc:3055] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:45.225649 25162 raft_consensus.cc:740] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:45.226528 25162 consensus_queue.cc:260] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:45.228614 22399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1421) took 1549 ms. Trace:
I20260709 12:17:45.211308 25187 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:45.229085 22399 rpcz_store.cc:276] 0709 12:17:43.679388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.725336 (+ 45948us) service_pool.cc:224] Handling call
0709 12:17:44.242794 (+517458us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:44.270628 (+ 27834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.228361 (+957733us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54000a9950. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:45.228543 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189264128}
I20260709 12:17:45.235388 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:45.236129 22395 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:45.216989 25115 raft_consensus.cc:740] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:45.196893 25246 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:45.248692 25115 consensus_queue.cc:260] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:45.250113 22474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 1484) took 2267 ms (client timeout 2139 ms). Trace:
I20260709 12:17:45.250478 25115 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:45.250561 22474 rpcz_store.cc:269] 0709 12:17:42.983111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.171199 (+188088us) service_pool.cc:224] Handling call
0709 12:17:45.249901 (+2078702us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400394754. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:45.250037 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2842977664}
I20260709 12:17:45.260155 25160 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:45.237629 25162 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:45.268263 22470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 1481) took 4019 ms (client timeout 3049 ms). Trace:
W20260709 12:17:45.268776 22470 rpcz_store.cc:269] 0709 12:17:41.248454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.147106 (+1898652us) service_pool.cc:224] Handling call
0709 12:17:45.267999 (+2120893us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b5400211954. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:45.268173 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3761769728}
I20260709 12:17:45.274475 22470 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:17:45.274900 22470 pending_rounds.cc:85] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 2
I20260709 12:17:45.275167 22470 pending_rounds.cc:107] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:17:45.275420 22470 raft_consensus.cc:2889] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:45.278257 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43060 (request call id 210) took 1749 ms. Trace:
I20260709 12:17:45.216768 25165 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:45.221391 25134 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:45.299533 22394 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 7. Ops: [5.4-5.4]
I20260709 12:17:45.303232 25135 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:45.278707 22468 rpcz_store.cc:276] 0709 12:17:43.528900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.570931 (+ 42031us) service_pool.cc:224] Handling call
0709 12:17:43.571246 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:43.656490 (+ 85244us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:43.818135 (+161645us) log.cc:844] Serialized 14 byte log entry
0709 12:17:44.234533 (+416398us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:44.234595 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:44.234644 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.278018 (+1043374us) spinlock_profiling.cc:243] Waited 85 ms on lock 0x7b540023fad4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:45.278069 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:45.278194 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":473638,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":665,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"spinlock_wait_cycles":195439488,"thread_start_us":574017,"threads_started":2,"wal-append.queue_time_us":497442}
W20260709 12:17:45.281351 24732 consensus_meta.cc:287] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 1.338s	user 0.013s	sys 0.008s
I20260709 12:17:45.314446 22544 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:45.318884 22470 raft_consensus.cc:1240] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:45.307356 25134 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:45.309758 25212 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:45.318629 25219 consensus_meta.cc:287] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.004s
I20260709 12:17:45.314499 25081 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:45.318830 23127 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 8 LEARNER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:17:45.348592 22470 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:45.315677 24732 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:45.347016 25081 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:45.346029 25134 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.360755 22395 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:45.354384 25236 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:45.389907 25084 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:45.394238 25209 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:45.402460 25165 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:45.407446 25254 log.cc:927] Time spent T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.265s	user 0.000s	sys 0.002s
I20260709 12:17:45.409881 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:45.414587 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:45.419798 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:45.421254 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:45.423117 23127 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:17:45.424893 24690 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:45.426828 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:45.430037 22550 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:17:45.430663 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:45.429950 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:45.432955 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:45.431274 22547 raft_consensus.cc:2376] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6. Re-sending same reply.
W20260709 12:17:45.437583 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.438194 23095 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:45.433117 25157 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:45.440133 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:45.441169 22542 raft_consensus.cc:2368] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6.
W20260709 12:17:45.432463 25224 consensus_meta.cc:287] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 1.028s	user 0.004s	sys 0.009s
I20260709 12:17:45.365687 25134 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:45.413869 25167 consensus_meta.cc:287] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.972s	user 0.004s	sys 0.008s
I20260709 12:17:45.444272 22398 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:17:45.375046 25163 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:45.410141 25245 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:45.432073 25166 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.451141 22542 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:45.447886 25132 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.449851 24887 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:17:45.457437 25132 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:45.447520 25224 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:45.458462 25193 log.cc:927] Time spent T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 1.644s	user 0.003s	sys 0.000s
I20260709 12:17:45.461061 25132 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:45.462010 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.463913 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.464993 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.446000 25174 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:45.448643 24965 consensus_queue.cc:1059] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:17:45.439886 24690 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:17:45.466599 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:45.470667 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.473084 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.475183 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.475715 22471 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:45.479182 22473 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:45.482339 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:45.484571 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:45.490692 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:45.491284 22399 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:45.491163 23095 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:45.492182 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:45.492725 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:45.494469 22542 raft_consensus.cc:2410] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:45.493755 22397 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:45.468134 25174 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:45.495934 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:45.497133 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:45.497835 25081 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:45.497972 25080 consensus_queue.cc:1059] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:45.495992 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:45.501111 22397 raft_consensus.cc:2393] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:45.500440 22399 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:45.497157 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.502382 22470 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:45.500361 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:45.504458 22547 raft_consensus.cc:2376] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10. Re-sending same reply.
I20260709 12:17:45.504680 22474 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:45.505892 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.493790 25217 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:45.510458 22442 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:45.507817 22471 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:45.495879 25174 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:45.515473 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.516103 22470 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:45.517894 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:45.518713 22395 raft_consensus.cc:2393] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 8: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:45.450300 25167 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:45.519879 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.527736 22399 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:17:45.531030 25134 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:45.470101 25166 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:45.538398 23129 raft_consensus.cc:2393] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:45.538703 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.540256 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:45.540850 22542 raft_consensus.cc:2376] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7. Re-sending same reply.
I20260709 12:17:45.517340 25212 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.542024 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.551529 22474 raft_consensus.cc:2393] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:45.544257 22470 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:45.540182 24732 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:45.536005 25114 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:17:45.547407 25221 consensus_meta.cc:287] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.000s
I20260709 12:17:45.521013 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:45.552723 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.553031 22399 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:45.549842 25175 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.967s	user 0.014s	sys 0.016s
I20260709 12:17:45.570428 25166 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:45.571049 24838 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:45.554423 25212 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:45.568800 25175 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.013s	user 0.015s	sys 0.016s
I20260709 12:17:45.573127 25179 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:45.558312 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.551381 25245 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:45.555370 25162 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.560029 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:45.574806 25162 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:45.574703 25245 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:45.561026 25173 raft_consensus.cc:3055] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:45.563651 25174 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:45.568049 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1414) took 1892 ms. Trace:
I20260709 12:17:45.575187 23124 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:45.561985 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.568660 25221 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:45.601563 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.577215 25162 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:45.579090 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:45.579438 22396 rpcz_store.cc:276] 0709 12:17:43.675584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.713476 (+ 37892us) service_pool.cc:224] Handling call
0709 12:17:43.722829 (+  9353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:44.602223 (+879394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.567788 (+965565us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b54000b68d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:45.567979 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2019851136}
I20260709 12:17:45.580674 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:45.581234 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:45.606984 22546 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:45.581790 22551 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:45.582442 25246 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:45.581800 22543 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:45.583411 25174 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:45.573305 25212 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:45.578088 25173 raft_consensus.cc:740] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:45.588212 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:45.591923 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:45.592705 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:45.608006 22542 raft_consensus.cc:2393] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 8: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:45.608498 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.614845 22395 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:17:45.603721 25245 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:45.613020 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:45.622299 25173 consensus_queue.cc:260] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:45.625836 25173 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:45.635694 25167 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:45.639699 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.642743 25221 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:45.645398 24887 raft_consensus.cc:3055] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:45.645911 24887 raft_consensus.cc:740] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:45.646760 24887 consensus_queue.cc:260] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:45.648180 24887 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:45.660434 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:45.662032 25164 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.662680 25164 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:45.664307 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:45.665153 25164 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:45.666108 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:45.648104 25153 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:45.674398 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.677306 22549 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:45.674371 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:45.698305 22470 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:17:45.706406 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.710294 25201 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:17:45.696962 25190 consensus_queue.cc:1059] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:17:45.700572 25220 raft_consensus.cc:3055] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:45.718142 25220 raft_consensus.cc:740] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:45.720095 25220 consensus_queue.cc:260] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:45.721161 25220 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:45.722105 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:45.715639 22546 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:45.729794 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:45.734655 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.736961 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.737165 22468 raft_consensus.cc:1275] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:45.737891 22472 raft_consensus.cc:2393] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:45.708076 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:45.739171 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:45.739923 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.716944 23124 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:45.743337 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:45.745062 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.746526 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.746698 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:45.747226 22472 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:17:45.747426 22397 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:45.748442 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:45.749133 22397 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:17:45.750523 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:45.751255 22396 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:45.752354 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:45.753180 22397 raft_consensus.cc:2393] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:17:45.755365 25262 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.411s	user 0.003s	sys 0.000s
I20260709 12:17:45.757053 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.757835 22475 raft_consensus.cc:2393] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:45.758680 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.759224 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:45.761309 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.761752 22397 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:17:45.762423 22470 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:45.763921 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:45.764777 22396 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:45.765488 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.764066 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.758013 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41012 (request call id 250) took 1371 ms. Trace:
I20260709 12:17:45.766898 22475 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:45.768786 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:45.768761 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.769702 22397 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:45.770833 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.767735 23124 rpcz_store.cc:276] 0709 12:17:44.386349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.387478 (+  1129us) service_pool.cc:224] Handling call
0709 12:17:45.559857 (+1172379us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b58001c5698. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fe9c 00007fb4f5a2fa5b 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:45.751995 (+192138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3940224}
I20260709 12:17:45.779204 22544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1804) took 1354 ms. Trace:
I20260709 12:17:45.779708 22544 rpcz_store.cc:276] 0709 12:17:44.424681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.424817 (+   136us) service_pool.cc:224] Handling call
0709 12:17:44.440304 (+ 15487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:45.315022 (+874718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.778877 (+463855us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b5400178754. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:45.779125 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2009923840}
I20260709 12:17:45.785284 23129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41028 (request call id 366) took 1034 ms. Trace:
I20260709 12:17:45.785789 23129 rpcz_store.cc:276] 0709 12:17:44.750697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.750825 (+   128us) service_pool.cc:224] Handling call
0709 12:17:45.785074 (+1034249us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b540047c054. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:45.785218 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1743166208}
I20260709 12:17:45.791985 25168 raft_consensus.cc:3055] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:45.792464 25168 raft_consensus.cc:740] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:45.793264 25168 consensus_queue.cc:260] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:45.795204 25168 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:45.802240 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.803123 22400 raft_consensus.cc:1275] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:45.805955 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1423) took 1022 ms. Trace:
I20260709 12:17:45.806330 22394 rpcz_store.cc:276] 0709 12:17:44.783837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.951037 (+167200us) service_pool.cc:224] Handling call
0709 12:17:44.951446 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:45.299985 (+348539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.805697 (+505712us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b54001e4454. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:45.805900 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":799957376}
W20260709 12:17:45.810292 25276 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:17:45.811596 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:17:45.812515 23122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41012 (request call id 249) took 1426 ms (client timeout 1864 ms). Trace:
W20260709 12:17:45.812907 23122 rpcz_store.cc:269] 0709 12:17:44.386053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.387576 (+  1523us) service_pool.cc:224] Handling call
0709 12:17:45.811430 (+1423854us) spinlock_profiling.cc:243] Waited 7.98 ms on lock 0x7b58001c5698. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:45.812439 (+  1009us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18347776}
W20260709 12:17:45.816359 25239 log.cc:927] Time spent T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.392s	user 0.002s	sys 0.000s
I20260709 12:17:45.818055 22402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 248) took 1341 ms. Trace:
I20260709 12:17:45.818470 22402 rpcz_store.cc:276] 0709 12:17:44.476176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.485819 (+  9643us) service_pool.cc:224] Handling call
0709 12:17:44.813406 (+327587us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:44.814113 (+   707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.817868 (+1003755us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54000b72d0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:45.817997 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752489856}
I20260709 12:17:45.819787 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1451) took 1529 ms. Trace:
I20260709 12:17:45.821127 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.820155 22393 rpcz_store.cc:276] 0709 12:17:44.290695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.327064 (+ 36369us) service_pool.cc:224] Handling call
0709 12:17:44.327374 (+   310us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:44.327711 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:44.327737 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:44.373373 (+ 45636us) log.cc:844] Serialized 52 byte log entry
0709 12:17:44.585462 (+212089us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:44.952288 (+366826us) log.cc:844] Serialized 14 byte log entry
0709 12:17:45.037510 (+ 85222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.037590 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:45.423657 (+386067us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b18000a8ac0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:17:45.815826 (+392169us) spinlock_profiling.cc:243] Waited 8.22 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:45.819588 (+  3762us) raft_consensus.cc:1685] finished
0709 12:17:45.819609 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:45.819733 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":152625,"prepare.queue_time_us":131011,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":100036,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":1762,"spinlock_wait_cycles":24113792,"thread_start_us":402901,"threads_started":2,"wal-append.queue_time_us":617633}
I20260709 12:17:45.822525 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.823434 22473 raft_consensus.cc:2393] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:45.818557 25173 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:45.803469 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.826730 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.827390 22475 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:45.828217 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.829330 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.831249 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:45.886775 22548 raft_consensus.cc:2393] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 8: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:45.834468 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1727) took 1063 ms. Trace:
I20260709 12:17:45.887156 22476 rpcz_store.cc:276] 0709 12:17:44.770543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.817156 (+ 46613us) service_pool.cc:224] Handling call
0709 12:17:45.834309 (+1017153us) spinlock_profiling.cc:243] Waited 82 ms on lock 0x7b5400160154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:45.834408 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188590336}
I20260709 12:17:45.835259 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 240) took 2075 ms. Trace:
I20260709 12:17:45.888182 22401 rpcz_store.cc:276] 0709 12:17:43.760240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.760352 (+   112us) service_pool.cc:224] Handling call
0709 12:17:43.760669 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:44.857910 (+1097241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.835045 (+977135us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000b5ed4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:45.835201 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2479865600}
I20260709 12:17:45.836267 24679 consensus_queue.cc:1059] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:45.837723 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:45.840864 22366 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:45.841375 22399 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:17:45.843945 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:45.899598 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.844295 25220 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:45.845131 22367 leader_election.cc:336] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.173s (SENT)
I20260709 12:17:45.845736 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.901618 22474 raft_consensus.cc:2376] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8. Re-sending same reply.
I20260709 12:17:45.845997 22400 raft_consensus.cc:1240] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 7. Current term is 8. Ops: []
W20260709 12:17:45.846781 22469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 1478) took 4628 ms (client timeout 1652 ms). Trace:
I20260709 12:17:45.847661 25219 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.847481 25208 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:45.848986 25237 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:45.849617 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:17:45.850116 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.931391 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.931538 22548 raft_consensus.cc:1275] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:45.851763 23125 raft_consensus.cc:1240] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:45.855302 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.855723 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.856632 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:45.858666 22549 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:45.859714 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:45.860402 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1725) took 1090 ms. Trace:
I20260709 12:17:45.938915 22477 rpcz_store.cc:276] 0709 12:17:44.770070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.039066 (+268996us) service_pool.cc:224] Handling call
0709 12:17:45.039418 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:45.422474 (+383056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:45.422504 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:45.422998 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:17:45.517723 (+ 94725us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:45.541551 (+ 23828us) log.cc:844] Serialized 14 byte log entry
0709 12:17:45.784689 (+243138us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b18003e4b20. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a67522 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:17:45.858301 (+ 73612us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b18003e4b20. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f59e1c0a 00007fb4ff121219 00007fb4f5a69a40 00007fb4f5a644e4 00007fb4f5a64455 00007fb4f8b4c060 00007fb4f8b5e716 00007fb4f8b6f287 00007fb4f8b6f208
0709 12:17:45.858466 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.860136 (+  1670us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b5400110154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:45.860176 (+    40us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:45.860226 (+    50us) raft_consensus.cc:1685] finished
0709 12:17:45.860238 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:45.860347 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8964,"prepare.queue_time_us":23827,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":324728,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":175,"spinlock_wait_cycles":885699456,"thread_start_us":94174,"threads_started":1,"wal-append.queue_time_us":132429}
I20260709 12:17:45.863806 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:45.941182 22543 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:45.865510 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 322339us
I20260709 12:17:45.866214 22546 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:17:45.942677 22546 pending_rounds.cc:85] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 6
I20260709 12:17:45.942927 22546 pending_rounds.cc:107] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:17:45.943167 22546 raft_consensus.cc:2889] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:45.867496 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:45.944433 22542 raft_consensus.cc:2410] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:17:45.868536 22398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1404) took 4003 ms (client timeout 1959 ms). Trace:
W20260709 12:17:45.876809 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.885550 22470 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
W20260709 12:17:45.903575 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 58479.9us
I20260709 12:17:45.868156 25114 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:17:45.902691 22469 rpcz_store.cc:269] 0709 12:17:41.218232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.218459 (+   227us) service_pool.cc:224] Handling call
0709 12:17:45.846570 (+4628111us) spinlock_profiling.cc:243] Waited 4.54 s on lock 0x7b54003e3354. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:45.846685 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10441625856}
I20260709 12:17:45.926344 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:45.927346 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 86547.3us
I20260709 12:17:45.948366 22366 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:45.928475 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.932538 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.948860 22547 raft_consensus.cc:2368] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7.
I20260709 12:17:45.949088 22367 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
W20260709 12:17:45.945106 22398 rpcz_store.cc:269] 0709 12:17:41.864763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.123208 (+258445us) service_pool.cc:224] Handling call
0709 12:17:45.856209 (+3733001us) spinlock_profiling.cc:243] Waited 3.18 s on lock 0x7b54000375d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:45.868439 (+ 12230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7318592896}
I20260709 12:17:45.950346 22367 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:45.933394 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:45.934754 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.935319 22471 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:45.952803 22469 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:45.867918 24946 consensus_queue.cc:1059] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:17:45.949291 22472 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:45.932804 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:45.953290 22471 raft_consensus.cc:1240] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:45.953433 22475 raft_consensus.cc:2393] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:45.954131 22469 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 7. Ops: [5.4-5.4]
I20260709 12:17:45.946163 22470 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:45.930398 25013 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:45.961854 22469 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:17:45.962212 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 112657us
W20260709 12:17:45.963907 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 230251us
I20260709 12:17:45.964488 22472 raft_consensus.cc:1240] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:45.969237 22441 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:45.952646 22297 catalog_manager.cc:5697] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:45.974988 22367 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:46.002302 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:46.003118 22549 raft_consensus.cc:2410] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:46.000150 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:46.004958 22297 catalog_manager.cc:5697] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:46.028306 22551 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:46.006563 22297 catalog_manager.cc:5697] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 5 to 6, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 6 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:46.011430 23094 leader_election.cc:400] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7.
I20260709 12:17:46.029515 23094 leader_election.cc:403] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:17:46.029671 22470 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:17:46.015029 22543 raft_consensus.cc:2410] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:17:46.009259 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.029929 22297 catalog_manager.cc:5697] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:46.003479 22367 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:45.976795 22442 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:46.005395 25132 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:46.032051 22297 catalog_manager.cc:5697] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 1 to 5, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 5 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:46.010347 22474 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:45.975266 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:45.973964 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41012 (request call id 248) took 1579 ms. Trace:
I20260709 12:17:45.931566 25219 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:46.031867 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 62720.2us
I20260709 12:17:45.930063 25220 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:46.047333 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:45.932060 25208 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:46.036543 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.040583 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:46.042735 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:46.052096 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:46.001811 25076 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:46.044245 22367 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
W20260709 12:17:45.968633 25149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.299s	user 0.015s	sys 0.055s
I20260709 12:17:46.035812 22297 catalog_manager.cc:5697] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:17:46.054194 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 77475us
I20260709 12:17:46.062314 22442 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:45.974216 24718 consensus_queue.cc:1059] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:17:45.965233 25068 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:46.028846 25237 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:46.061463 22297 catalog_manager.cc:5697] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 5 to 6, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 6 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:17:46.036988 25198 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:46.065876 22475 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:46.064797 22367 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:46.066745 22473 raft_consensus.cc:1240] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:46.076190 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:45.958961 25187 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:46.073378 22543 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:17:46.055537 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.057139 24748 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:46.077199 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.999794 24922 consensus_queue.cc:1059] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:17:45.998421 24887 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:17:46.028645 24965 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 12:17:46.104053 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 60461.7us
I20260709 12:17:46.061942 25013 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:17:46.109416 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 44704.9us
I20260709 12:17:46.114799 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:46.110059 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.116465 22367 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:46.113992 22441 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:46.117466 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:46.054030 25188 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7.
W20260709 12:17:46.067196 25282 log.cc:927] Time spent T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.178s	user 0.000s	sys 0.005s
I20260709 12:17:46.064188 25153 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:46.122010 22441 leader_election.cc:400] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 5. Current term is 6.
W20260709 12:17:46.120358 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 45323.8us
I20260709 12:17:46.146395 22442 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:46.143833 25068 raft_consensus.cc:697] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:46.148619 22442 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:46.133898 22516 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
W20260709 12:17:46.060796 25149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.391s	user 0.015s	sys 0.062s
I20260709 12:17:46.114076 24938 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.078488 24946 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.109812 25187 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:46.111094 24748 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:46.143765 23129 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:46.056542 25132 raft_consensus.cc:697] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:17:46.159992 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 43602.5us
I20260709 12:17:46.067865 25076 raft_consensus.cc:697] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:46.114437 25013 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.104310 25237 raft_consensus.cc:697] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:46.144652 25168 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.158838 25187 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:46.140388 25196 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.165795 22367 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:46.162449 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:46.157229 22442 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:46.119776 25148 consensus_queue.cc:1048] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:17:46.168695 22441 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:46.161417 25136 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.162777 25190 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:46.174196 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:46.183640 22542 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 6: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:46.184091 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:46.184976 22547 raft_consensus.cc:2410] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:46.176666 22516 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:46.159696 25015 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:46.160409 24748 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:46.140799 25224 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:17:46.163468 25079 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.111948 25114 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:46.167426 25013 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:46.202256 22296 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50176 (request call id 184) took 17487 ms (client timeout 15000 ms). Trace:
I20260709 12:17:46.036899 23125 rpcz_store.cc:276] 0709 12:17:44.385433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.387608 (+  2175us) service_pool.cc:224] Handling call
0709 12:17:45.851353 (+1463745us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b58001c5698. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2feee 000000000036eb39 00007fb4fdaa31e0 00007fb4fdb6c0c4 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:17:45.851541 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:45.952603 (+101062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.965141 (+ 12538us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5154176}
I20260709 12:17:46.208297 22441 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:46.209564 25277 log.cc:927] Time spent T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:17:46.145704 25153 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.205039 24993 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 12:17:46.245056 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.245155 25153 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:46.246349 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:46.246646 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:46.247386 22400 raft_consensus.cc:2393] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:46.209972 24938 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:17:46.247588 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:46.248709 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:46.249663 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:46.245985 22366 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:46.250650 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:46.251632 22366 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:46.253015 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:46.217942 25097 consensus_queue.cc:1059] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:46.253597 25237 consensus_queue.cc:237] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:46.254180 24993 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:46.255000 24993 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.246198 24679 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:17:46.256574 25192 raft_consensus.cc:3055] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:17:46.256910 25283 log.cc:927] Time spent T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:17:46.246345 25076 consensus_queue.cc:237] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:46.258401 25220 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:46.209807 25219 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:46.193342 25157 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:46.226141 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:46.229696 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:46.118651 25106 consensus_queue.cc:1059] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:17:46.183315 25190 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:46.193825 24718 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:46.234262 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:46.234649 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:46.235847 22393 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:46.229214 24946 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.273645 25148 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.237090 22401 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:17:46.237679 25281 log.cc:927] Time spent T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:17:46.262605 22394 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:17:46.238759 25208 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:46.239655 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.279876 22547 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:46.185278 24977 consensus_queue.cc:1059] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:17:46.280893 24977 raft_consensus.cc:3055] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:46.281255 24977 raft_consensus.cc:740] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:46.281394 22547 raft_consensus.cc:1275] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:46.234112 25068 consensus_queue.cc:237] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:46.251818 22544 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:46.282927 25097 raft_consensus.cc:3055] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:46.283352 25097 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:46.218575 25212 consensus_queue.cc:1048] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:46.268890 22366 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:46.261257 22542 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:46.245986 25015 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:46.280126 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:46.326646 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 57854.8us
I20260709 12:17:46.327692 22366 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:46.278776 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 70576.7us
I20260709 12:17:46.255182 25104 raft_consensus.cc:3055] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:46.333979 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:46.260500 24993 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.267813 25134 raft_consensus.cc:3055] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:46.346130 25208 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.345899 24977 consensus_queue.cc:260] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:46.216317 22296 rpcz_store.cc:269] 0709 12:17:28.702968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.703243 (+   275us) service_pool.cc:224] Handling call
0709 12:17:28.842259 (+139016us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b540038b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abe090 00007fb4f8b5cf3a 00007fb4fe912e9c 00007fb4fea1104e 00007fb4fced22a4 00007fb4fced2232 00007fb4fced2161 00007fb4fced20dc 00007fb4fced1392 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:46.190385 (+17348126us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:39.996025 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:40.047710 (+ 51685us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:40.047770 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:17:40.047804 (+    34us) tablet.cc:662] Decoding operations
0709 12:17:40.049486 (+  1682us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:40.049603 (+   117us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:40.049630 (+    27us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:17:40.050757 (+  1127us) tablet.cc:701] Row locks acquired
0709 12:17:40.050805 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:17:40.051021 (+   216us) write_op.cc:270] Start()
0709 12:17:40.051183 (+   162us) write_op.cc:276] Timestamp: P: 1783599460050948 usec, L: 0
0709 12:17:40.051202 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:17:40.052028 (+   826us) log.cc:844] Serialized 5534 byte log entry
0709 12:17:40.621457 (+569429us) op_driver.cc:464] REPLICATION: finished
0709 12:17:40.815485 (+194028us) write_op.cc:301] APPLY: starting
0709 12:17:40.828848 (+ 13363us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:40.870767 (+ 41919us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:40.870906 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:40.872747 (+  1841us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:40.873210 (+   463us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:17:40.873268 (+    58us) write_op.cc:312] APPLY: finished
0709 12:17:40.972497 (+ 99229us) log.cc:844] Serialized 100 byte log entry
0709 12:17:41.003924 (+ 31427us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:41.033841 (+ 29917us) write_op.cc:454] Released schema lock
0709 12:17:41.070677 (+ 36836us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:41.235911 (+165234us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:41.266006 (+ 30095us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":630361,"reported_tablets":50,"spinlock_wait_cycles":67673984,"child_traces":[["op",{"apply.queue_time_us":159186,"apply.run_cpu_time_us":5020,"apply.run_wall_time_us":380728,"num_ops":14,"prepare.queue_time_us":373575,"prepare.run_cpu_time_us":41092,"prepare.run_wall_time_us":173282,"raft.queue_time_us":221248,"raft.run_cpu_time_us":20178,"raft.run_wall_time_us":100380,"replication_time_us":552559,"thread_start_us":1024730,"threads_started":4,"wal-append.queue_time_us":248204,"wal-append.run_cpu_time_us":44779,"wal-append.run_wall_time_us":1680590}]]}
I20260709 12:17:46.257659 25132 consensus_queue.cc:237] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:46.346647 25208 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:46.348387 25079 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:46.348815 25208 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:46.325870 25097 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:46.350529 25097 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.354664 25224 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:46.358930 24838 raft_consensus.cc:3055] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:46.359440 24838 raft_consensus.cc:740] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:46.360312 24838 consensus_queue.cc:260] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:46.331727 25104 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:46.331235 25226 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:46.332455 25157 raft_consensus.cc:697] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:46.338819 25236 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.279140 25099 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.261454 25192 raft_consensus.cc:740] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:46.281570 24718 raft_consensus.cc:697] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:46.246089 25188 consensus_queue.cc:1059] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 12:17:46.338507 25149 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.381075 22401 raft_consensus.cc:1240] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:17:46.382584 22542 raft_consensus.cc:2410] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:46.383026 22366 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:46.277155 25190 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:46.278891 25148 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:46.343065 22441 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:46.329591 25015 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:46.361738 24838 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:46.414641 22366 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:46.386962 24977 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:46.417681 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 74704.6us
I20260709 12:17:46.424553 22441 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:46.426229 22366 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:46.426124 22441 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:46.384034 25134 raft_consensus.cc:740] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:46.441788 22366 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:46.417045 25079 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.454349 25079 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:46.455062 25079 consensus_queue.cc:1243] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:46.423429 24993 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.432837 25136 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.450445 24269 consensus_queue.cc:1048] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:46.460068 24269 consensus_queue.cc:1243] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:46.431453 25212 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.430701 24946 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.372550 25104 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:46.437738 25149 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:46.440048 25236 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:46.465196 24938 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:46.524443 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.465685 25168 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:46.471165 25212 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:46.540555 25212 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:46.541914 25187 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:46.544396 25187 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:46.548830 22400 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:46.465420 25226 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
W20260709 12:17:46.556468 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 380055us
W20260709 12:17:46.563611 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:46.383719 25196 consensus_queue.cc:1175] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b8621fa34be04d3fa2d68a300f858cd1" responder_term: 7 status { last_received { term: 6 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:46.470204 24748 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:46.566918 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.549417 25104 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.555821 25220 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.565171 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:46.583055 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:46.587531 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.468056 25157 consensus_queue.cc:237] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:46.579746 22516 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:46.488523 25192 consensus_queue.cc:260] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:46.602701 22470 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:46.521037 24718 consensus_queue.cc:237] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:46.609310 22477 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:17:46.601850 25189 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:46.618117 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.600394 25208 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:46.622179 22442 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:46.623826 24946 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.625104 22442 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:46.625936 25114 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.626462 25212 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:46.609601 25219 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:46.630261 25219 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.556468 25134 consensus_queue.cc:260] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:46.630280 24946 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:46.630736 25219 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:46.637903 25290 consensus_queue.cc:1059] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:46.640107 25153 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:46.642043 22393 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:17:46.642732 25136 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:46.612232 24679 consensus_queue.cc:1059] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 12:17:46.687186 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 234741us
I20260709 12:17:46.655391 25134 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:46.629190 25189 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:46.725622 22395 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: []
W20260709 12:17:46.732139 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 272122us
W20260709 12:17:46.733747 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 45777.1us
I20260709 12:17:46.737643 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:46.742215 22469 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:46.660838 25015 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:46.754354 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 83431us
I20260709 12:17:46.663723 25148 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:46.763068 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:46.760778 23095 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:46.772135 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 165908us
I20260709 12:17:46.774536 22474 raft_consensus.cc:1275] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:46.779527 22366 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:46.773945 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:46.782963 22548 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:46.784591 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:46.785069 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:46.788367 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:46.788986 22468 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:46.793401 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:46.804685 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:46.689567 25208 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 12:17:46.824859 22473 raft_consensus.cc:2410] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:46.815445 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:17:46.820641 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.821779 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:46.822412 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.826627 22543 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
W20260709 12:17:46.798882 25076 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.044s	sys 0.048s
W20260709 12:17:46.829843 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 45219.8us
I20260709 12:17:46.789533 25187 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:46.753836 25224 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
W20260709 12:17:46.834607 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 78281.2us
I20260709 12:17:46.787770 24946 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:46.847301 22548 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:46.848663 22542 raft_consensus.cc:1275] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:46.851298 22542 raft_consensus.cc:1217] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[5.3-9.5]   Dedup: 5.3->[7.4-9.5]
I20260709 12:17:46.851771 22542 pending_rounds.cc:85] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 3
I20260709 12:17:46.852006 22542 pending_rounds.cc:107] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:17:46.810531 24732 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:46.852228 22542 raft_consensus.cc:2889] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:46.852840 22547 pending_rounds.cc:85] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 1
I20260709 12:17:46.823016 25293 raft_consensus.cc:3055] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:17:46.836014 25076 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.044s	sys 0.048s
W20260709 12:17:46.865904 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 53585us
I20260709 12:17:46.871537 22547 pending_rounds.cc:107] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:17:46.772598 25292 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 12:17:46.813544 25299 consensus_queue.cc:1059] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 12:17:46.823381 25245 consensus_queue.cc:1059] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:17:46.788261 24938 consensus_queue.cc:1059] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:17:46.884742 24269 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:46.853330 25237 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.886399 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:46.838690 25153 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:46.859403 25238 raft_consensus.cc:3055] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:46.891700 22547 raft_consensus.cc:2889] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:46.778851 25068 consensus_queue.cc:1048] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:17:46.854087 25232 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:46.869837 22516 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:46.896536 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:46.948844 22543 raft_consensus.cc:2410] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:46.854823 25290 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.868274 25293 raft_consensus.cc:740] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:17:46.892936 25294 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:17:46.892232 25310 raft_consensus.cc:2764] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:17:46.889113 25317 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:46.958359 25187 consensus_queue.cc:1048] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:17:46.889484 24732 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:46.861544 24946 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:46.919680 25015 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:17:46.935544 25238 raft_consensus.cc:740] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:46.980963 25148 raft_consensus.cc:3055] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:47.005190 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:47.005787 22474 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:46.991269 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 63060.4us
I20260709 12:17:46.944654 25237 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:46.979946 25289 log.cc:927] Time spent T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.352s	user 0.000s	sys 0.001s
I20260709 12:17:46.899675 25097 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 12:17:46.987646 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:17:47.036299 25301 log.cc:927] Time spent T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:17:47.037544 25303 log.cc:927] Time spent T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:17:47.038843 25187 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:47.039083 22545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1814) took 1091 ms. Trace:
I20260709 12:17:47.039687 25189 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:47.039409 25187 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:47.040632 25114 raft_consensus.cc:3055] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:47.041111 25114 raft_consensus.cc:740] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:47.042029 25293 consensus_queue.cc:260] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:47.011978 25148 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:47.045082 25148 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:47.046286 25148 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:47.039461 22545 rpcz_store.cc:276] 0709 12:17:45.947396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.006105 (+ 58709us) service_pool.cc:224] Handling call
0709 12:17:46.006401 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:46.006717 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:46.006744 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:46.355289 (+348545us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b2c001328c8. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f744da11 00007fb4f745d372 00007fb4f8b8fa01 00007fb4f8b5443a 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2
0709 12:17:46.355756 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 12:17:46.653169 (+297413us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:46.653205 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:46.653288 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:47.038791 (+385503us) raft_consensus.cc:1685] finished
0709 12:17:47.038811 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.039022 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4088,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":4674,"spinlock_wait_cycles":8089344,"thread_start_us":297046,"threads_started":1,"wal-append.queue_time_us":539987}
I20260709 12:17:47.051703 22401 raft_consensus.cc:1275] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:47.009478 22367 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:47.012441 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.969363 25313 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
W20260709 12:17:47.041900 25297 log.cc:927] Time spent T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 12:17:47.097443 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 88050.6us
W20260709 12:17:47.104028 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.065717 25290 raft_consensus.cc:3055] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:47.108162 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:47.128593 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 277801us
I20260709 12:17:47.025353 25219 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:47.098497 25153 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:47.083667 25292 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:47.042034 25114 consensus_queue.cc:260] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:47.157253 25311 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:47.237171 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 126033us
I20260709 12:17:47.118494 25290 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:47.232043 22401 raft_consensus.cc:2410] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:47.247866 22474 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:17:47.284507 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43060 (request call id 220) took 1242 ms. Trace:
I20260709 12:17:47.285002 22471 rpcz_store.cc:276] 0709 12:17:46.041814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.041927 (+   113us) service_pool.cc:224] Handling call
0709 12:17:46.042231 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:46.074407 (+ 32176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:46.074437 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:46.103470 (+ 29033us) log.cc:844] Serialized 26 byte log entry
0709 12:17:46.394931 (+291461us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:46.394979 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:46.395057 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:47.284281 (+889224us) raft_consensus.cc:1685] finished
0709 12:17:47.284301 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.284442 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39099,"raft.queue_time_us":31965,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":25040,"thread_start_us":254758,"threads_started":1,"wal-append.queue_time_us":457885}
I20260709 12:17:47.174758 24946 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:47.236073 25153 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:47.248390 25013 consensus_meta.cc:287] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 1.013s	user 0.013s	sys 0.007s
I20260709 12:17:47.304338 25114 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:47.304791 25153 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:47.346591 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.325718 25323 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:47.287916 25311 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:47.345001 25237 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:47.327854 25013 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:47.381138 25013 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:47.382352 25326 log.cc:927] Time spent T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:17:47.387825 25317 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:47.388466 25317 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:47.373238 25323 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:47.392504 25317 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:47.393276 25323 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:47.394212 25306 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.383s	user 0.000s	sys 0.001s
I20260709 12:17:47.398727 25219 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:47.394634 24732 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:47.397953 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:47.369603 25187 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:47.400777 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.411639 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 260) took 1031 ms. Trace:
I20260709 12:17:47.412107 22393 rpcz_store.cc:276] 0709 12:17:46.380682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.381140 (+   458us) service_pool.cc:224] Handling call
0709 12:17:46.381419 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:46.642482 (+261063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.411332 (+768850us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54000a9e54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:47.411568 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598835200}
I20260709 12:17:47.419130 22393 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:47.414531 25295 log.cc:927] Time spent T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.625s	user 0.000s	sys 0.002s
I20260709 12:17:47.375810 25315 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:47.417739 25300 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.279s	user 0.007s	sys 0.002s
W20260709 12:17:47.415347 25304 log.cc:927] Time spent T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
W20260709 12:17:47.434602 25104 consensus_meta.cc:287] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.856s	user 0.011s	sys 0.000s
W20260709 12:17:47.437295 24977 consensus_meta.cc:287] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 1.005s	user 0.010s	sys 0.000s
I20260709 12:17:47.438277 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 257) took 1242 ms. Trace:
I20260709 12:17:47.438791 22398 rpcz_store.cc:276] 0709 12:17:46.201532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.201658 (+   126us) service_pool.cc:224] Handling call
0709 12:17:46.231528 (+ 29870us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:46.231757 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:46.231782 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:46.261953 (+ 30171us) log.cc:844] Serialized 26 byte log entry
0709 12:17:46.654681 (+392728us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:46.654720 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:46.654819 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:47.389370 (+734551us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:47.437868 (+ 48498us) raft_consensus.cc:1685] finished
0709 12:17:47.437899 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.438182 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11520768,"thread_start_us":315065,"threads_started":1,"wal-append.queue_time_us":699749}
I20260709 12:17:47.443186 25311 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:47.425295 25190 consensus_meta.cc:287] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.994s	user 0.013s	sys 0.007s
W20260709 12:17:47.448333 22516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.020s	sys 0.022s
W20260709 12:17:47.449731 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 600611us
I20260709 12:17:47.456279 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:47.463135 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 262) took 1001 ms. Trace:
I20260709 12:17:47.463366 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1493) took 1974 ms. Trace:
I20260709 12:17:47.463616 22400 rpcz_store.cc:276] 0709 12:17:46.462056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.462409 (+   353us) service_pool.cc:224] Handling call
0709 12:17:46.516648 (+ 54239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:46.556210 (+ 39562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.462844 (+906634us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b540006ed54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:47.463062 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73586944}
I20260709 12:17:47.469619 22477 rpcz_store.cc:276] 0709 12:17:45.488830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.940897 (+452067us) service_pool.cc:224] Handling call
0709 12:17:45.951812 (+ 10915us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:46.610790 (+658978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.463137 (+852347us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54003098d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:47.463308 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1508123904}
I20260709 12:17:47.471376 25338 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.472003 25338 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:47.474460 25338 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:47.479758 24946 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:47.480424 24946 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:47.481525 22367 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:47.483484 24946 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:47.484035 25168 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:47.484520 25168 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:47.488546 22366 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:47.484503 25338 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:47.489187 22367 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:47.512908 22442 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:47.522310 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:47.535290 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:47.552815 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 96600.4us
W20260709 12:17:47.552896 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 64429.5us
I20260709 12:17:47.554356 22366 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:47.553889 22516 leader_election.cc:400] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7.
I20260709 12:17:47.555148 22516 leader_election.cc:403] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:17:47.555666 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:47.557543 22402 raft_consensus.cc:2393] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:17:47.556422 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 43595.4us
W20260709 12:17:47.564601 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 97613.7us
I20260709 12:17:47.561177 22550 raft_consensus.cc:1275] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:47.568233 22550 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:47.568306 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:47.568780 22550 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:47.570366 22550 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:47.471558 25290 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:47.571262 22550 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:47.563064 22366 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:47.578374 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:47.591715 22545 raft_consensus.cc:2393] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:47.598894 22516 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:47.558954 25338 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:47.563992 25237 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:47.559655 24977 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:47.605294 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:47.661019 22545 raft_consensus.cc:2393] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:17:47.565397 25291 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.045s	sys 0.056s
I20260709 12:17:47.559208 25104 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:47.559427 25097 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:47.590945 25173 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7.
I20260709 12:17:47.560075 24732 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:47.567015 25132 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.011s	sys 0.046s
W20260709 12:17:47.638662 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.559428 25322 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:47.563992 25220 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:47.572142 25187 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:47.452064 25190 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:47.730811 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1477) took 1458 ms. Trace:
I20260709 12:17:47.731273 22395 rpcz_store.cc:276] 0709 12:17:46.273257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.273370 (+   113us) service_pool.cc:224] Handling call
0709 12:17:46.278319 (+  4949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:46.726235 (+447916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.730411 (+1004176us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b54002da354. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:47.730743 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1028115712}
W20260709 12:17:47.703470 25132 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.012s	sys 0.047s
W20260709 12:17:47.732765 25336 log.cc:927] Time spent T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
W20260709 12:17:47.662164 25291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.045s	sys 0.060s
W20260709 12:17:47.735148 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.678254 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:47.686213 23129 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:47.684190 22550 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:17:47.738910 22550 pending_rounds.cc:85] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 4
I20260709 12:17:47.739202 22550 pending_rounds.cc:107] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:17:47.739454 22550 raft_consensus.cc:2889] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:47.610526 25323 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:47.561499 24946 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 12:17:47.446486 25315 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:47.674335 25292 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:47.743765 22545 raft_consensus.cc:1240] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:47.662483 25338 raft_consensus.cc:697] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:47.685315 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:47.722878 25337 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:47.734833 25318 log.cc:927] Time spent T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.122s	user 0.000s	sys 0.003s
I20260709 12:17:47.688928 25097 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:47.734761 25173 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:47.742990 25115 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.676518 24977 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:47.742424 25323 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:47.689142 25104 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:47.765370 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 166546us
I20260709 12:17:47.734334 25220 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:47.771134 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:47.778263 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.742074 25153 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:47.785377 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.782447 22516 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:47.787850 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:47.792919 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:47.770756 25323 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:47.797986 22516 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:47.761580 25337 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:47.791394 25322 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:47.786155 25344 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:47.799384 24838 consensus_meta.cc:287] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 1.367s	user 0.012s	sys 0.000s
I20260709 12:17:47.769533 25115 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:47.782394 25245 consensus_queue.cc:1059] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:17:47.769124 25173 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:47.840469 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 275838us
W20260709 12:17:47.827272 23095 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.015s	sys 0.002s
W20260709 12:17:47.919822 23095 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.018s	sys 0.005s
W20260709 12:17:47.917382 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 119490us
W20260709 12:17:47.876281 25114 consensus_meta.cc:287] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.002s
I20260709 12:17:47.871318 25104 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:47.926605 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:47.931793 23124 raft_consensus.cc:2393] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 2: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:47.799172 25331 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:47.871965 25345 log.cc:927] Time spent T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 12:17:47.872677 25348 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:17:47.926577 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:17:47.929059 25148 consensus_meta.cc:287] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.882s	user 0.008s	sys 0.004s
I20260709 12:17:47.874228 24977 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:47.943205 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:47.944346 22516 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:47.946556 22401 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:47.948204 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:47.948474 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:47.803471 25168 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:47.842585 25356 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:47.950564 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:47.951004 22393 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:47.966876 24977 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.974267 25337 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:47.974393 24977 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:47.821592 25338 consensus_queue.cc:237] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:47.975343 24748 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:47.975534 25365 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:47.976197 25365 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:47.976557 24977 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:47.874869 25238 consensus_queue.cc:260] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:47.978055 25104 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:17:47.978523 22472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43060 (request call id 218) took 1938 ms (client timeout 1918 ms). Trace:
I20260709 12:17:47.979059 25227 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.979415 25104 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.979593 25227 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:47.979931 25104 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:47.976156 25314 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.970714 25220 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:47.978890 22472 rpcz_store.cc:269] 0709 12:17:46.040120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.040295 (+   175us) service_pool.cc:224] Handling call
0709 12:17:47.978321 (+1938026us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b5400395654. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:47.978454 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1930062080}
I20260709 12:17:47.985836 25315 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:47.939731 24922 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:47.986970 24922 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:47.988093 25153 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:47.989226 24922 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:47.990573 25097 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:47.990799 25115 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:47.970777 25352 log.cc:927] Time spent T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:17:47.983765 25314 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:47.961135 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:47.940950 25322 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:48.010095 25168 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:48.011534 25104 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:48.012024 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1778) took 1260 ms. Trace:
W20260709 12:17:48.012449 25134 consensus_meta.cc:287] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 1.308s	user 0.016s	sys 0.002s
I20260709 12:17:48.012758 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:48.013032 22394 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:48.013564 23124 raft_consensus.cc:2393] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:47.989073 25190 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:48.010169 25322 raft_consensus.cc:697] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:48.008025 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:17:48.013736 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 45257.7us
I20260709 12:17:48.012394 22468 rpcz_store.cc:276] 0709 12:17:46.751691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.832542 (+ 80851us) service_pool.cc:224] Handling call
0709 12:17:46.856055 (+ 23513us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:46.856415 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:46.856443 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:46.882229 (+ 25786us) log.cc:844] Serialized 52 byte log entry
0709 12:17:47.068349 (+186120us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:47.295796 (+227447us) log.cc:844] Serialized 14 byte log entry
0709 12:17:47.296173 (+   377us) log.cc:844] Serialized 14 byte log entry
0709 12:17:47.302480 (+  6307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.303724 (+  1244us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:47.395275 (+ 91551us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b1800436600. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:17:47.476489 (+ 81214us) spinlock_profiling.cc:243] Waited 7.85 ms on lock 0x7b1800436600. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:17:47.974067 (+497578us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b2400433418. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f58ed9c4 00007fb4f58ebacb 00007fb4f5aa6dc9 00007fb4f5aa6a55 00007fb4f5aa5fb0 00007fb4f871c488 00007fb4f871cbe8 00007fb4f86f4398 00007fb4f86ef76a 00007fb4f86eebb6
0709 12:17:48.011823 (+ 37756us) raft_consensus.cc:1685] finished
0709 12:17:48.011845 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:48.011972 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35750,"prepare.queue_time_us":394998,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":104,"raft.queue_time_us":14497,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":17581,"spinlock_wait_cycles":60062208,"thread_start_us":289128,"threads_started":2,"wal-append.queue_time_us":544530}
I20260709 12:17:48.021196 22401 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:17:48.022223 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:48.022403 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:48.022908 22401 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
W20260709 12:17:48.026782 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:48.027794 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 246886us
I20260709 12:17:47.941529 25237 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:48.030673 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 69650.9us
I20260709 12:17:48.013943 25364 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.973301 25173 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:48.007783 25292 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:48.043989 23129 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:48.045670 22472 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:17:48.065470 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.066334 22477 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:17:48.046329 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:48.049242 22471 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:48.026908 24718 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:48.046316 22442 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:48.059437 22468 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:17:48.024891 24922 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.050562 22474 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:17:48.074522 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:48.070374 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.076635 22516 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:48.077026 22471 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:48.059865 25190 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:48.061257 25237 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.068626 25364 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.080793 25364 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:48.081688 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1464) took 1232 ms. Trace:
I20260709 12:17:47.941128 25344 consensus_queue.cc:1059] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.133s
I20260709 12:17:48.082126 22542 rpcz_store.cc:276] 0709 12:17:46.849353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.850088 (+   735us) service_pool.cc:224] Handling call
0709 12:17:46.851090 (+  1002us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:17:47.110302 (+259212us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:47.171413 (+ 61111us) log.cc:844] Serialized 14 byte log entry
0709 12:17:47.302662 (+131249us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:47.303299 (+   637us) log.cc:844] Serialized 52 byte log entry
0709 12:17:47.303474 (+   175us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:47.303510 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.303585 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:47.987771 (+684186us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b1800349840. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:17:48.081283 (+ 93512us) raft_consensus.cc:1685] finished
0709 12:17:48.081430 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:48.081622 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64817,"prepare.queue_time_us":61035,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":15516,"raft.queue_time_us":203745,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":37017,"spinlock_wait_cycles":11687680,"thread_start_us":237993,"threads_started":2,"wal-append.queue_time_us":103352}
I20260709 12:17:48.085638 22395 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:48.086261 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:48.088667 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:48.089457 22400 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:17:48.090703 22442 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:48.092265 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.094873 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.093053 22475 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:48.070380 25173 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:48.071172 25153 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.098744 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
W20260709 12:17:48.164626 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 71856us
W20260709 12:17:48.140196 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.068027 25224 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:17:48.085640 25219 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:48.093745 24977 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.093750 25354 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:48.093819 25115 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:48.263152 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.104974 25292 raft_consensus.cc:3055] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:17:48.273867 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.072147 25196 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.100s
W20260709 12:17:48.293516 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 53380.7us
I20260709 12:17:48.165194 25190 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:48.094099 25366 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:17:48.304008 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 138402us
I20260709 12:17:48.145987 25338 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:48.101877 25173 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:48.241493 22399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1480) took 1193 ms. Trace:
I20260709 12:17:48.318044 22399 rpcz_store.cc:276] 0709 12:17:47.047987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.049236 (+  1249us) service_pool.cc:224] Handling call
0709 12:17:47.083189 (+ 33953us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:47.083868 (+   679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:47.083898 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:47.688011 (+604113us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b2c00106b88. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f744da11 00007fb4f745d372 00007fb4f8b8fa01 00007fb4f8b5443a 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2
0709 12:17:47.688550 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 12:17:47.971839 (+283289us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b4800003e58. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fda7daa1 00007fb4fda74b37 00007fb4fda749ca 00007fb4fdb6c26f 00007fb4fdb6bf37 00007fb4fdb8055c 00007fb4fdb80508 00007fb4fdb80488 00007fb4fdb80443 00007fb4fdb7f6ec 00007fb4fcaa9a96
0709 12:17:48.021558 (+ 49719us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:48.021598 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:48.021660 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:48.241252 (+219592us) raft_consensus.cc:1685] finished
0709 12:17:48.241274 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:48.241425 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26169,"raft.queue_time_us":372,"raft.run_cpu_time_us":3089,"raft.run_wall_time_us":873422,"spinlock_wait_cycles":45173760,"thread_start_us":264579,"threads_started":1,"wal-append.queue_time_us":341114}
I20260709 12:17:48.192842 25227 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:48.167764 25097 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:48.270123 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.325165 25173 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:48.338464 22474 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:48.339753 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.190742 25344 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:48.272572 25104 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.293339 25354 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.317564 25366 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:48.293541 25292 raft_consensus.cc:740] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:48.304112 25148 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.293294 25364 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.313072 25190 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:48.274917 25322 consensus_queue.cc:237] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.189489 25153 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:48.386775 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 288113us
I20260709 12:17:48.341432 25097 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.312631 25115 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.166832 25358 consensus_queue.cc:1059] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.285s
W20260709 12:17:48.381107 25335 log.cc:927] Time spent T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:17:48.349603 25344 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:48.304080 24977 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.397146 25190 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:48.094321 25225 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.385282 25354 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:48.335793 25136 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:48.086678 24922 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.388374 25366 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:48.430469 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:48.340968 25338 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:48.428333 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:48.439251 25225 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.420485 25097 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:48.388198 25104 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.470551 22472 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:48.472541 25104 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:48.443852 25292 consensus_queue.cc:260] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.475232 25292 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:48.426712 25105 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:48.477089 25105 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.450162 25136 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.476655 25225 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:48.479198 24977 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:48.479705 25136 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:48.429294 25344 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:48.482151 22397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1485) took 1375 ms. Trace:
I20260709 12:17:48.482580 22397 rpcz_store.cc:276] 0709 12:17:47.106463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.108552 (+  2089us) service_pool.cc:224] Handling call
0709 12:17:47.108880 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:47.236109 (+127229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:47.236140 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:47.257281 (+ 21141us) log.cc:844] Serialized 52 byte log entry
0709 12:17:47.417130 (+159849us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:47.721680 (+304550us) log.cc:844] Serialized 14 byte log entry
0709 12:17:47.723406 (+  1726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.723478 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:48.474539 (+751061us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b18000a8dc0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:17:48.481853 (+  7314us) raft_consensus.cc:1685] finished
0709 12:17:48.481951 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:48.482094 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139553,"prepare.queue_time_us":31298,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":3495,"raft.queue_time_us":131348,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":11743,"spinlock_wait_cycles":3126016,"thread_start_us":362339,"threads_started":2,"wal-append.queue_time_us":277520}
I20260709 12:17:48.487277 22399 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:48.427379 23125 raft_consensus.cc:1275] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:17:48.489010 22398 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:48.496750 22472 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:17:48.497592 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:48.498844 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:48.497205 22473 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:48.466869 25317 consensus_queue.cc:1059] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:17:48.468134 25293 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:48.504477 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:48.508514 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:48.509560 22367 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:48.510958 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:48.511657 22398 raft_consensus.cc:2376] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8. Re-sending same reply.
I20260709 12:17:48.394176 25148 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:48.466744 25115 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:48.495489 25219 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:48.467054 25314 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:48.560200 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:48.561964 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:48.562809 22441 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:48.566089 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:48.575664 22473 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:17:48.398102 25364 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.576248 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:48.468421 25190 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.577656 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:48.563597 25375 log.cc:927] Time spent T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:17:48.556236 25329 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.578747 22473 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:48.556936 25370 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:48.559912 25187 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:48.580770 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:48.567095 25136 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.566756 24732 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.552830 25015 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
W20260709 12:17:48.629788 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:48.652499 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.557314 25341 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:17:48.575362 25115 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:48.616740 25310 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.573559 25219 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:48.652664 25377 log.cc:927] Time spent T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:17:48.616390 25329 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:48.647310 25187 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.653327 25136 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.672080 24922 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:48.674407 25136 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:48.677261 25372 log.cc:927] Time spent T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
W20260709 12:17:48.665000 25323 consensus_meta.cc:287] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.858s	user 0.010s	sys 0.001s
I20260709 12:17:48.668926 25187 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:48.698856 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 373060us
I20260709 12:17:48.662530 25310 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:48.710099 25379 log.cc:927] Time spent T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:17:48.710903 25219 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:48.689227 25383 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:17:48.652166 25370 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.714417 25173 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.679380 25097 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.689538 25323 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.728922 25364 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:48.718897 25344 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.731729 25393 consensus_queue.cc:1059] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:17:48.733070 25354 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:48.736931 25338 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:48.739001 25374 log.cc:927] Time spent T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.351s	user 0.000s	sys 0.002s
W20260709 12:17:48.739943 25371 log.cc:927] Time spent T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 12:17:48.740718 25366 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:48.741052 25354 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:48.767627 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 257891us
I20260709 12:17:48.774340 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:48.776732 22367 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:48.627868 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:48.780187 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:48.780923 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:48.782055 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1486) took 1675 ms. Trace:
I20260709 12:17:48.782536 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:48.786090 22393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1493) took 1271 ms (client timeout 1694 ms). Trace:
I20260709 12:17:48.795135 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1491) took 1280 ms. Trace:
I20260709 12:17:48.831200 22394 rpcz_store.cc:276] 0709 12:17:47.514471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.521948 (+  7477us) service_pool.cc:224] Handling call
0709 12:17:48.794819 (+1272871us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54000a9454. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:48.794979 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110351104}
I20260709 12:17:48.829988 22396 rpcz_store.cc:276] 0709 12:17:47.106754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.109200 (+  2446us) service_pool.cc:224] Handling call
0709 12:17:47.159819 (+ 50619us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:17:47.342225 (+182406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:47.342256 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:17:47.348882 (+  6626us) log.cc:844] Serialized 78 byte log entry
0709 12:17:47.768209 (+419327us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:47.796433 (+ 28224us) log.cc:844] Serialized 14 byte log entry
0709 12:17:47.796951 (+   518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.797037 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:48.733647 (+936610us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b18002806c0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:17:48.778572 (+ 44925us) raft_consensus.cc:1685] finished
0709 12:17:48.778822 (+   250us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:48.781806 (+  2984us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10301,"prepare.queue_time_us":30797,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":59,"raft.queue_time_us":58000,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":5017,"spinlock_wait_cycles":25617152,"thread_start_us":486768,"threads_started":2,"wal-append.queue_time_us":456353}
I20260709 12:17:48.684774 22441 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:48.833372 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:48.833698 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 148920us
W20260709 12:17:48.830912 22393 rpcz_store.cc:269] 0709 12:17:47.514926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.535045 (+ 20119us) service_pool.cc:224] Handling call
0709 12:17:48.785609 (+1250564us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b5400225454. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:48.785858 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":953328512}
W20260709 12:17:48.845388 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.810650 22366 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:48.813902 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.814062 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.846971 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.847118 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.848309 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:48.848618 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.849188 22472 raft_consensus.cc:2376] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8. Re-sending same reply.
I20260709 12:17:48.814167 22473 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:48.815405 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:48.850165 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.850685 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.850872 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.851045 22471 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:48.851656 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.852013 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:48.852229 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.852732 22470 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:48.853075 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:48.815994 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1777) took 2078 ms. Trace:
I20260709 12:17:48.853626 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:48.855297 22471 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:48.853988 22476 rpcz_store.cc:276] 0709 12:17:46.737099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.785197 (+ 48098us) service_pool.cc:224] Handling call
0709 12:17:46.827059 (+ 41862us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:46.831585 (+  4526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:46.831616 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:46.832218 (+   602us) log.cc:844] Serialized 52 byte log entry
0709 12:17:48.208859 (+1376641us) spinlock_profiling.cc:243] Waited 8.71 ms on lock 0x7b1800478900. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a49e07 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b 00007fb4f86f3d23 00007fb4f86f40d1 00007fb4f8b0fa0f
0709 12:17:48.391562 (+182703us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:48.424464 (+ 32902us) log.cc:844] Serialized 14 byte log entry
0709 12:17:48.424796 (+   332us) log.cc:844] Serialized 14 byte log entry
0709 12:17:48.424961 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:48.425034 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:48.733741 (+308707us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b1800478900. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:17:48.815423 (+ 81682us) raft_consensus.cc:1685] finished
0709 12:17:48.815469 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:48.815787 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28964,"prepare.queue_time_us":77207,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":9142,"raft.queue_time_us":82005,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":12051,"spinlock_wait_cycles":173869184,"thread_start_us":182518,"threads_started":1,"wal-append.queue_time_us":1706885}
I20260709 12:17:48.817219 22474 raft_consensus.cc:2393] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:48.817476 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.821858 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.857522 22472 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:48.856781 22471 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:17:48.865996 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:48.866897 22546 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:48.869832 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:48.871052 22546 raft_consensus.cc:2410] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:48.654585 24732 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.881479 25015 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.882349 25015 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:48.701576 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:48.884063 24732 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:48.884502 23125 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:17:48.885129 25015 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:48.887235 25013 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.887547 24977 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:48.888316 24748 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.877701 23129 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 8 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:17:48.880127 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:17:48.876012 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.880467 25097 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:48.888070 25013 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.893680 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:48.891218 23127 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:48.895422 25097 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:48.896402 24718 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:48.896960 24718 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:48.889014 24748 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.898670 25219 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:48.899348 25219 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.899897 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:48.907996 24748 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:48.887174 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:48.908376 25148 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:48.910282 25173 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:48.913636 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:48.913950 25173 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.914551 22544 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:48.914757 25173 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:48.916371 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:48.916572 22545 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:17:48.723984 25190 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:48.918115 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:48.725248 25313 raft_consensus.cc:3055] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:48.919150 25292 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:48.920090 25316 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:48.920495 25292 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:48.921396 25308 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:48.918110 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:48.919463 22551 raft_consensus.cc:2410] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 10 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:17:48.958016 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 147806us
I20260709 12:17:48.961567 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:48.922538 25308 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:48.968330 22544 raft_consensus.cc:2393] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 8: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:48.972267 25387 consensus_queue.cc:1059] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:48.974052 25316 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:48.976908 25316 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:48.981189 25153 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:48.973568 25313 raft_consensus.cc:740] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:48.983392 25313 consensus_queue.cc:260] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:48.984220 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:48.987923 25013 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:48.960389 25015 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:48.981215 22543 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:17:49.005108 22472 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:48.997979 22543 pending_rounds.cc:85] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 3
I20260709 12:17:49.014040 22474 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:49.010865 22543 pending_rounds.cc:107] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:17:49.016229 22543 raft_consensus.cc:2889] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:48.981709 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:48.977228 25105 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:49.021591 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:49.023434 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:49.023574 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.026562 25338 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:49.028990 25338 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:48.997931 25015 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.988888 25308 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:49.021716 22475 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:49.049950 22548 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:49.051386 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.052855 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.053982 25391 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.054811 25391 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:49.059062 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:49.060366 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.062532 22545 raft_consensus.cc:1240] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:49.037210 25015 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:49.059466 25313 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:49.064312 25308 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:49.066767 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.069890 24718 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
W20260709 12:17:49.080664 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 304242us
I20260709 12:17:49.031270 25341 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:49.031961 25338 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:49.088778 22543 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:49.089808 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.090489 22543 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:49.092499 24718 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:49.063544 25391 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:49.095814 22442 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:49.097345 22442 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:49.097787 25384 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:49.098284 25384 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:49.098186 25308 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:49.098758 25384 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:49.098771 22550 raft_consensus.cc:2393] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:49.101990 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.102739 22550 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 7.
I20260709 12:17:49.100813 25308 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:49.103684 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.105824 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.106079 23094 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:49.106850 22550 raft_consensus.cc:2393] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 10: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:49.115412 25399 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:49.116178 25399 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:49.117208 25384 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:49.107966 25321 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 1.365s	user 0.002s	sys 0.001s
W20260709 12:17:49.120507 25392 log.cc:927] Time spent T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:17:49.122288 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1788) took 1070 ms. Trace:
I20260709 12:17:49.123821 25366 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:49.123991 25384 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:49.111966 22470 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:49.125259 24946 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.125687 25173 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:49.126027 24946 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:49.126781 25290 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:49.129134 24946 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:49.130415 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1776) took 2393 ms. Trace:
I20260709 12:17:49.111114 23127 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:17:49.122697 22468 rpcz_store.cc:276] 0709 12:17:48.051511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.092526 (+ 41015us) service_pool.cc:224] Handling call
0709 12:17:48.094613 (+  2087us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:48.474490 (+379877us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:48.474764 (+   274us) log.cc:844] Serialized 14 byte log entry
0709 12:17:48.645970 (+171206us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:48.817947 (+171977us) log.cc:844] Serialized 26 byte log entry
0709 12:17:48.818300 (+   353us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:48.818379 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:48.821262 (+  2883us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b5400211e54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:48.821316 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:49.121752 (+300436us) raft_consensus.cc:1685] finished
0709 12:17:49.121875 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:49.122063 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":588,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":5234,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":5449,"spinlock_wait_cycles":872762752,"thread_start_us":170388,"threads_started":1,"wal-append.queue_time_us":235907}
I20260709 12:17:49.137244 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:49.148500 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 72557.9us
I20260709 12:17:49.087538 25341 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.156279 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.157485 22547 raft_consensus.cc:2410] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:17:49.158500 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:49.159051 22547 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:17:49.160113 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.156006 25341 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:49.161469 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.152915 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.130815 22469 rpcz_store.cc:276] 0709 12:17:46.736872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.779510 (+ 42638us) service_pool.cc:224] Handling call
0709 12:17:46.779797 (+   287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:46.795537 (+ 15740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:46.795567 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:46.796115 (+   548us) log.cc:844] Serialized 52 byte log entry
0709 12:17:46.917601 (+121486us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:46.917643 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:46.917707 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:49.106917 (+2189210us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:49.129920 (+ 23003us) raft_consensus.cc:1685] finished
0709 12:17:49.129940 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:49.130226 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17619,"raft.queue_time_us":16173,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":13969,"spinlock_wait_cycles":5152640,"thread_start_us":66809,"threads_started":1,"wal-append.queue_time_us":773725}
I20260709 12:17:49.169476 23124 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:17:49.170056 23124 pending_rounds.cc:85] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: Aborting all ops after (but not including) 7
I20260709 12:17:49.170156 25314 raft_consensus.cc:3055] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:49.170703 23124 pending_rounds.cc:107] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:17:49.171149 23124 raft_consensus.cc:2889] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:49.163273 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 57381.5us
I20260709 12:17:49.172621 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:49.169521 25188 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:49.174995 25188 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:49.175402 25188 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:49.176453 25015 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:49.178900 25314 raft_consensus.cc:740] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:17:49.179323 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 82121.5us
I20260709 12:17:49.180295 22442 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:49.182030 24946 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:49.181557 25314 consensus_queue.cc:260] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:49.182544 24946 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:49.168123 22548 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:17:49.170446 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.189015 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.191319 22395 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:49.191671 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.191893 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.192516 22401 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:17:49.193017 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.196702 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.199076 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:49.171128 25173 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.187659 24946 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:49.184154 25314 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:49.207932 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.170778 25187 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:49.211714 25173 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:49.209594 25384 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:49.220726 23095 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.017s	sys 0.038s
I20260709 12:17:49.223891 22548 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:17:49.228127 22367 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:49.238260 23095 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.017s	sys 0.038s
I20260709 12:17:49.239332 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.242729 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.245083 25399 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:49.229107 25384 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:49.248351 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:49.253964 25293 consensus_meta.cc:287] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.690s	user 0.007s	sys 0.008s
I20260709 12:17:49.255668 24718 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:49.258078 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.259895 22397 raft_consensus.cc:2393] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:49.248045 22366 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:49.261269 25308 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:49.262861 22547 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:17:49.263949 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.265009 25219 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:49.268424 25329 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:49.269694 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 84974.2us
I20260709 12:17:49.270538 25344 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:49.277357 25245 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:49.299618 25187 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:49.300007 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:49.300230 22542 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:17:49.300740 22542 pending_rounds.cc:85] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 3
I20260709 12:17:49.301003 22542 pending_rounds.cc:107] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:17:49.301286 22542 raft_consensus.cc:2889] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:49.302448 22400 raft_consensus.cc:1240] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:49.281778 25310 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:49.305336 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 77313us
I20260709 12:17:49.307494 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.278630 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:49.278929 25370 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:49.280975 25319 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.254966 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:49.252125 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 551861us
I20260709 12:17:49.288457 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.250005 25384 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:49.314504 22545 raft_consensus.cc:2393] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:49.251853 25015 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:49.291193 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.314990 22548 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:49.294593 25308 raft_consensus.cc:697] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:49.320291 22401 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:49.320925 25309 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:49.321058 25337 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:49.325090 25320 consensus_queue.cc:1059] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:49.339232 25136 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:17:49.325933 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:49.326651 25406 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:17:49.342628 25410 log.cc:927] Time spent T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:17:49.326025 25402 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:49.327862 23095 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.918s (SENT) [suppressed 24 similar messages]
I20260709 12:17:49.320492 22367 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:49.344533 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.345592 22544 raft_consensus.cc:2410] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:49.346462 22441 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:17:49.347332 25136 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:49.349282 25136 raft_consensus.cc:697] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:49.350358 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:49.350445 25136 consensus_queue.cc:237] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:49.358572 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:49.359258 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.362867 25173 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:49.363245 25308 consensus_queue.cc:237] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:49.336935 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.342697 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.367098 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:49.375820 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 97390.2us
W20260709 12:17:49.378626 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 51165us
W20260709 12:17:49.382709 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:49.386268 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 139728us
I20260709 12:17:49.449258 25237 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:49.445760 22402 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:49.450830 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.557379 22550 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
W20260709 12:17:49.559350 25349 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.065s	user 0.005s	sys 0.004s
I20260709 12:17:49.446583 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:49.560678 25192 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:49.522993 22549 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 2.
I20260709 12:17:49.561187 25290 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:49.561998 25290 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:49.561748 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 115313us
W20260709 12:17:49.499024 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 73862.3us
I20260709 12:17:49.459774 22400 raft_consensus.cc:2393] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:17:49.395669 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 75253us
I20260709 12:17:49.425626 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:49.454147 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:49.405751 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.423378 25370 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:49.562391 25290 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:49.571801 22546 raft_consensus.cc:2393] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:17:49.403091 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.579744 22551 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:49.577714 22401 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:17:49.438872 25015 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:49.439751 24887 raft_consensus.cc:3055] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:49.386850 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.565557 23122 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:49.613606 22442 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:49.578150 23095 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:49.617192 24887 raft_consensus.cc:740] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:49.630162 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:49.635358 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 54245.6us
I20260709 12:17:49.614912 25015 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.637280 25015 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:49.570034 25188 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:49.639750 25188 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:49.453500 25338 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:49.582728 25105 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:49.654459 25400 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:49.659909 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:49.660172 25314 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:49.661515 25314 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:49.662056 25314 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:49.665570 25400 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:49.666077 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 81130.9us
I20260709 12:17:49.423549 25319 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:49.577991 25383 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:49.674747 22471 raft_consensus.cc:1240] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:49.679783 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:49.687784 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:49.644750 25370 raft_consensus.cc:697] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:49.690587 22442 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:49.694715 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 116848us
I20260709 12:17:49.665125 25015 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:49.697804 22366 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:49.651194 25341 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:49.702494 22547 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:49.708575 25337 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:49.708878 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:49.688964 25238 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:49.709331 22367 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:49.689136 25400 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:49.713029 22548 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:49.718384 22394 raft_consensus.cc:2393] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:49.707334 25136 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:49.684548 25105 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:49.690209 25308 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:17:49.686555 25383 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:49.735026 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.714627 25293 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:49.697867 24946 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:49.719655 25136 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.736541 25337 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:49.740020 25136 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:49.737303 25389 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:49.739104 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:49.749517 22548 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:49.730329 25384 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:49.737633 25400 consensus_queue.cc:1059] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:17:49.768710 25389 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.770628 25134 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:49.796494 25378 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.796849 22548 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:17:49.783667 25293 consensus_queue.cc:1059] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:17:49.798202 22548 raft_consensus.cc:1240] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:49.797240 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:17:49.814504 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 111943us
I20260709 12:17:49.802459 25219 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.818729 25219 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:49.822619 25369 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:17:49.823752 25219 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:49.825079 22516 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:49.793838 25389 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:49.803653 25134 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.829087 22367 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:49.797235 24946 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:49.806350 25015 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:49.819499 25319 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:49.814805 25338 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:49.773811 25370 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:49.839815 25421 log.cc:927] Time spent T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:17:49.856773 25292 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:49.849251 25208 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:49.858323 25208 raft_consensus.cc:697] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:49.859393 25208 consensus_queue.cc:237] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:49.840982 25329 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:49.838037 25310 raft_consensus.cc:3055] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:17:49.864281 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 157013us
I20260709 12:17:49.837255 25134 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:49.855067 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 64352.7us
I20260709 12:17:49.840629 22441 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:49.842281 25400 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:49.866250 25310 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:49.890137 25400 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.890568 25400 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:49.890796 25310 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:49.892146 25310 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:49.876777 25323 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:49.879951 25330 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.894037 25330 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:49.895637 25157 consensus_queue.cc:1059] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:49.884219 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.896791 25224 raft_consensus.cc:3055] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:49.897185 25224 raft_consensus.cc:740] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:49.899156 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:49.902094 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.902416 23129 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:49.881219 25384 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:49.883419 25105 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:49.884326 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:49.884718 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.884987 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:49.885633 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.886262 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:49.886571 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:49.888077 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:49.885030 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:49.893107 22284 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0723691b01e2413baf71cbc73a551fdc with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8c3bcfa13ca74a24ab8999a408532932 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:49.896759 22395 raft_consensus.cc:2393] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:49.881348 25337 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:49.817176 25378 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:49.853726 25341 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:49.886301 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.861701 25329 raft_consensus.cc:697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:49.917407 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.922660 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:49.922818 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:49.922549 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:49.916694 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:49.930472 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.943890 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:49.946973 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.949577 22472 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:49.951822 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.957675 22397 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:49.962154 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.959007 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.979135 22550 raft_consensus.cc:2410] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:17:49.991273 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:49.994160 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:49.994889 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:49.997069 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.998814 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:49.994447 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:49.994887 22395 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
W20260709 12:17:50.003980 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 176379us
I20260709 12:17:50.004048 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:50.004966 25330 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:50.005785 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:50.010227 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:50.011407 22401 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:50.013883 23126 raft_consensus.cc:2410] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:17:50.014276 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:49.978441 25292 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.017867 25341 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.018167 25292 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.018484 25341 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.019398 25290 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.020604 22550 raft_consensus.cc:2393] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:50.020928 25383 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:49.999715 25173 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.021632 25173 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.022886 25329 consensus_queue.cc:237] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.023816 25173 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:49.979233 25369 consensus_queue.cc:1059] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:17:50.025324 25369 raft_consensus.cc:3055] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:49.958014 25384 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:50.027873 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:50.028685 25314 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:49.997668 22548 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:50.029933 23125 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:50.030737 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:50.032263 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:50.033083 23128 raft_consensus.cc:2393] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:50.035712 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:50.038444 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:49.945493 25224 consensus_queue.cc:260] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:50.041855 25337 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:50.042271 22441 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.042469 25337 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:50.044581 25337 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:50.046509 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:50.047155 22547 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:17:50.048063 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:50.048553 22547 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:50.050107 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:50.051808 23094 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:50.057483 22397 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:17:50.021526 25290 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:50.025719 25369 raft_consensus.cc:740] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:50.020471 25292 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:49.995453 22284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 102630us
I20260709 12:17:50.041936 23123 raft_consensus.cc:2393] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:50.020471 25341 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:50.086678 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 191116us
W20260709 12:17:50.088021 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 45867.4us
I20260709 12:17:50.037204 25219 consensus_queue.cc:1059] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
W20260709 12:17:50.087605 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 53302.8us
I20260709 12:17:50.040477 25293 consensus_queue.cc:1059] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:17:50.078063 25330 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:50.092864 25219 raft_consensus.cc:3055] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:50.094045 25219 raft_consensus.cc:740] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:50.083452 25337 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.094959 25219 consensus_queue.cc:260] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.095260 25337 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:50.096328 25219 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:50.097431 25337 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:50.098392 22516 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.103502 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.105198 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.098628 25293 raft_consensus.cc:3055] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:50.106040 25293 raft_consensus.cc:740] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:50.107023 25293 consensus_queue.cc:260] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:50.108400 25293 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:50.108698 25400 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.110841 25400 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:50.078982 25323 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:50.086995 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:50.080449 24977 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:50.080777 25237 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:50.050724 22468 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:50.093261 25330 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.122040 22441 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.122355 25330 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:50.122912 24977 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:50.126497 22549 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 1478) took 2518 ms (client timeout 2109 ms). Trace:
W20260709 12:17:50.127019 22549 rpcz_store.cc:269] 0709 12:17:47.607710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.608594 (+   884us) service_pool.cc:224] Handling call
0709 12:17:50.126221 (+2517627us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b540031c4d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:50.126397 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4052546816}
I20260709 12:17:50.130012 24838 raft_consensus.cc:3055] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:50.130488 24838 raft_consensus.cc:740] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:50.131479 25323 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:50.131283 24838 consensus_queue.cc:260] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.093524 22442 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:50.134158 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 46069.9us
I20260709 12:17:50.135111 22442 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:50.123998 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:50.091048 25224 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:50.137814 24977 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:50.132458 25310 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:50.132349 24838 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:50.112775 25389 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.146823 22476 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:50.153631 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:50.146451 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.155462 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:50.162695 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:50.163690 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1847) took 1249 ms. Trace:
I20260709 12:17:50.164556 23129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41028 (request call id 387) took 1160 ms. Trace:
I20260709 12:17:50.164999 23129 rpcz_store.cc:276] 0709 12:17:49.003713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.014337 (+ 10624us) service_pool.cc:224] Handling call
0709 12:17:50.164136 (+1149799us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b540012b454. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:50.164436 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2009767680}
I20260709 12:17:50.165659 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:50.166378 25310 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:50.166810 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:50.168604 24977 raft_consensus.cc:697] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:50.131129 25314 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:50.170235 22547 raft_consensus.cc:2410] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:50.171198 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1806) took 1208 ms. Trace:
I20260709 12:17:50.195644 22393 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:50.189357 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.172329 22398 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
W20260709 12:17:50.200743 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 76841.7us
I20260709 12:17:50.137272 25292 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:50.172165 22402 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:50.164088 22542 rpcz_store.cc:276] 0709 12:17:48.914000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.914223 (+   223us) service_pool.cc:224] Handling call
0709 12:17:48.914648 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:49.310056 (+395408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.163450 (+853394us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b540008cad4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:50.163611 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":885149440}
I20260709 12:17:50.213397 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:50.209754 22474 rpcz_store.cc:276] 0709 12:17:48.963195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.963352 (+   157us) service_pool.cc:224] Handling call
0709 12:17:49.013866 (+ 50514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:49.014575 (+   709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.155060 (+1140485us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b540016f650. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:50.171133 (+ 16073us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13403904}
I20260709 12:17:50.225267 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:50.226297 22398 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 8: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:17:50.235150 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 45873.4us
I20260709 12:17:50.119364 25237 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.213133 25389 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:50.254814 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.260083 22441 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:50.268953 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.269515 25104 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:50.236573 24946 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:50.223798 25105 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:50.188676 24977 consensus_queue.cc:237] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:50.353256 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.354552 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:50.286538 25314 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.364123 25187 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:50.364851 25323 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.365442 25323 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.365994 23126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41028 (request call id 388) took 1360 ms. Trace:
W20260709 12:17:50.367539 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 53298.8us
I20260709 12:17:50.352880 25292 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:50.391949 22547 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9.
I20260709 12:17:50.347601 25104 raft_consensus.cc:697] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:50.275503 25136 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.394176 23094 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:17:50.395073 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 140330us
I20260709 12:17:50.355719 25173 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:50.401813 22549 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:50.409888 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:50.410189 22547 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:50.410773 22400 raft_consensus.cc:2393] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:50.369148 25293 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:50.254616 25369 consensus_queue.cc:260] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:50.369935 25383 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:50.417150 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:50.366444 23126 rpcz_store.cc:276] 0709 12:17:49.006055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.021488 (+ 15433us) service_pool.cc:224] Handling call
0709 12:17:50.365700 (+1344212us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b5400650254. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:50.365912 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114154240}
I20260709 12:17:50.430181 22516 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.399748 25219 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.370059 25314 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:50.441890 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:50.417621 25238 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:50.369352 25105 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.455310 22400 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:50.453116 25292 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:50.460086 25308 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:50.459934 25104 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.461306 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.406067 25173 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.433918 25383 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:50.446393 22366 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:50.416234 25400 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:17:50.475857 22366 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:50.455912 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:50.444370 25219 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.465524 25383 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:50.486815 25389 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.487408 25389 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:50.489500 25105 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:50.489467 25389 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:50.490679 25439 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:17:50.491601 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 262921us
I20260709 12:17:50.492851 22441 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.496078 25237 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:50.497005 25389 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:50.480659 25015 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:50.497959 25015 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.498368 25015 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:50.502556 22399 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:50.503089 22441 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.491233 25314 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:50.507019 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.519742 25389 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:50.523949 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:50.524875 22397 raft_consensus.cc:2410] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:17:50.525756 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:50.526021 22475 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:50.526953 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:50.528122 25389 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:50.529134 22441 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.531332 22441 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.531935 25389 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:50.537379 25136 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:50.562671 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.544687 24887 consensus_queue.cc:260] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:50.546468 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41012 (request call id 264) took 1196 ms. Trace:
I20260709 12:17:50.547045 25219 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:50.475144 25292 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:50.559250 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 52274.8us
I20260709 12:17:50.480150 25323 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:50.569438 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.563766 25310 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:50.585505 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 54271.5us
W20260709 12:17:50.582491 25134 consensus_meta.cc:287] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.001s
I20260709 12:17:50.590085 22441 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.602829 25393 consensus_queue.cc:1059] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:17:50.603967 25314 consensus_queue.cc:1059] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:50.606210 22398 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:17:50.607450 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:50.608736 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:50.609264 22398 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:50.610023 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41012 (request call id 265) took 1114 ms. Trace:
I20260709 12:17:50.595602 25134 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:50.614115 25134 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:50.614921 22397 raft_consensus.cc:2393] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 8: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:50.615919 25015 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.570698 23122 rpcz_store.cc:276] 0709 12:17:49.349910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.350070 (+   160us) service_pool.cc:224] Handling call
0709 12:17:50.546263 (+1196193us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54002bb954. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:50.546408 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473170304}
I20260709 12:17:50.592093 24887 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:50.618719 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:50.591399 25136 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:50.589006 25208 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.000s	sys 0.035s
I20260709 12:17:50.588631 25338 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:50.610483 23124 rpcz_store.cc:276] 0709 12:17:49.495233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.536320 (+ 41087us) service_pool.cc:224] Handling call
0709 12:17:49.582718 (+ 46398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:49.645540 (+ 62822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:49.650316 (+  4776us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:49.838296 (+187980us) log.cc:844] Serialized 582 byte log entry
0709 12:17:50.354655 (+516359us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:50.361013 (+  6358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.368898 (+  7885us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:50.609754 (+240856us) raft_consensus.cc:1685] finished
0709 12:17:50.609791 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:50.609943 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6041,"raft.queue_time_us":9545,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":2450,"thread_start_us":436711,"threads_started":1,"wal-append.queue_time_us":697915}
I20260709 12:17:50.610384 25446 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:50.619407 22395 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
W20260709 12:17:50.628576 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 193633us
I20260709 12:17:50.634079 22399 raft_consensus.cc:1240] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:50.634538 22516 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:50.637389 22516 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:50.623947 22442 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:50.625989 25208 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.000s	sys 0.036s
I20260709 12:17:50.640499 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:50.625989 25136 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.644292 22516 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
W20260709 12:17:50.650045 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 60058.1us
I20260709 12:17:50.643567 25292 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:50.642338 25310 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:50.650981 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.681578 22516 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:50.643558 25015 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:50.651966 22398 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:17:50.646433 25238 raft_consensus.cc:697] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 9 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:50.647051 25157 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:50.690318 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.648386 25136 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:50.646733 25188 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:50.651105 25104 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:50.681306 25292 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.670244 25293 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:50.694892 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:17:50.685009 25330 consensus_meta.cc:287] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.002s
I20260709 12:17:50.681564 25337 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:50.640383 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "277d262725804effb16ede64e81d19c8"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:17:50.699508 22475 raft_consensus.cc:606] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.700456 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:17:50.701660 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.704111 25173 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:50.696341 25292 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:50.706058 25238 consensus_queue.cc:237] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:50.684983 25323 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:50.709110 25330 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:50.710115 25104 raft_consensus.cc:697] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:50.711102 25104 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.714829 25188 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:50.683238 25310 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:50.718079 25310 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:50.724062 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.727066 25369 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:50.645617 25446 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.731611 22441 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.732250 25446 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:50.735648 25196 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:50.717595 25292 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:50.740413 25157 consensus_queue.cc:1059] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:50.744205 25196 consensus_queue.cc:1059] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:50.745364 24977 raft_consensus.cc:3055] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:50.745747 24977 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:50.746516 24977 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.748000 25384 raft_consensus.cc:3055] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:50.748425 25384 raft_consensus.cc:740] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:50.749277 25384 consensus_queue.cc:260] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.750737 25384 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:50.750617 25157 consensus_queue.cc:1059] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:50.752238 25105 raft_consensus.cc:3055] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:50.752620 25105 raft_consensus.cc:740] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:50.753364 25105 consensus_queue.cc:260] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.754575 25105 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:50.758188 25445 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:50.758708 25445 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.759073 25445 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:50.760787 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.761747 25323 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:50.766026 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.768127 25438 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:50.769387 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.770186 25438 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:50.771306 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.772059 25438 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:50.772428 25438 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:50.772779 25438 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:50.696301 25219 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:50.693936 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:50.774991 23127 raft_consensus.cc:2393] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 8: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:50.767278 25378 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:50.780704 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:50.780989 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:50.782917 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:50.783241 22551 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:17:50.783512 22546 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:50.783702 22551 pending_rounds.cc:85] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 5
I20260709 12:17:50.783977 22551 pending_rounds.cc:107] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:17:50.784197 22551 raft_consensus.cc:2889] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:50.784137 25438 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.784904 25219 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.786149 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:50.786484 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.787386 25323 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:50.787794 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.788010 22549 raft_consensus.cc:1240] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:50.789222 25323 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:50.789624 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.785449 25219 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:17:50.742988 25310 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:50.793892 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.807548 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:50.810750 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:50.810802 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.811719 22402 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:50.815047 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:50.816018 22398 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:50.807194 25157 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:17:50.821605 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:50.821882 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:50.822312 22472 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:50.822887 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:50.825369 22542 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:50.821658 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:50.826143 22475 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:50.824892 22474 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:17:50.823369 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:50.828859 22477 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:50.830320 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:50.831140 22400 raft_consensus.cc:2393] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:50.833046 25219 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:50.833799 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:50.834468 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:50.835006 22516 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:50.822875 25455 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.128s	user 0.003s	sys 0.009s
I20260709 12:17:50.835394 25292 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:50.836190 25310 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:50.836814 25293 raft_consensus.cc:697] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:50.824126 25434 consensus_queue.cc:1059] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:17:50.822983 25329 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:50.838212 25434 raft_consensus.cc:3055] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:50.837821 25293 consensus_queue.cc:237] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:50.838617 25434 raft_consensus.cc:740] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:50.839286 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:50.839454 25434 consensus_queue.cc:260] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.834757 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:50.840408 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:50.840854 22399 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
W20260709 12:17:50.841670 25451 log.cc:927] Time spent T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.133s	user 0.003s	sys 0.000s
I20260709 12:17:50.842073 22473 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:50.820082 25338 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:50.835042 22476 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:50.843665 25438 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:50.845566 25383 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:50.847960 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 84696.3us
I20260709 12:17:50.849238 25188 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:50.834429 22395 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:50.851004 25015 consensus_queue.cc:1059] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:50.851792 25015 consensus_queue.cc:1243] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:17:50.828279 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:50.854185 22544 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:50.856078 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.849583 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:50.853191 25458 raft_consensus.cc:3055] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:50.695814 22442 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:50.840551 25434 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:50.857704 25290 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:50.899935 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 214353us
I20260709 12:17:50.863451 25329 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:17:50.910024 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 214356us
I20260709 12:17:50.868503 25458 raft_consensus.cc:740] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:50.877573 25437 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:50.873106 25439 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:50.879073 25208 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:17:50.926396 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 70394.1us
I20260709 12:17:50.936615 22516 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:50.937525 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:50.938678 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:50.843130 25338 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:50.923831 22366 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:50.942186 25324 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:50.942633 25324 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.942989 25324 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:50.943215 25438 consensus_queue.cc:1059] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:50.947259 22476 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:50.933574 22402 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:50.924654 25329 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:50.944972 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:50.922374 25389 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:50.921624 25290 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:50.956948 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:50.959067 22398 raft_consensus.cc:2393] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 8: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:17:50.960280 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 140903us
I20260709 12:17:50.967144 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:50.968485 22516 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:50.965615 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:50.973937 22402 raft_consensus.cc:2410] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:17:50.978803 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:50.952332 25329 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:50.952060 25310 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:50.984102 22395 raft_consensus.cc:2393] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 8: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:50.984181 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:50.986160 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:50.986326 22396 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:50.986575 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:50.969141 25293 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:50.927969 25134 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:17:50.954167 25208 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:50.961192 25290 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:50.983422 25292 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:50.994886 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:50.985107 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:50.933708 25446 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:17:50.959918 25173 raft_consensus.cc:3055] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:50.954196 25219 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:17:50.994151 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:50.983650 25438 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:50.987910 25323 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:50.999498 22442 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:51.012306 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 70978.8us
W20260709 12:17:51.056496 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 57083.3us
I20260709 12:17:50.995281 25310 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.987046 25383 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:50.985844 22284 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0723691b01e2413baf71cbc73a551fdc with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8c3bcfa13ca74a24ab8999a408532932 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:51.001941 25292 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.999729 25208 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:50.949254 25439 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.004400 25173 raft_consensus.cc:740] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:50.996582 25293 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.057431 22442 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:51.090945 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.111027 25338 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:51.111652 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:51.112982 23127 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:17:51.091596 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 106583us
I20260709 12:17:51.114112 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:51.079262 25448 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:51.114987 25448 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.115401 25448 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:51.115612 22545 raft_consensus.cc:1240] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:51.079234 25310 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:51.120064 25461 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:17:51.104044 22542 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:51.122846 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:51.081645 25323 raft_consensus.cc:697] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:51.112888 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:51.069582 25370 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:17:51.131228 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:51.163028 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 202067us
I20260709 12:17:51.105831 25292 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:51.105554 25208 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:51.107885 25308 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:51.154295 23124 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:51.107749 22284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 124418us
I20260709 12:17:51.155473 25389 raft_consensus.cc:697] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:17:51.170851 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 113492us
I20260709 12:17:51.182682 25323 consensus_queue.cc:237] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.186134 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:51.189050 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:51.175504 25196 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:17:51.194412 25466 log.cc:927] Time spent T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 12:17:51.194818 25467 log.cc:927] Time spent T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:17:51.198520 24977 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:51.201952 25473 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.202564 25473 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:51.204618 22297 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32988 (request call id 91) took 12526 ms (client timeout 15000 ms). Trace:
I20260709 12:17:51.043505 25458 consensus_queue.cc:260] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.179805 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:51.206465 25438 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:51.206914 25438 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:51.207671 25389 consensus_queue.cc:237] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.124573 25293 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.204749 25473 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:51.205217 22297 rpcz_store.cc:269] 0709 12:17:38.667551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.668175 (+   624us) service_pool.cc:224] Handling call
0709 12:17:51.193067 (+12524892us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:46.695173 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:46.917863 (+222690us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:46.919833 (+  1970us) write_op.cc:435] Acquired schema lock
0709 12:17:46.928605 (+  8772us) tablet.cc:662] Decoding operations
0709 12:17:47.038526 (+109921us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:47.038600 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:47.038633 (+    33us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:17:47.039205 (+   572us) tablet.cc:701] Row locks acquired
0709 12:17:47.039225 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:17:47.039368 (+   143us) write_op.cc:270] Start()
0709 12:17:47.039483 (+   115us) write_op.cc:276] Timestamp: P: 1783599467039322 usec, L: 0
0709 12:17:47.039507 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:17:47.040173 (+   666us) log.cc:844] Serialized 2937 byte log entry
0709 12:17:47.382191 (+342018us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f5a4a0ac 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b
0709 12:17:48.729389 (+1347198us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b18002e58e0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:17:49.219240 (+489851us) op_driver.cc:464] REPLICATION: finished
0709 12:17:49.457920 (+238680us) write_op.cc:301] APPLY: starting
0709 12:17:49.458061 (+   141us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:49.458329 (+   268us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:49.458370 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:49.486954 (+ 28584us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:49.487351 (+   397us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:17:49.487413 (+    62us) write_op.cc:312] APPLY: finished
0709 12:17:49.487863 (+   450us) log.cc:844] Serialized 58 byte log entry
0709 12:17:49.488094 (+   231us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:49.488283 (+   189us) write_op.cc:454] Released schema lock
0709 12:17:49.488381 (+    98us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:49.488866 (+   485us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:49.488899 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2996389,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":146109,"apply.run_cpu_time_us":4028,"apply.run_wall_time_us":57508,"num_ops":7,"prepare.queue_time_us":499103,"prepare.run_cpu_time_us":108649,"prepare.run_wall_time_us":1077693,"raft.queue_time_us":480582,"raft.run_cpu_time_us":4700,"raft.run_wall_time_us":115890,"replication_time_us":2172561,"spinlock_wait_cycles":50185856,"thread_start_us":1362181,"threads_started":4,"wal-append.queue_time_us":715091,"wal-append.run_cpu_time_us":30183,"wal-append.run_wall_time_us":1760427}]]}
I20260709 12:17:51.215127 22544 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:51.169739 25370 raft_consensus.cc:697] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:51.218811 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:51.130174 23094 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:51.179405 25173 consensus_queue.cc:260] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:51.230647 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 100585us
W20260709 12:17:51.224968 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 92677.2us
W20260709 12:17:51.225200 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 98117.3us
I20260709 12:17:51.171536 25308 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.205699 25458 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:51.235872 22399 raft_consensus.cc:1240] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: []
W20260709 12:17:51.214416 25462 log.cc:927] Time spent T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:17:51.240021 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:51.243120 25463 log.cc:927] Time spent T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:17:51.243502 25460 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:51.253604 23094 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:51.213711 25310 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:51.260138 25445 consensus_meta.cc:287] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.501s	user 0.002s	sys 0.009s
I20260709 12:17:51.233132 25196 raft_consensus.cc:697] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:51.277375 25196 consensus_queue.cc:237] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.251993 25173 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.263522 25459 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:51.264375 25370 consensus_queue.cc:237] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.267931 25439 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:51.268539 25136 consensus_meta.cc:287] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.569s	user 0.003s	sys 0.006s
I20260709 12:17:51.252292 25238 consensus_queue.cc:1059] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:17:51.234508 25473 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:17:51.295971 23124 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:51.285185 25208 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.272631 25330 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:51.315512 22366 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:51.254356 25324 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.311753 25438 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.321558 25437 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:51.323422 22548 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:51.324545 25208 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:51.298121 25445 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.311087 25173 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:51.330155 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:51.315822 25464 log.cc:927] Time spent T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.081s	user 0.000s	sys 0.003s
I20260709 12:17:51.338040 25448 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.339648 25329 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:51.306850 25136 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.378249 22476 raft_consensus.cc:1240] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:51.366905 25238 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:51.368512 25437 raft_consensus.cc:697] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:51.386644 22474 raft_consensus.cc:2393] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:51.384543 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:51.371083 25173 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.391717 25324 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:51.393359 25445 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:51.394908 25308 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:51.393241 25173 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:51.397383 25314 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.398069 25314 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.400138 25314 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:51.402189 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:51.402870 25448 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:51.404577 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:51.405272 22397 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
W20260709 12:17:51.414541 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.415017 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:51.415544 22546 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:51.416604 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:51.411398 23095 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:51.417110 22549 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:17:51.420210 22551 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 8: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:51.421908 22516 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:51.401469 25292 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.386967 25238 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.424926 25457 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:51.425263 25292 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:51.425601 25457 raft_consensus.cc:697] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:51.427001 25238 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:51.426630 25457 consensus_queue.cc:237] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.428254 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:51.429006 22551 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:17:51.431650 25438 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:51.422923 25314 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:51.438367 25314 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.438786 25314 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:51.447705 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:51.449549 25329 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:51.419055 25310 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:51.450639 25310 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:51.451092 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:51.455175 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.456123 25136 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:51.457396 22399 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:51.458738 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:51.460088 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:51.459499 22295 catalog_manager.cc:5697] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:17:51.461347 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:51.463217 25290 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.463937 22395 raft_consensus.cc:2393] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:51.455161 25437 consensus_queue.cc:237] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.423141 25370 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.465683 25370 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.466951 25310 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:51.467998 22543 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:51.475776 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:51.476598 22398 raft_consensus.cc:2393] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:51.478346 23094 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:51.482862 22397 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:17:51.486300 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:51.487821 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:51.488713 22397 raft_consensus.cc:2393] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:17:51.489758 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.498126 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:51.499347 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:51.503515 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:51.504145 22399 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:51.471268 25370 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:51.492527 25369 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:51.509909 25293 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.513134 22401 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:51.496260 25329 consensus_queue.cc:1059] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:17:51.514129 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:51.515163 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:51.517033 22474 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:51.518725 22547 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:17:51.521209 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:51.521960 22543 raft_consensus.cc:2393] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:51.524075 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:51.524271 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:51.514735 25329 raft_consensus.cc:3055] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:51.525838 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:51.525965 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:51.526531 22475 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:51.525118 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:51.527062 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:51.528821 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:51.529686 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:51.530323 22470 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.516575 25472 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:51.529425 22543 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:17:51.569732 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:51.542528 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:51.571494 22395 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.541602 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:51.573117 22398 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:51.541247 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:51.542351 22397 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:51.525621 25329 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:51.520874 25290 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:51.513411 25314 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.532866 25310 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:51.525097 25370 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:17:51.586927 22398 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:51.536829 25472 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:51.578012 25476 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:51.595352 22470 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:51.524865 25378 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 12:17:51.597671 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 416855us
I20260709 12:17:51.537125 25292 consensus_queue.cc:1059] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:17:51.608517 23129 raft_consensus.cc:1240] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:51.610661 23129 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:51.611543 22472 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:51.612331 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:51.612543 23127 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: []
W20260709 12:17:51.614259 25490 log.cc:927] Time spent T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:17:51.593093 25472 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:51.616794 22366 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:51.619104 22475 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:51.620272 23095 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:51.621374 25488 log.cc:927] Time spent T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:17:51.623766 25329 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.630221 22395 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:51.635042 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:17:51.659895 23095 leader_election.cc:336] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.918s (SENT)
W20260709 12:17:51.667816 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 59482.5us
I20260709 12:17:51.670141 22366 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:51.645529 25237 consensus_queue.cc:1059] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:17:51.671572 25400 consensus_queue.cc:1059] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:17:51.679569 22474 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:17:51.680114 25314 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:51.642405 25453 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:51.645646 25439 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:51.690537 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:51.691673 22474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:17:51.693651 22474 raft_consensus.cc:606] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:51.708379 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:51.695256 25157 consensus_queue.cc:1059] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:17:51.696254 25457 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:51.646092 24838 consensus_queue.cc:1059] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
W20260709 12:17:51.743546 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.669695 23122 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:51.747639 22399 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:51.748843 25224 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:17:51.749504 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 89661us
I20260709 12:17:51.754285 22400 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:51.692215 25439 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:51.759681 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:51.760239 22399 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:51.754890 25457 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:51.759289 25237 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.774487 25237 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.758580 25439 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:51.678628 22295 catalog_manager.cc:5697] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 2, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 2 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:17:51.783840 25383 consensus_queue.cc:1059] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:51.784228 25389 raft_consensus.cc:2955] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Committing config change with OpId 6.6: config changed from index 3 to 6, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:51.784830 22295 catalog_manager.cc:5697] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 2, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.786352 25445 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:51.786883 25445 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.787945 22295 catalog_manager.cc:5697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 4 to 5, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 5 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.788914 25445 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:51.789474 25445 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.802977 22469 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:51.781069 22544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4e53d64761746008e02335e67f74c08"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:17:51.819602 22544 raft_consensus.cc:606] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:51.819994 22544 raft_consensus.cc:614] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:51.781562 25136 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.782142 22474 raft_consensus.cc:1240] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:51.782243 24946 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:51.782560 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:51.782691 25428 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:51.783324 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:51.803088 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:51.803539 25434 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:51.781955 25446 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.824201 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:51.803803 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:51.756596 25224 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.805434 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:51.780503 25293 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:51.808979 22399 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
W20260709 12:17:51.817011 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 51599.7us
I20260709 12:17:51.765703 25457 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:51.802522 25445 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.784763 25383 raft_consensus.cc:3055] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:51.768970 25157 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.782016 25105 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:51.768880 25468 raft_consensus.cc:3055] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:51.828219 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:51.829614 22468 raft_consensus.cc:2393] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:51.818861 25459 raft_consensus.cc:3055] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:51.835564 22442 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:51.846095 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:51.846874 22468 raft_consensus.cc:2393] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:51.839823 25383 raft_consensus.cc:740] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:51.824298 25446 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.842408 25459 raft_consensus.cc:740] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:51.829980 24946 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.830035 25136 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.865478 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:51.867163 24946 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:51.869181 25237 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:51.870579 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:51.871181 22396 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:51.871299 25446 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:51.858585 22468 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:17:51.832262 25495 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:17:51.842679 25468 raft_consensus.cc:740] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:51.847240 25470 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:51.862442 25224 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:51.863184 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:51.877522 25500 log.cc:927] Time spent T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:17:51.845065 25105 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.892071 25105 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:51.873610 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:51.831437 25428 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.895973 25428 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:51.896500 22472 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:51.897214 25459 consensus_queue.cc:260] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.898401 25459 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.898108 25383 consensus_queue.cc:260] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.899251 25383 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.876477 22442 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:51.818810 22295 catalog_manager.cc:5697] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:17:51.841564 25157 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.863902 25445 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:51.878249 25497 log.cc:927] Time spent T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:17:51.886183 25136 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:51.887423 25468 consensus_queue.cc:260] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.888320 25470 raft_consensus.cc:697] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:51.918692 25468 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.907608 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:51.918007 22295 catalog_manager.cc:5697] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 3 to 6, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 6 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.908257 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:51.896181 25329 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:51.910251 25495 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:51.920259 22295 catalog_manager.cc:5697] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 6, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 6 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:17:51.921088 25495 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.921520 25495 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:51.888629 25494 raft_consensus.cc:3055] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:51.922971 25494 raft_consensus.cc:740] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:51.924602 25337 raft_consensus.cc:3055] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:51.925021 25337 raft_consensus.cc:740] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:51.925895 25337 consensus_queue.cc:260] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.927052 25337 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.927502 25438 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:51.928732 25157 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:51.931339 22476 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:17:51.933974 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:51.935009 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:51.936554 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:51.937428 22542 raft_consensus.cc:2410] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:17:51.938894 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:51.939525 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:51.940721 22546 raft_consensus.cc:2368] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7.
I20260709 12:17:51.941483 22551 raft_consensus.cc:2368] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7.
W20260709 12:17:51.942268 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:51.926818 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 343172us
I20260709 12:17:51.944522 22398 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:17:51.946907 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:51.918339 25457 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.947762 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:51.935875 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:51.885290 25472 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.964164 22399 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:17:51.965550 22549 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 10: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:51.966923 22550 raft_consensus.cc:1240] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:51.945443 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:51.967873 22468 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.971880 25224 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:51.972451 25224 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.974478 25224 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:51.975035 25457 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:51.975775 25292 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.976254 25292 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.978091 25485 raft_consensus.cc:3055] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:51.978488 25485 raft_consensus.cc:740] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:51.978816 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:51.979665 22397 raft_consensus.cc:2410] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:51.979246 25485 consensus_queue.cc:260] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.980594 25485 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:51.980850 22394 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:51.983410 22401 raft_consensus.cc:2955] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 3 to 6, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:51.984513 22516 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:51.946900 25428 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:51.986907 25476 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:51.986828 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:51.988178 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:51.989416 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:51.990341 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:51.936614 25293 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.991910 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:51.993147 22516 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:51.997808 22516 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:51.998390 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:51.999385 22468 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
W20260709 12:17:52.003829 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.004580 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:51.986022 25483 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.923852 25494 consensus_queue.cc:260] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.009748 25224 consensus_queue.cc:1059] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:52.003623 25290 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:52.010624 25224 raft_consensus.cc:3055] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:52.011718 25224 raft_consensus.cc:740] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:51.996886 25370 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:52.010788 25329 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:52.012648 25224 consensus_queue.cc:260] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.003432 25310 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:52.013311 25329 raft_consensus.cc:697] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:52.013792 25310 raft_consensus.cc:697] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:52.014238 25329 consensus_queue.cc:237] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.014740 25310 consensus_queue.cc:237] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.006153 25495 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:52.013896 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.010111 25483 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:51.991063 25208 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:52.011799 25473 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:52.026072 22399 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:52.010628 25494 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:52.010581 25292 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:51.991022 25428 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.998471 25293 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.011035 25470 consensus_queue.cc:237] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:51.995887 22295 catalog_manager.cc:5697] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 1 to 5, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 5 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
W20260709 12:17:52.188530 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 183985us
W20260709 12:17:52.203171 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.176391 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:52.082947 22468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
W20260709 12:17:52.144109 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.173920 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:52.195091 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:52.215312 22399 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:52.207809 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.209095 22542 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:52.084337 22548 raft_consensus.cc:1240] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:52.189779 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.207808 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:52.097473 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:52.209971 23095 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:52.066246 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:52.218211 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:52.219072 22477 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:52.218582 22476 raft_consensus.cc:2368] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6.
I20260709 12:17:52.140717 25476 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:52.217722 22366 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:52.011293 25290 raft_consensus.cc:697] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:52.222949 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
W20260709 12:17:52.275482 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 52598.9us
I20260709 12:17:52.276549 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:52.127767 25468 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:52.274855 25292 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:52.042273 25015 raft_consensus.cc:3055] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:52.286840 25015 raft_consensus.cc:740] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:52.286536 25468 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.287678 25015 consensus_queue.cc:260] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.288757 25015 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:52.149588 25105 consensus_queue.cc:1059] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.141s
I20260709 12:17:52.041224 25208 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.189293 25224 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:52.038045 25370 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:52.307106 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.124536 25337 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:52.330209 22399 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:52.164213 25472 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:52.091847 25495 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:52.066448 25308 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.074918 25473 raft_consensus.cc:697] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:52.136536 25438 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:52.275801 25323 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:52.275174 25188 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:52.374588 25188 raft_consensus.cc:697] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 11 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:52.374783 25323 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:52.375221 25323 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:52.375533 25188 consensus_queue.cc:237] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:52.206449 25483 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:52.074605 25434 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.265s
I20260709 12:17:52.342411 22442 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:52.304813 24718 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:52.379175 25434 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:52.379742 25434 raft_consensus.cc:697] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:52.380689 25292 raft_consensus.cc:697] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:52.380618 25434 consensus_queue.cc:237] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:52.381686 25292 consensus_queue.cc:237] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.370994 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:52.383160 22477 raft_consensus.cc:2368] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8.
I20260709 12:17:52.040769 25439 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.370987 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:52.358592 25310 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:52.372345 25473 consensus_queue.cc:237] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.373131 25438 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.374130 25290 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
W20260709 12:17:52.399461 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 181824us
I20260709 12:17:52.375957 25428 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:52.359272 22476 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:52.290045 25468 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:52.339938 25105 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.389444 22543 raft_consensus.cc:2393] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 8: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:52.290611 24946 raft_consensus.cc:3055] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:52.379128 24718 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:52.411391 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 135084us
I20260709 12:17:52.415337 22395 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:52.348773 25337 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.374230 25208 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:52.349220 25370 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.366314 25308 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.430658 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:52.430660 22543 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:52.411412 25445 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.432734 25445 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.414245 24946 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:52.413203 24718 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:52.419628 25310 raft_consensus.cc:697] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:52.450170 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:52.392916 25510 consensus_queue.cc:1059] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:17:52.425460 25483 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:52.417174 25105 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:52.494071 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:52.486557 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.468570 25428 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.494189 22549 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:17:52.492223 25445 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:52.450141 25208 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:17:52.451666 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:52.500902 22468 raft_consensus.cc:606] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:52.501487 22468 raft_consensus.cc:614] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:17:52.474519 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.495014 25483 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.524366 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:52.527127 22474 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:17:52.455441 25509 log.cc:927] Time spent T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:17:52.529886 23129 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:17:52.532435 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:52.533178 22474 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:52.531963 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:52.537405 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:52.546083 25293 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:52.549628 25521 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:17:52.532124 24946 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.554226 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:52.557528 25329 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.558583 25370 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:52.537578 25310 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.609292 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:52.651578 22473 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:52.652635 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:52.537228 22284 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0723691b01e2413baf71cbc73a551fdc with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8c3bcfa13ca74a24ab8999a408532932 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:52.610190 22543 raft_consensus.cc:1240] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:52.611408 22475 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
I20260709 12:17:52.495877 25428 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:52.637889 23126 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
W20260709 12:17:52.638994 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:52.638612 25514 log.cc:927] Time spent T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:17:52.643783 25438 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:52.608783 25445 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.985742 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:52.659335 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:52.988974 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1588) took 1011 ms. Trace:
I20260709 12:17:52.670609 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:52.665988 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:52.988305 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 329047us
W20260709 12:17:52.754848 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.989388 22401 rpcz_store.cc:276] 0709 12:17:51.977103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.982790 (+  5687us) service_pool.cc:224] Handling call
0709 12:17:51.983088 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:51.983295 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:52.067077 (+ 83782us) log.cc:844] Serialized 14 byte log entry
0709 12:17:52.656047 (+588970us) log.cc:844] Serialized 14 byte log entry
0709 12:17:52.988623 (+332576us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.988678 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:52.988729 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.988795 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.988906 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":709606,"prepare.queue_time_us":261506,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":24458,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7198,"thread_start_us":558790,"threads_started":3,"wal-append.queue_time_us":451436}
I20260709 12:17:52.713758 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:52.811533 25485 consensus_meta.cc:287] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.831s	user 0.004s	sys 0.009s
W20260709 12:17:52.982565 25323 consensus_meta.cc:287] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.607s	user 0.009s	sys 0.001s
W20260709 12:17:52.941347 25494 consensus_meta.cc:287] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.715s	user 0.009s	sys 0.015s
W20260709 12:17:52.913591 25517 log.cc:927] Time spent T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 12:17:53.021713 22475 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:52.984606 25292 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.022912 22472 raft_consensus.cc:2410] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:17:52.649991 23127 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:17:53.015795 22542 raft_consensus.cc:2410] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:17:52.654064 25293 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.649459 25510 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:53.084554 25510 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.018083 22543 raft_consensus.cc:1275] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:17:53.086066 25293 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.086691 25510 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:53.087292 22545 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:52.919490 25378 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:53.026083 25308 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:53.026520 25438 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.087239 25510 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:53.049969 25292 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.100647 25510 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.100425 25438 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.101068 25510 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:53.102626 25438 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:53.028126 24718 consensus_meta.cc:287] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.568s	user 0.006s	sys 0.001s
I20260709 12:17:52.657804 25329 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:53.030347 25530 log.cc:927] Time spent T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:17:53.034823 25187 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.106400 24718 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.107753 25187 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.038590 25468 consensus_queue.cc:1059] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:17:53.034744 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.988390 25105 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:52.995476 25337 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:53.041803 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:53.043047 25224 consensus_meta.cc:287] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.703s	user 0.008s	sys 0.006s
I20260709 12:17:53.043664 25483 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:52.620309 25208 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.394s
I20260709 12:17:53.113493 22470 raft_consensus.cc:2410] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:17:53.049176 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:53.114264 22547 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:52.713219 22284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 178372us
I20260709 12:17:53.050365 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:53.051450 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:52.738340 25524 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.379s
I20260709 12:17:53.099190 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:52.670974 25370 consensus_queue.cc:1059] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.392s
I20260709 12:17:53.008457 25445 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.100943 25476 raft_consensus.cc:3055] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:17:53.110335 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.115511 22551 raft_consensus.cc:2393] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 10: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:53.109624 24718 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:53.102536 25292 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:53.115577 22546 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:53.105528 25523 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:53.132306 22366 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:53.111248 25187 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:53.117952 25468 consensus_queue.cc:1243] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:17:53.104843 25378 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:53.146800 22547 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:17:53.143059 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:53.148102 22546 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:53.131819 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:53.148262 22366 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:53.110101 25400 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:17:53.156302 22544 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:53.127154 25476 raft_consensus.cc:740] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:53.141815 25459 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.149359 25329 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:53.153234 25293 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:53.165894 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.177362 22476 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:53.145498 25337 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:53.154363 24718 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:53.181119 24718 raft_consensus.cc:697] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:53.182132 24718 consensus_queue.cc:237] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.017058 25323 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.180284 25224 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.188432 25224 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.190999 25224 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:53.178562 25337 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.192466 25337 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:53.151373 25468 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:17:53.204428 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.146701 25523 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.227358 22515 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:17:53.229429 23095 leader_election.cc:336] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.715s (SENT)
I20260709 12:17:53.238346 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:53.240461 22543 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:53.244788 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 1522) took 1249 ms. Trace:
I20260709 12:17:53.258973 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:53.260423 22395 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:53.173313 25459 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:53.274647 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 47409.8us
I20260709 12:17:53.286391 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.287907 22473 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:53.239239 25134 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.313155 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.238993 25428 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:53.288789 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:53.245273 22549 rpcz_store.cc:276] 0709 12:17:51.986059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.989192 (+  3133us) service_pool.cc:224] Handling call
0709 12:17:53.235461 (+1246269us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54000659d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:53.235572 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":807239040}
I20260709 12:17:53.320281 22469 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:53.320356 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:53.322124 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.324168 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.324855 22476 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:53.274539 25370 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.275055 25542 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.278497 25485 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:53.331503 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:53.333683 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.334527 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.342257 25445 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:53.342485 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:53.344982 22469 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:53.233319 25476 consensus_queue.cc:260] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:53.350133 25537 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:17:53.345916 25545 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.354323 25545 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:53.356550 25545 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:53.357920 25292 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.358516 25292 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:53.359762 25507 log.cc:927] Time spent T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 1.141s	user 0.004s	sys 0.000s
I20260709 12:17:53.360944 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1496) took 1410 ms. Trace:
I20260709 12:17:53.362190 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:53.363004 22471 raft_consensus.cc:2393] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:53.363814 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.364360 22471 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:53.361292 22398 rpcz_store.cc:276] 0709 12:17:51.950457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.951303 (+   846us) service_pool.cc:224] Handling call
0709 12:17:51.951670 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:51.952060 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:51.952092 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:51.966530 (+ 14438us) log.cc:844] Serialized 26 byte log entry
0709 12:17:52.209064 (+242534us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:52.209106 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.209169 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:53.359172 (+1150003us) spinlock_profiling.cc:243] Waited 56.2 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:53.360646 (+  1474us) raft_consensus.cc:1685] finished
0709 12:17:53.360671 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:53.360881 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12057,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":22195,"spinlock_wait_cycles":129171712,"thread_start_us":233211,"threads_started":1,"wal-append.queue_time_us":227470}
I20260709 12:17:53.368301 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:53.336158 25485 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:53.345109 25529 log.cc:927] Time spent T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.226s	user 0.000s	sys 0.002s
I20260709 12:17:53.366608 25543 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.371557 25378 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:53.374732 22546 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:53.379531 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.394222 22469 raft_consensus.cc:2410] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:53.385408 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.394963 22476 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:17:53.386336 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.345821 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:53.320607 25134 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.335934 25370 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.398533 25510 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.373553 25292 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:53.400725 22473 raft_consensus.cc:2393] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:53.419304 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:53.420974 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.384495 25330 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:53.405210 25323 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:53.390463 25485 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:53.379877 25523 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:53.406091 25370 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:53.339282 25542 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:53.393999 25543 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.407958 25134 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:53.408936 25510 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:53.409518 22551 raft_consensus.cc:2393] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 6: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:53.435727 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:53.422567 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:53.402487 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1529) took 1335 ms. Trace:
I20260709 12:17:53.426602 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.428875 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.430053 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.455065 22544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1922) took 1257 ms. Trace:
I20260709 12:17:53.455621 22473 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:53.456497 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.458015 22473 raft_consensus.cc:2410] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:17:53.457947 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:53.455542 22544 rpcz_store.cc:276] 0709 12:17:52.197935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.207757 (+  9822us) service_pool.cc:224] Handling call
0709 12:17:52.208242 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:53.156804 (+948562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.454813 (+298009us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b540008c0d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:53.455004 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2179904256}
I20260709 12:17:53.458766 22471 raft_consensus.cc:2368] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 8.
I20260709 12:17:53.436005 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:53.462266 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.460686 22543 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:17:53.454972 22550 rpcz_store.cc:276] 0709 12:17:52.067327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.078918 (+ 11591us) service_pool.cc:224] Handling call
0709 12:17:52.088288 (+  9370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.088506 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:52.519501 (+430995us) log.cc:844] Serialized 14 byte log entry
0709 12:17:52.914651 (+395150us) log.cc:844] Serialized 14 byte log entry
0709 12:17:53.401968 (+487317us) log.cc:844] Serialized 14 byte log entry
0709 12:17:53.402164 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:53.402210 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:53.402258 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.402323 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:53.402430 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31697,"prepare.queue_time_us":106121,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":472509,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":4096,"spinlock_wait_cycles":6684416,"thread_start_us":1270711,"threads_started":4,"wal-append.queue_time_us":253582}
W20260709 12:17:53.464659 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 235269us
I20260709 12:17:53.465404 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 1531) took 1189 ms. Trace:
I20260709 12:17:53.465730 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:53.464808 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:53.466590 22469 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:53.465790 22542 rpcz_store.cc:276] 0709 12:17:52.276174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.276309 (+   135us) service_pool.cc:224] Handling call
0709 12:17:53.465221 (+1188912us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b5400179654. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:53.465348 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1698067840}
I20260709 12:17:53.467013 23094 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:53.468446 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.469551 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:53.466480 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:53.470899 23129 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:53.457688 25510 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.472580 25510 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.475222 22543 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:53.476711 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:53.477012 23127 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 11 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:17:53.479665 25550 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:53.480121 25550 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.480449 25550 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:53.482348 22515 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:53.484681 25510 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:53.485219 25510 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:53.485349 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:17:53.486037 25533 log.cc:927] Time spent T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.314s	user 0.002s	sys 0.000s
I20260709 12:17:53.490166 22476 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:17:53.490898 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:53.494272 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:53.494375 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.495847 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:53.485606 25510 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.491688 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:53.484577 25523 consensus_queue.cc:1059] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:17:53.493484 22550 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:53.498090 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:53.494614 22367 leader_election.cc:336] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.670s (SENT)
I20260709 12:17:53.491072 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:53.498584 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:53.499871 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.498638 22471 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:53.500921 22544 raft_consensus.cc:2368] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8.
I20260709 12:17:53.501111 22476 raft_consensus.cc:2410] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:17:53.500561 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:53.499142 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:53.503165 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:53.503647 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:53.504245 23124 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:17:53.505205 22469 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9.
I20260709 12:17:53.506872 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:53.508308 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.510143 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:53.510391 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:53.495626 24718 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:53.517258 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.517220 22471 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 5. Current term is 7. Ops: []
I20260709 12:17:53.520093 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:53.500401 25510 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:53.520745 22473 raft_consensus.cc:2376] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8. Re-sending same reply.
I20260709 12:17:53.521512 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:53.501859 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:53.497924 25459 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:53.508004 25290 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:17:53.531837 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 66511.9us
I20260709 12:17:53.499548 25337 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.538000 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:53.539294 22471 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:17:53.540261 23095 leader_election.cc:336] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.874s (SENT)
I20260709 12:17:53.539398 22400 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
W20260709 12:17:53.544023 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.552831 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:53.553623 23124 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:53.556445 25552 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:53.559319 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:53.561802 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:53.564013 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:53.524577 25323 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:53.518589 25105 consensus_queue.cc:1059] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:17:53.560570 23125 raft_consensus.cc:2393] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 2: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:53.538966 25468 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:53.574668 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:53.580427 22544 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:17:53.580857 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:53.586074 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:53.594708 22550 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:17:53.596727 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:53.523204 24718 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:53.597644 25559 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:53.600198 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:53.600828 22545 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:17:53.604969 22549 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
W20260709 12:17:53.605890 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.607074 23124 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:53.574928 25330 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.602324 25370 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:53.599251 25329 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:53.601940 25543 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:53.644505 25542 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:53.661288 25337 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:53.515528 23127 raft_consensus.cc:2955] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 3 to 6, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:53.541158 25290 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:53.670188 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 91860us
I20260709 12:17:53.579237 25323 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.676471 25565 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.677596 25561 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:53.677906 25134 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:53.600550 25468 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.666102 25292 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:53.689495 23131 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:53.692946 22367 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
W20260709 12:17:53.692611 23095 leader_election.cc:336] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.570s (SENT)
I20260709 12:17:53.646085 25330 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:53.695294 22441 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:53.696542 22367 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:53.680866 25543 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:53.695624 25542 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.702109 24718 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:53.671200 25329 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.702270 25542 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:53.704346 25329 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:53.670481 25370 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.719942 22441 leader_election.cc:400] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7.
I20260709 12:17:53.697667 25400 consensus_queue.cc:1059] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:17:53.738085 25400 raft_consensus.cc:3055] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:53.738467 25400 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:53.739282 25400 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.740180 25510 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:53.693954 25292 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:53.727710 25560 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:53.741199 25560 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:53.742123 22470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1829) took 1307 ms. Trace:
I20260709 12:17:53.741600 25560 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:53.742506 22470 rpcz_store.cc:276] 0709 12:17:52.434643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.434976 (+   333us) service_pool.cc:224] Handling call
0709 12:17:53.741908 (+1306932us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b5400200dd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:53.742045 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1366311808}
W20260709 12:17:53.726612 23095 leader_election.cc:336] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.870s (SENT)
I20260709 12:17:53.737347 22441 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:53.740579 25400 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:53.745258 23095 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:53.752395 22441 leader_election.cc:400] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7.
W20260709 12:17:53.736703 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.753403 22441 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:53.704504 25542 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:17:53.756508 22367 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:53.754777 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:53.757400 25480 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:53.758551 22367 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:53.759408 25480 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:53.759858 22367 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:53.760704 25480 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:53.761089 25480 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:53.761445 25480 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:53.761788 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50990 (request call id 14) took 1667 ms. Trace:
I20260709 12:17:53.744522 25323 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:53.761567 22367 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:53.742513 25292 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:53.773516 25523 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:53.773934 25523 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:53.774302 25523 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:53.778812 25539 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:53.779392 25539 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.781783 25510 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:53.781539 25539 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:53.691664 25561 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.782614 25308 raft_consensus.cc:3055] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:53.783001 25308 raft_consensus.cc:740] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:53.783799 25468 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:53.785440 22367 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:53.735917 25522 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:53.786756 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:53.762805 25485 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:53.792663 25523 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.793617 22543 raft_consensus.cc:2368] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
I20260709 12:17:53.794697 25485 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:53.795116 25468 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:53.737195 25105 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:53.797320 22367 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:53.763168 22441 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:53.755841 25540 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:53.768512 25337 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:53.697074 25134 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.785605 25370 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:53.766412 22468 rpcz_store.cc:276] 0709 12:17:52.082661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.082828 (+   167us) service_pool.cc:224] Handling call
0709 12:17:53.750226 (+1667398us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54003e2e54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b4e853 00007fb4fdb1c60a 00007fb4f70a27d4 00007fb4f70a2762 00007fb4f70a2691 00007fb4f70a260c 00007fb4f70a18c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:53.750364 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":674295680}
I20260709 12:17:53.762167 25428 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:53.745716 25329 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:53.892719 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 95121us
I20260709 12:17:53.756569 25224 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:53.774221 25542 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:53.900327 22367 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:53.690863 25565 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.793664 25476 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:53.913409 22367 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:53.737149 25543 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.794824 25523 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:53.916998 22367 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:53.901834 25485 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.891909 25522 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:53.925076 22367 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:53.929526 22367 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:53.932701 22542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:17:53.918138 25468 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:53.933362 22542 raft_consensus.cc:606] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:53.921095 25015 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:53.934265 22542 raft_consensus.cc:614] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:53.923969 25428 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:53.897706 25337 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:53.910287 25329 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.931968 25523 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:53.946784 25134 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:53.783862 25308 consensus_queue.cc:260] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:53.928375 24718 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:53.953204 25565 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:53.928450 25564 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.926370 25485 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:53.937803 25522 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:53.954619 25550 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:53.928927 25290 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:53.978897 25308 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:53.980508 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 217412us
I20260709 12:17:53.968699 24718 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:53.971873 22295 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.018s	sys 0.005s
I20260709 12:17:53.985921 24718 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:53.978976 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:53.995247 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:53.971980 25564 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:53.991935 22295 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.018s	sys 0.005s
I20260709 12:17:53.999686 25480 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:54.003355 22441 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:53.992471 25543 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:54.010452 25337 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:54.011938 25564 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:54.013902 25480 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:54.005708 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 76281.7us
I20260709 12:17:54.028857 25439 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:54.031145 25445 raft_consensus.cc:3055] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:54.031585 25445 raft_consensus.cc:740] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:54.029641 22367 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:54.032505 25445 consensus_queue.cc:260] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.033118 24718 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.033669 25439 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:54.038338 22542 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:17:54.039000 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:54.039721 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:54.020219 22472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1821) took 2022 ms (client timeout 1808 ms). Trace:
I20260709 12:17:54.021878 22469 raft_consensus.cc:1275] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:17:54.045258 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:54.045528 23131 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:17:53.993537 25571 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:54.022258 25563 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:54.078696 22472 rpcz_store.cc:269] 0709 12:17:51.998036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.998162 (+   126us) service_pool.cc:224] Handling call
0709 12:17:54.020023 (+2021861us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400110154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:54.020153 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2354125056}
I20260709 12:17:54.057207 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:54.057647 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:54.057967 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:54.081254 22544 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:54.081686 22543 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.058923 25561 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:54.060885 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:54.057967 25559 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:54.062438 25564 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.062556 25329 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:54.001812 25330 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:54.063192 22366 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:54.089025 25561 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:54.089753 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.090374 22402 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:54.091284 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.091435 22366 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:54.063660 24946 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:54.091868 22402 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:54.092715 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.093387 22402 raft_consensus.cc:2393] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:54.094185 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:54.094658 22402 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:54.094713 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.095345 22394 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:54.096139 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.096803 22394 raft_consensus.cc:2393] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 10: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:54.098085 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.098465 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:54.064322 25480 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:54.027593 25485 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:54.067451 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.067690 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:54.068393 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:54.069989 25550 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:54.073835 25437 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.106220 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:54.113162 23131 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:54.023458 22441 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:54.076454 22399 raft_consensus.cc:1240] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:54.066864 23095 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:54.078136 22549 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:54.078896 22469 pending_rounds.cc:85] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 3
I20260709 12:17:54.078717 22545 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:54.081341 22551 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 2.
I20260709 12:17:54.082446 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:54.083446 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.084275 22401 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:17:54.086611 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:54.086747 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.087528 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:54.099159 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.098654 22397 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:17:54.101964 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:54.084400 25562 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.342s	user 0.003s	sys 0.001s
I20260709 12:17:54.097512 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.139858 22394 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:54.114921 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.140393 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.140664 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:54.139580 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.142647 22469 pending_rounds.cc:107] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:17:54.106242 22400 raft_consensus.cc:2393] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 7: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:54.107299 22548 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:54.141000 22401 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:17:54.111166 25560 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:54.143020 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 76256.4us
I20260709 12:17:54.140612 22399 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
W20260709 12:17:54.141465 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 118106us
I20260709 12:17:54.085305 23127 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.145486 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:54.144543 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.146814 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:54.148048 22400 raft_consensus.cc:2393] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:54.148938 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.146132 22469 raft_consensus.cc:2889] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:54.144570 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.150394 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.151118 23129 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:54.148754 22396 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:54.154703 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.103611 22402 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:54.106006 25480 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.155839 25330 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:54.190510 22441 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:54.157804 25560 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:54.159010 24718 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:54.159760 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 60179.1us
I20260709 12:17:54.191964 22395 raft_consensus.cc:2410] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:17:54.161561 22550 raft_consensus.cc:2368] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9.
I20260709 12:17:54.162249 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:54.193368 22546 raft_consensus.cc:2393] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 10: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:54.162400 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.162595 25445 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:54.163136 23126 raft_consensus.cc:2393] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:54.195129 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:54.085534 25571 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.197629 25571 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:54.103206 25564 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:54.099861 25559 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.198027 24946 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:54.198868 22441 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:54.199138 23129 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:54.199702 25559 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:54.105579 25522 consensus_queue.cc:1059] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:17:54.165488 25105 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.146689 25383 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:54.165915 25552 consensus_queue.cc:1059] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:54.141567 22394 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:17:54.208735 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.209383 22394 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:54.210698 22394 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:54.166911 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.212810 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:54.167696 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.213454 22472 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:54.171536 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.172850 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.214600 22402 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:54.213565 22474 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:54.216661 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.217670 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.173530 22442 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:54.173933 22401 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:54.174113 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:54.218966 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 45551.7us
I20260709 12:17:54.219090 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:54.219295 22471 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:54.218688 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.220293 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.220485 22474 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:54.222261 22396 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:54.175920 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.179319 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1533) took 1784 ms. Trace:
I20260709 12:17:54.177400 25308 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:54.180794 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.180996 22468 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:54.147601 25570 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:54.177475 25551 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.226558 22473 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:54.228806 24718 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:17:54.183256 25329 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:54.139353 25437 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.190948 25330 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:54.186919 25224 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:54.190126 22547 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:17:54.194206 22400 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:54.195039 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:54.201643 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.200929 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:54.234252 22471 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:54.205003 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.205446 22399 raft_consensus.cc:2393] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:54.205641 22441 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:54.207593 24946 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:54.206619 22515 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:54.167598 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.221369 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.239473 22474 raft_consensus.cc:2393] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:54.224186 22397 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 2.
W20260709 12:17:54.225551 25562 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:17:54.225416 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.181834 22477 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:54.227562 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.240235 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:54.240360 22515 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:54.240811 22546 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.241142 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.178606 24977 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:54.228291 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 113544us
I20260709 12:17:54.228693 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.241636 22468 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:17:54.243909 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.244463 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.182715 25480 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:54.229708 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.223295 22548 rpcz_store.cc:276] 0709 12:17:52.395395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.395622 (+   227us) service_pool.cc:224] Handling call
0709 12:17:52.395909 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:54.143720 (+1747811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.179105 (+ 35385us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54001b8854. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:54.179266 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3935456128}
I20260709 12:17:54.247473 25564 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:54.249655 23095 leader_election.cc:336] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.830s (SENT)
I20260709 12:17:54.233074 25329 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.252044 25329 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:54.252748 25572 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:17:54.254110 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.238870 25384 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:54.213604 25105 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.255249 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:54.255815 22477 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:54.244532 22396 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:54.257715 22396 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:54.260676 22473 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:54.183794 22516 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:54.234381 22547 pending_rounds.cc:85] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 7
I20260709 12:17:54.261495 22547 pending_rounds.cc:107] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:17:54.236595 22472 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:54.237275 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:54.235607 22395 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
W20260709 12:17:54.262192 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 78471.4us
I20260709 12:17:54.262626 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.263108 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:54.237219 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.114215 25561 raft_consensus.cc:697] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:54.236505 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:54.265168 22400 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.242380 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.265918 22397 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:17:54.216333 25310 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:54.250142 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:54.223955 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:54.267387 22469 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:54.267776 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.261725 22547 raft_consensus.cc:2889] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:54.232511 22402 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:17:54.263279 22472 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:54.270953 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.271694 22472 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:54.272980 22472 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:17:54.231276 25571 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:54.275364 22546 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9.
I20260709 12:17:54.277473 23094 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:54.287292 22472 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:54.236289 25330 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.249500 25476 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:54.293960 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 56766.8us
I20260709 12:17:54.297166 22472 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:54.217180 25383 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.308187 22441 leader_election.cc:400] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8.
I20260709 12:17:54.308506 22441 leader_election.cc:403] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:54.293947 22366 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:54.300202 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.233350 25551 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.302873 25561 consensus_queue.cc:237] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.238554 25439 raft_consensus.cc:3055] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:54.307719 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:54.315476 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.368496 22469 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:17:54.309217 25208 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:54.369843 25485 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:54.370841 25485 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.371227 25485 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:54.371716 25105 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:54.370266 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 62941.4us
W20260709 12:17:54.351065 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 131030us
I20260709 12:17:54.378796 22473 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:54.378979 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:54.340052 22402 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:54.380437 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:54.380626 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.381258 22402 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:54.309396 22441 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:54.382022 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:54.302181 25329 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:54.286302 25571 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.288702 25552 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:17:54.384724 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 75384us
I20260709 12:17:54.338719 25438 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:17:54.260396 25543 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:54.399053 22394 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:54.374327 25439 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:54.341794 25476 raft_consensus.cc:697] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:17:54.374660 25580 log.cc:927] Time spent T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 12:17:54.388335 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 94624.7us
I20260709 12:17:54.385105 25551 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:54.313980 25384 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:54.393900 22477 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:54.304607 25570 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:54.378269 22442 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:54.275074 24977 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.388890 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:54.313613 25188 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:54.374365 25208 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:54.424993 25208 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.431623 25549 raft_consensus.cc:3055] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:54.432152 25549 raft_consensus.cc:740] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:54.432664 25188 raft_consensus.cc:697] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 9 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:54.434798 25188 consensus_queue.cc:237] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:54.440248 25485 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.445915 22400 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
W20260709 12:17:54.451442 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 73233.9us
I20260709 12:17:54.405315 22441 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:54.460947 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 55880.7us
I20260709 12:17:54.461961 25563 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:54.387434 25292 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:54.387218 25290 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:54.462466 25563 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.462723 25290 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:54.393626 25370 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:54.462976 25563 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.463685 25292 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:54.459160 25439 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.396929 25543 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.464537 25543 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:54.393659 25329 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.464697 25439 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:54.464987 25329 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.394383 25522 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:54.469743 25522 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:54.470197 25522 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.470846 24977 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:54.470674 25563 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.472944 25563 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:54.292394 25310 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:54.473541 25438 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:54.413923 22543 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:17:54.393857 25571 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.476802 25383 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:54.395488 25105 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:54.413985 22366 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:54.482357 22441 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:54.482640 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 68740.1us
I20260709 12:17:54.484298 22366 leader_election.cc:400] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9.
I20260709 12:17:54.484603 22366 leader_election.cc:403] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:54.485190 22366 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:54.485411 22441 leader_election.cc:400] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
I20260709 12:17:54.485707 22441 leader_election.cc:403] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:54.463980 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49290 (request call id 295) took 1284 ms. Trace:
I20260709 12:17:54.449034 25437 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:54.495935 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:54.498121 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:54.499083 22549 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:54.499627 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:54.500201 22545 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.504326 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:54.506099 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:54.507541 22544 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:54.505105 22548 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:17:54.450209 25551 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.516350 22551 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:17:54.516381 22442 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:54.486117 22547 rpcz_store.cc:276] 0709 12:17:53.179367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.279965 (+100598us) service_pool.cc:224] Handling call
0709 12:17:53.280224 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:54.268654 (+988430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.463732 (+195078us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b54001400d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:54.463921 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091818368}
I20260709 12:17:54.456188 25572 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:54.525619 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:54.463377 25370 raft_consensus.cc:697] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:54.464102 25292 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:54.528988 22441 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:54.530192 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:54.482084 25290 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:54.538223 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:54.538990 22542 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:17:54.543883 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:54.544592 25542 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:54.545117 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:54.526000 25564 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9.
I20260709 12:17:54.534559 25438 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:54.546712 25438 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:54.433013 25549 consensus_queue.cc:260] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:54.534390 25494 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3.
I20260709 12:17:54.550616 25494 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:54.551245 25494 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:54.537961 24977 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:54.552601 25446 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:54.553009 25446 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:54.553383 25446 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:54.553947 25523 consensus_queue.cc:1059] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:17:54.555198 25523 raft_consensus.cc:3055] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:54.555539 25523 raft_consensus.cc:740] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:54.556281 25523 consensus_queue.cc:260] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:54.531347 25572 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.558250 25572 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:54.559149 25523 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.561558 25438 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:54.568404 22545 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:17:54.525452 24946 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:54.574193 24946 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.574591 24946 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.575709 22441 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:54.576457 25104 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:54.576540 25290 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.517908 25308 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:54.577422 25308 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:54.577847 25308 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:54.577989 25572 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.579015 25290 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:54.581701 25337 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:54.584188 22366 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:54.586241 25370 consensus_queue.cc:237] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.531598 25485 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:54.589094 25337 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:54.590728 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 201903us
I20260709 12:17:54.593145 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:54.612115 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:54.613284 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:54.613888 22542 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:54.615326 22366 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:54.613477 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:54.541474 25437 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:54.620234 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:54.621429 23131 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:17:54.623003 22548 raft_consensus.cc:2955] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 3 to 6, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:54.626000 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:54.626500 25587 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:54.628142 25587 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:54.628558 25587 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:54.628903 25587 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:54.630506 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.633098 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:54.458478 25476 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:54.589604 25337 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:54.655562 22473 raft_consensus.cc:2368] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11.
I20260709 12:17:54.635499 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.658643 23124 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:54.590400 23127 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:17:54.660665 22366 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:54.642421 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:54.662431 22468 raft_consensus.cc:2368] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8.
I20260709 12:17:54.621394 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:54.532783 25551 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:54.664916 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.536116 25428 consensus_queue.cc:1059] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:17:54.592180 25224 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:17:54.683820 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:54.668437 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.670261 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.612038 25290 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:54.675828 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.677184 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:54.687158 23131 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:17:54.677188 22475 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:54.680632 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.633883 25549 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:54.681495 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 60171.9us
I20260709 12:17:54.692754 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:54.656651 25400 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:54.687911 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:54.693661 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:54.694527 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.699476 22473 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
W20260709 12:17:54.678047 25576 log.cc:927] Time spent T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:17:54.697225 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:17:54.706216 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 171181us
I20260709 12:17:54.699852 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:54.662631 25337 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:54.703301 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:54.709363 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.709934 22469 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.681851 25573 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:54.713662 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.660228 25437 raft_consensus.cc:697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:54.695397 25588 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:54.705435 25572 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:54.635089 25485 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:17:54.746217 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:54.745193 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 66859.2us
I20260709 12:17:54.703965 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.710127 22395 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:54.658017 25565 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:17:54.712232 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:54.717042 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:54.689900 25290 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.718747 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:54.749164 22515 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:54.749594 22393 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:54.657979 25188 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:17:54.706284 22543 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:17:54.724231 23124 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:54.733049 25330 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:54.747021 22549 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:54.707185 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:54.748842 22396 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:54.698910 25438 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:54.697826 25400 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:54.666567 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.842461 25400 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:54.843686 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:54.843981 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 94893.9us
I20260709 12:17:54.766842 22469 raft_consensus.cc:2410] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:54.699048 25310 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:54.711074 25134 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:54.840804 22473 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:17:54.835233 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 89036.2us
I20260709 12:17:54.690442 25446 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.722332 25588 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:54.864004 25588 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:54.754432 25290 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.852691 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:54.856837 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:54.865258 22473 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.853559 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.866415 22367 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:54.708281 25104 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.137s
I20260709 12:17:54.854060 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.854562 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:54.752985 25573 raft_consensus.cc:697] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:54.767520 25438 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:54.713861 25208 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.860324 25603 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:54.860708 25134 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.863502 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.869853 22367 leader_election.cc:400] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11.
I20260709 12:17:54.890400 22367 leader_election.cc:403] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:17:54.890981 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.891535 22367 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:54.891692 25134 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:54.892112 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.892760 22367 leader_election.cc:400] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8.
I20260709 12:17:54.893092 22367 leader_election.cc:403] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:17:54.872562 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 178971us
I20260709 12:17:54.874552 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.874907 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.874524 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:17:54.893920 22475 raft_consensus.cc:2393] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 7: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:54.877245 22468 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:17:54.894064 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:54.894604 22441 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:54.878391 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:54.746731 25540 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 12:17:54.872046 25310 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:54.855722 25552 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:54.872321 25559 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:54.902030 22542 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:54.878551 25438 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.912494 22367 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:54.914685 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:54.923895 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:54.901001 25310 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.934116 22367 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:54.915750 25485 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:54.917007 25564 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8.
W20260709 12:17:54.945504 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 50548.5us
I20260709 12:17:54.920151 25572 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:54.947434 22367 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:54.930677 25439 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:54.962705 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 48102.9us
I20260709 12:17:54.963536 23095 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:54.940017 25574 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:17:54.949261 25590 log.cc:927] Time spent T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 12:17:54.926766 25428 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:17:54.939246 25310 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:54.916093 25552 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:54.948421 25485 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:54.964875 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:54.952525 25559 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:54.915659 25437 consensus_queue.cc:237] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.950917 25572 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.947662 25607 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:54.994643 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:55.001358 22543 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:54.992894 25559 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.002944 25559 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.968400 25187 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:55.016024 25596 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:17:55.018016 25610 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:54.966630 25600 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:17:54.946687 25573 consensus_queue.cc:237] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:55.000689 25329 consensus_meta.cc:287] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.535s	user 0.005s	sys 0.004s
W20260709 12:17:55.027750 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 62945.3us
I20260709 12:17:55.005131 25572 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:55.032780 25571 consensus_meta.cc:287] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.558s	user 0.006s	sys 0.000s
I20260709 12:17:55.039101 25571 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:54.994127 25485 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.999442 25564 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:55.004380 25604 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:55.044472 23095 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:55.023578 25551 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:55.047871 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 93535us
I20260709 12:17:54.980010 25292 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.036770 25610 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:55.052466 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:55.054528 22476 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:55.056298 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:55.038290 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 90931.1us
I20260709 12:17:55.034116 25330 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:55.020159 25445 consensus_meta.cc:287] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.815s	user 0.010s	sys 0.000s
I20260709 12:17:55.021729 25600 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:17:55.060103 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:55.060552 22367 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:55.043746 25564 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.061848 22470 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:17:55.061714 22474 raft_consensus.cc:2410] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:17:55.071691 22546 raft_consensus.cc:2393] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:55.071563 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:55.072996 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:55.077795 25599 log.cc:927] Time spent T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:17:55.081918 25208 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:55.082621 24946 consensus_meta.cc:287] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.002s
I20260709 12:17:55.083055 24946 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.085163 24946 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:55.088088 25438 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.089263 22549 raft_consensus.cc:1240] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:55.042246 25329 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.090265 22471 raft_consensus.cc:2393] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:55.089725 22473 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:17:55.091835 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:17:55.081518 25308 consensus_meta.cc:287] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.000s
I20260709 12:17:55.092171 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:55.090999 22393 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:17:55.095314 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:55.095901 25134 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11.
I20260709 12:17:55.067350 25337 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.095928 25612 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:55.103940 25208 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:55.099884 25308 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.114094 25400 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:55.098568 25384 consensus_meta.cc:287] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.680s	user 0.007s	sys 0.001s
I20260709 12:17:55.115665 25384 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8.
I20260709 12:17:55.116104 25308 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:55.119500 25310 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.122201 25619 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:55.122987 25329 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:55.092229 25564 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:55.100390 22474 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:55.126787 25571 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:55.127952 25438 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:55.130023 25559 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.132176 25559 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:55.133208 25400 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:55.136437 25337 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:55.138196 25522 consensus_meta.cc:287] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.001s
I20260709 12:17:55.138860 25612 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:55.138674 25522 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.105613 22543 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:17:55.140863 25522 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:55.140990 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:17:55.145015 25523 consensus_meta.cc:287] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.585s	user 0.005s	sys 0.005s
I20260709 12:17:55.062139 25604 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:55.106710 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:55.147716 25609 raft_consensus.cc:2764] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:17:55.148437 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.149252 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:55.149827 25476 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:17:55.051592 22284 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0723691b01e2413baf71cbc73a551fdc with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8c3bcfa13ca74a24ab8999a408532932 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:17:55.154057 22284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 102760us
W20260709 12:17:55.154852 25587 consensus_meta.cc:287] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
I20260709 12:17:55.155289 25587 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.156107 25476 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:55.156903 22545 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:55.162890 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:55.119905 25292 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:55.167310 22516 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:55.173650 25290 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.191175 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:55.105882 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 45419.7us
I20260709 12:17:55.192507 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:55.167014 22474 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:17:55.193090 22399 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:55.174671 25615 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:55.175009 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:55.192096 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:55.198643 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:55.204783 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:55.196851 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:55.176332 25446 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:55.177075 25485 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.172956 25564 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.177524 25208 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:55.171686 25438 raft_consensus.cc:2764] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 12:17:55.180157 25584 log.cc:927] Time spent T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.340s	user 0.001s	sys 0.002s
I20260709 12:17:55.180837 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 1595) took 1013 ms. Trace:
I20260709 12:17:55.214502 22476 rpcz_store.cc:276] 0709 12:17:54.167139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.191218 (+ 24079us) service_pool.cc:224] Handling call
0709 12:17:55.180665 (+989447us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b5400210554. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:55.180786 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1885083008}
I20260709 12:17:55.183776 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:55.216815 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:55.184068 25543 consensus_meta.cc:287] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.703s	user 0.009s	sys 0.000s
I20260709 12:17:55.184515 25572 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:55.163554 25588 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.185323 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:55.217712 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:55.218425 22546 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:55.189343 22469 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:55.121685 25310 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:55.219856 25310 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:55.220388 25310 raft_consensus.cc:697] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:55.221086 25572 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:55.194243 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:55.207267 22393 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:55.210340 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:55.203388 22396 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:55.214789 25292 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:55.196070 22551 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:55.060096 25601 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:55.169415 25587 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:55.249359 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:55.190610 25603 raft_consensus.cc:697] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:55.194734 25604 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:55.237947 22401 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:17:55.238418 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 44267.3us
I20260709 12:17:55.215389 25476 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:17:55.212543 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:55.222055 25329 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:17:55.223327 25619 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:17:55.292632 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:55.293882 22367 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:55.294862 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:55.219411 25588 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:55.276422 22550 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:55.239775 25438 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:55.229902 25543 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:55.287827 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:55.239195 22399 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:17:55.242574 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:55.302268 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 301) took 1232 ms. Trace:
I20260709 12:17:55.302656 22398 rpcz_store.cc:276] 0709 12:17:54.069569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.070527 (+   958us) service_pool.cc:224] Handling call
0709 12:17:54.070858 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:54.275553 (+204695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:54.275589 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:54.292370 (+ 16781us) log.cc:844] Serialized 26 byte log entry
0709 12:17:54.482966 (+190596us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:54.483005 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.547019 (+ 64014us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54001e2b54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:54.547070 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:55.179534 (+632464us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:55.302075 (+122541us) raft_consensus.cc:1685] finished
0709 12:17:55.302095 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.302216 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48798,"raft.queue_time_us":59647,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":11658,"spinlock_wait_cycles":369787904,"thread_start_us":133199,"threads_started":1,"wal-append.queue_time_us":332040}
I20260709 12:17:55.304105 22402 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:17:55.291563 22441 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:55.244011 25292 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:55.311172 25134 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:55.319343 22516 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:17:55.221341 25310 consensus_queue.cc:237] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.320770 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:55.317323 22441 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:55.317976 25292 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:55.301134 25438 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:55.339216 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:55.317803 25592 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.399s	user 0.002s	sys 0.000s
I20260709 12:17:55.308636 25559 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:55.336467 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:55.328998 25104 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:55.305562 25400 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:55.332953 22441 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:55.338769 25588 raft_consensus.cc:2764] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:17:55.276978 25601 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:55.363701 25620 log.cc:927] Time spent T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:17:55.366850 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:55.367491 25552 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:55.372763 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:55.373554 23127 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:55.383628 23127 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:17:55.387203 22398 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:17:55.387656 22398 pending_rounds.cc:85] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 8
I20260709 12:17:55.387898 22398 pending_rounds.cc:107] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:17:55.388147 22398 raft_consensus.cc:2889] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:55.343698 25208 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:55.339324 25438 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:55.335657 25542 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:55.391485 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:55.352260 22441 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:55.395681 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:55.396633 25383 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:55.397056 25383 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:55.397957 25105 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:55.398170 25564 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:55.398561 25383 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.348529 25104 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.362596 25446 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:55.403061 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:55.353729 25559 raft_consensus.cc:697] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:55.416531 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:55.418314 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:55.418156 25602 consensus_queue.cc:1059] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:55.415437 22542 raft_consensus.cc:2393] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:55.419458 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:55.419346 25602 consensus_queue.cc:1059] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:55.420692 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:55.410877 25104 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:55.421912 25383 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:55.410531 25329 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:55.427141 22542 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:17:55.414477 25105 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:55.420436 25224 raft_consensus.cc:3055] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:55.423329 25485 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:55.431577 25329 raft_consensus.cc:697] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:55.438889 25329 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.413720 25494 consensus_queue.cc:1059] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:17:55.442448 22543 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
W20260709 12:17:55.443588 25617 log.cc:927] Time spent T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
W20260709 12:17:55.444402 25623 log.cc:927] Time spent T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:17:55.434072 25224 raft_consensus.cc:740] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:17:55.465480 25614 log.cc:927] Time spent T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 12:17:55.468050 25601 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:55.357033 25603 consensus_queue.cc:237] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:55.482040 25105 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:55.485862 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.433862 25610 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:17:55.526087 25224 consensus_queue.cc:260] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:55.532450 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 211726us
I20260709 12:17:55.534879 22544 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:55.539134 22395 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:17:55.539299 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:55.540349 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:55.540899 22398 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:55.567428 25615 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:55.590857 22545 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:55.595328 22547 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:55.603675 22398 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:17:55.519549 25559 consensus_queue.cc:237] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.623942 22545 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:17:55.633272 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:55.635383 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:55.638746 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:55.649463 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:55.648381 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:55.654330 22516 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:55.654466 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:55.643093 25615 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:55.637542 25476 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:55.675240 22366 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:55.639827 25224 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:55.679380 25637 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:55.684026 25523 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:55.684288 25637 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.684684 25637 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:55.649597 25633 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:55.695051 24718 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:55.682538 25560 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:55.680104 25310 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:55.702069 25560 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:55.699158 25522 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:17:55.723768 25602 raft_consensus.cc:3055] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:55.724241 25602 raft_consensus.cc:740] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:55.725032 25602 consensus_queue.cc:260] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.726228 25602 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:55.748677 25438 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.749205 25627 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:55.749241 22516 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:55.751163 25615 consensus_queue.cc:1059] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:55.751204 25485 consensus_queue.cc:1059] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:55.751497 25618 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:55.752353 25485 raft_consensus.cc:3055] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:55.752723 25485 raft_consensus.cc:740] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:55.753245 22543 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:55.753870 25618 raft_consensus.cc:697] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:55.754704 25618 consensus_queue.cc:237] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.706717 25292 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.718693 25560 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:55.745486 25104 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.786667 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:55.795410 22401 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:55.788324 22442 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:55.797734 22442 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:55.784320 25637 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.803225 25635 raft_consensus.cc:3055] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:55.803781 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1558) took 1201 ms. Trace:
I20260709 12:17:55.809731 22548 rpcz_store.cc:276] 0709 12:17:54.602188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.622391 (+ 20203us) service_pool.cc:224] Handling call
0709 12:17:54.622683 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:54.622883 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:54.926805 (+303922us) log.cc:844] Serialized 14 byte log entry
0709 12:17:55.782726 (+855921us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b180036d4e0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a49e07 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a64455 00007fb4fc54c3c7 00007fb4f8b5e9a7 00007fb4f8b6e0bf 00007fb4f8b6e038
0709 12:17:55.794556 (+ 11830us) log.cc:844] Serialized 14 byte log entry
0709 12:17:55.803437 (+  8881us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.803483 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:55.803533 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.803604 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.803711 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9681,"prepare.queue_time_us":264104,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":2013,"raft.queue_time_us":51345,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":27003,"spinlock_wait_cycles":2444672,"thread_start_us":133438,"threads_started":2,"wal-append.queue_time_us":275048}
I20260709 12:17:55.804174 25600 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:55.804854 25292 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:55.804884 22542 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:55.815922 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:55.806813 25563 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:55.833490 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:55.834134 22393 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:55.839761 22442 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:55.753551 25485 consensus_queue.cc:260] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.807142 25105 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:55.846707 22393 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:17:55.847725 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:55.848126 22442 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:55.812844 25635 raft_consensus.cc:740] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:55.850863 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:55.854429 22393 raft_consensus.cc:1240] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:55.856727 22393 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:55.858069 22401 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:55.858716 22393 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:55.860016 22393 raft_consensus.cc:1240] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:55.852471 25608 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:55.870563 25384 consensus_queue.cc:1059] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:55.871680 25446 consensus_queue.cc:1059] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:55.871843 25494 consensus_queue.cc:1059] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:55.872509 25446 consensus_queue.cc:1059] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:55.872638 25635 consensus_queue.cc:260] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:55.873498 25446 raft_consensus.cc:3055] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:55.873087 25438 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:55.841215 25565 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.874460 25608 raft_consensus.cc:697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:55.843911 25105 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.874053 25445 raft_consensus.cc:3055] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:55.882982 22401 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:55.885085 25104 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:55.873921 25635 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:55.848856 25563 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:17:55.886106 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.873988 25485 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:55.902395 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:55.900195 25105 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:55.900365 25565 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:55.900612 25445 raft_consensus.cc:740] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:55.883699 25446 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:55.911191 22401 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:55.937575 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:55.979717 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.981195 22401 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
W20260709 12:17:55.987212 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.985002 22442 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:56.002017 25591 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 1.106s	user 0.004s	sys 0.013s
I20260709 12:17:56.016546 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:17:55.965837 25559 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.966526 25437 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:55.972332 25610 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:56.028033 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.025928 25612 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.029497 25612 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.031533 25612 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:56.033806 25543 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:56.035832 25640 log.cc:927] Time spent T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.351s	user 0.002s	sys 0.000s
I20260709 12:17:56.024595 25608 consensus_queue.cc:237] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.052073 25560 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:56.052585 25523 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:56.023419 25494 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:56.065990 22393 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:56.071156 25560 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:56.078187 25224 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:56.083163 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:56.078833 25224 raft_consensus.cc:697] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:56.054949 25610 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:56.028941 25559 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.027730 25437 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:56.107205 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 90756.4us
I20260709 12:17:56.027817 25445 consensus_queue.cc:260] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:56.112985 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 57956.2us
I20260709 12:17:56.054591 25446 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.114292 22401 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:56.118582 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:56.109355 25494 raft_consensus.cc:697] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:56.121061 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:56.121939 22468 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:17:56.115274 25565 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:56.127061 25446 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:56.142944 25610 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:56.147135 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:56.126631 25224 consensus_queue.cc:237] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:56.150341 25570 raft_consensus.cc:3055] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:56.150784 25570 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:56.151110 25437 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:56.143769 25655 log.cc:927] Time spent T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 12:17:56.151603 25570 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.152207 25494 consensus_queue.cc:237] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.152868 25570 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:56.158517 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:56.162681 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:56.163573 22472 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:56.166448 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:56.170154 22470 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:56.176090 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:56.176926 22470 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:56.188213 22367 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:56.194373 22441 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:56.237670 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:17:56.240733 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 52646.1us
W20260709 12:17:56.242501 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 48250us
I20260709 12:17:56.246129 22474 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:17:56.247680 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:56.249336 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:56.250291 22474 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:17:56.257305 22470 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:17:56.260130 22367 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:56.258404 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 144684us
I20260709 12:17:56.263852 25656 consensus_queue.cc:1059] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:17:56.264464 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.265384 24718 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.265386 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:56.266754 22475 raft_consensus.cc:1240] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:17:56.265900 24718 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.270529 22367 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:56.273521 24718 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:56.274765 22367 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:56.279219 22472 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:17:56.280094 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:56.280671 22472 raft_consensus.cc:2410] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:56.240037 25104 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.237346 25559 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:56.133526 25105 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.264930 25656 raft_consensus.cc:3055] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:56.258373 25480 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:56.294126 25480 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:56.294600 25480 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:56.288306 25656 raft_consensus.cc:740] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:56.306726 25656 consensus_queue.cc:260] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.308046 25656 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:56.287539 22475 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:56.251857 25660 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:56.271368 25439 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:56.288405 25665 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.283059 25564 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:56.274058 25560 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:17:56.285298 25523 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:56.333644 22468 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:17:56.288779 25104 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.327317 25523 raft_consensus.cc:697] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:56.338699 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1870) took 1713 ms. Trace:
I20260709 12:17:56.338964 22470 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:56.324932 25564 raft_consensus.cc:697] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:56.339057 22471 rpcz_store.cc:276] 0709 12:17:54.625570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.625707 (+   137us) service_pool.cc:224] Handling call
0709 12:17:56.338484 (+1712777us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b5400309dd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:56.338639 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1065741056}
I20260709 12:17:56.350652 22473 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:17:56.323212 25665 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.340440 25610 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.361330 25610 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:56.362097 25105 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:56.346302 25660 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:56.378695 23130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41012 (request call id 288) took 1184 ms. Trace:
I20260709 12:17:56.379142 23130 rpcz_store.cc:276] 0709 12:17:55.194680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.194967 (+   287us) service_pool.cc:224] Handling call
0709 12:17:55.215199 (+ 20232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.411640 (+196441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.411679 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.411720 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:55.411751 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.378458 (+966707us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54005b0ed4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:56.378508 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:56.378635 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451298688}
I20260709 12:17:56.380692 25564 consensus_queue.cc:237] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.382048 25523 consensus_queue.cc:237] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.385586 25104 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:56.397989 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.416741 25637 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:56.385457 25665 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:56.379078 25610 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:56.407989 25660 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:56.426172 25660 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:56.427958 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:56.428834 22398 raft_consensus.cc:2393] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 3: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:56.428870 25572 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.429478 25572 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:56.432060 25572 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:56.432859 22545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 1576) took 1211 ms. Trace:
I20260709 12:17:56.433283 22545 rpcz_store.cc:276] 0709 12:17:55.221787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.366594 (+144807us) service_pool.cc:224] Handling call
0709 12:17:56.432653 (+1066059us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54004209d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:56.432766 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":513558400}
I20260709 12:17:56.434863 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1897) took 1577 ms. Trace:
I20260709 12:17:56.435284 22477 rpcz_store.cc:276] 0709 12:17:54.857393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.892928 (+ 35535us) service_pool.cc:224] Handling call
0709 12:17:54.893194 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.103841 (+210647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.103871 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.103910 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:55.103944 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.434610 (+1330666us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b5400161554. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:56.434663 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:56.434802 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484001024}
W20260709 12:17:56.436599 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.431967 22402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1528) took 2209 ms. Trace:
I20260709 12:17:56.438725 22402 rpcz_store.cc:276] 0709 12:17:54.222746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.386995 (+164249us) service_pool.cc:224] Handling call
0709 12:17:55.303927 (+916932us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:55.304423 (+   496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.431761 (+1127338us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b54001e2b50. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:56.431892 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2092010880}
I20260709 12:17:56.440054 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:56.440969 25208 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.441574 25329 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:56.442160 25329 raft_consensus.cc:697] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:56.441473 25208 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:56.443049 25329 consensus_queue.cc:237] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.444761 25603 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:56.445257 25603 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.447763 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:56.448800 22547 raft_consensus.cc:2393] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 8: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:56.450395 22549 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:56.451442 25208 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:56.451481 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:56.452394 25603 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:56.453573 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.482097 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1559) took 1865 ms. Trace:
I20260709 12:17:56.482553 22551 rpcz_store.cc:276] 0709 12:17:54.616213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.832435 (+216222us) service_pool.cc:224] Handling call
0709 12:17:55.195879 (+363444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.244297 (+ 48418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.481890 (+1237593us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b540008d4d0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:56.482030 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":834230656}
I20260709 12:17:56.492614 25571 raft_consensus.cc:3055] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:56.493132 25571 raft_consensus.cc:740] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:56.499037 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:56.499907 22399 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:56.515064 23095 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:56.516481 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1890) took 1664 ms. Trace:
I20260709 12:17:56.516880 22469 rpcz_store.cc:276] 0709 12:17:54.852026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.852339 (+   313us) service_pool.cc:224] Handling call
0709 12:17:55.189000 (+336661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.219236 (+ 30236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.516254 (+1297018us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54003e3350. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:56.516414 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":771741440}
I20260709 12:17:56.520925 25656 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:56.521503 25656 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.521963 25446 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.523698 25656 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:56.523375 25446 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.524664 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:56.526067 25446 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:56.530562 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:56.534132 25290 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:56.538610 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:56.542032 22472 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:17:56.543121 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:56.550357 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:56.550858 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:56.551537 22473 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:56.552152 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:56.552351 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:56.552922 22473 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:56.553182 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:56.505105 22298 catalog_manager.cc:5697] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 7 to 10, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 10 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:56.554915 22298 catalog_manager.cc:5697] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:56.555519 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:56.525300 22477 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:56.556614 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:56.557741 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.558281 25446 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:56.558804 25446 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:56.560745 25446 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:56.561220 25446 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:56.554083 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:56.563349 22549 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:17:56.563865 22543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1983) took 1350 ms. Trace:
W20260709 12:17:56.564100 22284 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0723691b01e2413baf71cbc73a551fdc with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8c3bcfa13ca74a24ab8999a408532932 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:56.561702 25446 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:56.565600 25290 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:56.556624 22298 catalog_manager.cc:5697] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 7 to 11, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 11 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:56.567277 25290 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.565994 22543 rpcz_store.cc:276] 0709 12:17:55.213945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.502687 (+288742us) service_pool.cc:224] Handling call
0709 12:17:55.525978 (+ 23291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.753697 (+227719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.563653 (+809956us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54003ac354. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:56.563810 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522232192}
I20260709 12:17:56.570148 25290 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:56.557651 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:56.575409 22546 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:17:56.566371 22549 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:56.575999 25446 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:56.568473 22298 catalog_manager.cc:5697] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 4 to 7, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 7 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:56.494328 25571 consensus_queue.cc:260] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.583465 25571 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:56.566139 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:56.586275 22469 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:56.587566 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1976) took 1428 ms. Trace:
I20260709 12:17:56.587981 22542 rpcz_store.cc:276] 0709 12:17:55.158902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.432837 (+273935us) service_pool.cc:224] Handling call
0709 12:17:55.433095 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.831111 (+398016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.587331 (+756220us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b540042c054. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:56.587511 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":854642560}
I20260709 12:17:56.592414 22477 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:17:56.592752 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:56.595944 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:56.596712 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:56.598042 22367 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:56.598701 22547 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:56.600636 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:56.601646 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:56.602672 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:56.580598 22470 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:56.550391 22472 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:17:56.611261 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:56.610495 23124 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:17:56.611516 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:56.612319 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:56.612883 22546 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:17:56.612941 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:56.613966 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:56.614269 22542 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 8: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:56.613854 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:56.615378 22474 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:17:56.616205 22542 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:56.615409 22546 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:56.616750 22474 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:17:56.611865 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:56.594779 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:56.617718 22546 raft_consensus.cc:1240] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:56.603695 22475 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:17:56.604151 22395 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
W20260709 12:17:56.619175 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 165228us
I20260709 12:17:56.619472 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1555) took 1076 ms. Trace:
I20260709 12:17:56.622303 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:56.623050 22477 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:56.623087 23124 raft_consensus.cc:2410] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:17:56.626543 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:56.627357 22469 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:17:56.607271 25638 log.cc:927] Time spent T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:17:56.635030 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:56.631541 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:56.637493 22473 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:56.640688 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:56.623842 22441 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:56.635396 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:56.632385 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:56.645920 22477 raft_consensus.cc:2393] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 10: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:56.646304 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:56.647650 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:56.650528 22477 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:56.663551 22543 raft_consensus.cc:2393] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 8: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:17:56.620033 22395 rpcz_store.cc:276] 0709 12:17:55.543171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.545189 (+  2018us) service_pool.cc:224] Handling call
0709 12:17:56.530408 (+985219us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:17:56.619418 (+ 89010us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12579200}
I20260709 12:17:56.665529 22477 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:56.666031 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:56.609758 25522 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.460642 25602 consensus_queue.cc:1059] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.170s
I20260709 12:17:56.681516 22473 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:56.664456 22366 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:56.669466 23130 raft_consensus.cc:1275] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:56.668773 22477 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:56.678684 24718 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:56.679225 22516 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:56.626178 25290 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:56.610518 25665 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:56.700254 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 76488.5us
I20260709 12:17:56.623521 25383 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:56.663097 25337 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:17:56.712126 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:56.715570 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.663214 25587 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:56.668299 25633 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:56.678505 25572 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.717324 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:56.668183 25600 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:56.668119 25612 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.719795 22441 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:17:56.728206 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:56.699407 25476 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:56.702929 25188 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:56.662885 25308 consensus_queue.cc:1059] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 12:17:56.731189 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 216212us
I20260709 12:17:56.706532 25635 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:56.669071 25384 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:17:56.706274 25570 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:56.677860 25543 consensus_queue.cc:1059] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:17:56.715337 25337 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.699568 25208 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:17:56.725839 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:56.761099 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:56.697994 25522 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:56.755162 25570 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:56.764514 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 130266us
I20260709 12:17:56.733093 25105 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:56.711419 25485 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:17:56.718551 25603 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:17:56.820746 22401 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:56.732997 25656 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:56.714468 25665 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.736843 25608 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:17:56.826189 22472 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:56.759747 25635 raft_consensus.cc:697] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:56.827662 25635 consensus_queue.cc:237] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:56.728215 25612 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.736585 25600 raft_consensus.cc:697] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:56.718312 25383 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:56.821528 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:56.843680 22396 raft_consensus.cc:2393] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:56.731506 25660 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 12:17:56.753335 25476 raft_consensus.cc:697] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:56.819229 25573 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:56.818524 25105 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:17:56.855625 25669 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:17:56.859624 22396 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:56.859624 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:56.861027 22398 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
W20260709 12:17:56.831046 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 160641us
I20260709 12:17:56.730659 25572 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:56.816768 22397 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:56.837447 22472 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:56.811198 25337 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:56.810945 25543 consensus_queue.cc:1243] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:56.819761 25570 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:56.846520 22543 raft_consensus.cc:1275] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:56.897496 24718 raft_consensus.cc:697] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:56.898329 22399 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:56.903821 22367 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:56.909421 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:56.912822 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:56.923026 22402 raft_consensus.cc:2393] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 10: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:56.857712 25105 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:56.937970 22398 raft_consensus.cc:1240] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:56.938937 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 122149us
W20260709 12:17:56.939613 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 203436us
I20260709 12:17:56.925233 22397 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:56.936646 25446 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:56.943682 25639 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 1.258s	user 0.002s	sys 0.019s
I20260709 12:17:56.944063 25572 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:56.944355 25600 consensus_queue.cc:237] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.946215 25676 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:17:56.946867 22367 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:17:56.947579 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.947779 25684 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:56.948153 25684 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.948501 25684 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:56.950735 25603 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:56.951539 25445 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:56.941923 25602 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:17:56.953442 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:56.954648 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:56.934640 25688 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:56.954913 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:56.955921 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:17:56.926702 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 262318us
I20260709 12:17:56.914803 24718 consensus_queue.cc:237] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.929008 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:56.959215 22394 raft_consensus.cc:2393] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:56.940876 23095 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:56.962025 22402 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:56.936108 25308 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:56.916280 25439 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:17:56.981447 22548 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:56.985450 22402 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:56.987304 22471 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:56.989073 23124 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:56.989565 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:56.951267 25603 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:56.990725 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:56.980777 25308 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:56.982815 25688 raft_consensus.cc:697] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:56.993059 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:56.994964 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:57.006911 23131 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:56.963855 25400 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:56.991760 23125 raft_consensus.cc:1240] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:57.013666 23127 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:56.974677 25695 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:57.011933 25329 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:17:57.014307 25400 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:17:56.998468 25602 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.039436 25602 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.041499 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:57.041253 25688 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.042160 22469 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:17:56.943904 25476 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.042726 25612 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:57.043670 22442 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:57.044955 22442 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:57.046903 25383 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:57.047456 25383 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:57.024168 25308 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:57.028496 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:57.029371 22396 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:57.049274 25603 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:56.980063 25564 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:17:57.037918 25522 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:56.981648 25694 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:17:57.058086 22396 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:57.060272 22470 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3.
I20260709 12:17:57.019796 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:57.061684 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 96879.4us
I20260709 12:17:57.064740 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:57.043740 25480 consensus_meta.cc:287] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.749s	user 0.008s	sys 0.002s
I20260709 12:17:57.064137 22397 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:57.071060 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:57.072332 22442 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:57.074673 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:57.047379 25494 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:57.076481 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:57.075485 22397 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9.
I20260709 12:17:57.115680 22397 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:57.081375 22442 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:57.119375 25662 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:57.120604 22442 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:57.120745 25662 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:57.061668 25603 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:57.061619 25685 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.068380 25587 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:17:57.084813 22515 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.4:34357 timed out after 1.580s (SENT) [suppressed 29 similar messages]
I20260709 12:17:57.127401 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:57.162180 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 203534us
W20260709 12:17:57.173077 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.174111 25685 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:57.198167 25695 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:57.198853 25695 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:57.097523 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:57.389840 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 292406us
I20260709 12:17:57.390547 22516 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:57.392048 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:57.393064 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:57.393934 25370 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:57.077631 25543 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:57.394585 25370 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:57.394938 25370 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:57.395331 25370 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:57.125181 25104 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:57.395730 25633 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:57.395834 25104 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:57.396500 25104 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:57.397401 25633 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:57.077224 25660 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 12:17:57.397950 25290 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:57.115507 25383 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:57.186093 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:57.399710 22394 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
W20260709 12:17:57.400624 25687 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.275s	user 0.001s	sys 0.001s
I20260709 12:17:57.079281 25572 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 12:17:57.191581 22366 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:57.403038 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 211521us
I20260709 12:17:57.115303 25208 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:17:57.406241 25559 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:57.407626 25694 consensus_queue.cc:1059] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:57.408605 25694 raft_consensus.cc:3055] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:57.408937 25694 raft_consensus.cc:740] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:57.176438 25587 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:57.200263 25685 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:57.106838 23095 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:57.201119 25695 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:57.201594 22398 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9.
I20260709 12:17:57.176738 25603 raft_consensus.cc:697] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:57.207873 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:57.211601 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:17:57.213670 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 89699.6us
I20260709 12:17:57.206869 25618 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:17:57.259210 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 174414us
I20260709 12:17:57.257841 25329 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:57.209656 25105 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:57.216059 25337 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.288462 22476 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:17:57.264909 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:57.289080 23127 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:17:57.302968 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:57.309054 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:57.314682 25672 log.cc:927] Time spent T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.495s	user 0.003s	sys 0.000s
I20260709 12:17:57.318250 25710 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:57.337677 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:57.338696 25706 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:17:57.345945 22475 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:57.345063 25400 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:57.350188 25570 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.331951 25684 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:57.381138 25691 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.557s	user 0.002s	sys 0.008s
I20260709 12:17:57.386428 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:57.388360 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:57.388566 25609 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.395069 25543 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:57.424775 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:57.476635 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:57.443107 22393 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 10: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:57.447669 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:57.478050 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:57.478451 25633 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:57.433422 25710 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:57.076828 25480 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.446031 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:57.476871 22551 raft_consensus.cc:2393] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 8: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:17:57.412339 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 306945us
I20260709 12:17:57.443487 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:57.431533 22472 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9.
I20260709 12:17:57.488515 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:57.425297 22544 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:57.480995 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:57.438205 22367 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:57.482182 22549 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:17:57.464802 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:57.493439 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:17:57.494832 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:57.448560 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:17:57.416923 25675 log.cc:927] Time spent T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.590s	user 0.003s	sys 0.001s
I20260709 12:17:57.414027 25665 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:57.502167 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 64041.9us
I20260709 12:17:57.502559 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:57.412678 25695 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:17:57.414430 25689 log.cc:927] Time spent T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.590s	user 0.000s	sys 0.004s
I20260709 12:17:57.501047 22546 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:57.505834 22401 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:57.506513 24718 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:57.522842 22367 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:57.411631 25370 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:57.441068 25570 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:57.509016 25480 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:57.509310 25699 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:57.492723 25208 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.426783 25476 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.429613 25105 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:57.431334 25337 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:57.508867 25676 consensus_queue.cc:1059] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:17:57.510583 25684 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:57.411545 25587 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:57.409744 25694 consensus_queue.cc:260] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.501108 22474 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:57.422047 25618 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.425280 25329 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:57.516269 25104 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:57.414260 25438 raft_consensus.cc:3055] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:57.520816 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:57.523355 24718 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.603180 24718 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:57.548835 23129 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
W20260709 12:17:57.577332 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 51308.4us
I20260709 12:17:57.605589 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:17:57.606711 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:57.578670 25543 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.437927 25683 consensus_queue.cc:1059] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:17:57.492885 25523 consensus_queue.cc:1059] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:17:57.583510 22545 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:57.522680 25695 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.524214 25700 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:57.592999 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 199990us
I20260709 12:17:57.415272 25603 consensus_queue.cc:237] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.576061 25564 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:57.602814 25438 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:57.641286 25438 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.642505 25438 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:57.575891 25437 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:17:57.646098 25683 raft_consensus.cc:3055] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:57.646492 25683 raft_consensus.cc:740] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:57.484714 25609 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.647233 25683 consensus_queue.cc:260] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.648331 25683 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:57.648473 25559 consensus_queue.cc:1175] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8c3bcfa13ca74a24ab8999a408532932" responder_term: 8 status { last_received { term: 6 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:57.543506 25633 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:17:57.650311 25523 raft_consensus.cc:3055] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:57.650599 25633 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:57.651911 25633 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:57.576231 25635 consensus_queue.cc:1059] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:17:57.652882 25104 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:57.653450 25104 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.618880 22477 raft_consensus.cc:1240] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:57.619455 22441 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:17:57.580703 25208 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:57.614408 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 93671.6us
I20260709 12:17:57.620829 25696 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:57.630252 25660 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:57.615823 25543 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.620110 25570 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:57.635746 25329 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:57.637562 25618 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:57.580617 25476 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.639112 25370 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:17:57.687788 25682 log.cc:927] Time spent T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.861s	user 0.000s	sys 0.003s
I20260709 12:17:57.697082 25572 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:17:57.696986 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 77582.6us
I20260709 12:17:57.680480 25685 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.620168 25383 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.698887 25383 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.700387 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:57.613596 25674 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:57.701047 22545 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:57.697707 25572 raft_consensus.cc:697] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:17:57.702396 25572 consensus_queue.cc:237] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:57.707149 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:57.707967 22543 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:57.708521 22545 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:17:57.710121 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:57.711148 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:57.712561 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:57.648332 25609 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:57.621037 25695 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:57.713145 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:57.726847 24718 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.758917 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:57.712463 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:57.712813 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:57.712127 22547 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:57.711395 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:57.617949 25105 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:57.764750 22543 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:17:57.766830 22549 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:17:57.768249 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 223738us
I20260709 12:17:57.767943 24718 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:57.653662 25635 raft_consensus.cc:3055] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:57.698292 25476 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:57.715896 25718 log.cc:927] Time spent T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:17:57.684304 25560 raft_consensus.cc:3055] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:57.701380 25523 raft_consensus.cc:740] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:17:57.770941 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 152648us
I20260709 12:17:57.773730 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:57.684129 25563 raft_consensus.cc:3055] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:57.617722 25542 consensus_queue.cc:1059] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.148s
W20260709 12:17:57.773900 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 153206us
I20260709 12:17:57.766386 25105 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:17:57.774930 24718 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:57.714984 25104 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.692663 25384 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:57.619935 25661 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.150s
I20260709 12:17:57.698284 25685 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.776436 25560 raft_consensus.cc:740] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:57.714751 25383 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:57.786710 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:57.772848 22366 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:57.772832 25635 raft_consensus.cc:740] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:57.722319 25660 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.800127 25712 raft_consensus.cc:3055] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:57.800679 25712 raft_consensus.cc:740] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:57.786875 25105 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:57.782701 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:57.783885 25563 raft_consensus.cc:740] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:17:57.802234 25727 log.cc:927] Time spent T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:17:57.802752 25437 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:57.803097 25674 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.803541 25674 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:57.803936 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:57.805028 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:57.802043 22474 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:57.806752 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:57.807344 22477 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:17:57.807430 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:57.807982 22469 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:57.808894 23130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41012 (request call id 298) took 1104 ms. Trace:
I20260709 12:17:57.800192 25560 consensus_queue.cc:260] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.809247 23130 rpcz_store.cc:276] 0709 12:17:56.704611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.705618 (+  1007us) service_pool.cc:224] Handling call
0709 12:17:57.518629 (+813011us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b58001c5698. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:17:57.518820 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.581290 (+ 62470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:57.581321 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:57.581360 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:57.581401 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.808690 (+227289us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b54005b0ed4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:57.808733 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.808843 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149023744}
I20260709 12:17:57.810549 25560 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:57.802080 25635 consensus_queue.cc:260] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:57.813010 25208 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:57.814400 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:57.814996 25543 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:57.798569 25104 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:57.801246 25660 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:57.816210 25563 consensus_queue.cc:260] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.816704 25685 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:57.797995 25523 consensus_queue.cc:260] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:57.819933 25523 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:57.823496 22474 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:17:57.824376 25563 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:57.805977 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:57.825017 25437 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:57.826012 25685 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:57.826735 22366 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:17:57.827418 25694 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:57.794883 25384 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:17:57.797972 25677 log.cc:927] Time spent T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.974s	user 0.003s	sys 0.000s
I20260709 12:17:57.830726 25716 consensus_queue.cc:1059] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:57.831517 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:57.808142 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:57.890569 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:57.801466 25712 consensus_queue.cc:260] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:57.833788 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:57.892201 22543 raft_consensus.cc:2410] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:17:57.828717 22469 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:17:57.505795 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:57.844764 22471 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 10: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:57.848941 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:57.855109 22551 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:17:57.894851 22551 pending_rounds.cc:85] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 5
I20260709 12:17:57.895128 22551 pending_rounds.cc:107] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:17:57.895377 22551 raft_consensus.cc:2889] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:57.891307 22477 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:17:57.845230 22298 catalog_manager.cc:5697] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 4 to 6, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 6 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:57.856654 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:57.896919 22477 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:17:57.884522 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.900579 22367 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:17:57.901582 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 53164.7us
I20260709 12:17:57.902868 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:57.905061 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 56214.3us
I20260709 12:17:57.908346 22367 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:57.909909 24718 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:57.882404 25559 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:57.910406 22367 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:57.907438 25543 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:17:57.918416 22367 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:57.911360 25618 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:57.925709 24718 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:57.918294 25712 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:57.900203 25105 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:57.917712 25696 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:57.913100 25729 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:57.915100 25700 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:17:57.921564 25565 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:57.921841 25559 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:57.912452 25731 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:17:57.954209 22477 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:57.934193 25618 raft_consensus.cc:697] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:17:57.973227 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.946040 25565 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.946018 25696 raft_consensus.cc:697] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:17:57.991281 25565 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:58.037195 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1632) took 1516 ms. Trace:
I20260709 12:17:58.037681 22468 rpcz_store.cc:276] 0709 12:17:56.520738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.525907 (+  5169us) service_pool.cc:224] Handling call
0709 12:17:56.526288 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:56.526765 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:56.527068 (+   303us) log.cc:844] Serialized 14 byte log entry
0709 12:17:56.733882 (+206814us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:56.734464 (+   582us) log.cc:844] Serialized 52 byte log entry
0709 12:17:56.734602 (+   138us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:56.734634 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.734699 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:57.795745 (+1061046us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:58.029819 (+234074us) raft_consensus.cc:1685] finished
0709 12:17:58.036975 (+  7156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:58.037133 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58,"prepare.queue_time_us":682,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":4357,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":3483,"spinlock_wait_cycles":51391360,"thread_start_us":206067,"threads_started":1,"wal-append.queue_time_us":293676}
I20260709 12:17:57.992240 25716 consensus_queue.cc:1059] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 12:17:58.045665 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 138757us
I20260709 12:17:58.048810 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:17:58.054368 25731 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:58.079986 25731 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.080417 25731 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:58.089691 25602 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:58.060909 25609 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:58.049077 25559 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:58.092252 25609 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:58.055032 25618 consensus_queue.cc:237] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:58.061467 25696 consensus_queue.cc:237] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:58.139024 22474 raft_consensus.cc:1240] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:58.121191 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 66879.4us
W20260709 12:17:58.159571 22476 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 1905) took 1994 ms (client timeout 1617 ms). Trace:
W20260709 12:17:58.164913 22476 rpcz_store.cc:269] 0709 12:17:56.164866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.165414 (+   548us) service_pool.cc:224] Handling call
0709 12:17:58.157713 (+1992299us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400394c54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:58.159495 (+  1782us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2385442560}
W20260709 12:17:58.170145 22284 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0723691b01e2413baf71cbc73a551fdc with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8c3bcfa13ca74a24ab8999a408532932 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:17:58.172133 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:58.174189 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:58.174911 22474 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:17:58.177539 22468 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:17:58.181411 22477 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:58.159246 25690 raft_consensus.cc:3055] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:17:58.150509 25742 log.cc:927] Time spent T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:17:58.159626 25635 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:58.203253 25695 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:58.143074 25747 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:58.206074 25751 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:17:58.206632 25751 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:58.133061 25732 log.cc:927] Time spent T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.189s	user 0.001s	sys 0.001s
I20260709 12:17:58.211412 22476 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:17:58.188653 22474 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 12:17:58.187170 25690 raft_consensus.cc:740] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:58.145287 25674 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:58.141662 25384 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:17:58.207835 25747 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:58.214811 25737 log.cc:927] Time spent T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:17:58.219847 25731 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:58.248175 25731 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:58.252322 25747 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:17:58.254266 22470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 1636) took 1712 ms (client timeout 2151 ms). Trace:
W20260709 12:17:58.254660 22470 rpcz_store.cc:269] 0709 12:17:56.541898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.612106 (+ 70208us) service_pool.cc:224] Handling call
0709 12:17:58.254101 (+1641995us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b5400160654. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:17:58.254200 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011021184}
I20260709 12:17:58.257558 22442 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:17:58.258762 22442 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:58.235107 25600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.273s	user 0.055s	sys 0.037s
I20260709 12:17:58.262794 22402 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:58.264879 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:58.265472 22401 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:58.212916 25565 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:17:58.263082 25600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.316s	user 0.056s	sys 0.037s
I20260709 12:17:58.310966 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:58.310853 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:17:58.303205 25691 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:17:58.314457 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 55797.7us
I20260709 12:17:58.317421 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:58.320605 22394 raft_consensus.cc:2393] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 12: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:58.321139 22393 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 12:17:58.315621 22402 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:58.315954 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:58.265895 25564 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.328079 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:58.317171 25656 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:58.324723 22401 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:17:58.329300 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:58.335603 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:58.335842 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:58.336413 22402 raft_consensus.cc:2393] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:58.337172 22399 raft_consensus.cc:1240] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:17:58.338877 22397 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 10: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:58.343199 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:58.345170 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:58.322335 25494 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.349009 25609 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:58.351118 25710 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:58.329102 25694 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.352986 25694 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:58.360965 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:58.330642 25564 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:58.337174 25695 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:17:58.367743 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 45775.2us
I20260709 12:17:58.370630 22401 raft_consensus.cc:2410] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:17:58.373507 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:58.372117 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 181858us
I20260709 12:17:58.375620 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:58.376856 22401 raft_consensus.cc:2410] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:17:58.394052 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.397125 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:58.399245 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:58.309294 25690 consensus_queue.cc:260] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:58.404197 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:58.401672 25755 log.cc:927] Time spent T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:17:58.361900 25494 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:58.409947 22442 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:58.415308 22516 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:58.414717 25656 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:58.417951 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:58.419250 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:17:58.419970 22469 raft_consensus.cc:2393] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:58.405927 25564 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:58.420722 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:58.421175 25609 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:58.421815 25609 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:58.424001 25609 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:58.426966 25756 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:58.427249 22397 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:58.427268 25438 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:58.427601 22516 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:58.406193 22473 raft_consensus.cc:2393] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:17:58.430493 22442 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:58.435859 25674 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:58.435762 25690 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:58.436142 25609 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:58.440783 22469 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:17:58.440959 25722 log.cc:927] Time spent T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.070s	user 0.006s	sys 0.000s
I20260709 12:17:58.460357 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:58.458515 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:58.463434 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:58.443863 25602 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:58.474946 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:17:58.477974 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:58.434669 25603 consensus_queue.cc:1059] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:17:58.457643 25564 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:58.474776 25696 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:17:58.474581 25609 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:58.475175 25756 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
W20260709 12:17:58.493706 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 50742.9us
I20260709 12:17:58.479799 25747 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:58.495652 22442 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:58.496608 25602 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:58.492408 25696 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:58.498649 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:58.499398 22402 raft_consensus.cc:2393] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:17:58.499775 25696 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:58.498138 22442 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:58.502858 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:58.503506 22397 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:17:58.504943 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:58.508188 22442 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:58.510113 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.509315 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:17:58.501701 25693 log.cc:927] Time spent T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 1.307s	user 0.000s	sys 0.007s
I20260709 12:17:58.495714 25747 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.489717 25731 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:17:58.553107 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:17:58.490165 25564 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:58.507812 25762 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.550359 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:17:58.511206 25104 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:58.555704 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.505560 25750 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:17:58.511739 25208 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:58.506850 25726 consensus_queue.cc:1059] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:17:58.513854 25635 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:58.619514 22397 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:17:58.560065 22516 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:17:58.511338 25602 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:58.608542 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.550287 25747 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:58.619139 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:17:58.621236 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 61247.4us
I20260709 12:17:58.568783 25370 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:58.627449 25656 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:17:58.632182 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1551) took 3089 ms. Trace:
I20260709 12:17:58.628575 25618 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:17:58.629366 25766 log.cc:927] Time spent T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:17:58.619423 25696 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.632570 22400 rpcz_store.cc:276] 0709 12:17:55.542205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.643411 (+101206us) service_pool.cc:224] Handling call
0709 12:17:56.590186 (+946775us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:17:56.590388 (+   202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:56.590618 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:56.590644 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:56.610961 (+ 20317us) log.cc:844] Serialized 26 byte log entry
0709 12:17:56.963184 (+352223us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:56.963524 (+   340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.963592 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:58.400513 (+1436921us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:17:58.631774 (+231261us) raft_consensus.cc:1685] finished
0709 12:17:58.631795 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:58.631909 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15314560,"thread_start_us":351944,"threads_started":1,"wal-append.queue_time_us":459209}
I20260709 12:17:58.634179 25564 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:58.585927 25762 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:58.631021 25494 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:58.644484 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:17:58.646693 22475 raft_consensus.cc:2376] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 3. Re-sending same reply.
W20260709 12:17:58.638422 25765 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:17:58.660449 25753 log.cc:927] Time spent T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.340s	user 0.001s	sys 0.000s
I20260709 12:17:58.662555 25565 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:58.660712 25747 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:58.677819 25754 raft_consensus.cc:3055] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:58.677608 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:58.678296 25754 raft_consensus.cc:740] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:17:58.679028 22545 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:17:58.679159 25754 consensus_queue.cc:260] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:58.680526 25747 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:17:58.682471 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:58.684746 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:58.685415 22548 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:17:58.687656 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:58.688340 23127 raft_consensus.cc:2376] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8. Re-sending same reply.
W20260709 12:17:58.688926 23127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34092 (request call id 363) took 1254 ms (client timeout 1580 ms). Trace:
I20260709 12:17:58.690299 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:58.690649 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:58.691233 23130 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:17:58.693248 23129 raft_consensus.cc:1240] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:17:58.691560 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:17:58.695837 23125 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:17:58.678193 22546 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:58.713168 22475 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:58.636092 25618 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:58.717491 25618 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:58.724815 25762 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:58.717645 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:17:58.776216 25674 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.776978 25674 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:58.779366 25674 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:58.782296 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:17:58.801474 25729 raft_consensus.cc:3055] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:58.802040 25729 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:17:58.802942 25729 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:58.803970 25729 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:58.821416 25740 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.664s	user 0.000s	sys 0.006s
W20260709 12:17:58.828819 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.831559 25188 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:17:58.832305 22545 raft_consensus.cc:1240] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:58.832311 25188 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:17:58.837180 25188 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:17:58.861505 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:17:58.875866 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:58.689332 23127 rpcz_store.cc:269] 0709 12:17:57.434828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.687344 (+1252516us) service_pool.cc:224] Handling call
0709 12:17:58.688859 (+  1515us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:58.980293 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.994540 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:58.995663 23127 raft_consensus.cc:2393] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 10: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:17:59.006637 25674 consensus_queue.cc:1059] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:59.008324 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:17:59.009474 23127 raft_consensus.cc:2393] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 10: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
W20260709 12:17:59.431715 25370 consensus_meta.cc:287] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.798s	user 0.007s	sys 0.001s
I20260709 12:17:58.648116 25696 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:17:59.463585 25370 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:59.971207 25729 consensus_meta.cc:287] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 1.167s	user 0.012s	sys 0.000s
I20260709 12:17:59.971951 25729 raft_consensus.cc:3055] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:59.972357 25729 raft_consensus.cc:740] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:17:59.925470 25661 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.878s	user 0.000s	sys 0.019s
W20260709 12:18:00.201435 25661 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.156s	user 0.000s	sys 0.020s
I20260709 12:17:59.973275 25729 consensus_queue.cc:260] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:00.205308 25696 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:00.220278 25618 consensus_meta.cc:287] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 1.502s	user 0.003s	sys 0.005s
I20260709 12:18:00.220806 25618 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:00.223392 25618 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:00.680949 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1580) took 2424 ms. Trace:
I20260709 12:18:01.322889 22393 rpcz_store.cc:276] 0709 12:17:58.256454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.256925 (+   471us) service_pool.cc:224] Handling call
0709 12:17:58.257174 (+   249us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:58.321543 (+ 64369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:00.679888 (+2358345us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x7b540006fc54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:00.680612 (+   724us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146512640}
I20260709 12:18:01.459501 25694 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:01.290691 25105 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:01.622967 22442 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.066s	user 0.019s	sys 0.059s
W20260709 12:18:01.700146 22442 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.143s	user 0.019s	sys 0.063s
W20260709 12:18:01.701643 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 3.14582e+06us
I20260709 12:18:01.713495 25105 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:01.715780 25105 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:01.714725 25572 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:01.718545 25572 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:01.721027 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1674) took 3547 ms. Trace:
I20260709 12:18:01.721858 25572 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:01.723810 25105 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:01.731268 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1581) took 3474 ms. Trace:
I20260709 12:18:01.731726 22395 rpcz_store.cc:276] 0709 12:17:58.256701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.256819 (+   118us) service_pool.cc:224] Handling call
0709 12:17:58.257099 (+   280us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:58.303715 (+ 46616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:58.303756 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:01.712823 (+3409067us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b2c00106b88. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f744da11 00007fb4f745d372 00007fb4f8b8fa01 00007fb4f8b5443a 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2
0709 12:18:01.714470 (+  1647us) log.cc:844] Serialized 52 byte log entry
0709 12:18:01.729026 (+ 14556us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:01.729065 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.729250 (+   185us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:01.729298 (+    48us) raft_consensus.cc:1685] finished
0709 12:18:01.729308 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:01.731092 (+  1784us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11380,"raft.queue_time_us":11563,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"spinlock_wait_cycles":11631360,"thread_start_us":14010,"threads_started":1,"wal-append.queue_time_us":10673}
I20260709 12:18:01.734624 25105 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:01.735812 25105 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:01.738878 25105 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:01.729075 22468 rpcz_store.cc:276] 0709 12:17:58.173220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.178316 (+  5096us) service_pool.cc:224] Handling call
0709 12:17:58.178605 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:58.178814 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:58.178839 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:58.179341 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 12:17:58.293242 (+113901us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:58.293280 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.293349 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:01.660704 (+3367355us) spinlock_profiling.cc:243] Waited 8.17 ms on lock 0x7b2400433388. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f58ed9c4 00007fb4f58ebacb 00007fb4f5aa6dc9 00007fb4f5aa6a55 00007fb4f5aa5fb0 00007fb4f871c488 00007fb4f871cbe8 00007fb4f86f4398 00007fb4f86ef76a 00007fb4f86eebb6
0709 12:18:01.720064 (+ 59360us) raft_consensus.cc:1685] finished
0709 12:18:01.720096 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:01.720691 (+   595us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18780544,"thread_start_us":113490,"threads_started":1,"wal-append.queue_time_us":169392}
W20260709 12:18:01.792547 22544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.114s	user 0.022s	sys 0.018s
W20260709 12:18:01.793263 22544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.115s	user 0.023s	sys 0.019s
I20260709 12:18:01.803068 25788 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:01.806675 25751 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:01.807791 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:01.809386 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:01.809871 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:01.810257 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.808028 25791 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.816416 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1672) took 3483 ms. Trace:
I20260709 12:18:01.827155 25791 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:01.828171 23095 connection.cc:256] RPC call timeout handler was delayed by -1.8803749900000639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
W20260709 12:18:01.828713 23095 connection.cc:256] RPC call timeout handler was delayed by -1.8564789149997978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 12:18:01.829038 23095 connection.cc:256] RPC call timeout handler was delayed by -1.8486435840000013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
W20260709 12:18:01.829403 23095 connection.cc:256] RPC call timeout handler was delayed by -1.7453210480000507s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
W20260709 12:18:01.829704 23095 connection.cc:256] RPC call timeout handler was delayed by -1.3029419160000089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 12:18:01.830087 23095 connection.cc:256] RPC call timeout handler was delayed by -1.3029419160000089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
I20260709 12:18:01.826769 22394 rpcz_store.cc:276] 0709 12:17:58.332728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.401290 (+ 68562us) service_pool.cc:224] Handling call
0709 12:17:58.401676 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:58.403451 (+  1775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:58.403479 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:58.403893 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.803622 (+3399729us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b180034cae0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a49e07 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b 00007fb4f86f3d23 00007fb4f86f40d1 00007fb4f8b0fa0f
0709 12:18:01.805407 (+  1785us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:01.805466 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.805616 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:01.815788 (+ 10172us) raft_consensus.cc:1685] finished
0709 12:18:01.815812 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:01.816215 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1353,"raft.queue_time_us":2668,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":1367,"spinlock_wait_cycles":15589760,"thread_start_us":1399,"threads_started":1,"wal-append.queue_time_us":3400687}
I20260709 12:18:01.832043 25791 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:01.841672 25791 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.856108 25791 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:01.854666 22544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2023) took 3179 ms. Trace:
I20260709 12:18:01.858290 22544 rpcz_store.cc:276] 0709 12:17:58.675491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.676970 (+  1479us) service_pool.cc:224] Handling call
0709 12:17:58.677270 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:58.677618 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:58.677946 (+   328us) log.cc:844] Serialized 14 byte log entry
0709 12:18:01.793988 (+3116042us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:01.794784 (+   796us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.830277 (+ 35493us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:01.831087 (+   810us) log.cc:844] Serialized 14 byte log entry
0709 12:18:01.854174 (+ 23087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.854297 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:01.854358 (+    61us) raft_consensus.cc:1685] finished
0709 12:18:01.854370 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:01.854570 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22698,"prepare.queue_time_us":1875,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":97,"raft.queue_time_us":19840,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":431,"thread_start_us":3150596,"threads_started":2,"wal-append.queue_time_us":1331875,"wal-append.run_cpu_time_us":1382,"wal-append.run_wall_time_us":1084808}
I20260709 12:18:01.812541 25788 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:01.865401 25788 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:01.827582 25792 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:01.876216 25792 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:01.877413 22547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 2032) took 3195 ms (client timeout 2206 ms). Trace:
W20260709 12:18:01.877955 22547 rpcz_store.cc:269] 0709 12:17:58.681861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.877006 (+3195145us) service_pool.cc:211] Skipping call since client already timed out
0709 12:18:01.877196 (+   190us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:18:01.879484 22476 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 1668) took 3690 ms (client timeout 2345 ms). Trace:
W20260709 12:18:01.879944 22476 rpcz_store.cc:269] 0709 12:17:58.171656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.171839 (+   183us) service_pool.cc:224] Handling call
0709 12:18:01.861492 (+3689653us) spinlock_profiling.cc:243] Waited 38.6 ms on lock 0x7b54002021d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:01.861723 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88723200}
I20260709 12:18:01.869388 25754 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:01.886554 25791 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:01.890965 22443 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.304s	user 0.009s	sys 0.042s
W20260709 12:18:01.891991 22443 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.314s	user 0.009s	sys 0.042s
I20260709 12:18:01.894384 25792 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:01.898294 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49290 (request call id 323) took 3199 ms. Trace:
I20260709 12:18:01.898810 22550 rpcz_store.cc:276] 0709 12:17:58.698401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.889146 (+3190745us) service_pool.cc:224] Handling call
0709 12:18:01.890630 (+  1484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:01.891164 (+   534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:01.891201 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:01.891273 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:01.893563 (+  2290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.897883 (+  4320us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:01.898063 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:01.904490 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.905303 25290 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.906122 25290 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:01.910430 25587 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:01.910773 25751 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.911514 25587 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:01.912413 25572 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:01.913352 25572 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:01.911561 25751 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:01.914427 25587 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:01.915256 25750 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:01.915886 25750 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:01.921178 25563 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.923314 25750 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:01.926378 25290 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:01.923815 25543 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.924145 25476 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.927006 25587 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:01.927724 25476 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:01.927851 25587 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:01.922057 25563 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:01.924654 25781 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:01.915820 25572 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:01.933909 22468 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:01.939370 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:01.940292 22475 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:01.930338 25781 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:01.954115 25543 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:01.956750 25543 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:01.917179 25751 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:02.241122 22475 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:02.248569 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.248849 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.249751 22394 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:02.252259 25795 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:02.258109 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.259459 25754 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.259933 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:02.260179 25754 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.261471 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:02.263136 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 293954us
I20260709 12:18:02.271759 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.262370 25793 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.275381 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.277722 25781 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:02.278595 25781 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.281499 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.282488 25793 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:02.280948 23095 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.683s (SENT) [suppressed 3 similar messages]
I20260709 12:18:02.288679 25793 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:02.290176 25794 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:02.292486 22397 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:02.253017 25795 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.304311 22394 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:18:02.279436 25781 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.310493 25476 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:02.315990 25794 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.325054 25476 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:02.325846 25794 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:02.326069 25476 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.327049 25792 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:02.327879 25792 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:02.328332 25795 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:02.330611 25792 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:02.333995 25781 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:02.328353 25476 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:02.343333 25792 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:02.344201 25792 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:02.351389 25781 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:02.352437 25781 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:02.378546 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 120023us
W20260709 12:18:02.384063 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.389662 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.386566 25792 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:02.391553 22394 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:18:02.392601 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.393539 22394 raft_consensus.cc:2410] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:02.393469 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.412350 22399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1587) took 4095 ms. Trace:
I20260709 12:18:02.420507 22399 rpcz_store.cc:276] 0709 12:17:58.317024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.317880 (+   856us) service_pool.cc:224] Handling call
0709 12:17:58.336923 (+ 19043us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:58.337578 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.411910 (+4074332us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b54001e3550. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:02.412169 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42978048}
I20260709 12:18:02.446157 25802 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.446977 25802 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.451743 25802 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:02.446614 23094 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.441s	user 0.025s	sys 0.017s
W20260709 12:18:02.474570 23094 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.469s	user 0.026s	sys 0.017s
W20260709 12:18:02.475193 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 3.46931e+06us
I20260709 12:18:02.477007 25750 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.478217 25750 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.479318 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1579) took 4223 ms. Trace:
I20260709 12:18:02.480517 25802 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:02.479740 22398 rpcz_store.cc:276] 0709 12:17:58.256185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.256281 (+    96us) service_pool.cc:224] Handling call
0709 12:17:58.256599 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:58.267417 (+ 10818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:58.267447 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:01.961024 (+3693577us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b2c00106b88. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f744da11 00007fb4f745d372 00007fb4f8b8fa01 00007fb4f8b5443a 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2
0709 12:18:02.206022 (+244998us) log.cc:844] Serialized 52 byte log entry
0709 12:18:02.377923 (+171901us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:02.377967 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.383280 (+  5313us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.449848 (+ 66568us) raft_consensus.cc:1685] finished
0709 12:18:02.449869 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.479121 (+ 29252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11546,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":8498,"spinlock_wait_cycles":82328832,"thread_start_us":109977,"threads_started":1,"wal-append.queue_time_us":190486}
I20260709 12:18:02.475059 25609 raft_consensus.cc:3055] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:02.481722 25802 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.482221 25609 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:02.480635 25750 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:02.498924 25587 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:02.499560 25806 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:02.500401 25806 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.483641 25609 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.502885 25609 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:02.503161 25806 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:02.508049 25781 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:02.509713 22515 connection.cc:256] RPC call timeout handler was delayed by -3.6190789300001143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 12:18:02.510349 22515 connection.cc:256] RPC call timeout handler was delayed by -3.5560789300000124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
I20260709 12:18:02.511075 25745 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:02.511937 25745 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:02.517436 25745 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:02.518488 25587 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:02.519232 25587 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:02.521380 25587 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:02.522732 22515 connection.cc:256] RPC call timeout handler was delayed by -2.8626461999997446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
I20260709 12:18:02.527137 25745 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:02.528201 25745 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:02.530988 25745 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:02.531558 25745 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:02.532126 25745 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:02.534024 22515 connection.cc:256] RPC call timeout handler was delayed by -2.3295720199998868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2705s for a response
W20260709 12:18:02.510963 22542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.834s	user 0.020s	sys 0.021s
I20260709 12:18:01.932175 25563 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:02.534787 25609 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:02.528602 22298 catalog_manager.cc:5697] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 6 to 8, now has a pending config: VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1), VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2), VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3), VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 8 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:18:02.569447 22542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.893s	user 0.021s	sys 0.023s
I20260709 12:18:02.536113 25587 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:02.534212 25805 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:02.581138 22515 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:02.582185 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:02.589789 25609 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.601971 25785 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:02.602240 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:02.603122 22550 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9.
I20260709 12:18:02.602857 25785 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:02.603611 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.603992 25543 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:02.604669 22516 connection.cc:256] RPC call timeout handler was delayed by -2.7361595020001914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 12:18:02.605077 22516 connection.cc:256] RPC call timeout handler was delayed by -2.7361595020001914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 12:18:02.605376 22516 connection.cc:256] RPC call timeout handler was delayed by -2.4422732580001139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260709 12:18:02.606159 25543 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:02.606643 25756 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.607329 25756 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.594933 25745 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:02.609266 25609 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:02.609668 25745 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:02.607240 25290 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:02.535954 25806 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:02.588416 25802 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:02.534713 25781 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:02.594559 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2022) took 3919 ms. Trace:
I20260709 12:18:02.600797 22547 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:18:02.606904 25543 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.609716 25756 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:02.614080 25543 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:02.609875 25609 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:02.615065 25609 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:02.605667 22516 connection.cc:256] RPC call timeout handler was delayed by -2.4412510780000503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
W20260709 12:18:02.616664 22516 connection.cc:256] RPC call timeout handler was delayed by -2.3239815080000881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23450000000000004s for a response
W20260709 12:18:02.623220 22516 connection.cc:256] RPC call timeout handler was delayed by -2.162859502000174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
I20260709 12:18:02.603629 22515 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:02.615367 25781 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.610011 25731 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:02.610520 25290 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.625262 25731 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.610427 25745 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.611821 22542 rpcz_store.cc:276] 0709 12:17:58.675158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.675313 (+   155us) service_pool.cc:224] Handling call
0709 12:17:58.675654 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:58.676030 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:58.676058 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:58.676492 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 12:18:02.594115 (+3917623us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:02.594169 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.594285 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.594324 (+    39us) raft_consensus.cc:1685] finished
0709 12:18:02.594335 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.594498 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":249,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":3898291,"threads_started":1,"wal-append.queue_time_us":1533905,"wal-append.run_cpu_time_us":2318,"wal-append.run_wall_time_us":1006971}
I20260709 12:18:02.628041 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:02.639953 23127 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:18:02.643810 25754 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:02.644013 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:02.644835 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.645372 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.649597 25808 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:02.650048 22468 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 12:18:02.650542 25808 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.627112 25810 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:02.652082 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.652189 25810 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.653611 22475 raft_consensus.cc:2393] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:02.611037 25806 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:02.654640 25609 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:02.655726 25754 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:02.651618 22398 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: []
W20260709 12:18:02.657027 23094 connection.cc:256] RPC call timeout handler was delayed by -2.1976884229998177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 12:18:02.657131 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 53664.3us
W20260709 12:18:02.657732 23094 connection.cc:256] RPC call timeout handler was delayed by -1.9960884229999465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
W20260709 12:18:02.656900 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 161229us
I20260709 12:18:02.655992 25674 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.663136 25290 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:02.663441 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:02.611488 25802 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:02.668568 22468 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:02.669607 25806 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:18:02.670953 25785 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:02.663422 25674 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:02.656232 25754 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:02.678179 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:02.678584 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:02.679237 22471 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:02.678303 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.678109 25729 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:02.686007 25785 consensus_queue.cc:1059] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:02.686350 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1677) took 4500 ms. Trace:
I20260709 12:18:02.687067 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1592) took 4362 ms. Trace:
I20260709 12:18:02.687234 25290 raft_consensus.cc:3055] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:02.687752 25290 raft_consensus.cc:740] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:02.686978 22474 rpcz_store.cc:276] 0709 12:17:58.185881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.212854 (+ 26973us) service_pool.cc:224] Handling call
0709 12:17:58.213142 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:58.213332 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:58.225280 (+ 11948us) log.cc:844] Serialized 14 byte log entry
0709 12:17:58.665112 (+439832us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b180034f600. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a67522 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:18:02.408671 (+3743559us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b180034f600. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f59e1c0a 00007fb4ff121219 00007fb4f5a69a40 00007fb4f5a644e4 00007fb4f5a64455 00007fb4fc54c3c7 00007fb4f8b5e9a7 00007fb4f8b6e0bf 00007fb4f8b6e038
0709 12:18:02.497267 (+ 88596us) log.cc:844] Serialized 14 byte log entry
0709 12:18:02.665624 (+168357us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:02.674313 (+  8689us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:02.685865 (+ 11552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.685998 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.686172 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42065,"prepare.queue_time_us":17971,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":97889,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":254,"spinlock_wait_cycles":29245056,"thread_start_us":136208,"threads_started":2,"wal-append.queue_time_us":120082}
I20260709 12:18:02.686147 22515 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:02.693233 25609 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:02.693979 25785 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:02.690387 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.695289 22398 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:02.686348 25754 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:02.698702 25674 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:02.702301 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:02.707378 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:02.708106 22542 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
W20260709 12:18:02.710268 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 45069.7us
I20260709 12:18:02.711859 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:02.712819 23094 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:02.714084 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:02.714550 25799 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:02.714744 22550 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 7.
I20260709 12:18:02.714779 25810 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:02.624660 25805 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.715165 25799 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:02.690984 25290 consensus_queue.cc:260] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:02.717723 25805 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:02.718163 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1681) took 4327 ms. Trace:
I20260709 12:18:02.687491 22396 rpcz_store.cc:276] 0709 12:17:58.324169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.336390 (+ 12221us) service_pool.cc:224] Handling call
0709 12:17:58.350111 (+ 13721us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:58.366608 (+ 16497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:58.366641 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:58.367133 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:17:58.490813 (+123680us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:58.490856 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.663910 (+4173054us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b540005ebd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:02.665713 (+  1803us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.674237 (+  8524us) raft_consensus.cc:1685] finished
0709 12:18:02.674252 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.686914 (+ 12662us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1568,"raft.queue_time_us":395,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":29835,"spinlock_wait_cycles":37064064,"thread_start_us":87784,"threads_started":1,"wal-append.queue_time_us":184597,"wal-append.run_cpu_time_us":4740,"wal-append.run_wall_time_us":1101507}
I20260709 12:18:02.718955 25290 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:02.725369 22399 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:02.719857 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:02.726922 22550 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
W20260709 12:18:02.734257 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 70114.8us
I20260709 12:18:02.719576 25781 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:02.720362 22469 rpcz_store.cc:276] 0709 12:17:58.390030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.464548 (+ 74518us) service_pool.cc:224] Handling call
0709 12:17:58.488607 (+ 24059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:58.488823 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:02.483398 (+3994575us) log.cc:844] Serialized 14 byte log entry
0709 12:18:02.674194 (+190796us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:02.713732 (+ 39538us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:02.714110 (+   378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.716374 (+  2264us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.717151 (+   777us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3996039,"raft.queue_time_us":81748,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":180540,"threads_started":2,"wal-append.queue_time_us":140278}
I20260709 12:18:02.743081 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.754369 22442 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:02.769673 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.771906 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.774331 22399 raft_consensus.cc:2410] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:02.774374 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.779073 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.780450 25745 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:02.786230 22396 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:02.781549 22398 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:02.788333 23127 raft_consensus.cc:1240] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:02.790675 25729 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:02.791134 25729 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.791517 25729 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:02.792747 25808 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:02.793499 25731 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:02.767824 25754 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:02.794258 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 57785.1us
I20260709 12:18:02.740016 25587 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.807386 25384 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:02.808365 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1678) took 4617 ms. Trace:
I20260709 12:18:02.808781 22477 rpcz_store.cc:276] 0709 12:17:58.190798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.213702 (+ 22904us) service_pool.cc:224] Handling call
0709 12:17:58.214004 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:58.214196 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:58.225546 (+ 11350us) log.cc:844] Serialized 14 byte log entry
0709 12:18:01.896340 (+3670794us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b180017a9a0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:18:02.793781 (+897441us) log.cc:844] Serialized 14 byte log entry
0709 12:18:02.806767 (+ 12986us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:02.806849 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:02.806960 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.807981 (+  1021us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.808184 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4578713,"prepare.queue_time_us":17205,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":32442,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":355,"spinlock_wait_cycles":16133888,"thread_start_us":12442,"threads_started":1}
I20260709 12:18:02.811566 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:02.815832 22474 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:02.744164 25802 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:02.818945 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.821390 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.822558 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:02.822829 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.827339 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.830145 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:02.830819 22468 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:02.832666 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:02.834031 22394 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:18:02.834421 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:02.835146 22469 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:18:02.835462 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:02.836084 22472 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:02.836314 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:02.836788 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:02.837047 22474 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:18:02.840324 22471 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:18:02.843781 25384 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:02.844345 25384 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:02.823251 22544 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:18:02.851505 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.853169 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:02.250381 25751 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:02.857676 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:02.858424 25751 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:02.859513 25799 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:02.860399 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.847273 25754 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:02.866168 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:02.866909 22477 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:18:02.871037 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:02.872610 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.872548 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:02.877203 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.876286 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.878695 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:02.879325 22471 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:02.896134 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:02.896809 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:02.872457 25802 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:02.902786 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:02.904874 22399 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
I20260709 12:18:02.903471 22542 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:02.911494 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:02.912137 22544 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:02.910904 22442 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:02.919621 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:02.920104 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.920562 22472 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:18:02.923640 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:02.927984 22442 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:02.930022 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:02.913077 25808 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:02.933482 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:02.928800 22477 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:02.934195 22544 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:02.923772 25572 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:02.936375 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.929661 25781 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:03.070602 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:03.068169 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:03.111261 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.965356 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:02.961820 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:03.112231 22542 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:03.112257 22544 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 3.
I20260709 12:18:02.960443 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:03.113098 22547 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:02.938021 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.114058 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:03.114850 23126 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:03.116103 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:02.971112 25290 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.118211 25290 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.119223 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.118886 22298 catalog_manager.cc:5697] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:03.119958 22394 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:18:03.120517 25290 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:03.121021 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.951365 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:03.071516 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:02.974898 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:03.122653 22469 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:03.071403 22470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1954) took 4683 ms. Trace:
I20260709 12:18:03.124161 22550 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:18:02.958056 22475 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:02.945241 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:02.962095 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:03.046897 23130 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:18:03.114153 22397 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:18:03.136682 25808 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:03.138193 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:03.072305 25822 log.cc:927] Time spent T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:18:03.139112 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.135290 22548 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:18:03.139801 22394 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 10: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:03.123461 22470 rpcz_store.cc:276] 0709 12:17:58.253701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.266525 (+ 12824us) service_pool.cc:224] Handling call
0709 12:17:58.266862 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:58.267075 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:02.778415 (+4511340us) log.cc:844] Serialized 14 byte log entry
0709 12:18:02.896652 (+118237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:02.902400 (+  5748us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:02.911160 (+  8760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.923637 (+ 12477us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.937533 (+ 13896us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4450040,"raft.queue_time_us":89,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":18192,"thread_start_us":153299,"threads_started":2,"wal-append.queue_time_us":146489}
W20260709 12:18:03.141882 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.138684 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:03.063611 25785 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.937216 25814 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:02.965286 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:03.149559 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:03.078383 25587 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:02.961951 25572 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.156654 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:18:03.163326 22295 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50166 (request call id 207) took 33484 ms (client timeout 15000 ms). Trace:
I20260709 12:18:03.164189 22472 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:18:02.948967 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:03.168691 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:03.169188 23094 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.131464 25781 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:03.170053 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:02.970916 25745 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.170575 22395 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:18:03.174157 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.174934 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.148342 25808 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:03.079483 25751 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:03.154608 22545 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:18:02.943892 25729 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:03.183233 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.192926 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:03.183883 22550 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:18:03.169299 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:03.187186 23128 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:18:03.191622 22442 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:03.176265 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:03.181615 25814 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.200899 22397 raft_consensus.cc:2410] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:18:03.201960 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:03.189188 25781 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:03.207523 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:03.207509 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.209192 22475 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:18:03.209856 22399 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:03.211968 23129 raft_consensus.cc:2393] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 10: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:03.222060 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.222332 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:03.223887 22442 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:03.229802 22469 raft_consensus.cc:2410] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:18:03.200290 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:03.206432 25814 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.187861 25745 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.211563 25816 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:03.328539 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:03.330996 22394 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
W20260709 12:18:03.329519 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 105729us
I20260709 12:18:03.201344 25785 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:03.339922 25829 log.cc:927] Time spent T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:18:03.334084 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:03.337901 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:18:03.340705 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 212107us
I20260709 12:18:03.340626 22469 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 7.
I20260709 12:18:03.343120 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:03.341841 23124 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:18:03.345314 25785 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:03.338996 25823 log.cc:927] Time spent T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 12:18:03.338742 25384 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.339433 25745 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:03.349300 23130 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
W20260709 12:18:03.352527 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 153541us
I20260709 12:18:03.332183 25751 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:03.329262 25816 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:03.333719 25799 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:03.358078 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:03.354135 25831 log.cc:927] Time spent T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:18:03.353992 25786 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:03.366930 22515 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.357089 25750 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:03.358562 25816 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:03.358291 25799 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:03.383164 23152 debug-util.cc:398] Leaking SignalData structure 0x7b080010c4c0 after lost signal to thread 21247
W20260709 12:18:03.384233 23152 debug-util.cc:398] Leaking SignalData structure 0x7b0800310e00 after lost signal to thread 22333
W20260709 12:18:03.385452 23152 debug-util.cc:398] Leaking SignalData structure 0x7b080022cea0 after lost signal to thread 22426
I20260709 12:18:03.386871 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:03.373111 25750 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:03.393819 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 50818.6us
I20260709 12:18:03.374248 25731 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:03.386951 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:03.388422 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.370747 25751 raft_consensus.cc:697] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:03.398669 25751 consensus_queue.cc:237] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.387698 22474 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 3.
I20260709 12:18:03.401456 25384 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.377040 25799 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:03.409492 23152 debug-util.cc:398] Leaking SignalData structure 0x7b08002694a0 after lost signal to thread 22501
W20260709 12:18:03.411130 23152 debug-util.cc:398] Leaking SignalData structure 0x7b080026b0a0 after lost signal to thread 22502
W20260709 12:18:03.419924 23152 debug-util.cc:398] Leaking SignalData structure 0x7b080035a720 after lost signal to thread 22575
W20260709 12:18:03.420527 23152 debug-util.cc:398] Leaking SignalData structure 0x7b0800341b00 after lost signal to thread 22576
W20260709 12:18:03.422024 23152 debug-util.cc:398] Leaking SignalData structure 0x7b0800159140 after lost signal to thread 23155
W20260709 12:18:03.422330 23152 debug-util.cc:398] Leaking SignalData structure 0x7b08003802e0 after lost signal to thread 23156
I20260709 12:18:03.395282 25750 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:03.425005 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:03.425640 22474 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:18:03.413084 25731 raft_consensus.cc:697] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:18:03.185500 22295 rpcz_store.cc:269] 0709 12:17:29.678935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.715823 (+ 36888us) service_pool.cc:224] Handling call
0709 12:17:29.963230 (+247407us) spinlock_profiling.cc:243] Waited 8.71 ms on lock 0x7b540038b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abe090 00007fb4f8b5cf3a 00007fb4fe912e9c 00007fb4fea1104e 00007fb4fced22a4 00007fb4fced2232 00007fb4fced2161 00007fb4fced20dc 00007fb4fced1392 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:17:53.192915 (+23229685us) spinlock_profiling.cc:243] Waited 7.93 ms on lock 0x7b540038afa8. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fda7daa1 00007fb4fdaa49b4 00007fb4fc5883dc 00007fb4fc549e0b 00007fb4fc549be4 00007fb4fea49fa1 00007fb4fea4a7ff 00007fb4fe909a1b 00007fb4fea1190e 00007fb4fced22a4 00007fb4fced2232
0709 12:18:03.163072 (+9970157us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:53.789133 (+     0us) spinlock_profiling.cc:243] Waited 6.71 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f5a4a0ac 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a64455 00007fb4fc58916c
0709 12:17:53.983246 (+194113us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:53.983894 (+   648us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:53.983952 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:17:53.983971 (+    19us) tablet.cc:662] Decoding operations
0709 12:17:53.984954 (+   983us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:53.985043 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:53.985081 (+    38us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:17:54.001398 (+ 16317us) tablet.cc:701] Row locks acquired
0709 12:17:54.073831 (+ 72433us) write_op.cc:260] PREPARE: finished
0709 12:17:54.074041 (+   210us) write_op.cc:270] Start()
0709 12:17:54.074291 (+   250us) write_op.cc:276] Timestamp: P: 1783599474073965 usec, L: 0
0709 12:17:54.074326 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:17:54.112917 (+ 38591us) log.cc:844] Serialized 3233 byte log entry
0709 12:17:54.401568 (+288651us) op_driver.cc:464] REPLICATION: finished
0709 12:17:54.704861 (+303293us) write_op.cc:301] APPLY: starting
0709 12:17:54.704942 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:54.705121 (+   179us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:54.705146 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:54.859991 (+154845us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:54.860230 (+   239us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:17:54.860274 (+    44us) write_op.cc:312] APPLY: finished
0709 12:17:54.860525 (+   251us) log.cc:844] Serialized 64 byte log entry
0709 12:17:54.860683 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:54.860793 (+   110us) write_op.cc:454] Released schema lock
0709 12:17:54.860838 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:54.861237 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:54.861263 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9933,"reported_tablets":51,"spinlock_wait_cycles":38261376,"child_traces":[["op",{"apply.queue_time_us":300589,"apply.run_cpu_time_us":3258,"apply.run_wall_time_us":156348,"num_ops":8,"prepare.queue_time_us":789518,"prepare.run_cpu_time_us":34011,"prepare.run_wall_time_us":303208,"raft.queue_time_us":17890,"raft.run_cpu_time_us":102268,"raft.run_wall_time_us":236948,"replication_time_us":322367,"spinlock_wait_cycles":15422848,"thread_start_us":1125109,"threads_started":4,"wal-append.queue_time_us":150173,"wal-append.run_cpu_time_us":3255,"wal-append.run_wall_time_us":1588716}]]}
I20260709 12:18:03.431417 25572 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.461647 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:03.462467 22474 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:03.437844 25729 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.463677 25838 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.470444 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:03.470868 25836 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:03.475733 25840 consensus_queue.cc:1059] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:18:03.476135 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 59296.8us
W20260709 12:18:03.477715 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 106241us
I20260709 12:18:03.450117 25731 consensus_queue.cc:237] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:03.480837 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:03.481504 22548 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:03.483338 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 54223.2us
I20260709 12:18:03.484251 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.477579 25838 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:03.493316 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:03.497401 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:03.499231 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:03.500038 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:03.502121 22547 raft_consensus.cc:2410] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:18:03.505329 22548 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:03.506395 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:03.508587 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:03.506727 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:03.511921 22471 raft_consensus.cc:2393] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:03.512079 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:03.512950 22476 raft_consensus.cc:2410] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:03.500542 22545 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:03.514011 23094 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.522015 22544 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 12: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:03.511197 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:03.510456 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:03.534647 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 50560.5us
I20260709 12:18:03.540480 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:03.523710 25791 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:03.543035 22546 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 8: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:03.544219 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:03.538461 23095 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.554651 22442 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:03.550767 25786 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.548779 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.494174 25836 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:03.561632 23152 debug-util.cc:398] Leaking SignalData structure 0x7b08002c9bc0 after lost signal to thread 25696
I20260709 12:18:03.556528 25188 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:03.562036 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:03.568195 22545 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:03.566965 22442 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:03.528497 25849 raft_consensus.cc:3055] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:03.566002 22395 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:03.572468 25656 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:03.572852 25656 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:03.573132 25656 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:03.574811 25808 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.576900 25808 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.578267 25564 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:03.563895 25791 raft_consensus.cc:697] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 10 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:03.569664 25188 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.579298 25188 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:03.578935 25564 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:03.579459 25791 consensus_queue.cc:237] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:03.579011 25696 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.581241 25696 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.583451 25696 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.583963 25696 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:03.584501 25696 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:03.584807 22366 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:03.586192 25750 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.587363 25400 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:03.587561 25559 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:03.587918 25400 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:03.571096 25781 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.566730 25751 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:03.591487 25751 raft_consensus.cc:697] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:03.560950 25786 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:03.591758 25565 consensus_queue.cc:1059] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:03.592448 23095 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:03.593719 23095 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.596201 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:18:03.593538 25565 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:03.607169 22395 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
W20260709 12:18:03.609004 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 46620.1us
W20260709 12:18:03.608673 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 44245.8us
I20260709 12:18:03.611402 25587 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:03.612921 22516 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:03.613821 25842 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:03.614269 25842 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:03.614667 25842 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:03.541494 25814 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.621726 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1693) took 1349 ms. Trace:
I20260709 12:18:03.594170 25523 consensus_queue.cc:1059] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:18:03.622886 25400 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:03.623070 24718 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:03.609076 25565 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:03.592098 25781 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.572013 25849 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:03.633970 25837 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:18:03.634358 25841 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:18:03.609189 25729 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:03.604161 25384 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.624369 22393 rpcz_store.cc:276] 0709 12:18:02.255543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.282836 (+ 27293us) service_pool.cc:224] Handling call
0709 12:18:02.283170 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:02.283576 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:02.442475 (+158899us) log.cc:844] Serialized 14 byte log entry
0709 12:18:03.604460 (+1161985us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:03.604518 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:03.604571 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:03.604651 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:03.604780 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1052565,"prepare.queue_time_us":286173,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"thread_start_us":212001,"threads_started":2,"wal-append.queue_time_us":184198}
I20260709 12:18:03.603950 25674 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:03.637012 22470 raft_consensus.cc:2393] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 4: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:18:03.636890 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.624439 25793 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:03.636431 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 50751.9us
I20260709 12:18:03.630492 25565 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:03.648062 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.635030 25105 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:03.651742 25838 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.635560 25837 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:03.639026 25729 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:03.651460 22442 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:03.656889 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.652155 24718 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.641363 25674 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:03.661490 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.648730 25798 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:03.626027 25559 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.649433 25793 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:03.671978 25785 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:03.672454 25785 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.672822 25785 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:03.674444 25836 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:03.677178 25814 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:03.679363 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 55101.1us
I20260709 12:18:03.670996 22516 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.652431 25564 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:03.687310 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.660269 25837 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:03.666188 25674 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.693619 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:03.666349 25745 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:03.653496 25384 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.663717 25729 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:03.660044 25587 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:03.700968 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1686) took 1394 ms. Trace:
I20260709 12:18:03.701370 22473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1680) took 5248 ms. Trace:
W20260709 12:18:03.703408 25845 log.cc:927] Time spent T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:18:03.679551 25793 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:03.704175 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1687) took 1373 ms. Trace:
I20260709 12:18:03.705899 25731 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:03.705870 25798 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.705816 25684 raft_consensus.cc:3055] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:03.701380 25750 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:03.667063 25799 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.724476 25684 raft_consensus.cc:740] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:03.725922 25816 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:03.726336 25684 consensus_queue.cc:260] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.727665 25684 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:03.728205 25816 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:18:03.729966 22441 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:03.731014 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 65084.4us
I20260709 12:18:03.731732 22441 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:03.733254 22441 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:03.737035 25837 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:03.710134 25745 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.694206 25290 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:03.692768 25814 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:03.662694 25105 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.720615 22545 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:03.718786 22401 rpcz_store.cc:276] 0709 12:18:02.244700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.399268 (+154568us) service_pool.cc:224] Handling call
0709 12:18:02.399681 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:03.588157 (+1188476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:03.588184 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:03.588682 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:18:03.617466 (+ 28784us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:03.617499 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:03.617557 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:03.617592 (+    35us) raft_consensus.cc:1685] finished
0709 12:18:03.617601 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:03.617697 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1204938,"raft.queue_time_us":1194659,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":25258,"thread_start_us":28398,"threads_started":1,"wal-append.queue_time_us":21662}
I20260709 12:18:03.705875 25188 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:03.670614 25751 consensus_queue.cc:237] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.748961 25808 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:03.749409 25808 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:03.749794 25808 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:03.750684 25785 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.752815 25785 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:03.748203 25656 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.754053 25665 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:03.754496 25665 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.754827 25665 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:03.755481 25656 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.742447 25745 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:03.718829 25849 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.721515 25731 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:03.712952 25587 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.766669 25587 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:03.749064 25559 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.714536 22473 rpcz_store.cc:276] 0709 12:17:58.389398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.435013 (+ 45615us) service_pool.cc:224] Handling call
0709 12:17:58.440840 (+  5827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:58.441186 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:02.896940 (+4455754us) log.cc:844] Serialized 14 byte log entry
0709 12:18:03.577659 (+680719us) log.cc:844] Serialized 14 byte log entry
0709 12:18:03.621482 (+ 43823us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:03.626449 (+  4967us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:03.626507 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:03.632003 (+  5496us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:03.637279 (+  5276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4981878,"prepare.queue_time_us":5338625,"prepare.run_cpu_time_us":178,"prepare.run_wall_time_us":179,"raft.queue_time_us":26590,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":39974,"thread_start_us":129832,"threads_started":2,"wal-append.queue_time_us":247068}
I20260709 12:18:03.713158 22400 rpcz_store.cc:276] 0709 12:18:02.244356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.247246 (+  2890us) service_pool.cc:224] Handling call
0709 12:18:02.248889 (+  1643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:02.249309 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:02.433718 (+184409us) log.cc:844] Serialized 14 byte log entry
0709 12:18:03.608780 (+1175062us) log.cc:844] Serialized 14 byte log entry
0709 12:18:03.637438 (+ 28658us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:03.637486 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:03.637537 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:03.637607 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:03.639207 (+  1600us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1094782,"prepare.queue_time_us":308836,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1441,"raft.queue_time_us":1140124,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3703,"spinlock_wait_cycles":38448384,"thread_start_us":275946,"threads_started":2,"wal-append.queue_time_us":224862}
W20260709 12:18:03.768865 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 117364us
W20260709 12:18:03.738485 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.766562 25731 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:03.761035 25814 raft_consensus.cc:697] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:03.707901 22516 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.672621 25696 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:03.761868 22441 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:03.742166 25290 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.774261 25290 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:03.777127 25384 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.780014 25105 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.780876 25188 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.781252 25842 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:03.782342 25849 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:03.784250 25842 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:03.785171 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:03.785902 25565 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.801831 25564 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.802292 24718 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.802464 25564 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.802917 25754 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:03.803359 25754 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:03.803453 25565 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.804039 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:03.804592 25564 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.805938 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:03.806384 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:03.807118 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.807629 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.808205 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.808676 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.809348 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.786391 22441 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:03.811112 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.811529 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:03.812119 22441 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:03.807574 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:03.812877 22402 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:03.814178 25608 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:03.814594 25608 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.815055 25608 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:03.817063 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.786618 25786 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:03.803754 25754 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:03.813258 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.818639 25384 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:03.819044 25384 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:03.819396 25384 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:03.820025 25786 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.787499 25105 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:03.820688 25105 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.811899 22393 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:18:03.821728 22401 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:18:03.822072 25781 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:03.822304 25814 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.823316 22441 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:03.791527 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 83697.5us
I20260709 12:18:03.792474 25480 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.824211 25480 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.826192 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:03.827070 25842 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:03.796267 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.828038 22394 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:18:03.828439 25480 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.787063 25799 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.814030 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:03.829304 22398 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:03.807639 25798 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.789830 23094 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.834168 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.834882 22393 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:18:03.835798 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:03.836303 22393 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:03.836488 25793 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.838006 25837 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:03.793156 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:03.812067 22395 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.841193 25290 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:03.838392 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.843173 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.843588 25745 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.844039 25290 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:03.841537 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.844687 22545 raft_consensus.cc:2393] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 8: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:03.845369 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.843731 22394 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:18:03.846457 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:03.847078 22400 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:18:03.846514 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.849545 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:18:03.838352 25859 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.079s	user 0.002s	sys 0.000s
W20260709 12:18:03.849939 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 60243.2us
I20260709 12:18:03.851663 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:03.852362 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:03.853062 23129 raft_consensus.cc:2393] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:03.838977 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:03.853855 22401 raft_consensus.cc:2376] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10. Re-sending same reply.
I20260709 12:18:03.818639 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:03.855605 22399 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:18:03.858312 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:03.859005 22401 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:18:03.860638 25808 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.744019 25816 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:03.861964 25816 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:03.862399 25816 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:03.863039 25745 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:03.851943 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:03.865967 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.827225 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.867830 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.868121 25842 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:03.868726 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.869503 25785 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:03.850344 25781 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:03.870013 25785 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:03.870167 25781 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:03.870494 25785 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:03.871690 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:03.871901 25731 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.873944 25745 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:03.874397 25745 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:03.874758 25745 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:03.874660 25750 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.875408 25750 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:03.878342 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 55120.9us
I20260709 12:18:03.879182 22441 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:03.879492 25750 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:03.879997 25656 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:03.880472 25656 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:03.881007 25656 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:03.821065 25105 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:03.885985 25814 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:03.887575 25729 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:03.888833 25384 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:03.890796 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 92645.3us
I20260709 12:18:03.724871 25523 consensus_queue.cc:1243] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:03.891459 25384 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.893929 25855 raft_consensus.cc:3055] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:03.894487 25855 raft_consensus.cc:740] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:03.895424 25855 consensus_queue.cc:260] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.891469 22398 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:03.896682 22400 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:18:03.851680 25786 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:03.897653 25786 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.898102 25786 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:03.898478 22442 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:03.899611 22442 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:03.868759 25842 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:03.900514 22516 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.903644 22395 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 4.
I20260709 12:18:03.904567 22402 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:03.913666 22401 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:03.908830 22399 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:18:03.880390 22441 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:03.888337 25656 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.916287 22397 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:03.919310 22393 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 13.
I20260709 12:18:03.916061 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:03.914852 22442 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:03.919315 22441 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:03.920500 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 150133us
I20260709 12:18:03.923142 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:03.923439 22441 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:03.900286 25814 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:03.896647 25855 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:03.758776 25674 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:03.893409 25785 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.926175 22441 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:03.917209 25842 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:03.919373 25799 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:03.885572 25754 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.919538 25290 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:03.944947 22442 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:03.928130 25802 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:03.927480 25840 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:03.868377 25587 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.928445 25814 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.929523 25384 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:03.954905 23128 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:03.953025 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:03.951872 25840 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.947939 25290 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:03.927928 25665 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:03.957407 25814 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:03.988230 22442 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:03.956549 25731 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:03.996870 25785 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:03.997856 25665 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.998090 25793 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.999495 25754 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:04.002178 25860 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:04.004730 25290 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:03.947461 25608 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.010818 22516 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:04.012707 22442 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:04.024291 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 75229.6us
W20260709 12:18:04.025954 25854 log.cc:927] Time spent T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.055s	user 0.006s	sys 0.000s
I20260709 12:18:04.014493 25384 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:04.029194 25862 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:04.030594 25656 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:03.993932 25840 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:04.038138 25793 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:04.039024 25870 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:04.039415 25785 consensus_queue.cc:1059] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:04.031747 25665 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:04.040710 25105 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.028609 22367 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:04.052418 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 126286us
I20260709 12:18:04.045254 25745 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:04.063032 22441 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:04.049903 25860 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:18:04.066200 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 46412.9us
W20260709 12:18:04.066788 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 79757us
I20260709 12:18:04.068563 22545 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:04.070263 25656 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:04.070848 25656 raft_consensus.cc:697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:04.071741 25656 consensus_queue.cc:237] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.076619 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.024931 25781 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:04.081875 22367 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:04.081722 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.082782 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:04.062201 25665 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:04.086053 22545 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:04.086630 22546 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:04.078043 25684 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:04.093029 25684 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:04.093511 25684 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:04.087054 25188 consensus_queue.cc:1059] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:18:04.094496 25105 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.095305 25608 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.067014 25808 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.098624 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:04.100036 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:04.102164 22547 raft_consensus.cc:1240] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:04.076658 25860 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:04.078889 25750 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:04.106415 23129 raft_consensus.cc:2368] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8.
I20260709 12:18:04.131870 23128 raft_consensus.cc:1240] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:04.096539 25665 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:04.135217 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:04.138347 22543 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:04.139077 22548 raft_consensus.cc:2368] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8.
I20260709 12:18:04.134631 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:04.078315 25786 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:04.166170 25587 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:04.166798 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:04.179021 25523 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:04.182770 25781 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:04.166967 25866 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:04.098855 25674 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:04.183677 22366 connection.cc:256] RPC call timeout handler was delayed by -4.9529759030001514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
I20260709 12:18:04.183993 24718 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.104270 25842 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.106371 25729 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.131914 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:04.185351 22546 raft_consensus.cc:1240] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:04.188244 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:04.188406 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 49637.5us
I20260709 12:18:04.324159 24718 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.106871 25798 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:04.101681 25384 raft_consensus.cc:697] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:04.204252 22547 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:04.183553 25745 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:04.209616 25868 log.cc:927] Time spent T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:18:04.210429 23126 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:04.210927 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:04.214339 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 156850us
I20260709 12:18:04.239277 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:04.255297 25874 log.cc:927] Time spent T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:18:04.140818 22542 raft_consensus.cc:2410] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 12:18:04.271258 25881 log.cc:927] Time spent T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.058s	user 0.002s	sys 0.013s
I20260709 12:18:04.274336 25290 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.280035 25840 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.283464 25684 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.285962 25872 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:04.205312 25816 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.286584 25665 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.292703 25814 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.141566 25785 consensus_queue.cc:1059] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
W20260709 12:18:04.294981 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 232017us
I20260709 12:18:04.295432 25793 raft_consensus.cc:697] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:04.296088 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.298880 25750 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.367869 25793 consensus_queue.cc:237] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.368455 25814 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.368554 25750 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:04.369834 25684 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.370558 22543 raft_consensus.cc:2368] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9.
I20260709 12:18:04.370759 25750 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:04.362293 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:04.299527 25870 raft_consensus.cc:697] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:18:04.324206 22366 connection.cc:256] RPC call timeout handler was delayed by -4.6001759030000358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
I20260709 12:18:04.320813 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:04.329638 22550 raft_consensus.cc:2368] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10.
I20260709 12:18:04.329514 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:04.375510 22545 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:04.331634 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:04.375684 22366 connection.cc:256] RPC call timeout handler was delayed by -3.4571759030000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3166s for a response
I20260709 12:18:04.333222 22393 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:04.337520 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:04.339617 25751 raft_consensus.cc:3055] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:04.347790 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:04.329375 25866 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:04.341535 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 156927us
I20260709 12:18:04.351249 22551 raft_consensus.cc:2368] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6.
I20260709 12:18:04.345912 22549 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:04.324023 25799 raft_consensus.cc:697] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:04.354938 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:04.355763 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:04.356112 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:04.329205 25856 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:04.362370 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:04.363124 24718 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.363149 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:04.352331 25560 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:04.372447 22546 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:04.323983 25523 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.334508 22548 raft_consensus.cc:1240] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:04.394621 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:18:04.379076 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 58369us
I20260709 12:18:04.347925 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:04.397571 22441 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:04.371354 25840 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:04.358404 25872 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:04.400146 25872 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:04.381753 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.386597 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:04.401710 22545 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:18:04.368201 25785 raft_consensus.cc:3055] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:04.391029 23129 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:04.402521 25785 raft_consensus.cc:740] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:04.403168 25560 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.403445 25785 consensus_queue.cc:260] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.404399 25785 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:04.405340 25560 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.354668 25729 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:18:04.361505 25860 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.390969 22396 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:04.393536 22397 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:04.368279 25290 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:04.395315 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:04.397725 23095 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:04.386605 25791 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:04.409834 22549 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:04.410713 22516 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:04.411718 23128 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:04.412133 23095 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:04.399219 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:04.399712 25608 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:04.401232 22551 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:18:04.363071 25786 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.406843 22542 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:04.397425 23122 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:04.378933 25751 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:04.428445 22516 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:04.414548 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:04.401108 25866 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.409524 25384 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:04.406103 25816 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.432430 25188 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:04.396391 25882 consensus_queue.cc:1059] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:18:04.414635 25754 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:04.392589 25856 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:04.448172 23095 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:04.449366 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:04.450157 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 51016.8us
I20260709 12:18:04.386791 25862 raft_consensus.cc:3055] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:04.427271 22551 pending_rounds.cc:85] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 6
I20260709 12:18:04.455219 23095 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:04.427774 25840 raft_consensus.cc:2764] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:18:04.432552 25656 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:04.450906 22396 raft_consensus.cc:2410] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:04.429697 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:04.460757 22542 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
I20260709 12:18:04.461696 23094 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:04.452988 22397 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:04.445451 22298 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32988 (request call id 92) took 11019 ms. Trace:
I20260709 12:18:04.427224 25608 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:04.453905 25862 raft_consensus.cc:740] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:04.454998 22551 pending_rounds.cc:107] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:18:04.465031 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:04.465540 22551 raft_consensus.cc:2889] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:04.458627 25786 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:04.458468 25674 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:04.488124 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:04.430289 25729 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:04.463131 25656 raft_consensus.cc:697] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:04.492377 25862 consensus_queue.cc:260] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:04.492925 25656 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:04.436326 25799 consensus_queue.cc:237] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.489575 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:04.463975 25842 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:04.498276 25523 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.439124 25751 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:04.500834 25751 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:04.458537 25754 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:04.461843 25802 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:04.446180 25665 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.500171 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.503548 22551 raft_consensus.cc:2368] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9.
I20260709 12:18:04.493543 25862 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:04.504957 22474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "277d262725804effb16ede64e81d19c8"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:04.505904 22474 raft_consensus.cc:606] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:04.469369 25860 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.469907 25814 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:04.509547 22476 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:04.502409 25754 raft_consensus.cc:697] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:04.512044 25754 consensus_queue.cc:237] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.498055 25786 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:04.470543 25856 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.471318 25837 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:04.514106 25786 raft_consensus.cc:697] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 11 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:04.445158 25872 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:04.474589 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:04.514879 22477 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:04.477049 22468 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:04.479396 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:04.518532 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 120623us
I20260709 12:18:04.518934 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.462579 22298 rpcz_store.cc:276] 0709 12:17:53.426229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.460520 (+ 34291us) service_pool.cc:224] Handling call
0709 12:17:53.777284 (+316764us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b5400030890. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a300b2 00007fb4fe9a9759 00007fb4fe941a76 00007fb4fe912d58 00007fb4fea1104e 00007fb4fced22a4 00007fb4fced2232 00007fb4fced2161 00007fb4fced20dc
0709 12:18:03.387376 (+9610092us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b540038afa8. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fc4be161 00007fb4fc5483af 00007fb4fc549b11 00007fb4fea49fa1 00007fb4fea4a7ff 00007fb4fe909a1b 00007fb4fea1190e 00007fb4fced22a4 00007fb4fced2232 00007fb4fced2161 00007fb4fced20dc
0709 12:18:04.445350 (+1057974us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:03.473698 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:03.474416 (+   718us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:03.474465 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:18:03.474483 (+    18us) tablet.cc:662] Decoding operations
0709 12:18:03.511938 (+ 37455us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:03.512037 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:03.512073 (+    36us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:18:03.512771 (+   698us) tablet.cc:701] Row locks acquired
0709 12:18:03.512820 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:18:03.513012 (+   192us) write_op.cc:270] Start()
0709 12:18:03.513174 (+   162us) write_op.cc:276] Timestamp: P: 1783599483512940 usec, L: 0
0709 12:18:03.513198 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:18:03.626637 (+113439us) log.cc:844] Serialized 3184 byte log entry
0709 12:18:03.944803 (+318166us) op_driver.cc:464] REPLICATION: finished
0709 12:18:03.990509 (+ 45706us) write_op.cc:301] APPLY: starting
0709 12:18:03.990612 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:03.990840 (+   228us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:03.991021 (+   181us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:03.992093 (+  1072us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:03.992426 (+   333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:18:03.992471 (+    45us) write_op.cc:312] APPLY: finished
0709 12:18:03.992807 (+   336us) log.cc:844] Serialized 58 byte log entry
0709 12:18:04.023875 (+ 31068us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:04.049105 (+ 25230us) write_op.cc:454] Released schema lock
0709 12:18:04.057354 (+  8249us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:04.093883 (+ 36529us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:04.093917 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6492547,"reported_tablets":13,"spinlock_wait_cycles":19586176,"child_traces":[["op",{"apply.queue_time_us":45441,"apply.run_cpu_time_us":3385,"apply.run_wall_time_us":85593,"num_ops":7,"prepare.queue_time_us":74926,"prepare.run_cpu_time_us":6257,"prepare.run_wall_time_us":183606,"raft.queue_time_us":93168,"raft.run_cpu_time_us":2284,"raft.run_wall_time_us":2384,"replication_time_us":431415,"thread_start_us":166530,"threads_started":4,"wal-append.queue_time_us":26859}]]}
I20260709 12:18:04.480441 22367 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:04.480760 22516 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:04.485484 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.437667 25882 raft_consensus.cc:3055] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:04.459079 25791 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:04.466035 25608 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:04.488122 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:04.489499 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:04.489629 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:04.490698 25400 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:04.491271 25290 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:18:04.436008 25870 consensus_queue.cc:237] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.472779 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:04.515084 25786 consensus_queue.cc:237] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:04.522415 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:04.606931 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 84590.2us
I20260709 12:18:04.524464 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:04.544445 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.546571 22550 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:18:04.546588 22469 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 7: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:18:04.550747 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 70397.7us
I20260709 12:18:04.551241 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.550719 22474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "367745908a334997957e47f869d9fb14"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:04.610126 22474 raft_consensus.cc:606] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:04.610569 22474 raft_consensus.cc:614] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:04.611511 22551 raft_consensus.cc:2393] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 6: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:04.554860 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:04.542932 25882 raft_consensus.cc:740] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:04.491855 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.564726 25878 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:18:04.653475 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 198332us
I20260709 12:18:04.645397 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:04.562417 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.563769 25665 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:04.563484 25860 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:04.564538 25781 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.563345 25880 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:04.636565 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:04.637596 25884 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.638382 25879 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:04.638829 25861 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:04.639735 22469 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:04.543919 25842 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:04.642369 25872 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:04.644200 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.650733 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:04.653102 25808 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.651440 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:04.654480 22542 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:04.564234 25816 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:04.657596 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.659103 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:04.661429 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:04.651522 22476 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 4.
I20260709 12:18:04.723078 22396 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:04.703373 22394 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:04.545970 25523 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:04.706601 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.736374 22547 raft_consensus.cc:2393] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:04.703456 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:04.564287 25791 raft_consensus.cc:697] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:04.711341 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:04.739676 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:04.711483 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.740242 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.563377 25802 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:04.603530 25814 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:04.743012 22550 raft_consensus.cc:2393] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 12: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:04.712103 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.652621 25750 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:04.638556 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:04.547017 25188 raft_consensus.cc:697] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 10 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:04.746023 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.750684 22544 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:04.732959 22543 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:04.751030 25188 consensus_queue.cc:237] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:04.756464 22477 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:18:04.757804 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:04.759071 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:04.739759 25850 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:04.760432 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:04.760797 25882 consensus_queue.cc:260] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:04.762249 25882 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:04.762663 25791 consensus_queue.cc:237] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:04.765235 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:04.766140 22469 raft_consensus.cc:2393] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:04.720317 25866 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:04.656298 25729 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.739243 22398 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:04.744395 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:04.720018 25842 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:04.734418 25880 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:04.745929 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 212717us
W20260709 12:18:04.733491 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 72140.3us
I20260709 12:18:04.758983 22548 raft_consensus.cc:3055] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:04.774435 22548 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:04.771590 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:04.771608 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.775324 22470 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:04.782491 22545 raft_consensus.cc:2393] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 12: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:04.662891 25878 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:04.796499 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.801966 22542 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:04.802167 22515 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:04.803172 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.803349 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:04.803952 22543 raft_consensus.cc:2393] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:04.805034 23095 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:04.806131 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:04.807089 25837 consensus_queue.cc:1059] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:04.807673 25608 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:04.808240 25837 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:04.809084 25837 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:04.809743 25856 raft_consensus.cc:3055] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:04.810192 25856 raft_consensus.cc:740] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:04.811066 25856 consensus_queue.cc:260] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:04.811758 22544 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:18:04.783032 22396 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:18:04.713510 25884 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.784233 22366 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:04.785633 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.814613 22549 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:04.789273 22469 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:04.791208 25880 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.773247 25842 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:04.791625 22548 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.708694 25860 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.702170 25665 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:04.722040 25781 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.818131 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:04.819511 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:04.809608 25837 raft_consensus.cc:697] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:04.824137 22545 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:04.826525 22477 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:18:04.750540 25814 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.826668 22548 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:04.826577 23129 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 7: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:04.827483 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:04.723526 25861 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.832973 22441 leader_election.cc:400] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9.
I20260709 12:18:04.743257 25808 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.835536 22468 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:04.839321 22471 raft_consensus.cc:2393] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 11: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:04.822010 25587 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:04.770198 25802 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.819408 25523 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:04.773856 25816 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.826964 25856 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:04.859109 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:04.875224 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:04.950258 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.838723 22441 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:04.842571 25877 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:04.919277 25665 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:04.921136 25884 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.922224 25684 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:04.922626 25587 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.923101 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:04.923779 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 139656us
I20260709 12:18:04.836863 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:04.924352 25781 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.926244 25802 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.823514 25290 consensus_queue.cc:1059] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 12:18:04.976454 25877 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:04.990208 25290 raft_consensus.cc:3055] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:04.990605 25290 raft_consensus.cc:740] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:04.990798 25814 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.930346 25878 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.930879 25837 consensus_queue.cc:237] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:04.932478 22284 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0723691b01e2413baf71cbc73a551fdc with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8c3bcfa13ca74a24ab8999a408532932 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:04.933133 25860 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:04.793663 25729 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:04.734232 25879 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:04.938442 22473 raft_consensus.cc:2410] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:18:04.943351 22475 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:04.834887 22547 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:04.970906 22470 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
W20260709 12:18:04.978892 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 140247us
I20260709 12:18:04.986828 22550 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:05.017937 22441 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:04.988505 25587 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:04.987610 25665 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:04.989143 22548 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:18:04.991478 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 343721us
I20260709 12:18:04.992241 22366 leader_election.cc:400] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8.
I20260709 12:18:05.024494 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.026304 22469 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:18:05.025818 22366 leader_election.cc:403] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:05.035475 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.036193 22469 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:18:04.988659 25684 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.022665 25878 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:05.009967 25400 consensus_queue.cc:1059] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:18:05.037917 25560 consensus_queue.cc:1059] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:18:05.034192 25866 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8.
W20260709 12:18:05.043788 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.044056 25816 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:05.044829 25608 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:05.014825 22284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 82583.9us
I20260709 12:18:05.055742 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.031303 25877 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:05.056989 22442 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:05.061800 22441 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:05.062232 23095 leader_election.cc:336] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.583s (SENT)
I20260709 12:18:05.066313 23095 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:05.064266 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:05.070554 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:05.072911 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:05.075898 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.076535 22474 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:05.076687 25886 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:05.077090 25729 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:05.077682 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:05.078313 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.079092 22546 raft_consensus.cc:1240] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:05.079479 25684 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:05.051468 25751 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.080240 25751 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.082221 25878 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:05.083015 22550 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:05.083518 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.084128 22474 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:05.084954 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.085338 25893 raft_consensus.cc:993] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:18:05.082427 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:05.085831 25808 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:05.082454 25751 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:05.079423 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.086640 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.087328 22477 raft_consensus.cc:2393] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 10: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:05.087505 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.088193 22468 raft_consensus.cc:2393] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:05.088059 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.088619 22477 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:18:05.088948 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.089428 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.022927 25290 consensus_queue.cc:260] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:05.093487 25878 raft_consensus.cc:697] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:05.089622 22468 raft_consensus.cc:2393] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 11: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:05.094313 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:05.111397 22474 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:05.095268 22472 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:05.099397 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:05.100690 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:05.112989 25860 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:05.113895 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:05.113047 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:05.114640 22468 raft_consensus.cc:2393] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:05.114862 22475 raft_consensus.cc:2393] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 12: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:05.115393 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:05.113049 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:05.115512 25878 consensus_queue.cc:237] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.116496 23122 raft_consensus.cc:2393] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:05.116847 22470 raft_consensus.cc:2393] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 12: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:18:05.119352 25885 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.727s	user 0.014s	sys 0.007s
I20260709 12:18:05.119700 22470 raft_consensus.cc:1240] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:05.119999 25861 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:05.121472 25861 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.101646 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:05.102069 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:05.103631 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.122028 25861 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.122206 22468 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:05.099239 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.124238 25861 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:05.124765 25861 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.125137 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:05.125880 22548 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:18:05.127311 23094 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:05.106284 22477 raft_consensus.cc:2410] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:18:05.128947 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:05.124439 22473 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:05.129807 22475 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:05.130635 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:05.131042 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.131436 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:05.131759 22469 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 10: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:05.129760 22477 raft_consensus.cc:2393] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:05.132344 25754 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:05.132743 25754 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:05.133018 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.122601 22471 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:05.133262 25754 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:05.134102 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:05.131873 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.135640 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:05.134774 22468 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:05.131340 22473 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:05.136051 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:05.137084 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:05.109138 25893 raft_consensus.cc:1081] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:18:05.106745 22549 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:05.138862 25729 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:05.139351 25729 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.137874 22473 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:05.137638 22475 raft_consensus.cc:2393] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:05.141814 22475 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:05.134496 22477 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:05.075769 25879 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:05.132694 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:05.139578 22470 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:05.146196 22474 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:05.147158 22469 raft_consensus.cc:2393] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:18:05.111609 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 49941.6us
I20260709 12:18:05.147902 22474 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:05.100373 25842 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:05.155608 22516 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:05.156111 22471 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:05.161844 22516 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:05.162679 22476 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:05.163049 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:05.173270 22441 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:05.152457 25729 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:05.178563 22471 raft_consensus.cc:1240] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:05.204710 22547 raft_consensus.cc:1240] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:05.217010 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.175770 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:05.180833 22470 raft_consensus.cc:1240] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: []
W20260709 12:18:05.242338 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 69177us
I20260709 12:18:05.243136 22441 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:05.243469 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 67780us
I20260709 12:18:05.125801 25587 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:05.163733 25850 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:05.246658 22516 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:05.125259 25861 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.247943 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:05.172562 25751 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:05.172869 25608 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.240471 25750 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:05.257421 22476 raft_consensus.cc:1275] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:18:05.259923 22441 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:05.245419 25384 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:05.247239 25877 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:05.251423 25816 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:18:05.239769 22350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 60627.9us
I20260709 12:18:05.179014 25808 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:18:05.266853 22441 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:05.274161 22366 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:05.276342 22441 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:05.259178 25750 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:05.266254 25860 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:05.264786 25840 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:05.279345 22441 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:05.279652 22549 raft_consensus.cc:1240] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:05.267843 25877 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.284346 22441 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:05.285168 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 172943us
I20260709 12:18:05.268857 25879 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:05.287068 22367 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:05.260972 25608 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.288738 22441 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:05.288136 25816 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:05.277827 25384 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:05.284027 25750 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:05.283008 25665 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:05.286737 25877 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:05.318583 22441 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:05.324304 22476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:05.326543 22476 raft_consensus.cc:606] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:05.285452 25560 consensus_queue.cc:1059] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 12:18:05.327934 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 81350us
I20260709 12:18:05.304802 25814 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:05.328430 22473 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:05.331053 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:18:05.335110 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.335454 22396 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:05.333563 22441 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:05.319932 25882 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:05.339404 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:05.343860 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:05.345216 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:05.332975 25754 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.351732 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:05.351733 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:05.346514 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:05.355075 22543 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:05.348440 23095 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:05.349050 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:05.356213 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:05.347344 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:05.341225 25901 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:05.335734 25816 raft_consensus.cc:697] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:05.360126 23095 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:05.351980 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:05.352535 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:05.336404 25523 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:05.351729 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:05.339784 25880 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:05.339982 25840 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:05.332443 25837 consensus_queue.cc:1059] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:18:05.361519 22548 raft_consensus.cc:2410] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:18:05.351871 25751 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:05.361713 25188 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:05.366926 25786 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:05.366806 22470 raft_consensus.cc:1240] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:05.367977 25895 log.cc:927] Time spent T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:18:05.360056 25886 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:05.369421 25902 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:05.361928 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:05.413507 23130 raft_consensus.cc:2393] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 11: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:05.376432 22441 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:05.352707 25785 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:05.342478 25882 raft_consensus.cc:697] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:05.352830 25384 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:05.339776 25878 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 12:18:05.368571 25894 log.cc:927] Time spent T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:18:05.409482 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.408759 22468 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
W20260709 12:18:05.414712 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 54656.9us
I20260709 12:18:05.415122 25879 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:05.439580 22468 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: []
W20260709 12:18:05.414860 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 62349.3us
I20260709 12:18:05.417012 25560 consensus_queue.cc:1059] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:18:05.417840 25904 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:18:05.446066 25816 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.438110 25751 consensus_queue.cc:1059] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 12:18:05.444233 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 137077us
I20260709 12:18:05.418150 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:05.418596 25899 log.cc:927] Time spent T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:18:05.380725 25840 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.420203 25786 raft_consensus.cc:697] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 4 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:18:05.423683 25898 log.cc:927] Time spent T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:18:05.430631 25608 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:05.424540 25896 log.cc:927] Time spent T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:18:05.398351 25850 consensus_queue.cc:1059] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:18:05.372674 25905 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:05.414247 25837 consensus_queue.cc:1243] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:05.411489 25587 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:05.411825 25908 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:05.352368 25791 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:18:05.372426 25880 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:05.433449 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.495836 25880 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:05.496037 22470 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
W20260709 12:18:05.424431 25897 log.cc:927] Time spent T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
W20260709 12:18:05.417122 25900 log.cc:927] Time spent T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:18:05.442075 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.442948 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:05.441519 22367 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:05.429718 25877 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.446339 25750 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.409014 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:05.449541 22366 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:05.449890 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:05.430357 25861 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:05.523205 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 73744.1us
I20260709 12:18:05.523732 25861 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:05.469110 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 94864.6us
I20260709 12:18:05.524243 22366 leader_election.cc:400] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8.
I20260709 12:18:05.524869 22516 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:05.487030 25916 raft_consensus.cc:3055] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:05.494731 25400 raft_consensus.cc:3055] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:05.525905 25560 consensus_queue.cc:1059] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:05.526999 25560 consensus_queue.cc:1059] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:05.527392 25750 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:05.500059 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 58613.4us
I20260709 12:18:05.497648 22544 raft_consensus.cc:1275] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:05.411299 25901 consensus_queue.cc:1059] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:18:05.528309 22367 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:05.445364 25882 consensus_queue.cc:237] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.465312 25840 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:05.512398 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:05.513123 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:05.536991 22394 raft_consensus.cc:2393] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:05.537827 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:05.495419 25729 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:05.526805 22366 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:05.443133 25384 raft_consensus.cc:697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:18:05.541890 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 126153us
I20260709 12:18:05.529441 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:05.542974 22474 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:05.544559 25384 consensus_queue.cc:237] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.532495 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:05.437440 25902 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:05.545797 22398 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
W20260709 12:18:05.529634 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.547421 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:05.538993 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:05.502545 25850 consensus_queue.cc:1243] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:18:05.550613 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:05.553227 25870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.014s	sys 0.008s
I20260709 12:18:05.553414 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:05.554036 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:05.554623 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:05.559839 22397 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:05.525955 25400 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:05.559412 22545 raft_consensus.cc:2368] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8.
I20260709 12:18:05.557654 22367 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:05.561138 22399 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:05.529078 25916 raft_consensus.cc:740] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:05.510076 25911 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:05.576789 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:05.536481 25750 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:05.610404 25750 raft_consensus.cc:697] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:05.611711 25877 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:05.611384 25750 consensus_queue.cc:237] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:05.600871 25911 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:05.614073 25911 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:05.614234 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 56684.3us
I20260709 12:18:05.614933 23122 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:05.615141 25861 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:05.615809 25861 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:05.616170 25861 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.616518 25861 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:05.561532 25902 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:05.617800 25786 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:05.618793 25915 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.619304 25915 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.582406 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:05.605041 25910 log.cc:927] Time spent T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:18:05.605239 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 78504us
I20260709 12:18:05.642760 22366 leader_election.cc:400] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10.
I20260709 12:18:05.643090 22366 leader_election.cc:403] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:05.644025 22366 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:05.645180 22366 leader_election.cc:400] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6.
I20260709 12:18:05.645442 22366 leader_election.cc:403] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:05.609378 25905 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:05.645970 25905 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.646337 25905 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:05.528091 25914 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 12:18:05.532394 25816 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 12:18:05.653908 25866 raft_consensus.cc:3055] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:05.654480 25866 raft_consensus.cc:740] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:05.655418 25866 consensus_queue.cc:260] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:05.656548 25866 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:05.636914 25856 raft_consensus.cc:3055] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:05.664112 25856 raft_consensus.cc:740] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:05.665055 25856 consensus_queue.cc:260] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:05.666103 25856 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:05.559134 25870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.014s	sys 0.009s
I20260709 12:18:05.668382 25916 consensus_queue.cc:260] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.669540 25916 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:05.635601 25915 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:05.637648 25754 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:05.638991 25400 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.615000 22367 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:05.736809 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.641505 25911 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.748448 22401 raft_consensus.cc:2393] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:05.715123 25914 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:05.750986 25914 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:05.751381 25914 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:05.751492 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 136570us
I20260709 12:18:05.713100 25901 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10.
I20260709 12:18:05.752209 22367 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:05.752939 22393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "277d262725804effb16ede64e81d19c8"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:18:05.750279 25917 consensus_queue.cc:1059] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:05.753563 22393 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:05.753950 22393 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:05.769701 22474 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:05.777446 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:05.751662 25915 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:05.785336 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:05.784178 22393 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.787411 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:05.755211 25902 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6.
I20260709 12:18:05.790329 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:05.789426 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 255131us
I20260709 12:18:05.795033 25886 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:05.769030 25901 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:05.796203 25861 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.819648 25922 consensus_queue.cc:1059] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:05.820524 25754 raft_consensus.cc:3055] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:05.826210 25754 raft_consensus.cc:740] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:05.827075 25754 consensus_queue.cc:260] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.828198 25754 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:05.779382 25729 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:05.837930 25861 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:05.791293 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.785531 25915 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:05.839129 25915 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:05.842193 25902 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:05.846707 25919 raft_consensus.cc:3055] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:05.847271 25919 raft_consensus.cc:740] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:05.848657 25919 consensus_queue.cc:260] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.820801 25901 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.850373 25901 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:05.821280 25400 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:05.849789 25919 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:05.867136 25785 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:05.868172 22549 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:18:05.871388 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 63831.8us
I20260709 12:18:05.872493 25922 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:05.875211 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:05.876109 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:05.876353 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:05.876552 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:05.876864 22396 raft_consensus.cc:2393] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:05.877157 22394 raft_consensus.cc:2410] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:18:05.877346 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:05.877503 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:05.877666 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:05.877753 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:05.877907 22402 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:05.878458 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:05.878602 22398 raft_consensus.cc:2393] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:05.878666 22396 raft_consensus.cc:2393] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:05.876065 22399 raft_consensus.cc:2368] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13.
I20260709 12:18:05.886495 22402 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:05.757136 25911 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:05.894629 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:05.898619 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:05.899036 22399 raft_consensus.cc:1240] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:05.898569 25750 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:05.912451 22393 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:05.915337 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 270271us
I20260709 12:18:05.916045 22366 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:05.927131 25750 raft_consensus.cc:697] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:18:05.928609 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.928369 25750 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.933576 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:05.936976 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:05.940577 22366 leader_election.cc:400] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9.
I20260709 12:18:05.941687 22366 leader_election.cc:403] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:18:05.942471 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:05.943879 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:05.944746 22393 raft_consensus.cc:2410] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:05.914279 25880 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.936659 25684 raft_consensus.cc:3055] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:05.937414 25911 raft_consensus.cc:2764] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:18:05.951455 25684 raft_consensus.cc:740] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:05.953543 25861 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:05.940724 25745 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:05.962188 25745 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.964380 25745 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:05.965365 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.966566 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:05.968636 22395 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:05.965199 25914 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:05.920980 25840 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:05.949517 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 196169us
I20260709 12:18:05.972498 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:05.978701 22400 raft_consensus.cc:1240] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:06.006567 22542 raft_consensus.cc:2393] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:06.007697 25842 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:05.970819 25785 consensus_queue.cc:1059] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:18:06.012293 25861 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9.
I20260709 12:18:06.012735 25785 consensus_queue.cc:1243] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:18:06.013291 25842 raft_consensus.cc:3055] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:06.013685 25842 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:06.014523 25842 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.016028 25840 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:06.019122 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.024870 25901 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.026276 22399 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:06.004715 25908 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.013490 25861 consensus_queue.cc:1059] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:18:06.000145 25911 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:18:06.046653 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:06.047523 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:18:06.048943 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:06.048982 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 152221us
W20260709 12:18:06.050006 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 106815us
I20260709 12:18:06.042361 25908 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:06.055092 25880 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:06.057063 22395 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:06.059583 23122 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:18:06.059898 22471 raft_consensus.cc:1240] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:06.061831 25523 raft_consensus.cc:3055] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:06.062292 25523 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:06.062394 25916 consensus_queue.cc:1059] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:06.046098 25905 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.071062 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:06.065227 22395 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 12:18:06.066761 22471 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:06.067070 25523 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.069538 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:06.069861 25929 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:18:06.072624 22475 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:18:06.075083 22397 raft_consensus.cc:2393] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:06.077419 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:06.077508 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:06.078047 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.063216 25916 consensus_queue.cc:1243] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:06.078476 22400 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
W20260709 12:18:06.080766 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 78582us
I20260709 12:18:06.080410 22395 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:06.079443 22402 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:06.081199 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:06.083788 22470 raft_consensus.cc:1217] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Deduplicated request from leader. Original: 6.4->[7.5-7.5]   Dedup: 7.5->[]
I20260709 12:18:06.083680 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:06.084357 22470 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:18:06.085233 25925 consensus_queue.cc:1059] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 12:18:06.089107 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1972) took 1451 ms. Trace:
I20260709 12:18:06.071708 25905 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:06.091889 25911 consensus_queue.cc:1059] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:06.093279 25908 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:06.094444 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.095433 25908 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:06.098521 22400 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:18:06.089504 22472 rpcz_store.cc:276] 0709 12:18:04.637286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.774517 (+137231us) service_pool.cc:224] Handling call
0709 12:18:05.095077 (+320560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:05.113097 (+ 18020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.088869 (+975772us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54002b3750. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:06.089015 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644374912}
I20260709 12:18:06.106981 25750 consensus_queue.cc:1059] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:06.107600 25925 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:06.108026 25925 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:06.108230 25903 raft_consensus.cc:3055] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:06.108667 25903 raft_consensus.cc:740] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:06.108852 25925 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.109592 25903 consensus_queue.cc:260] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.109845 25793 consensus_queue.cc:1059] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:06.106324 22366 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:06.111892 22367 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:06.110860 25903 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:06.114162 25905 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:06.114689 25905 raft_consensus.cc:697] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:06.114841 25560 consensus_queue.cc:1059] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:06.115588 25905 consensus_queue.cc:237] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.117666 25665 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.117937 25934 consensus_queue.cc:1059] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:06.118232 25665 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.113627 25866 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:06.119755 25866 raft_consensus.cc:3055] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:06.120097 25866 raft_consensus.cc:740] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:06.120393 25665 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:06.120842 25866 consensus_queue.cc:260] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.122601 25926 raft_consensus.cc:3055] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:06.122984 25926 raft_consensus.cc:740] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:06.123723 25926 consensus_queue.cc:260] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.125098 25925 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:06.127306 25913 consensus_queue.cc:1175] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "25ebf14868c042dca42f54b3e251e1b2" responder_term: 12 status { last_received { term: 9 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:06.108212 22395 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:06.111050 25911 raft_consensus.cc:3055] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:06.142171 22470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:06.149375 22470 raft_consensus.cc:606] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:06.149801 22470 raft_consensus.cc:614] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:06.115849 25560 consensus_queue.cc:1059] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:06.149222 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:06.160084 25750 consensus_queue.cc:1243] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:18:06.160714 25750 raft_consensus.cc:3055] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:06.161043 25750 raft_consensus.cc:740] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:06.161931 25750 consensus_queue.cc:260] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.160099 25880 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:06.162580 25665 consensus_queue.cc:1048] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:06.157925 25913 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.163690 25793 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:06.163784 25913 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:06.165508 22441 leader_election.cc:400] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8.
I20260709 12:18:06.165866 22441 leader_election.cc:403] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:18:06.166739 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:06.167536 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.137754 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:06.169564 25785 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.170619 25785 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.134747 25901 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:06.171813 25901 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.172302 25901 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:06.169518 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.173237 25785 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:06.146798 25884 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.174731 25884 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.175658 22543 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:06.176843 25884 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:06.129743 25866 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:06.177964 22543 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:06.179440 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49290 (request call id 353) took 1056 ms. Trace:
I20260709 12:18:06.179558 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:06.179828 22547 rpcz_store.cc:276] 0709 12:18:05.123098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.123517 (+   419us) service_pool.cc:224] Handling call
0709 12:18:05.123839 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:05.244156 (+120317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.179201 (+935045us) spinlock_profiling.cc:243] Waited 80.6 ms on lock 0x7b54003ca0d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:06.179356 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185403776}
I20260709 12:18:06.139447 25921 raft_consensus.cc:3055] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:06.181347 25921 raft_consensus.cc:740] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:18:06.181311 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.183684 22543 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:06.184145 22402 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:06.185791 22551 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:06.191192 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:06.186975 25750 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:06.135375 25914 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:06.195451 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.144045 25523 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:06.142405 25882 raft_consensus.cc:3055] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:06.196698 25877 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:06.196972 25882 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:06.197933 25882 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:06.198662 25877 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.147377 25911 raft_consensus.cc:740] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:06.199209 25877 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:06.200156 25911 consensus_queue.cc:260] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.137205 25902 consensus_queue.cc:1059] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:18:06.202452 25877 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:06.140470 25290 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:06.181610 25400 raft_consensus.cc:3055] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:06.207230 22545 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:06.187417 22475 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
W20260709 12:18:06.219372 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.215302 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:06.220224 22477 raft_consensus.cc:606] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:06.220598 22477 raft_consensus.cc:614] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:06.136147 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:06.208986 22473 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:06.222782 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:06.223501 22475 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:06.232575 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:06.199213 25882 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:06.234902 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:06.238996 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:06.241709 22477 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:18:06.241743 22470 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:06.146384 25915 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.255059 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:06.244196 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:06.258160 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:06.261659 25856 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:06.182366 25921 consensus_queue.cc:260] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:06.218814 25400 raft_consensus.cc:740] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:06.267726 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:06.224766 25793 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8.
I20260709 12:18:06.284929 22543 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:18:06.245112 25842 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:06.223860 25914 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:06.306043 25914 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:06.308831 25914 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:06.290055 22397 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 11: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:06.274859 22475 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:06.293459 22401 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:06.287743 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:06.312332 22474 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:06.295573 22402 raft_consensus.cc:1240] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:06.284647 25908 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:06.285203 25898 log.cc:927] Time spent T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:18:06.301244 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:06.347653 22544 raft_consensus.cc:2393] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 10: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:06.288265 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:06.348966 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:06.349716 22545 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:06.290954 25786 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.298161 25917 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.352936 25917 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:06.355053 25837 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.329833 25930 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:06.355589 25837 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:06.357936 25837 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:06.358469 22549 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:06.296365 25931 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:06.327945 23125 raft_consensus.cc:2410] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:18:06.377367 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:06.365899 22470 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:06.378130 22397 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:06.383750 22401 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
W20260709 12:18:06.384922 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 272137us
I20260709 12:18:06.347823 25921 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:06.388496 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:06.386523 22401 raft_consensus.cc:1275] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:06.249574 25913 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:06.330678 25840 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:06.389593 22474 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:06.346448 25901 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:06.392040 22395 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:06.390940 22367 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:06.392604 22476 raft_consensus.cc:1240] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:06.397492 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:06.397848 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 284497us
I20260709 12:18:06.398245 22543 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:06.378341 25931 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.400569 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:06.365746 25908 raft_consensus.cc:697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:06.424283 22544 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:18:06.432130 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:06.431963 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:06.434365 22550 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:06.377946 25786 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:06.400465 25861 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:06.443162 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.444865 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:18:06.445654 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 144950us
I20260709 12:18:06.447772 22401 raft_consensus.cc:2393] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:06.385432 25930 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:06.422878 25931 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:06.449869 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:06.436619 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.399132 25523 consensus_queue.cc:1059] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:18:06.424044 25608 consensus_queue.cc:1059] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:18:06.400516 25840 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.455221 22542 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:18:06.456136 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:06.458050 25786 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:06.491900 25786 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:06.492414 25786 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:06.494596 25786 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:06.463819 22397 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:06.466203 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:06.496517 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:06.497128 22543 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:06.498108 22399 raft_consensus.cc:1240] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:06.462989 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:06.466738 22542 pending_rounds.cc:85] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 8
I20260709 12:18:06.464427 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:06.480604 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:06.500344 22550 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:06.481805 25608 raft_consensus.cc:3055] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:06.483906 25840 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:06.485069 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:06.508292 22544 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
W20260709 12:18:06.508440 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.486234 25938 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.447017 25861 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.487367 25930 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:06.488056 22366 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:06.491250 25926 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:06.500420 22516 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:06.499917 22542 pending_rounds.cc:107] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:18:06.505066 22401 raft_consensus.cc:1240] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:06.506098 22397 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:18:06.519246 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:06.509388 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 1992) took 1143 ms. Trace:
I20260709 12:18:06.520229 22476 rpcz_store.cc:276] 0709 12:18:05.365936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.366179 (+   243us) service_pool.cc:224] Handling call
0709 12:18:05.366485 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:06.395930 (+1029445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.509152 (+113222us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400309dd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:06.509321 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2359527680}
W20260709 12:18:06.509331 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 101848us
I20260709 12:18:06.513432 22402 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:06.518887 22542 raft_consensus.cc:2889] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:06.531905 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:06.539074 22398 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 11: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:06.543200 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:06.536635 22442 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:06.549016 22442 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:06.542609 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:06.550782 22402 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:06.461728 25917 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:06.553375 22442 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:06.554077 22441 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:18:06.556303 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.520772 22366 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:06.531749 25934 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:06.507689 25608 raft_consensus.cc:740] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:06.566515 22543 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:06.579039 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:06.522434 25861 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:06.577358 22395 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:06.580966 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:06.532370 25754 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.582067 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:06.516345 25932 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:06.579231 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:06.586949 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:06.587447 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:06.588557 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:06.584085 22395 raft_consensus.cc:2410] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:18:06.582340 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 61648.5us
W20260709 12:18:06.584453 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 60852.4us
I20260709 12:18:06.587684 22476 raft_consensus.cc:2393] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:06.590569 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:06.589589 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.584970 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:06.561036 25850 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:06.564749 25880 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:06.552600 25915 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:06.592248 22395 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:06.554390 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:18:06.604014 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.555239 25884 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:06.614120 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:06.606747 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:06.564630 25930 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:06.610987 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:06.605384 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:06.618265 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:06.619798 22543 raft_consensus.cc:2368] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11.
I20260709 12:18:06.531961 25938 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.598588 25785 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:06.601653 25916 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:06.623106 22397 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:06.623576 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:06.633471 23094 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:06.598449 25903 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:06.598471 25905 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.577075 25870 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:18:06.603890 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:06.632124 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:06.634222 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:06.603482 25850 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.601365 25754 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:06.642168 22397 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 10: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:06.640606 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:06.646116 23125 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:06.647097 22548 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:06.652349 22550 raft_consensus.cc:1240] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:06.630030 25684 consensus_queue.cc:260] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:06.575073 25908 consensus_queue.cc:237] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.659102 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:06.661304 25938 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:06.662125 22546 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:06.632850 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:06.664324 22549 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:06.636612 25751 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:06.623106 25856 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:18:06.653831 22548 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:18:06.643726 25915 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.649539 25850 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:06.642072 25905 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:06.678359 25861 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.680258 25905 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:06.682071 25861 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:06.631297 25608 consensus_queue.cc:260] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.667847 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:06.684003 22398 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:06.669080 23130 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:06.671384 22548 raft_consensus.cc:1240] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:06.631242 25837 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:18:06.686689 25608 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:06.671828 22515 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:06.672073 25957 consensus_queue.cc:1059] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:18:06.672457 25943 log.cc:927] Time spent T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:18:06.672802 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:06.672492 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:06.676179 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:06.697888 22397 raft_consensus.cc:2410] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 12:18:06.671836 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 83339.3us
W20260709 12:18:06.685109 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 76796.9us
I20260709 12:18:06.662562 25684 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:06.697993 22402 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:06.699517 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:06.683825 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:06.708047 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:06.709661 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:06.711009 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:06.712386 22402 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:18:06.694653 25912 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.714869 22400 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:06.731208 22402 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:06.695183 25921 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:06.725319 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:06.737224 22397 raft_consensus.cc:1275] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:06.739363 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:06.705549 25932 raft_consensus.cc:697] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:06.747915 22516 leader_election.cc:400] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13.
I20260709 12:18:06.694262 25915 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.708679 25930 raft_consensus.cc:697] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:06.714141 25785 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:06.713687 25877 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:06.753356 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:06.734220 25916 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:06.795042 22398 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:06.783753 25915 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:06.784672 25955 log.cc:927] Time spent T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:18:06.799546 22400 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:06.800964 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:06.800966 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 100125us
I20260709 12:18:06.736511 25921 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:06.754776 25962 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:06.790544 25956 consensus_queue.cc:1059] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:18:06.790871 25963 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:06.824375 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:06.807329 25962 raft_consensus.cc:697] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:18:06.832472 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:06.832960 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:06.833261 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.833814 22516 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:06.734885 25912 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:06.803299 25840 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:18:06.840557 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 129876us
I20260709 12:18:06.812034 25921 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:06.831305 25861 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.831250 25750 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:06.850584 22400 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:06.816684 25964 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:06.839818 25916 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:18:06.852303 25842 consensus_meta.cc:287] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.003s
I20260709 12:18:06.865170 25912 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:06.865975 25912 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.866423 25912 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:06.868501 25912 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:06.848424 25959 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:18:06.849864 25963 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:18:06.871591 25963 consensus_queue.cc:1243] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer b8621fa34be04d3fa2d68a300f858cd1 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:06.872732 22547 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:06.851738 25919 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:06.859099 25840 raft_consensus.cc:697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:06.877955 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:06.877913 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 44222.6us
I20260709 12:18:06.879694 22400 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:18:06.879841 22516 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:06.880079 22400 pending_rounds.cc:85] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 5
I20260709 12:18:06.880362 22400 pending_rounds.cc:107] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:18:06.880581 22400 raft_consensus.cc:2889] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:06.883539 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:06.887423 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:06.856153 25861 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:06.882117 25908 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:06.889976 22516 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:06.848881 25932 consensus_queue.cc:237] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.859016 25960 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:18:06.853114 25930 consensus_queue.cc:237] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.889879 25750 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:06.885705 25400 consensus_queue.cc:260] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.899755 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:06.903086 25400 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:06.903458 22544 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
I20260709 12:18:06.904278 25750 raft_consensus.cc:697] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:06.905335 23094 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:06.886595 25919 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:06.905473 25750 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.886580 25916 consensus_queue.cc:1059] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:18:06.907496 25916 raft_consensus.cc:3055] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:06.907881 25916 raft_consensus.cc:740] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:06.908663 25969 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:06.909178 25969 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:06.908421 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:06.911722 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.888850 25962 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:06.909523 25969 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:06.888283 25751 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:06.892865 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:06.949476 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.886765 25880 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:06.905061 22299 catalog_manager.cc:5697] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 4 to 5, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 5 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:06.953826 22400 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
W20260709 12:18:06.962105 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.967660 22393 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:18:06.885954 25850 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.971222 22542 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:06.891892 25963 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:06.889153 25964 consensus_queue.cc:1059] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
W20260709 12:18:06.983388 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 91843.3us
I20260709 12:18:06.895234 25961 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:18:06.984427 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:06.982430 22299 catalog_manager.cc:5697] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:06.970741 25960 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:06.979363 25963 raft_consensus.cc:697] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:06.989008 25919 raft_consensus.cc:3055] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:06.990664 25919 raft_consensus.cc:740] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:06.991611 25919 consensus_queue.cc:260] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.992796 25919 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:06.993988 25751 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:06.995569 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:06.996351 22299 catalog_manager.cc:5697] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 1 to 5, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 5 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.997308 22516 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:06.908706 25916 consensus_queue.cc:260] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:06.982121 25972 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:06.998443 22516 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:06.981705 25840 consensus_queue.cc:237] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.006556 25972 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.007552 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:06.998942 25751 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:07.022404 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:07.022982 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:07.023324 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:07.024883 22402 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:07.026984 22402 pending_rounds.cc:85] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 5
I20260709 12:18:07.027282 22402 pending_rounds.cc:107] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:18:07.027520 22402 raft_consensus.cc:2889] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:07.020282 25684 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.028429 25684 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.030584 25684 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:07.031224 25972 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:07.031888 25972 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:06.999648 25930 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:07.038283 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:07.039173 23122 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:07.041400 22366 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:07.023937 22394 raft_consensus.cc:2376] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11. Re-sending same reply.
I20260709 12:18:07.041594 25963 consensus_queue.cc:237] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.020833 25974 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:07.042351 25684 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:07.042987 25684 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.043529 25684 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:07.043982 25850 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:07.046353 25976 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:18:07.046895 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:06.995591 25960 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.052254 22299 catalog_manager.cc:5697] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:06.998858 25921 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.051970 25908 consensus_queue.cc:1059] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:18:07.056910 25908 raft_consensus.cc:3055] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:07.057299 25908 raft_consensus.cc:740] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:07.042976 25974 raft_consensus.cc:697] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:07.058138 25908 consensus_queue.cc:260] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.058576 25974 consensus_queue.cc:237] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.059422 25908 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:07.051949 25684 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.073400 23122 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
W20260709 12:18:07.082330 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 56249.5us
I20260709 12:18:07.051844 25960 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:07.084933 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:07.099840 22397 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:07.100422 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.086253 25861 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:07.087976 25911 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:07.088270 25926 consensus_meta.cc:287] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.006s
I20260709 12:18:07.070868 25916 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:07.092360 25921 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:07.093052 22545 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
W20260709 12:18:07.094318 25931 consensus_meta.cc:287] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.000s
I20260709 12:18:07.094884 22299 catalog_manager.cc:5697] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:07.100243 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:07.085897 22394 raft_consensus.cc:1240] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:18:07.098680 22366 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:07.107030 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:07.115978 22543 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9.
I20260709 12:18:07.089645 25684 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:07.118096 22366 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:07.118687 23094 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:07.128650 22366 leader_election.cc:400] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11.
I20260709 12:18:07.129053 22366 leader_election.cc:403] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:07.119498 25750 consensus_queue.cc:1059] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:18:07.130077 25959 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:07.130446 25959 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:07.130633 25750 raft_consensus.cc:3055] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:07.131008 25523 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:18:07.131289 25975 log.cc:927] Time spent T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:18:07.131523 25523 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.120754 25931 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.129518 25400 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:07.137293 22299 catalog_manager.cc:5697] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 1 to 4, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 4 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:07.134896 22550 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:07.147812 22366 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:07.150970 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:07.157296 22397 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:07.157081 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:07.131261 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:07.160940 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:07.160326 22516 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:07.162402 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.133729 25523 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:07.149905 25959 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:07.154482 25684 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11.
I20260709 12:18:07.139396 25926 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:07.136073 25931 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:07.173182 22366 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:07.171146 22543 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:07.131039 25750 raft_consensus.cc:740] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:07.158757 25400 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:07.158041 25861 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:07.178210 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:07.178553 22548 raft_consensus.cc:1240] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:07.165521 23125 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:07.184379 23129 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:07.138602 25969 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.174969 25926 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.186151 25926 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:07.186146 22515 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:07.174499 25939 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:07.188251 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:07.174383 25982 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:07.190860 22299 catalog_manager.cc:5697] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 2 to 3, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 3 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:07.194520 22299 catalog_manager.cc:5697] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 4 to 6, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 6 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:07.181631 25915 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:07.202966 25954 raft_consensus.cc:3055] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:07.203493 25954 raft_consensus.cc:740] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:07.204384 25954 consensus_queue.cc:260] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.177135 25938 consensus_queue.cc:1059] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:18:07.206442 25938 raft_consensus.cc:3055] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:07.206802 25938 raft_consensus.cc:740] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:07.181739 25523 consensus_queue.cc:1059] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:18:07.207594 25938 consensus_queue.cc:260] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.208494 25523 raft_consensus.cc:3055] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:07.208789 25938 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:07.208870 25523 raft_consensus.cc:740] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:07.209863 25523 consensus_queue.cc:260] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.211024 25523 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:07.212170 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:07.214545 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:07.215775 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1692) took 1027 ms. Trace:
I20260709 12:18:07.182107 25919 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.214212 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:07.183120 25974 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:07.223991 22393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1649) took 1268 ms (client timeout 1513 ms). Trace:
W20260709 12:18:07.227906 22393 rpcz_store.cc:269] 0709 12:18:05.948750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.949012 (+   262us) service_pool.cc:224] Handling call
0709 12:18:07.216945 (+1267933us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b540005dcd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:07.217045 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2234253056}
I20260709 12:18:07.190604 25931 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:07.205672 25954 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:07.226310 25856 consensus_queue.cc:1059] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:18:07.231505 25917 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:18:07.232156 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 678119us
I20260709 12:18:07.232903 22441 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:07.233155 25917 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:07.233618 25917 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.234037 25917 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:07.234229 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.231690 25856 raft_consensus.cc:3055] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:07.216156 22551 rpcz_store.cc:276] 0709 12:18:06.188327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.188435 (+   108us) service_pool.cc:224] Handling call
0709 12:18:06.188708 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:06.660511 (+471803us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:18:06.660567 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:06.660608 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:06.660645 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.215568 (+554923us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b540031bad4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:07.215609 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:07.215727 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1185,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":1084354944}
I20260709 12:18:07.236052 23094 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:07.229184 22550 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:07.214603 25915 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.218849 25982 raft_consensus.cc:697] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:07.254695 25949 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:07.279201 25949 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.279592 25982 consensus_queue.cc:237] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.280148 25905 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.280654 25905 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.255657 22299 catalog_manager.cc:5697] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:07.256523 25400 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.253089 25750 consensus_queue.cc:260] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.218451 25861 consensus_queue.cc:1059] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:18:07.259176 25665 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:07.255064 25837 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:07.237624 25974 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.261945 25860 raft_consensus.cc:2764] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:18:07.291785 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:07.263514 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1699) took 1013 ms. Trace:
I20260709 12:18:07.292918 22547 rpcz_store.cc:276] 0709 12:18:06.251439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.251577 (+   138us) service_pool.cc:224] Handling call
0709 12:18:06.251918 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:06.873129 (+621211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.263279 (+390150us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54001414d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:07.263458 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427049856}
I20260709 12:18:07.264235 22515 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:07.255131 25931 raft_consensus.cc:697] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:07.267427 25754 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:07.228003 25919 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.271107 25969 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:07.273291 25917 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.278210 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:07.422096 22401 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:07.237949 25856 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:07.278527 25901 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:07.285178 22299 catalog_manager.cc:5697] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:07.446056 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:07.311012 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:07.446807 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:07.447069 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 266861us
I20260709 12:18:07.282243 25915 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:07.451431 22542 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:07.282580 25926 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:07.394157 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 159726us
W20260709 12:18:07.395220 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 131128us
I20260709 12:18:07.284651 25957 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:07.460331 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:07.278441 25960 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.108s
I20260709 12:18:07.279629 25949 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:07.291739 25837 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.444446 25754 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:07.390173 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1762) took 1317 ms. Trace:
I20260709 12:18:07.452994 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:07.465660 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 912351us
I20260709 12:18:07.454557 22299 catalog_manager.cc:5697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 3 to 5, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 5 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:07.425436 25750 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:07.482921 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1772) took 1251 ms. Trace:
W20260709 12:18:07.472946 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.447867 22366 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:07.478632 22442 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:07.455899 25966 log.cc:927] Time spent T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:18:07.481156 22549 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 12:18:07.484601 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.477237 22468 rpcz_store.cc:276] 0709 12:18:06.073093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.073206 (+   113us) service_pool.cc:224] Handling call
0709 12:18:06.073546 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:06.075825 (+  2279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:06.075854 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:06.078894 (+  3040us) log.cc:844] Serialized 52 byte log entry
0709 12:18:06.374771 (+295877us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:06.561055 (+186284us) log.cc:844] Serialized 14 byte log entry
0709 12:18:07.230931 (+669876us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b18001cba00. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f59e1c0a 00007fb4ff121219 00007fb4f5a69a40 00007fb4f5a644e4 00007fb4f5a64455 00007fb4f8b4c060 00007fb4f8b5e716 00007fb4f8b6f287 00007fb4f8b6f208
0709 12:18:07.389790 (+158859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.389876 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:07.389916 (+    40us) raft_consensus.cc:1685] finished
0709 12:18:07.389983 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:07.390116 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5965,"prepare.queue_time_us":141894,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":674587,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":4107,"spinlock_wait_cycles":32570624,"thread_start_us":602200,"threads_started":3,"wal-append.queue_time_us":364325}
I20260709 12:18:07.488842 22401 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:18:07.490166 23095 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:07.491676 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.483372 22477 rpcz_store.cc:276] 0709 12:18:06.231907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.242643 (+ 10736us) service_pool.cc:224] Handling call
0709 12:18:06.242975 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:06.243168 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:06.388678 (+145510us) log.cc:844] Serialized 14 byte log entry
0709 12:18:07.482524 (+1093846us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:07.482573 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:07.482614 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.482742 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:07.482868 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":684594,"prepare.queue_time_us":202431,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":1348,"raft.queue_time_us":685035,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":505240,"threads_started":3,"wal-append.queue_time_us":231607}
W20260709 12:18:07.503724 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.504626 25856 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.513190 22442 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:07.476692 25837 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:07.455236 25901 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.475925 25957 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.527069 25917 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:07.527451 25856 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:07.537405 22299 catalog_manager.cc:5697] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:07.540812 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:07.546613 22401 raft_consensus.cc:1240] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:07.547178 26000 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.548147 25962 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:07.477001 25754 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:07.493592 25963 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:07.563723 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.514420 25793 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:07.567332 22299 catalog_manager.cc:5697] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:07.573850 25930 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.584568 26000 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.596494 25877 consensus_queue.cc:1059] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:07.601843 25996 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:18:07.584350 23122 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:07.608572 25901 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:07.609478 25919 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:07.611559 25957 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:07.656082 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:07.652793 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:07.570448 25860 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:07.622747 25987 log.cc:927] Time spent T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:18:07.624272 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:07.626478 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:07.634282 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.560698 25905 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:07.641875 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2074) took 1216 ms. Trace:
I20260709 12:18:07.544648 25882 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:18:07.646950 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:07.647189 25994 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.591707 25754 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:07.657258 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 197716us
W20260709 12:18:07.658610 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 168057us
I20260709 12:18:07.618094 22393 raft_consensus.cc:3055] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:07.717675 22393 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:07.626709 25962 raft_consensus.cc:697] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 12 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:07.655738 25883 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.701196 22477 raft_consensus.cc:2410] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 12:18:07.704242 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.686343 22549 rpcz_store.cc:276] 0709 12:18:06.425070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.669146 (+244076us) service_pool.cc:224] Handling call
0709 12:18:06.694994 (+ 25848us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:07.494136 (+799142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.575681 (+ 81545us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b54003717a0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8acbdc0 00007fb4f8b57a02 00007fb4f8b53dd6 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2
0709 12:18:07.641530 (+ 65849us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b5400178254. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:07.641803 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814593024}
I20260709 12:18:07.661345 25665 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.566774 25931 consensus_queue.cc:237] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.732594 23095 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:07.759147 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 133837us
I20260709 12:18:07.760715 22393 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.643033 25930 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.775612 22393 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:07.715993 25917 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:18:07.780887 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 48378.4us
I20260709 12:18:07.761940 25883 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.784056 23129 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:07.687980 25860 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.759575 25961 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:07.790513 26003 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:18:07.794340 25998 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:18:07.795130 26008 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.770676 25665 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.795686 26008 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.797425 25665 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:07.797691 26008 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:07.799058 25930 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:07.799600 25962 consensus_queue.cc:237] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.800485 26000 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:07.794507 25883 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:07.772512 25877 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:07.791728 25917 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.719892 25994 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:07.821112 25939 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.821694 25861 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:07.821843 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 374035us
I20260709 12:18:07.822621 25911 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:18:07.823942 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.824455 25989 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.852804 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:07.824949 23125 consensus_meta.cc:287] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.610s	user 0.005s	sys 0.002s
I20260709 12:18:07.824869 25901 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.825254 25926 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:07.826653 26001 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.827461 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:07.809501 25915 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.767967 25997 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:07.767531 25793 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.792997 23126 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:07.828902 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:07.720000 25995 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.785696 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:07.850306 22544 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:18:07.853077 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.854099 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:07.855783 22366 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:07.827883 25684 raft_consensus.cc:3055] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:07.994760 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:08.151021 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:08.009120 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 210776us
I20260709 12:18:07.849124 22393 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:18:08.154273 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:07.975937 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.159600 22477 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:18:08.152925 22442 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.007s	sys 0.003s
W20260709 12:18:08.168540 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.830940 25938 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.831918 25905 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.981210 22471 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:18:08.188567 22393 pending_rounds.cc:85] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 6
I20260709 12:18:08.185087 22399 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 7.
W20260709 12:18:08.190172 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.187168 22542 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 7.
I20260709 12:18:08.181985 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:08.191712 22442 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.008s	sys 0.003s
W20260709 12:18:08.185551 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:08.198168 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 342429us
W20260709 12:18:08.198671 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 685528us
I20260709 12:18:08.188395 22441 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:18:07.831323 25842 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:08.189384 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:08.188158 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.195149 22393 pending_rounds.cc:107] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:18:08.193385 22468 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:18:08.186339 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.209470 22472 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 11: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:18:08.009096 25959 consensus_meta.cc:287] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.831s	user 0.008s	sys 0.002s
W20260709 12:18:08.067080 25992 log.cc:927] Time spent T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
W20260709 12:18:08.105043 25949 consensus_meta.cc:287] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.001s
I20260709 12:18:07.969048 25956 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:18:08.091558 25523 consensus_meta.cc:287] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.880s	user 0.009s	sys 0.000s
I20260709 12:18:08.216777 22473 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:08.213407 22393 raft_consensus.cc:2889] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:08.211869 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.230118 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.218928 22468 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:18:08.235046 22468 pending_rounds.cc:85] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 4
I20260709 12:18:08.235328 22468 pending_rounds.cc:107] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:18:08.235558 22468 raft_consensus.cc:2889] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:08.225832 22442 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:08.028097 25963 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:08.197053 25982 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.097743 25994 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:08.036281 25860 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.217293 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:07.855732 25877 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.024959 26010 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:08.222394 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:08.228807 25870 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.099913 25917 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:08.232635 23095 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.645s (SENT) [suppressed 13 similar messages]
I20260709 12:18:08.177825 26009 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.186611 25684 raft_consensus.cc:740] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:08.238713 22442 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:08.212559 22366 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:08.282440 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 69943us
I20260709 12:18:07.852404 25930 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.377s
I20260709 12:18:08.242347 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:08.286201 22468 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:08.216904 22469 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:08.287587 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.244764 23129 raft_consensus.cc:1240] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 12 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:07.855271 25861 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.218252 26021 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:08.237722 25837 consensus_meta.cc:287] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.675s	user 0.007s	sys 0.003s
I20260709 12:18:08.239607 25997 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:08.259838 22474 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:08.221655 22399 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:08.097113 25754 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:08.228868 25932 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:07.832508 25961 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:08.274252 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.189024 23125 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:08.197852 25793 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:07.860387 25939 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.217450 25938 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.326630 22515 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:08.326831 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:08.217278 25905 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.223278 25842 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.198025 25901 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.284726 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:08.312996 25523 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.243382 26022 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.296193 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:08.207228 26001 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.342553 22544 raft_consensus.cc:1240] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:08.281517 25870 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.307807 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:08.308738 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 70109.4us
I20260709 12:18:08.343592 22469 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:08.344341 22442 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:08.346203 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.313902 26026 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:08.359640 22469 raft_consensus.cc:2410] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:18:08.316046 25911 raft_consensus.cc:697] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:08.366842 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:08.317867 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:08.197810 25995 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.228767 25959 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:08.318492 25967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.003s	sys 0.020s
I20260709 12:18:08.256543 25982 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.325806 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:08.372242 22551 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:18:08.326381 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:08.373383 22550 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:18:08.237720 25949 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.296751 25921 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.199251 25989 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.311721 25997 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:08.243999 25608 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:08.332651 22473 raft_consensus.cc:3055] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:08.336825 22547 raft_consensus.cc:1240] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:08.240144 25956 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:08.296964 26009 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:08.345552 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:08.351842 26005 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.369s	user 0.003s	sys 0.000s
I20260709 12:18:08.340154 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:08.381457 22473 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:08.383122 23130 raft_consensus.cc:1240] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:08.381264 22470 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:08.386610 22477 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:08.354776 25684 consensus_queue.cc:260] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.357263 25840 raft_consensus.cc:3055] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:18:08.314743 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 82147.5us
I20260709 12:18:08.365475 22474 raft_consensus.cc:2410] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:18:08.367805 22468 raft_consensus.cc:2393] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 8: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:08.330905 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41028 (request call id 432) took 1228 ms. Trace:
I20260709 12:18:08.393914 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.398100 23095 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:08.399040 23095 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:08.362329 26026 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:08.280108 26010 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.316330 25837 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:08.406248 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 58591us
I20260709 12:18:08.328652 25962 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:18:08.328543 25400 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:18:08.331451 25963 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:18:08.379017 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:08.370765 25967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.003s	sys 0.021s
I20260709 12:18:08.411144 22473 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.347306 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.367542 25860 raft_consensus.cc:2764] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:18:08.416706 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.342523 25523 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:08.392493 22472 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:08.397578 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.419881 22473 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:08.407876 25957 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:08.380909 25926 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.405010 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.427517 26031 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.427942 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:08.338011 26003 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:08.428192 25949 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.428529 26003 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:08.346283 26022 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.428666 25877 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:08.430429 26022 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.430910 26022 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.431318 26022 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.432583 25523 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:08.433252 25523 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:08.381577 25997 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:08.409332 22442 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:08.384323 25608 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:08.404663 25856 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:08.385135 26021 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:08.396543 23125 rpcz_store.cc:276] 0709 12:18:07.099567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.104514 (+  4947us) service_pool.cc:224] Handling call
0709 12:18:08.322684 (+1218170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:08.327641 25932 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.392908 25840 raft_consensus.cc:740] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:08.380434 25921 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.405208 25915 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.407904 25993 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:08.421676 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:08.420246 22468 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:08.422130 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:08.406364 26026 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:08.423832 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 62974.6us
I20260709 12:18:08.410211 25684 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:08.410930 25785 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:08.404062 22477 raft_consensus.cc:2410] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:18:08.437538 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.469637 22474 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:18:08.447075 22442 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:08.442759 25608 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:08.433481 26022 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.424638 25957 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:08.458966 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.483922 22473 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:08.485097 22468 raft_consensus.cc:1240] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:08.486187 22468 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:08.483880 22471 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 12:18:08.434604 25523 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.428810 25870 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.498347 22471 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:08.446647 25917 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:08.442206 25861 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.472530 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.474627 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:08.446512 26015 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.474656 22477 raft_consensus.cc:1240] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:08.474648 25938 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.477866 26009 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:08.478291 25996 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:08.478521 25989 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.457243 25793 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.450037 26021 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.468303 22367 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:08.439150 25926 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.532780 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:08.533303 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 65085.8us
I20260709 12:18:08.428069 26031 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.498442 25901 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.470705 22474 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:08.534361 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:08.490877 25915 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.488221 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:18:08.511243 26007 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.525s	user 0.000s	sys 0.002s
I20260709 12:18:08.538769 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:08.539037 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:08.539494 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:08.539672 23127 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:18:08.540084 22548 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:08.450964 25949 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:18:08.477483 26027 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:08.541039 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:08.500509 25523 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.487865 25957 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:08.475857 25754 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:08.437667 25911 consensus_queue.cc:237] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.489037 25961 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:08.489435 26035 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:08.487756 26022 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:08.510037 26001 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.530603 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:08.552680 22550 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:08.531217 22549 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:08.533416 22551 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:08.534077 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:08.510171 25837 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.514439 25956 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:08.535981 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:08.530165 25938 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:08.538653 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:08.541860 26031 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.474190 26030 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:08.547552 25915 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.569154 26030 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.556732 26022 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:08.571705 26022 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:08.552330 26035 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.549932 26027 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:08.573851 25915 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.575462 25926 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.576043 25938 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:08.545172 22367 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:08.545535 22548 raft_consensus.cc:2410] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:08.545989 23130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41012 (request call id 339) took 1005 ms. Trace:
I20260709 12:18:08.545837 22542 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:08.515381 25939 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:08.549055 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 75096.5us
I20260709 12:18:08.550582 22366 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:08.536635 25989 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:08.555266 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:08.563447 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.583696 22442 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:08.585018 22367 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:08.580183 23130 rpcz_store.cc:276] 0709 12:18:07.540123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.540235 (+   112us) service_pool.cc:224] Handling call
0709 12:18:07.540558 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:08.388295 (+847737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.545691 (+157396us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54005a14d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:08.545918 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1937301888}
I20260709 12:18:08.537606 25905 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.564047 22545 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:18:08.547488 25523 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:08.548061 25995 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.540125 25982 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:08.544308 25959 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.524998 26015 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.581753 22366 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:08.583278 22544 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:08.555224 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:08.584256 23122 raft_consensus.cc:2393] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:08.574076 26021 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.572000 25921 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:08.595392 26030 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.588201 25939 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:08.578228 25938 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:08.584015 26031 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:08.591900 26009 consensus_queue.cc:1059] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:18:08.594226 22549 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:08.588299 25949 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:08.602486 22366 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:08.612408 22366 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:08.613698 22366 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:08.615444 22366 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:08.616266 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.616509 26022 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:08.616992 26022 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:08.617359 26022 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:08.577757 26026 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:08.594954 25996 consensus_queue.cc:1048] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:18:08.591238 26027 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:08.620951 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:08.623416 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:08.628090 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.619613 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:08.628284 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:08.629441 22544 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:08.629547 22543 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:08.630298 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:08.630457 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:08.631876 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.631556 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:08.637655 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:08.610702 26030 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:08.610759 26021 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:18:08.643448 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 52496.6us
I20260709 12:18:08.643739 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:08.641539 22549 raft_consensus.cc:2410] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:08.595767 25995 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:18:08.623591 25905 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:08.622726 25989 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:08.641736 25938 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:08.618793 26010 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.624967 26035 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.665566 25993 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:08.650542 25921 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.666846 25921 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.639521 25996 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.632611 26031 raft_consensus.cc:697] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:08.622874 25523 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:18:08.662396 22474 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:08.662588 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.665306 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:08.677336 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.654049 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:08.646687 26021 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:08.677953 22474 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:08.678030 22548 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:08.655608 25989 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:08.650955 25905 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:08.678431 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.651932 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:18:08.675828 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.631350 25840 consensus_queue.cc:260] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:08.645200 26039 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.124s
I20260709 12:18:08.670832 25938 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.777284 25989 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:08.778965 25938 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.779131 25931 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:08.733369 25957 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:08.779668 25931 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:08.736951 26040 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
I20260709 12:18:08.781584 25931 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:08.776834 25905 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:08.782644 22550 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:18:08.723860 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:08.753226 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:08.787516 22543 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:08.725665 22473 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:18:08.761539 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 287161us
W20260709 12:18:08.783823 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:08.789076 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.690753 22475 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:08.679045 25996 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.790357 25931 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.790896 25931 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.645092 26037 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:08.794564 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:08.795843 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.796022 22474 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:18:08.796394 22474 pending_rounds.cc:85] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 7
I20260709 12:18:08.656939 25884 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.133s
I20260709 12:18:08.792670 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1709) took 1282 ms. Trace:
I20260709 12:18:08.796705 22474 pending_rounds.cc:107] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:18:08.796978 22474 raft_consensus.cc:2889] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:08.796891 22547 rpcz_store.cc:276] 0709 12:18:07.510200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.511349 (+  1149us) service_pool.cc:224] Handling call
0709 12:18:07.511604 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:08.381660 (+870056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.792462 (+410802us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54004209d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:08.792616 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1891198848}
W20260709 12:18:08.793080 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.801280 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.785339 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.793834 25919 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.679091 25974 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:08.749011 26020 log.cc:927] Time spent T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.418s	user 0.002s	sys 0.000s
I20260709 12:18:08.800393 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.800449 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:08.758006 26026 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:08.806697 25921 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:08.676440 25982 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.782141 25840 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:08.681296 26021 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:08.810328 26035 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.811463 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:08.736354 25917 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:08.746930 26015 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.731364 25842 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:08.772125 25932 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:08.863860 26042 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.803189 22474 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 7.
I20260709 12:18:08.857914 25957 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.813140 26004 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:08.818670 25974 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:08.819757 25972 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:08.821826 25754 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:08.876232 25989 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.859740 25982 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.878444 25989 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.879170 25982 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:08.798607 25961 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:08.813901 25919 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:08.825621 25290 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:08.794152 25523 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:08.746133 26031 consensus_queue.cc:237] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:08.841528 25905 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.834785 25931 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:08.835217 25793 raft_consensus.cc:3055] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:08.840058 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:08.841207 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.890233 22476 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
W20260709 12:18:08.841491 26043 log.cc:927] Time spent T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 12:18:08.835484 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:08.842206 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:08.843458 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.793915 26037 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:08.741273 26022 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.846534 22366 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:08.900034 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 53594.5us
I20260709 12:18:08.851393 22543 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:08.723903 26003 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:08.745489 25608 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.808244 25996 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:08.860852 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.721951 25997 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:08.862401 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
W20260709 12:18:08.910935 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 48655.2us
I20260709 12:18:08.813896 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:08.860494 22393 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:18:08.865224 23129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34092 (request call id 401) took 1025 ms. Trace:
I20260709 12:18:08.871976 26013 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.860070 25930 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:18:08.798280 25938 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:08.870184 26015 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.887185 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:08.924190 22397 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:08.889930 23130 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:08.892654 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:08.880012 25974 consensus_queue.cc:1243] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:18:08.898490 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:08.863174 26035 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:08.901716 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:08.903199 22399 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:08.927788 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:08.903680 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:08.904716 22394 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:08.928370 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:08.928776 22398 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:08.905658 22400 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:08.906062 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:08.929754 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:08.900695 22366 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:08.907569 22402 raft_consensus.cc:1240] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: [9.8-11.9]
I20260709 12:18:08.910094 25911 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.884864 25523 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.912802 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:08.919803 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:08.971107 22476 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:08.971493 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:08.971505 22397 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:18:08.972891 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:08.919818 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.914242 23129 rpcz_store.cc:276] 0709 12:18:07.840302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.840431 (+   129us) service_pool.cc:224] Handling call
0709 12:18:07.849652 (+  9221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:08.288433 (+438781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.864972 (+576539us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b54001315d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:08.865165 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":908195584}
I20260709 12:18:08.918920 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:18:08.974782 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 62057.1us
I20260709 12:18:08.975016 23128 raft_consensus.cc:2393] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 10: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:08.922971 22396 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:08.924115 22470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "444001888258449e8c4f5fd4ad540389"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:08.975704 22470 raft_consensus.cc:606] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:08.924458 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.889973 22551 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:08.925891 22547 raft_consensus.cc:2393] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 10: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:08.873647 26042 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.882066 25961 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.935550 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:08.956173 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:08.889590 25793 raft_consensus.cc:740] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:08.929292 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:08.987865 22394 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:18:08.910138 26026 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:08.991291 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:08.991690 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:08.992390 22544 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:08.958159 23126 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:18:08.909449 22367 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:08.959342 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 58731.9us
I20260709 12:18:08.992022 22396 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 11: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:08.994359 22366 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:08.957939 22395 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:08.958897 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:08.996179 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:08.996928 22402 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:08.958887 22401 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:08.907222 26037 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:08.914839 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:08.998769 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 89393us
I20260709 12:18:08.966030 22543 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:18:08.965839 26030 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:08.968380 23124 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:08.923583 25938 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:08.919816 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:09.024860 22550 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:09.025743 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:08.930889 26015 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.976052 22470 raft_consensus.cc:614] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:08.976181 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:08.912012 26004 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:18:09.024449 26030 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.041201 26030 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:08.975029 22397 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:08.983309 22399 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:09.050285 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:09.050907 22399 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:08.984813 22398 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:08.987962 22542 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:08.989148 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:08.997731 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.973182 25911 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:08.999416 22543 pending_rounds.cc:85] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 8
I20260709 12:18:09.061105 22398 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:09.061123 22543 pending_rounds.cc:107] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:18:08.967427 25997 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:08.999159 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:09.000032 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:09.064193 22515 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:08.999370 22393 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:09.064554 22441 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:09.000397 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:09.064882 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 65810.2us
I20260709 12:18:09.000813 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:08.998646 25996 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.007453 26042 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:09.009366 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:09.010012 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:09.012296 25290 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:08.998890 26026 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.015894 25939 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:18:09.016846 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.925413 26013 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:09.000808 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:08.940028 25931 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:18:09.098724 26026 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:08.920984 25754 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:08.984283 25842 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:09.052393 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:09.140132 22399 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:09.053442 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:09.141285 22397 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 10: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:09.060194 22394 raft_consensus.cc:2393] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 8: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:09.061671 22543 raft_consensus.cc:2889] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:09.063033 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 86936.5us
I20260709 12:18:09.000612 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:09.064703 22544 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:18:09.005218 22476 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9.
I20260709 12:18:09.065893 22402 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:09.066465 22366 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:09.022015 25917 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.074892 22401 raft_consensus.cc:2410] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:18:09.075347 22551 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:09.076002 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.077819 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.147883 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:09.083130 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.148787 22469 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:09.085541 26046 consensus_queue.cc:1059] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:18:09.087368 26049 log.cc:927] Time spent T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:18:09.089902 25996 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:09.090905 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:09.133361 26003 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:09.093080 22547 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:09.093477 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:09.094566 22468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:09.163906 22468 raft_consensus.cc:606] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:09.094966 25932 consensus_queue.cc:1059] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:09.095568 25840 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:09.096081 25972 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:09.096781 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:09.030092 25938 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:09.103483 22396 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:09.104732 22442 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:09.175384 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 70736us
I20260709 12:18:09.175541 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:08.975809 26012 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.051577 26027 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:09.115489 22398 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:09.105618 22550 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:18:09.053989 25905 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:09.129310 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.066948 26033 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:09.074282 25989 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:09.133464 22393 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:18:09.100489 25785 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:09.140370 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.190510 22474 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:09.191556 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:09.192135 25905 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:09.192355 22474 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:09.192848 25961 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:09.193295 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:09.194237 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:09.197561 22474 raft_consensus.cc:2376] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12. Re-sending same reply.
I20260709 12:18:09.067551 22395 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 8: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:09.114373 26022 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:09.151823 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.158511 25917 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:09.152386 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.153527 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:09.149231 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:09.076807 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.099354 25982 consensus_queue.cc:1059] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:18:09.165930 22471 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:09.167002 22399 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:09.169902 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.139518 25974 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:09.170166 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.170686 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.171684 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.139799 25842 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:09.176802 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:09.176863 22442 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:09.152935 25939 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:09.181416 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:09.210557 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:09.210608 22549 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:09.114779 25793 consensus_queue.cc:260] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:09.160848 25523 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:09.144881 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 78482.7us
I20260709 12:18:09.147998 22475 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:09.217583 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.218302 22475 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:09.195544 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:09.198536 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.219538 22474 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:09.098655 25290 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:09.161656 25754 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:18:09.182029 26046 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:09.177739 25608 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:09.201196 22469 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:09.201491 22472 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
W20260709 12:18:09.203091 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 49669.7us
I20260709 12:18:09.197245 25785 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.205519 22468 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:09.201370 22551 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:09.209879 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.183084 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:09.186213 26012 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:09.213083 22442 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:09.205113 25961 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:09.215615 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:09.220454 26035 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:09.220935 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:09.216823 22366 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:09.225085 22551 raft_consensus.cc:1240] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:18:09.177434 25840 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:09.221483 26045 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:09.222872 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:09.209424 25842 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:09.228477 22442 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:09.213842 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:09.228753 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:09.228927 25290 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:09.210498 25939 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.232611 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:09.234120 22477 raft_consensus.cc:2410] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:18:09.212283 25974 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:09.432261 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.474603 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:09.423097 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:09.377869 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 377301us
I20260709 12:18:09.434425 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:09.434077 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.415285 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.473664 25884 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:09.343806 25930 raft_consensus.cc:3055] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:09.432174 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.474879 22548 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:09.433130 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.224066 26046 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.220248 26030 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:09.471989 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 243560us
I20260709 12:18:09.546631 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:09.557729 23126 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:18:09.572088 22477 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:09.238440 22366 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:09.511881 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:09.574327 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 335947us
I20260709 12:18:09.527462 22544 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:09.571698 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.578073 22475 raft_consensus.cc:2376] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9. Re-sending same reply.
I20260709 12:18:09.227468 25785 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:09.587632 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:09.477077 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.477489 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:09.477550 25290 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:09.554418 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:09.579128 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:09.476945 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 254170us
W20260709 12:18:09.575513 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:09.592437 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.494390 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:09.593588 22474 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:09.263358 25793 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:09.588227 23124 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:09.593045 22367 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:09.590394 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:09.600561 22469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b42c69680a57493c942307ff09185b72"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:09.601140 22469 raft_consensus.cc:606] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:09.339515 26051 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:18:09.591311 22551 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 5.
I20260709 12:18:09.597968 22470 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:09.234917 26045 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.262017 25982 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.512147 26022 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.531065 25608 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.362022 25996 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:09.239959 25905 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:09.344275 26042 raft_consensus.cc:3055] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:09.498158 26035 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.129s
I20260709 12:18:09.341692 26013 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:09.475663 25939 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:09.576383 22366 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:09.590814 25290 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.648332 25290 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:09.392429 25911 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:09.391449 25523 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:09.533978 25931 raft_consensus.cc:3055] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:09.280007 25840 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:09.241972 26015 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:09.628190 25972 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:18:09.606841 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:09.677104 22551 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:09.608639 25949 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.609715 26026 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:09.629899 26022 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:09.598946 22402 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:09.586596 25884 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.497509 26012 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:09.587234 26046 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:09.624698 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:09.694888 22399 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 10: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:09.230829 25997 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:09.552132 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:09.570863 25930 raft_consensus.cc:740] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:09.513021 26027 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:09.626721 23094 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:18:09.748353 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 121721us
I20260709 12:18:09.627084 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:09.620396 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:09.749886 23125 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:18:09.750047 22394 raft_consensus.cc:2410] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:18:09.533372 25919 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:09.631537 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:09.752310 22543 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:18:09.632550 22477 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:18:09.634914 22442 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:09.754367 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 119533us
I20260709 12:18:09.591346 22475 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:09.636510 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:09.632138 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:09.596464 25989 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:09.344645 26021 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:09.472648 26037 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:09.462527 25917 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:09.645200 22474 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:09.518600 25842 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:09.646001 23124 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:09.429224 25938 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:09.597231 26056 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:18:09.667277 22542 pending_rounds.cc:85] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 2
I20260709 12:18:09.663718 23123 raft_consensus.cc:1240] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:09.635675 25905 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.605021 23095 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:09.638921 26042 raft_consensus.cc:740] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:09.627626 25982 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:09.679540 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:09.803982 22551 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:09.611532 26045 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:09.635792 25608 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:09.811834 25608 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:09.668324 25911 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:09.668150 25931 raft_consensus.cc:740] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:09.814417 25931 consensus_queue.cc:260] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:09.815490 25931 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:09.691337 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:09.820257 22545 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:09.822290 25954 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:09.758279 25969 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:09.823254 25969 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.823663 25969 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:09.831282 25938 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:09.750938 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.766639 26012 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:18:09.833546 26012 consensus_queue.cc:1243] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:09.835861 26026 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:09.837675 26030 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:09.743633 22399 raft_consensus.cc:1240] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:18:09.690758 25884 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:09.678786 25840 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:18:09.766844 22548 raft_consensus.cc:2393] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:09.779096 26013 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:09.670799 25523 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:09.705879 25997 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.779855 22442 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:09.859207 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 79444.2us
I20260709 12:18:09.687397 25949 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:09.865010 22474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:09.797520 22475 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
I20260709 12:18:09.751487 26027 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:09.765753 26031 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:09.805755 22396 raft_consensus.cc:2393] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:09.782104 26015 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:18:09.822870 25974 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:09.831471 26037 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:09.756201 22547 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:09.697546 25290 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:09.840078 22400 raft_consensus.cc:2393] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:09.778860 22542 pending_rounds.cc:107] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:18:09.899593 22542 raft_consensus.cc:2889] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:09.758620 25989 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:09.786177 25905 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:09.781975 25919 consensus_queue.cc:1059] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 12:18:09.787081 25917 consensus_queue.cc:1059] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:18:09.860546 25997 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:09.864611 26033 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:09.846140 22399 raft_consensus.cc:1240] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:18:09.860638 26013 raft_consensus.cc:697] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:09.875537 25996 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.919503 25290 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:09.919940 22396 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:09.923528 22397 raft_consensus.cc:1240] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:09.924041 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1701) took 1019 ms. Trace:
I20260709 12:18:09.899588 25842 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:09.924495 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 314464us
I20260709 12:18:09.918519 25989 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:09.941743 22397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1800) took 1020 ms. Trace:
I20260709 12:18:09.932955 22400 rpcz_store.cc:276] 0709 12:18:08.904763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.971243 (+ 66480us) service_pool.cc:224] Handling call
0709 12:18:09.923268 (+952025us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54002319d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:09.923983 (+   715us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1910509824}
I20260709 12:18:09.960680 22441 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:09.942528 22397 rpcz_store.cc:276] 0709 12:18:08.921093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.196939 (+275846us) service_pool.cc:224] Handling call
0709 12:18:09.923371 (+726432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:09.932229 (+  8858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:09.941551 (+  9322us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b54002319d0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:09.941686 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1670081920}
I20260709 12:18:09.924208 26031 raft_consensus.cc:697] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:09.925017 26033 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.974249 22441 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:09.925647 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 297695us
W20260709 12:18:09.991961 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 398966us
I20260709 12:18:09.999051 22367 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:09.995618 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 54785us
W20260709 12:18:10.012177 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 435883us
I20260709 12:18:09.973590 25994 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:10.018512 26056 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:10.014204 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1727) took 1004 ms. Trace:
I20260709 12:18:09.916944 26042 consensus_queue.cc:260] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:09.987324 26033 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:09.939265 25996 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:10.022727 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:09.959563 25785 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.020946 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:10.023200 25972 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:18:10.034029 25995 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:10.045794 25793 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:10.031798 25961 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 12:18:10.033792 26062 log.cc:927] Time spent T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 12:18:10.041818 22398 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.010s	sys 0.010s
I20260709 12:18:10.023432 25974 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:18:10.037585 26021 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:10.005437 26022 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:10.069325 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 95141.4us
I20260709 12:18:10.028349 26013 consensus_queue.cc:237] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:10.076056 25793 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:10.070745 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 71778.1us
I20260709 12:18:10.073266 22473 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
W20260709 12:18:10.074828 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 53969.5us
I20260709 12:18:10.059230 22366 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:10.045672 22549 rpcz_store.cc:276] 0709 12:18:09.010171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.491263 (+481092us) service_pool.cc:224] Handling call
0709 12:18:09.491628 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:09.491860 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:09.764569 (+272709us) log.cc:844] Serialized 14 byte log entry
0709 12:18:10.013844 (+249275us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:10.013898 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:10.013952 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.014018 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:10.014140 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2869,"prepare.queue_time_us":426402,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":20725,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7103,"thread_start_us":518363,"threads_started":2}
I20260709 12:18:10.136709 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:10.046511 25608 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:10.077575 25290 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.148166 25290 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:10.080289 22398 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.011s	sys 0.010s
I20260709 12:18:10.148785 22516 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:10.059929 25982 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:10.079483 25842 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:10.055832 25917 consensus_queue.cc:1059] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 12:18:10.106904 26058 log.cc:927] Time spent T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 12:18:10.047549 26031 consensus_queue.cc:237] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:10.070405 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:10.110321 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:10.149633 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 124573us
W20260709 12:18:10.031250 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 426280us
I20260709 12:18:10.105978 26003 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:10.155449 22441 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:10.156430 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:10.137691 22367 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:10.166486 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:10.132041 25949 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:10.154000 25842 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.168825 23095 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:10.171209 22550 pending_rounds.cc:85] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 7
I20260709 12:18:10.077111 25995 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.149395 25793 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:10.066898 26078 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 12:18:10.171607 25290 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:10.195582 25290 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.176302 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:10.157924 25931 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:10.179725 22477 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:10.180406 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:10.180235 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:10.253247 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:10.229354 26067 log.cc:927] Time spent T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:18:10.172966 22441 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:10.185637 22550 pending_rounds.cc:107] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:18:10.186040 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:10.180112 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:10.254580 22550 raft_consensus.cc:2889] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:10.218498 25931 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:10.258404 25931 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:10.260576 25939 consensus_meta.cc:287] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.000s
I20260709 12:18:10.261004 25939 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.266426 26092 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:10.267696 26092 consensus_queue.cc:1059] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:10.111064 26045 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.201673 25290 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.269928 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1726) took 1260 ms. Trace:
I20260709 12:18:10.270355 22542 rpcz_store.cc:276] 0709 12:18:09.009881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.639863 (+629982us) service_pool.cc:224] Handling call
0709 12:18:09.667082 (+ 27219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:09.900812 (+233730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:09.900847 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:09.901295 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 12:18:10.111904 (+210609us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:10.111948 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.112033 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:10.269716 (+157683us) raft_consensus.cc:1685] finished
0709 12:18:10.269736 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:10.269871 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":210177,"threads_started":1,"wal-append.queue_time_us":293409}
I20260709 12:18:10.271076 26009 raft_consensus.cc:3055] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:10.271553 25290 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:10.180688 26082 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:10.235639 25523 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:10.180845 26003 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:10.274260 26003 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:10.154596 25608 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.276518 25608 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:10.229447 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1801) took 1270 ms. Trace:
I20260709 12:18:10.276994 25996 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:10.171597 26074 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:18:10.277275 22401 rpcz_store.cc:276] 0709 12:18:08.958680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.210320 (+251640us) service_pool.cc:224] Handling call
0709 12:18:09.225440 (+ 15120us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:09.225831 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:09.225862 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:09.226363 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 12:18:09.588252 (+361889us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:10.012302 (+424050us) log.cc:844] Serialized 14 byte log entry
0709 12:18:10.016432 (+  4130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.016549 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:10.229217 (+212668us) raft_consensus.cc:1685] finished
0709 12:18:10.229237 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:10.229382 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15116,"prepare.queue_time_us":456542,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":6972,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":14118,"thread_start_us":647666,"threads_started":2,"wal-append.queue_time_us":513602}
I20260709 12:18:10.181080 26072 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
W20260709 12:18:10.227833 26069 log.cc:927] Time spent T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 12:18:10.280957 25995 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:10.281334 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:10.281975 22471 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:10.283357 26035 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.283897 26035 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.284017 25939 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:10.284907 25939 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:18:10.286823 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 227730us
I20260709 12:18:10.287559 22366 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:10.289997 26021 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:10.290481 26021 raft_consensus.cc:697] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:10.291371 26021 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:10.292469 22473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 2043) took 1108 ms. Trace:
I20260709 12:18:10.287494 25989 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.294144 22393 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:10.295454 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:10.296005 22544 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:10.297039 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:10.298070 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:10.298619 22547 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:10.256151 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1812) took 1244 ms. Trace:
I20260709 12:18:10.300964 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:10.230777 26065 log.cc:927] Time spent T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:18:10.230057 26081 log.cc:927] Time spent T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:18:10.223230 23128 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:18:10.234447 25785 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:10.325109 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:10.325726 22402 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:10.192009 25842 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:10.187259 25919 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:10.187021 25994 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:10.194864 26012 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:10.194526 25982 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:10.212307 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:10.463965 22475 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:18:10.465066 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:10.159078 25932 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:10.256950 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 84062.9us
I20260709 12:18:10.301616 22401 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:10.398046 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1802) took 1436 ms. Trace:
I20260709 12:18:10.300693 22394 rpcz_store.cc:276] 0709 12:18:09.012863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.759535 (+746672us) service_pool.cc:224] Handling call
0709 12:18:09.759807 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:09.759988 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:09.760010 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:09.778865 (+ 18855us) log.cc:844] Serialized 26 byte log entry
0709 12:18:10.070229 (+291364us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:10.070280 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.070344 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:10.255952 (+185608us) raft_consensus.cc:1685] finished
0709 12:18:10.255972 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:10.256085 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":217966,"threads_started":1,"wal-append.queue_time_us":319791}
I20260709 12:18:10.277048 25608 raft_consensus.cc:3055] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:10.306193 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:10.306869 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:10.294159 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 156555us
I20260709 12:18:10.307859 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1803) took 1335 ms. Trace:
I20260709 12:18:10.470391 22400 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:10.292841 22473 rpcz_store.cc:276] 0709 12:18:09.184253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.199707 (+ 15454us) service_pool.cc:224] Handling call
0709 12:18:10.292285 (+1092578us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b5400210554. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:10.292390 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1898582272}
I20260709 12:18:10.471730 22475 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:10.472417 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:10.473263 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:10.474077 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:10.311034 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:10.312561 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:10.466919 22441 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:10.475103 23124 raft_consensus.cc:2393] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 11: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:10.315960 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:10.474877 22543 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:10.316591 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:10.317349 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:10.476122 22545 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:10.317183 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:10.476307 22542 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:10.186775 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:10.326640 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:10.477363 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:10.373705 25884 consensus_meta.cc:287] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.516s	user 0.002s	sys 0.007s
I20260709 12:18:10.485657 22516 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:10.318967 25939 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.372617 26035 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:10.335742 22468 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 10: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:10.332516 25930 consensus_queue.cc:260] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:10.250576 25961 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:10.446781 26037 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.335332 26045 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:10.382467 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:10.321511 26030 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:10.329442 23127 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:10.514504 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:10.374903 22548 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:10.467891 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:10.469082 25932 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:10.513454 22543 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:10.304956 22544 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:10.471495 22367 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:10.477485 22402 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:10.517107 22401 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:10.518970 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:10.271497 26009 raft_consensus.cc:740] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:10.478003 22542 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:10.474581 22473 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
I20260709 12:18:10.520588 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:10.520761 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:10.521301 22473 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:10.323684 22471 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:10.523115 22471 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:18:10.523917 22471 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:10.480341 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:10.480588 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:10.329988 25989 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:10.486302 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 228737us
I20260709 12:18:10.486864 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:10.468480 22398 rpcz_store.cc:276] 0709 12:18:08.961826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.539383 (+577557us) service_pool.cc:224] Handling call
0709 12:18:09.539769 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:09.540197 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:09.540229 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:09.540765 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 12:18:10.149377 (+608612us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:10.149417 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.149484 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:10.397808 (+248324us) raft_consensus.cc:1685] finished
0709 12:18:10.397830 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:10.397979 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5819,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":128,"thread_start_us":608202,"threads_started":1,"wal-append.queue_time_us":538501}
I20260709 12:18:10.486701 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:10.293246 26076 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:10.487480 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:18:10.487179 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 300461us
I20260709 12:18:10.487649 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:10.489604 22475 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:10.527016 23095 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:10.518167 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:10.489791 22366 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:10.470409 22395 rpcz_store.cc:276] 0709 12:18:08.972300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.542305 (+570005us) service_pool.cc:224] Handling call
0709 12:18:09.542627 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:09.542839 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:09.857634 (+314795us) log.cc:844] Serialized 14 byte log entry
0709 12:18:10.293495 (+435861us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:10.293549 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:10.293595 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.293664 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:10.307795 (+ 14131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126512,"prepare.queue_time_us":487986,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":1862,"raft.queue_time_us":132427,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":46,"thread_start_us":622663,"threads_started":2,"wal-append.queue_time_us":362851}
I20260709 12:18:10.447718 26080 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:10.452721 25994 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.535372 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:10.456780 26056 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.493095 25786 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:10.500916 26101 log.cc:927] Time spent T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.103s	user 0.005s	sys 0.017s
I20260709 12:18:10.502416 26042 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:10.515797 25957 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:10.480162 26012 raft_consensus.cc:697] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 9 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:10.502926 26037 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.373996 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:10.506229 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:10.506502 22547 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:10.517913 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:10.521829 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:10.516758 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:10.529140 22544 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:10.593111 22543 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:10.530253 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:10.531008 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:10.531591 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 60165.1us
I20260709 12:18:10.533169 22366 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:10.495509 22441 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:10.593600 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 71894.2us
I20260709 12:18:10.479950 25608 raft_consensus.cc:740] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:10.502718 25793 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:10.578287 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 51974.6us
W20260709 12:18:10.628564 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 133126us
I20260709 12:18:10.488444 25982 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.519852 25930 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:10.538384 22401 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:10.494405 26073 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:10.642755 26073 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.643244 26073 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:10.619099 25608 consensus_queue.cc:260] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:10.493183 25884 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:10.627022 25969 consensus_meta.cc:287] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.803s	user 0.010s	sys 0.000s
I20260709 12:18:10.646123 25969 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:10.647642 25884 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:10.497406 26090 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:10.591472 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:10.649828 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:10.651194 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:10.651629 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:10.390771 25997 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:10.595209 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 62115.6us
I20260709 12:18:10.593577 22548 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:10.597720 25840 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:10.581910 25957 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:10.668001 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1804) took 1694 ms. Trace:
I20260709 12:18:10.668435 22393 rpcz_store.cc:276] 0709 12:18:08.973949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.636320 (+662371us) service_pool.cc:224] Handling call
0709 12:18:09.636618 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:10.294520 (+657902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.667726 (+373206us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b54000b68d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:10.667936 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1511828224}
I20260709 12:18:10.520174 25932 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:10.539274 26080 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:10.534080 26003 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:10.519662 26077 consensus_queue.cc:1175] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "65951063312d4a1e9123f92354101c71" responder_term: 11 status { last_received { term: 9 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: [10.10-10.10]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:18:10.682610 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.530589 25785 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:10.538084 25786 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:10.530128 26076 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.583114 22477 pending_rounds.cc:85] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 4
I20260709 12:18:10.602885 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:10.686304 22477 pending_rounds.cc:107] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:18:10.686692 22402 raft_consensus.cc:2393] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:10.605214 22543 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:10.606817 25939 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:10.608434 22545 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:10.597751 22367 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:10.694079 22548 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:10.538344 26082 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:18:10.602029 26035 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:10.705574 26035 raft_consensus.cc:697] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:10.706553 26035 consensus_queue.cc:237] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:10.690858 26097 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.066s	user 0.005s	sys 0.003s
I20260709 12:18:10.707515 26073 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.710268 26073 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:10.671190 25608 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:10.712838 22474 raft_consensus.cc:606] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:10.713261 22474 raft_consensus.cc:614] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:10.692611 26076 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:10.576845 25938 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:18:10.718026 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1822) took 1142 ms. Trace:
I20260709 12:18:10.718432 22396 rpcz_store.cc:276] 0709 12:18:09.575191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.940527 (+365336us) service_pool.cc:224] Handling call
0709 12:18:10.039967 (+ 99440us) spinlock_profiling.cc:243] Waited 8.84 ms on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:18:10.040185 (+   218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:10.042330 (+  2145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.042397 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:10.043245 (+   848us) log.cc:844] Serialized 26 byte log entry
0709 12:18:10.199225 (+155980us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:10.251352 (+ 52127us) log.cc:844] Serialized 14 byte log entry
0709 12:18:10.280106 (+ 28754us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b18004a0f80. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f59e1c0a 00007fb4ff121219 00007fb4fca2858f 00007fb4f5a67571 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd
0709 12:18:10.317947 (+ 37841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.318031 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:10.717820 (+399789us) raft_consensus.cc:1685] finished
0709 12:18:10.717842 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:10.717968 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68638,"prepare.queue_time_us":51788,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":70731,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":33903,"spinlock_wait_cycles":26110464,"thread_start_us":110699,"threads_started":1,"wal-append.queue_time_us":593426}
W20260709 12:18:10.722491 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 124805us
I20260709 12:18:10.723909 22367 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:10.725010 22367 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:10.725953 26031 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:10.610644 26084 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.610976 25995 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:18:10.611917 22299 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50158 (request call id 189) took 29437 ms (client timeout 15000 ms). Trace:
I20260709 12:18:10.612855 26099 raft_consensus.cc:993] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:10.615334 26009 consensus_queue.cc:260] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.737154 26009 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:10.732092 22299 rpcz_store.cc:269] 0709 12:17:41.174498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.247750 (+ 73252us) service_pool.cc:224] Handling call
0709 12:18:10.611841 (+29364091us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:08.295276 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:08.306438 (+ 11162us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:08.306472 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:18:08.306484 (+    12us) tablet.cc:662] Decoding operations
0709 12:18:08.307656 (+  1172us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:08.307713 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:08.307746 (+    33us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:18:08.498568 (+190822us) tablet.cc:701] Row locks acquired
0709 12:18:08.498592 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:18:08.498756 (+   164us) write_op.cc:270] Start()
0709 12:18:08.498877 (+   121us) write_op.cc:276] Timestamp: P: 1783599488498699 usec, L: 0
0709 12:18:08.498896 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:18:08.499625 (+   729us) log.cc:844] Serialized 5149 byte log entry
0709 12:18:09.085701 (+586076us) op_driver.cc:464] REPLICATION: finished
0709 12:18:09.440436 (+354735us) write_op.cc:301] APPLY: starting
0709 12:18:09.440516 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:09.440766 (+   250us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:09.440885 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:09.493191 (+ 52306us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:09.493492 (+   301us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:18:09.493538 (+    46us) write_op.cc:312] APPLY: finished
0709 12:18:09.493863 (+   325us) log.cc:844] Serialized 94 byte log entry
0709 12:18:09.494038 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:09.494184 (+   146us) write_op.cc:454] Released schema lock
0709 12:18:09.494234 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:09.494644 (+   410us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:09.494669 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4439018,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":354429,"apply.run_cpu_time_us":3569,"apply.run_wall_time_us":54173,"num_ops":13,"prepare.queue_time_us":464284,"prepare.run_cpu_time_us":28345,"prepare.run_wall_time_us":291713,"raft.queue_time_us":259184,"raft.run_cpu_time_us":24182,"raft.run_wall_time_us":141359,"replication_time_us":586631,"thread_start_us":708557,"threads_started":4,"wal-append.queue_time_us":86643,"wal-append.run_cpu_time_us":46808,"wal-append.run_wall_time_us":1908085}]]}
I20260709 12:18:10.615077 22295 catalog_manager.cc:5697] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 3 to 6, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 6 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:10.685374 25785 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.741664 25785 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:10.741134 22295 catalog_manager.cc:5697] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 7 to 9, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 9 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:10.742894 22295 catalog_manager.cc:5697] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:10.615908 25842 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.616955 26012 consensus_queue.cc:237] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:10.618034 26027 consensus_meta.cc:287] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.724s	user 0.006s	sys 0.005s
W20260709 12:18:10.545832 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.629383 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:10.520071 26022 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:10.631875 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:10.754244 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 122456us
I20260709 12:18:10.577308 25754 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.641891 25974 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:10.652278 22469 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:10.661118 22475 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:10.662269 22366 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:10.695921 26003 raft_consensus.cc:697] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:10.665225 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:10.538628 25911 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:10.515168 25961 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.676416 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 2051) took 1245 ms. Trace:
I20260709 12:18:10.677434 22473 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 12:18:10.680303 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.744536 22295 catalog_manager.cc:5697] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 3 to 6, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1), VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2), VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3), VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 8 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:10.681150 22393 raft_consensus.cc:1240] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:18:10.557544 25994 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:10.539264 25523 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:10.679922 22442 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:10.783263 22295 catalog_manager.cc:5697] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:18:10.791942 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 112097us
I20260709 12:18:10.792780 22442 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:10.648248 25969 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:10.686642 22477 raft_consensus.cc:2889] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:10.671386 25917 consensus_queue.cc:1059] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:18:10.691421 25786 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:10.692119 25957 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:10.667078 26061 log.cc:927] Time spent T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.515s	user 0.005s	sys 0.005s
I20260709 12:18:10.635881 26072 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:10.649739 25793 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:10.702399 26102 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:18:10.703222 26037 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:10.704933 25982 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:10.579149 26056 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:10.728794 22367 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:10.804731 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 76019.3us
I20260709 12:18:10.805518 22367 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:10.722321 26030 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:10.692937 26033 consensus_meta.cc:287] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.000s
I20260709 12:18:10.808214 26033 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.810254 26033 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:10.812053 26056 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:10.813223 22470 raft_consensus.cc:2393] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 11: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:18:10.752277 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:10.814430 26046 consensus_meta.cc:287] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 1.073s	user 0.011s	sys 0.000s
I20260709 12:18:10.814841 26046 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.757941 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:10.818838 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:10.819276 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 62624.2us
I20260709 12:18:10.819461 22545 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:10.819999 22516 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:10.682176 25884 consensus_queue.cc:1059] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
W20260709 12:18:10.763072 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 100925us
I20260709 12:18:10.823424 22366 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:10.652245 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:10.825145 22398 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:10.734114 26026 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:10.777613 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 148309us
I20260709 12:18:10.781358 22468 rpcz_store.cc:276] 0709 12:18:09.431342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.432021 (+   679us) service_pool.cc:224] Handling call
0709 12:18:10.676187 (+1244166us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b5400160b54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:10.676350 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1980156800}
I20260709 12:18:10.752449 25997 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:10.794690 22295 catalog_manager.cc:5697] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:10.758417 26073 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:10.775784 25931 consensus_meta.cc:287] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.517s	user 0.007s	sys 0.002s
I20260709 12:18:10.775025 26031 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:10.775171 25949 raft_consensus.cc:1081] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:10.781586 25911 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.746851 25995 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:10.861493 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.802493 26092 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:10.807610 26037 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:10.795548 25523 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:10.758009 26027 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.817288 22476 raft_consensus.cc:2368] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11.
W20260709 12:18:10.816672 25905 consensus_meta.cc:287] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.893s	user 0.007s	sys 0.003s
I20260709 12:18:10.822155 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:10.770360 25754 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:10.763463 26022 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:10.820919 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:18:10.888435 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 67599.2us
I20260709 12:18:10.830157 26046 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:10.828735 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:10.746454 26084 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:10.852561 26021 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:10.844904 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:10.846900 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:10.851099 22545 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 6.
I20260709 12:18:10.792407 26042 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:10.875326 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:10.913256 22398 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:10.913504 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:10.826812 25840 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:10.829023 25982 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:10.847844 25989 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:10.884874 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49290 (request call id 383) took 1993 ms. Trace:
I20260709 12:18:10.824570 22366 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:10.853636 25931 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.889127 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:10.830231 22295 catalog_manager.cc:5697] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:10.869966 25911 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:10.933754 22295 catalog_manager.cc:5697] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 5 to 7, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 7 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:10.935249 22295 catalog_manager.cc:5697] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 1 to 4, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 4 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:10.921000 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:10.937119 25290 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:18:10.921617 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 97132.9us
W20260709 12:18:10.922467 22476 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 2039) took 1753 ms (client timeout 1618 ms). Trace:
W20260709 12:18:10.930044 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 166349us
I20260709 12:18:10.930492 26031 raft_consensus.cc:697] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:18:10.938104 23095 leader_election.cc:336] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.593s (SENT)
W20260709 12:18:10.937830 22476 rpcz_store.cc:269] 0709 12:18:09.169481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.169604 (+   123us) service_pool.cc:224] Handling call
0709 12:18:10.922218 (+1752614us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54003e3854. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:10.922389 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3712340864}
I20260709 12:18:10.876204 26073 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.939039 22394 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:10.948673 22295 catalog_manager.cc:5697] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 5 to 10, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 10 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:10.875097 26092 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.882598 25523 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:10.944267 22470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:10.950461 22470 raft_consensus.cc:606] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:10.950870 22470 raft_consensus.cc:614] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:10.950546 22295 catalog_manager.cc:5697] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:10.945713 22366 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:10.839895 25793 consensus_queue.cc:1059] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
W20260709 12:18:10.955518 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 126847us
I20260709 12:18:10.964306 22398 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:10.964669 22441 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:10.958811 25290 raft_consensus.cc:697] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:10.965255 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:10.919574 22546 rpcz_store.cc:276] 0709 12:18:08.891864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.893085 (+  1221us) service_pool.cc:224] Handling call
0709 12:18:08.910803 (+ 17718us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:08.911129 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:08.911170 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:09.362832 (+451662us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b2c001328c8. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f744da11 00007fb4f745d372 00007fb4f8b8fa01 00007fb4f8b5443a 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2
0709 12:18:09.422236 (+ 59404us) log.cc:844] Serialized 26 byte log entry
0709 12:18:09.849000 (+426764us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:09.849043 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:09.850021 (+   978us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:10.617883 (+767862us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:10.884651 (+266768us) raft_consensus.cc:1685] finished
0709 12:18:10.884671 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:10.884819 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13979,"raft.queue_time_us":7724,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3337,"spinlock_wait_cycles":8788992,"thread_start_us":417532,"threads_started":1,"wal-append.queue_time_us":634063}
I20260709 12:18:10.967115 22366 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:10.967322 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:10.968016 22366 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:10.904969 26078 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:10.975157 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:10.973266 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:10.973973 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:10.965939 25290 consensus_queue.cc:237] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.975143 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:10.975785 22542 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:10.984876 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:10.987334 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:10.988384 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:10.942538 26056 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:10.931595 25982 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:10.931932 25989 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.987550 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:10.990592 22441 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:10.949275 25996 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:10.976330 26021 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:10.977989 26078 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:11.010953 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 73756us
I20260709 12:18:10.976648 26030 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:10.948401 25972 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:10.973789 25949 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:10.894881 25905 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:10.871358 26003 consensus_queue.cc:237] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:10.962060 26092 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:10.949100 26037 consensus_queue.cc:1059] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:18:11.011088 25842 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:11.015530 26078 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:10.971987 26073 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:11.012197 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:11.005066 25982 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:11.025463 25840 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.003646 25989 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:11.012624 26045 raft_consensus.cc:2764] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 12:18:11.031418 26093 log.cc:927] Time spent T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 12:18:11.019920 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:11.015682 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:11.060691 22398 raft_consensus.cc:2393] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:11.033758 25974 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:11.034871 25972 raft_consensus.cc:697] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:11.047072 26035 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.103617 25949 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:11.104193 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 84348.4us
I20260709 12:18:11.114689 22441 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:11.104326 25793 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:11.055445 26030 raft_consensus.cc:697] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:11.041195 26126 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:11.060499 25961 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:11.116309 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.121183 22441 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:11.061184 26084 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:11.164808 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 43722.6us
I20260709 12:18:11.118106 25793 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:11.215672 25961 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.106288 26042 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:11.099443 25842 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:11.113888 26056 raft_consensus.cc:697] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:18:11.125110 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 112989us
I20260709 12:18:11.259315 22441 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:11.107040 26124 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:11.030222 26031 consensus_queue.cc:237] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:11.290215 25290 consensus_queue.cc:1059] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:11.126757 26045 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:11.307516 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:11.313269 25931 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:11.314204 23094 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:11.315116 25969 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:11.315689 25969 raft_consensus.cc:697] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:11.316597 25969 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:11.218297 26119 log.cc:927] Time spent T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
W20260709 12:18:11.219771 26111 log.cc:927] Time spent T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
W20260709 12:18:11.217849 26113 log.cc:927] Time spent T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
W20260709 12:18:11.300084 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 245652us
I20260709 12:18:11.095571 25840 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:11.223963 25997 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:11.224817 25793 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:11.113117 25974 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:11.218731 26027 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:11.218493 25995 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:11.216048 26128 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:11.218396 26123 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:11.127254 25949 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:11.312122 26045 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:11.127864 26035 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:11.320887 25754 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:11.320858 26022 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:11.218289 25961 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:11.303210 25842 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:11.339998 25932 consensus_meta.cc:287] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.647s	user 0.008s	sys 0.002s
I20260709 12:18:11.338917 25997 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:11.369349 26128 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:11.383996 25995 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:18:11.394677 25930 consensus_meta.cc:287] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.757s	user 0.011s	sys 0.000s
I20260709 12:18:11.393397 26027 raft_consensus.cc:3055] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:11.390513 26045 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:11.321715 26124 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:11.340242 25931 consensus_queue.cc:1059] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:18:11.403797 25997 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:11.336192 26030 consensus_queue.cc:237] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:11.331575 25972 consensus_queue.cc:237] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:11.422619 26128 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:11.427383 26027 raft_consensus.cc:740] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:11.389688 26123 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:11.443228 26073 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:11.456722 26127 log.cc:927] Time spent T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 12:18:11.457353 26133 log.cc:927] Time spent T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 12:18:11.458298 26122 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:18:11.405896 26056 consensus_queue.cc:237] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:11.460902 26072 raft_consensus.cc:3055] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:18:11.462208 26125 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 12:18:11.455574 26121 log.cc:927] Time spent T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.355s	user 0.001s	sys 0.000s
I20260709 12:18:11.452586 26126 raft_consensus.cc:697] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:11.473608 26078 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:11.466998 26072 raft_consensus.cc:740] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:18:11.476006 26108 log.cc:927] Time spent T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.438s	user 0.000s	sys 0.002s
I20260709 12:18:11.476280 26078 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:11.477232 26126 consensus_queue.cc:237] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:11.478331 26076 consensus_meta.cc:287] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.762s	user 0.010s	sys 0.000s
I20260709 12:18:11.478757 26076 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:11.479946 26072 consensus_queue.cc:260] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:11.489832 26072 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:11.491617 26080 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:11.491822 26094 raft_consensus.cc:3055] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:11.492326 26094 raft_consensus.cc:740] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:11.493199 26094 consensus_queue.cc:260] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:11.494573 26094 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:11.481009 26116 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.447s	user 0.001s	sys 0.000s
I20260709 12:18:11.483744 26123 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:11.485361 26124 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:11.486297 26092 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:11.498081 26092 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:11.533258 22366 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:11.535691 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:11.330746 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 344107us
W20260709 12:18:11.543284 22367 leader_election.cc:336] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.918s (SENT)
W20260709 12:18:11.544103 22368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.026s
W20260709 12:18:11.544735 22368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.000s	sys 0.026s
I20260709 12:18:11.545233 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1724) took 1223 ms. Trace:
I20260709 12:18:11.545233 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1729) took 1060 ms. Trace:
I20260709 12:18:11.546134 22396 rpcz_store.cc:276] 0709 12:18:10.321694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.720237 (+398543us) service_pool.cc:224] Handling call
0709 12:18:10.720558 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:10.720917 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.720944 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:10.721418 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:18:10.826359 (+104941us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:10.826399 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.826465 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:11.544568 (+718103us) raft_consensus.cc:1685] finished
0709 12:18:11.544617 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:11.544905 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9,"raft.queue_time_us":1192,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":104593,"threads_started":1,"wal-append.queue_time_us":256176}
I20260709 12:18:11.546190 22393 rpcz_store.cc:276] 0709 12:18:10.484509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.783589 (+299080us) service_pool.cc:224] Handling call
0709 12:18:10.784002 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:10.784374 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.784401 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:10.798590 (+ 14189us) log.cc:844] Serialized 26 byte log entry
0709 12:18:10.890823 (+ 92233us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:10.890869 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.890946 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:11.544340 (+653394us) raft_consensus.cc:1685] finished
0709 12:18:11.544430 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:11.544903 (+   473us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1163,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5569,"thread_start_us":63742,"threads_started":1,"wal-append.queue_time_us":142276}
I20260709 12:18:11.550997 22367 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:11.551813 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:11.553756 22367 leader_election.cc:336] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.174s (SENT)
I20260709 12:18:11.543728 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:11.555748 22367 leader_election.cc:336] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.552s (SENT)
I20260709 12:18:11.556367 22367 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:11.558837 22397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1715) took 1254 ms. Trace:
I20260709 12:18:11.550689 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:11.566109 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1726) took 1243 ms. Trace:
I20260709 12:18:11.566707 22401 rpcz_store.cc:276] 0709 12:18:10.322730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.780253 (+457523us) service_pool.cc:224] Handling call
0709 12:18:10.780663 (+   410us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:10.781073 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.781104 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:10.791278 (+ 10174us) log.cc:844] Serialized 52 byte log entry
0709 12:18:10.888497 (+ 97219us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b18004a04a0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a49e07 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b 00007fb4f86f3d23 00007fb4f86f40d1 00007fb4f8b0fa0f
0709 12:18:10.969876 (+ 81379us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:10.969915 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.969981 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:11.457606 (+487625us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b4800003e58. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fda7daa1 00007fb4fda74b37 00007fb4fda749ca 00007fb4fdb6c26f 00007fb4fdb6bf37 00007fb4fdb8055c 00007fb4fdb80508 00007fb4fdb80488 00007fb4fdb80443 00007fb4fdb7f6ec 00007fb4fcaa9a96
0709 12:18:11.565480 (+107874us) raft_consensus.cc:1685] finished
0709 12:18:11.565517 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:11.565893 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":11928,"raft.run_wall_time_us":666660,"spinlock_wait_cycles":17927936,"thread_start_us":81143,"threads_started":1,"wal-append.queue_time_us":293674}
W20260709 12:18:11.568720 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 309444us
I20260709 12:18:11.570302 22441 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:11.403602 25932 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:11.559444 22397 rpcz_store.cc:276] 0709 12:18:10.304111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.654385 (+350274us) service_pool.cc:224] Handling call
0709 12:18:10.661831 (+  7446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:10.673576 (+ 11745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.673609 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:10.674084 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:18:10.827294 (+153210us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:10.827332 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.923313 (+ 95981us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b54000375d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:10.923364 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:11.558109 (+634745us) raft_consensus.cc:1685] finished
0709 12:18:11.558153 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:11.558598 (+   445us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29389,"raft.queue_time_us":114,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":7937,"spinlock_wait_cycles":26014592,"thread_start_us":74564,"threads_started":1,"wal-append.queue_time_us":230902}
W20260709 12:18:11.574514 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.573694 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1714) took 1269 ms. Trace:
I20260709 12:18:11.610996 22549 raft_consensus.cc:2393] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 10: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:11.575503 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1815) took 1387 ms. Trace:
I20260709 12:18:11.578066 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:11.576251 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1814) took 1394 ms. Trace:
I20260709 12:18:11.624888 25917 raft_consensus.cc:993] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:11.602938 25842 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:11.629873 25938 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:11.700392 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:11.577232 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 271231us
I20260709 12:18:11.602672 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:18:11.700649 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 75304.7us
I20260709 12:18:11.458487 26035 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:11.488690 26076 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:11.737879 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:11.738492 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:11.603644 25905 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:11.628203 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:11.740443 22544 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:11.740829 26135 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:11.741955 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:11.742568 25974 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:11.601783 25961 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:11.743621 22396 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:11.744297 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:11.745077 22550 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:11.575306 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:11.610203 25930 raft_consensus.cc:3055] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:11.591014 25931 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.600657 25840 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:11.736099 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 180496us
I20260709 12:18:11.760257 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2135) took 1232 ms. Trace:
I20260709 12:18:11.739537 22542 raft_consensus.cc:2368] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11.
I20260709 12:18:11.590255 25932 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:11.742425 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:11.762661 22543 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:11.599825 25949 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:11.766417 25949 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:11.767030 25949 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:11.754087 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.767446 22442 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:11.770179 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 443234us
I20260709 12:18:11.772331 26145 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:11.773052 26145 raft_consensus.cc:697] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:11.773923 26022 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:11.743683 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:11.765354 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:11.641620 22400 rpcz_store.cc:276] 0709 12:18:10.303908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.653225 (+349317us) service_pool.cc:224] Handling call
0709 12:18:10.653514 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:10.653713 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:10.691948 (+ 38235us) log.cc:844] Serialized 14 byte log entry
0709 12:18:10.830987 (+139039us) log.cc:844] Serialized 14 byte log entry
0709 12:18:11.458467 (+627480us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b18004a07a0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a67522 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:18:11.475335 (+ 16868us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:11.572787 (+ 97452us) spinlock_profiling.cc:243] Waited 9.33 ms on lock 0x7b18004a07a0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f86fc4bc 00007fb4f5a4a48b 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a64455 00007fb4f8b4c060 00007fb4f8b5e716 00007fb4f8b6f287
0709 12:18:11.572986 (+   199us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:11.573068 (+    82us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:11.573188 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.573283 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:11.573484 (+   201us) inbound_call.cc:177] Queueing success response
0709 12:18:11.629206 (+ 55722us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b18004a07a0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a67522 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
Metrics: {"mutex_wait_us":18419,"prepare.queue_time_us":24455,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":2274,"raft.queue_time_us":42624,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":45561,"spinlock_wait_cycles":119305472,"thread_start_us":186739,"threads_started":2,"wal-append.queue_time_us":305814}
W20260709 12:18:11.773061 22394 consensus_meta.cc:287] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.823s	user 0.010s	sys 0.014s
I20260709 12:18:11.767474 25949 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:11.742435 26139 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:18:11.794941 22394 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
W20260709 12:18:11.796646 25785 consensus_meta.cc:287] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 1.054s	user 0.009s	sys 0.004s
W20260709 12:18:11.796801 22394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1718) took 1492 ms (client timeout 1639 ms). Trace:
I20260709 12:18:11.627512 25939 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.156s
W20260709 12:18:11.797222 22394 rpcz_store.cc:269] 0709 12:18:10.304751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.486429 (+181678us) service_pool.cc:224] Handling call
0709 12:18:11.796580 (+1310151us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b540005e6d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:11.796724 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949147008}
I20260709 12:18:11.798834 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:11.799599 22394 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
W20260709 12:18:11.800042 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.800618 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:11.801314 25931 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:11.740479 26126 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:11.741968 26135 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:18:11.803741 25786 consensus_meta.cc:287] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 1.000s	user 0.005s	sys 0.015s
I20260709 12:18:11.804391 22543 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:18:11.804283 25786 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:11.804664 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:11.806866 25786 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:11.793934 22545 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:11.808308 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:11.800644 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.645361 22477 rpcz_store.cc:276] 0709 12:18:10.181963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.536283 (+354320us) service_pool.cc:224] Handling call
0709 12:18:10.582918 (+ 46635us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:10.817492 (+234574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.817523 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:10.818091 (+   568us) log.cc:844] Serialized 52 byte log entry
0709 12:18:11.005712 (+187621us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:11.099781 (+ 94069us) log.cc:844] Serialized 14 byte log entry
0709 12:18:11.105064 (+  5283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.105169 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:11.575745 (+470576us) raft_consensus.cc:1685] finished
0709 12:18:11.575782 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:11.576071 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61561,"prepare.queue_time_us":111006,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":26318,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":3229,"thread_start_us":174523,"threads_started":2,"wal-append.queue_time_us":377885}
I20260709 12:18:11.823676 25793 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:11.797164 25785 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:11.770514 25884 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.752748 25930 raft_consensus.cc:740] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:11.787073 26120 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:11.842731 22468 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:18:11.916752 25905 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:18:11.760799 22547 rpcz_store.cc:276] 0709 12:18:10.467437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.630005 (+162568us) service_pool.cc:224] Handling call
0709 12:18:10.630311 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:10.804124 (+173813us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:10.805582 (+  1458us) log.cc:844] Serialized 14 byte log entry
0709 12:18:10.917241 (+111659us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:10.917309 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:10.917352 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.480273 (+562921us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:11.612075 (+131802us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b18004058e0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a352a6 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419
0709 12:18:11.613617 (+  1542us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b540042b654. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:11.613674 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:11.699959 (+ 86285us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3158,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":73,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":26566,"spinlock_wait_cycles":447109120,"thread_start_us":111337,"threads_started":1,"wal-append.queue_time_us":200521}
W20260709 12:18:11.967489 26009 consensus_meta.cc:287] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 1.230s	user 0.012s	sys 0.002s
W20260709 12:18:11.990238 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 420255us
I20260709 12:18:11.799798 26037 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:18:11.809618 25919 consensus_meta.cc:287] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 1.342s	user 0.011s	sys 0.007s
I20260709 12:18:11.974542 22396 raft_consensus.cc:1240] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:12.016660 25919 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:11.843842 26070 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.017907 26070 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:11.946739 22366 leader_election.cc:400] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11.
I20260709 12:18:12.019292 22366 leader_election.cc:403] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:18:12.019923 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 193165us
I20260709 12:18:11.841843 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:11.643002 22474 rpcz_store.cc:276] 0709 12:18:10.187927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.715633 (+527706us) service_pool.cc:224] Handling call
0709 12:18:10.715965 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:10.716366 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:10.879547 (+163181us) log.cc:844] Serialized 14 byte log entry
0709 12:18:10.943360 (+ 63813us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:10.972945 (+ 29585us) log.cc:844] Serialized 52 byte log entry
0709 12:18:10.973394 (+   449us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:11.004136 (+ 30742us) log.cc:844] Serialized 14 byte log entry
0709 12:18:11.009102 (+  4966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.009196 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:11.489784 (+480588us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b2400433268. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f58ed9c4 00007fb4f58ebacb 00007fb4f5aa6dc9 00007fb4f5aa6a55 00007fb4f5aa5fb0 00007fb4f871c488 00007fb4f871cbe8 00007fb4f86f4398 00007fb4f86ef76a 00007fb4f86eebb6
0709 12:18:11.574924 (+ 85140us) raft_consensus.cc:1685] finished
0709 12:18:11.574958 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:11.575253 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77708,"prepare.queue_time_us":326427,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":7448,"raft.queue_time_us":32605,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":31110,"spinlock_wait_cycles":57490048,"thread_start_us":212488,"threads_started":2,"wal-append.queue_time_us":132932}
I20260709 12:18:12.015709 22472 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:12.021755 26056 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11.
I20260709 12:18:11.970248 26033 raft_consensus.cc:1081] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
W20260709 12:18:11.891312 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.025512 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:12.025987 22546 raft_consensus.cc:1275] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:12.027204 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:12.025035 22551 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:18:12.028802 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:12.015775 25884 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:11.894556 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 104954us
I20260709 12:18:12.032825 25884 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:11.891896 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:12.036402 22397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1838) took 1149 ms. Trace:
I20260709 12:18:12.036680 22398 raft_consensus.cc:2393] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 11: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:11.810912 26027 consensus_queue.cc:260] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:12.038937 22545 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
W20260709 12:18:11.969594 25982 consensus_meta.cc:287] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.870s	user 0.006s	sys 0.006s
W20260709 12:18:12.006707 25608 consensus_meta.cc:287] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 1.295s	user 0.016s	sys 0.003s
W20260709 12:18:11.893621 26155 log.cc:927] Time spent T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:18:11.847337 25840 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.051229 26120 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:12.052507 25982 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:12.055727 26045 consensus_meta.cc:287] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.618s	user 0.007s	sys 0.004s
I20260709 12:18:12.058338 25840 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:12.059152 26045 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:12.061518 25840 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:12.062355 26045 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:12.063906 22548 raft_consensus.cc:1240] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:12.055557 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:11.892053 26021 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.004s	sys 0.008s
I20260709 12:18:12.058087 26154 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:18:12.066159 26021 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.008s	sys 0.011s
I20260709 12:18:12.066596 26021 raft_consensus.cc:697] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:12.067843 26021 consensus_queue.cc:237] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:12.070003 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1819) took 1855 ms. Trace:
I20260709 12:18:12.070835 22474 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:12.065507 23123 consensus_queue.cc:237] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:12.037436 22397 rpcz_store.cc:276] 0709 12:18:10.886710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.629322 (+742612us) service_pool.cc:224] Handling call
0709 12:18:11.629975 (+   653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:11.630471 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:11.891109 (+260638us) log.cc:844] Serialized 14 byte log entry
0709 12:18:12.035616 (+144507us) log.cc:844] Serialized 14 byte log entry
0709 12:18:12.036024 (+   408us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.036073 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:12.036121 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.036192 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.036330 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72188,"prepare.queue_time_us":135644,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":109,"raft.queue_time_us":72427,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":207,"thread_start_us":273124,"threads_started":2}
I20260709 12:18:12.010290 25793 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:11.844010 26080 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:12.078390 22550 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
W20260709 12:18:12.077294 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 49480.1us
I20260709 12:18:12.081192 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:12.078948 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:12.020274 26070 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:12.096323 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:12.110503 26140 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:12.114055 22468 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:12.114274 22545 raft_consensus.cc:2410] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:12.070431 22469 rpcz_store.cc:276] 0709 12:18:10.188921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.763837 (+574916us) service_pool.cc:224] Handling call
0709 12:18:10.764170 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:10.777099 (+ 12929us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:10.946130 (+169031us) spinlock_profiling.cc:243] Waited 904 us on lock 0x7b18002f7ee0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a49e07 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a64455 00007fb4fc54c3c7 00007fb4f8b5e9a7 00007fb4f8b6e0bf 00007fb4f8b6e038
0709 12:18:11.094178 (+148048us) log.cc:844] Serialized 14 byte log entry
0709 12:18:11.774474 (+680296us) log.cc:844] Serialized 14 byte log entry
0709 12:18:11.830347 (+ 55873us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:11.831067 (+   720us) log.cc:844] Serialized 26 byte log entry
0709 12:18:11.831229 (+   162us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:11.831266 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.833817 (+  2551us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.037305 (+203488us) raft_consensus.cc:1685] finished
0709 12:18:12.037343 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.044021 (+  6678us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":277576,"prepare.queue_time_us":231178,"prepare.run_cpu_time_us":183,"prepare.run_wall_time_us":39024,"raft.queue_time_us":591716,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":14671,"spinlock_wait_cycles":2078464,"thread_start_us":452007,"threads_started":3,"wal-append.queue_time_us":265625}
I20260709 12:18:12.122085 22399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1835) took 1095 ms. Trace:
I20260709 12:18:12.095297 25884 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.095057 26037 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:12.133141 25931 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:12.132296 26037 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:12.114743 25911 consensus_meta.cc:287] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 1.152s	user 0.011s	sys 0.007s
W20260709 12:18:12.143608 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:12.144202 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.145048 22468 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
W20260709 12:18:12.152087 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 77224.9us
W20260709 12:18:12.177567 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 74299.6us
I20260709 12:18:12.076892 26145 consensus_queue.cc:237] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:12.187640 22472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 1818) took 1999 ms (client timeout 2063 ms). Trace:
I20260709 12:18:12.190768 25930 consensus_queue.cc:260] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:12.194931 26157 log.cc:927] Time spent T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:18:12.181648 25785 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:12.185093 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:12.150516 25884 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:12.154076 25911 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:12.103686 26080 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:12.190809 22551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 2131) took 1873 ms (client timeout 1823 ms). Trace:
W20260709 12:18:12.218605 22472 rpcz_store.cc:269] 0709 12:18:10.188665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.505861 (+317196us) service_pool.cc:224] Handling call
0709 12:18:12.187402 (+1681541us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400047254. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:12.187557 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3272095488}
I20260709 12:18:12.122591 22399 rpcz_store.cc:276] 0709 12:18:10.844026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.563305 (+719279us) service_pool.cc:224] Handling call
0709 12:18:11.563943 (+   638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:11.564375 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:18:11.564992 (+   617us) log.cc:844] Serialized 14 byte log entry
0709 12:18:11.934712 (+369720us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:11.934764 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:11.934818 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.934885 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:11.939314 (+  4429us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74752,"prepare.queue_time_us":156562,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":15172,"raft.queue_time_us":103929,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9989,"thread_start_us":265216,"threads_started":1,"wal-append.queue_time_us":560568}
I20260709 12:18:12.223639 22402 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:12.989173 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:12.760129 25840 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:12.792543 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:12.991942 22468 raft_consensus.cc:2410] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 12:18:12.303872 22551 rpcz_store.cc:269] 0709 12:18:10.316883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.480086 (+163203us) service_pool.cc:224] Handling call
0709 12:18:12.190518 (+1710432us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54001419d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:12.190698 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3432114432}
W20260709 12:18:12.213500 22549 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 2136) took 1734 ms (client timeout 1720 ms). Trace:
W20260709 12:18:12.286005 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.587806 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:12.857549 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:12.230012 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:18:12.537582 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.230381 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:12.781920 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 216926us
W20260709 12:18:12.564431 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 385101us
I20260709 12:18:12.879118 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:12.865610 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:12.997610 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.989141 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1829) took 2146 ms. Trace:
I20260709 12:18:13.005390 22393 rpcz_store.cc:276] 0709 12:18:10.842676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.553931 (+711255us) service_pool.cc:224] Handling call
0709 12:18:11.554537 (+   606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.211478 (+656941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.211507 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.211549 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:12.211577 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.988853 (+777276us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b540006ed54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:12.988894 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.989049 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1510211968}
W20260709 12:18:12.994292 22549 rpcz_store.cc:269] 0709 12:18:10.479031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.480384 (+  1353us) service_pool.cc:224] Handling call
0709 12:18:12.213183 (+1732799us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000659d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:12.213408 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2496045824}
I20260709 12:18:13.005364 22396 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:12.755136 26161 log.cc:927] Time spent T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.907s	user 0.006s	sys 0.012s
I20260709 12:18:12.792868 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:12.793248 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:12.852170 26021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.002s	sys 0.018s
I20260709 12:18:13.052824 22471 raft_consensus.cc:2410] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:18:12.224709 25884 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:18:12.629072 26080 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:12.970777 25793 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:12.618355 26120 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:13.054638 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 899719us
I20260709 12:18:12.312433 26172 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:18:13.055877 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.620486 25931 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:13.042907 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 291151us
W20260709 12:18:12.795264 26173 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.584s	user 0.000s	sys 0.013s
W20260709 12:18:12.205229 25523 consensus_meta.cc:287] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 1.220s	user 0.012s	sys 0.007s
W20260709 12:18:12.430768 25997 consensus_meta.cc:287] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.988s	user 0.011s	sys 0.000s
W20260709 12:18:12.801266 26177 log.cc:927] Time spent T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.590s	user 0.000s	sys 0.013s
W20260709 12:18:12.226581 26167 log.cc:927] Time spent T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.382s	user 0.009s	sys 0.005s
W20260709 12:18:13.058738 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 61963.7us
W20260709 12:18:12.209434 26072 consensus_meta.cc:287] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.719s	user 0.009s	sys 0.001s
W20260709 12:18:12.310652 25989 consensus_meta.cc:287] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 1.204s	user 0.008s	sys 0.004s
W20260709 12:18:12.216795 25994 consensus_meta.cc:287] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 1.418s	user 0.008s	sys 0.007s
W20260709 12:18:12.419838 26094 consensus_meta.cc:287] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.925s	user 0.005s	sys 0.004s
W20260709 12:18:12.218369 26128 consensus_meta.cc:287] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.762s	user 0.009s	sys 0.003s
W20260709 12:18:12.855556 26145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.010s	sys 0.013s
I20260709 12:18:12.218060 26046 raft_consensus.cc:3055] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:13.061746 22469 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:13.004215 25930 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:12.234591 25982 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:12.349125 26160 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.002s	sys 0.014s
I20260709 12:18:12.619474 26129 raft_consensus.cc:3055] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:13.071137 25793 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:12.586041 25786 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:13.066872 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.102310 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:13.066951 23095 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:13.065591 25939 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.066074 26031 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:13.113067 25939 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.068845 22402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1723) took 2756 ms. Trace:
I20260709 12:18:13.055938 25754 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.114005 22402 rpcz_store.cc:276] 0709 12:18:10.321390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.692807 (+371417us) service_pool.cc:224] Handling call
0709 12:18:10.693120 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:12.989034 (+2295914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.003130 (+ 14096us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400226354. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:13.061933 (+ 58803us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3519040256}
I20260709 12:18:12.464751 25911 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:12.795377 26124 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:18:13.056808 26021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.002s	sys 0.024s
I20260709 12:18:13.068106 26035 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:13.070474 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:12.604427 26026 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:12.857929 26077 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:12.197744 25949 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:12.990588 25840 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:12.538363 26037 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:13.079527 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.081718 22398 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:13.082346 22366 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:13.083230 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:13.130992 22468 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:13.080111 26027 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:13.092526 26140 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:18:13.125175 25972 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.018s	sys 0.029s
I20260709 12:18:13.084023 26120 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:18:13.141933 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 63603.3us
I20260709 12:18:13.137426 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:13.065568 26123 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:13.093551 25997 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.113338 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:13.113508 22476 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:13.114341 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 380) took 2257 ms. Trace:
I20260709 12:18:12.238623 25996 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:13.100342 25994 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:13.117543 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 50696.3us
I20260709 12:18:13.123759 22471 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 11: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:13.123279 22477 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:18:13.100297 26128 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.099624 26046 raft_consensus.cc:740] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:18:13.128090 26183 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:18:13.091686 25523 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.128373 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:13.111616 26129 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:13.096107 22400 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:13.143471 22402 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:13.099500 25989 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:13.098610 26145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.014s	sys 0.017s
I20260709 12:18:13.148628 22366 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:13.147965 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.171301 22394 raft_consensus.cc:1240] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:13.171577 22547 raft_consensus.cc:1240] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:13.102737 25931 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.094133 26172 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.147567 22401 rpcz_store.cc:276] 0709 12:18:10.856606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.568966 (+712360us) service_pool.cc:224] Handling call
0709 12:18:11.569512 (+   546us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:11.571617 (+  2105us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:11.571650 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:11.572535 (+   885us) log.cc:844] Serialized 52 byte log entry
0709 12:18:11.732459 (+159924us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:11.732495 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.735179 (+  2684us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.754188 (+1019009us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:13.114027 (+359839us) raft_consensus.cc:1685] finished
0709 12:18:13.114050 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.114280 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":172032,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":140,"spinlock_wait_cycles":57508608,"thread_start_us":154270,"threads_started":1,"wal-append.queue_time_us":216560}
I20260709 12:18:13.135569 26185 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:13.178280 26185 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:13.178696 26185 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:13.179167 25840 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:13.180814 25949 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.181612 25939 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.174571 26123 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:13.154721 26037 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.184309 26123 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:13.137734 25972 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.019s	sys 0.030s
I20260709 12:18:13.162477 22551 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:18:13.188220 22551 pending_rounds.cc:85] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 7
I20260709 12:18:13.126554 25786 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:13.154501 25996 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:13.167035 22470 raft_consensus.cc:2393] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:13.167721 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:13.164752 22542 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:13.168435 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:13.132946 25754 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.174353 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.177148 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.194839 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:13.196241 22473 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:13.177246 26046 consensus_queue.cc:260] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.177721 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:13.189646 22549 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:13.137262 26035 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.194119 22395 raft_consensus.cc:2368] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9.
I20260709 12:18:13.193667 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:13.188585 22551 pending_rounds.cc:107] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:18:13.200428 22551 raft_consensus.cc:2889] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:13.146286 26026 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.128886 26124 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.185520 26021 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:13.185148 26037 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.195187 25905 consensus_queue.cc:1059] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:18:13.195341 25754 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:13.217844 26003 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.203366 25939 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:13.218444 26003 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:13.205811 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 73154us
I20260709 12:18:13.154987 26077 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:13.205088 22399 raft_consensus.cc:2393] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:13.206545 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:13.187647 26120 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.211082 22401 raft_consensus.cc:2393] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 10: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:13.212809 25972 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:13.166971 26140 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.234220 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:13.235018 22399 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:13.235899 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:13.236435 22399 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:13.226934 26021 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:13.239890 26021 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:13.242049 26179 log.cc:927] Time spent T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.831s	user 0.004s	sys 0.004s
I20260709 12:18:13.243801 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1840) took 1696 ms. Trace:
I20260709 12:18:13.244186 22394 rpcz_store.cc:276] 0709 12:18:11.547627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.810583 (+262956us) service_pool.cc:224] Handling call
0709 12:18:11.810974 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:13.171692 (+1360718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.243516 (+ 71824us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400348854. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:13.243733 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3128136960}
I20260709 12:18:13.240617 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:13.250845 25754 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:13.251430 22542 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:13.252849 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:13.221444 26003 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.254907 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.256608 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2151) took 1232 ms. Trace:
I20260709 12:18:13.258196 22547 rpcz_store.cc:276] 0709 12:18:12.024238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.042709 (+ 18471us) service_pool.cc:224] Handling call
0709 12:18:12.070178 (+ 27469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:13.171904 (+1101726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.256318 (+ 84414us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540040ea54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:13.256522 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2532665088}
I20260709 12:18:13.236446 26046 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:13.266420 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:13.267642 22544 raft_consensus.cc:2393] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 12: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:13.270414 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:13.270601 22545 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:13.271171 22548 raft_consensus.cc:2393] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 10: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:13.271829 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:13.272068 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:13.272740 22548 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:18:13.272796 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:13.274056 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:13.274626 22550 raft_consensus.cc:2376] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5. Re-sending same reply.
I20260709 12:18:13.275220 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:13.276043 22549 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:13.277172 26080 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:13.277667 22544 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:18:13.281452 22395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1827) took 2439 ms (client timeout 1846 ms). Trace:
W20260709 12:18:13.281968 22395 rpcz_store.cc:269] 0709 12:18:10.842197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.846649 (+  4452us) service_pool.cc:224] Handling call
0709 12:18:13.281120 (+2434471us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b54000b6dd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:13.281338 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5229791616}
I20260709 12:18:13.285145 26120 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.287247 26140 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.288512 25949 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.289192 25949 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.273609 22545 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:13.294490 26128 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:13.301489 26026 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.292279 25949 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.318320 25949 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.319129 25949 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.321489 25949 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.322438 26129 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.331197 25931 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:13.275362 22295 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32988 (request call id 93) took 6284 ms. Trace:
I20260709 12:18:13.336324 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:13.216197 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:18:13.355080 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.354502 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:13.360461 22398 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:13.329545 26077 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:13.362668 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1733) took 1321 ms. Trace:
I20260709 12:18:13.354501 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:13.341827 22472 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:13.365839 23125 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
W20260709 12:18:13.341521 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 124729us
I20260709 12:18:13.366010 22398 rpcz_store.cc:276] 0709 12:18:12.040958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.229519 (+188561us) service_pool.cc:224] Handling call
0709 12:18:13.362609 (+1133090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:13.386061 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:13.367057 22366 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:13.389395 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:13.389587 26080 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:13.390065 26080 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:13.385003 23127 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:13.390692 26080 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:13.392007 25786 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:13.388984 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:13.394181 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:13.389148 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.390057 22550 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:13.367362 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:13.358472 26128 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.389508 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:13.342811 26026 consensus_queue.cc:1059] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:18:13.366616 26129 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:13.365254 26070 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:13.418190 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.341969 26031 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:18:13.431274 22400 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:13.423981 22367 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.823s (SENT) [suppressed 35 similar messages]
I20260709 12:18:13.432258 23094 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:13.367203 25931 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:13.438427 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:13.441641 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 74901.2us
I20260709 12:18:13.401070 26077 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:13.444520 22472 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 10: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:13.442567 22366 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:13.439069 26070 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.426812 26154 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.412957 25793 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.456856 22549 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:13.411460 25996 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:13.481997 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 228386us
I20260709 12:18:13.441851 25997 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.427686 26128 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.489378 26124 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.489884 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:13.503165 26172 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.505633 22515 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:13.411574 25786 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
W20260709 12:18:13.487025 22367 leader_election.cc:336] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.559s (SENT)
I20260709 12:18:13.434434 26003 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:18:13.456061 26026 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:18:13.506712 23096 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.045s	sys 0.080s
W20260709 12:18:13.531292 23096 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.046s	sys 0.080s
I20260709 12:18:13.531208 26026 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.510174 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:13.532945 25969 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:13.478273 26145 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:13.533407 25969 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.534027 25969 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:13.486236 25994 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.433571 26185 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:13.525295 25911 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:13.533272 22472 raft_consensus.cc:2393] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:13.524788 22400 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:13.460322 25931 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:13.529359 22515 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:13.530400 22367 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:13.357210 22295 rpcz_store.cc:276] 0709 12:18:06.990750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.993934 (+  3184us) service_pool.cc:224] Handling call
0709 12:18:13.275064 (+6281130us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:11.334663 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:11.454894 (+120231us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:11.456199 (+  1305us) write_op.cc:435] Acquired schema lock
0709 12:18:11.462697 (+  6498us) tablet.cc:662] Decoding operations
0709 12:18:11.470564 (+  7867us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:11.470647 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:11.470678 (+    31us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:18:11.471668 (+   990us) tablet.cc:701] Row locks acquired
0709 12:18:11.471685 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:18:11.471867 (+   182us) write_op.cc:270] Start()
0709 12:18:11.471985 (+   118us) write_op.cc:276] Timestamp: P: 1783599491471806 usec, L: 0
0709 12:18:11.472003 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:18:11.472825 (+   822us) log.cc:844] Serialized 4457 byte log entry
0709 12:18:11.506041 (+ 33216us) op_driver.cc:464] REPLICATION: finished
0709 12:18:12.196086 (+690045us) write_op.cc:301] APPLY: starting
0709 12:18:12.196235 (+   149us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:12.196567 (+   332us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:12.196707 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:12.198188 (+  1481us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:12.198664 (+   476us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:18:12.198717 (+    53us) write_op.cc:312] APPLY: finished
0709 12:18:12.199276 (+   559us) log.cc:844] Serialized 82 byte log entry
0709 12:18:12.206008 (+  6732us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:12.206323 (+   315us) write_op.cc:454] Released schema lock
0709 12:18:12.206426 (+   103us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":689631,"apply.run_cpu_time_us":4667,"apply.run_wall_time_us":112981,"num_ops":11,"prepare.queue_time_us":288829,"prepare.run_cpu_time_us":6075,"prepare.run_wall_time_us":179525,"raft.queue_time_us":1393,"replication_time_us":33856,"thread_start_us":111544,"threads_started":4,"wal-append.queue_time_us":27096,"wal-append.run_cpu_time_us":4107,"wal-append.run_wall_time_us":1707080}]]}
W20260709 12:18:13.512662 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 70193.9us
I20260709 12:18:13.546469 22366 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:13.548244 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.547622 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:13.551208 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:13.532670 25957 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 12:18:13.555742 22470 raft_consensus.cc:2410] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:13.539541 25972 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:13.566922 22472 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:18:13.541383 26120 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.553378 26077 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:13.525934 26154 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.579100 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:13.533836 26145 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:13.565694 25972 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.563915 26031 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:13.573401 25911 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:13.570412 26128 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:13.589877 25989 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.588356 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.656471 22472 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:18:13.594319 26070 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.598263 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:13.599061 25523 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.599618 22473 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:13.600275 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:13.660597 22476 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:13.600983 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.661468 22471 raft_consensus.cc:2410] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:18:13.601696 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:13.602576 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.602828 26185 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.580237 26120 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.662061 22475 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:13.605734 25919 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:13.599110 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.609633 26027 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:13.612434 26188 log.cc:927] Time spent T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.173s	user 0.002s	sys 0.002s
I20260709 12:18:13.651582 25911 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:13.588086 25994 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.605887 25982 consensus_queue.cc:1059] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:18:13.616950 22296 catalog_manager.cc:5697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 3 to 7, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 7 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:13.623505 25931 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:13.677945 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.577126 26077 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.682811 26077 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:13.629472 22469 consensus_meta.cc:287] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.002s
W20260709 12:18:13.643553 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.574306 26035 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.663601 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:13.585974 25972 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:13.678668 22471 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:13.660169 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:13.687786 22545 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:13.613090 22396 consensus_meta.cc:287] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.000s
I20260709 12:18:13.662930 26139 raft_consensus.cc:3055] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:13.659154 26031 raft_consensus.cc:697] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:13.679172 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.679772 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:13.684845 22469 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:13.685454 22543 raft_consensus.cc:2410] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:18:13.686395 23095 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.009s	sys 0.026s
I20260709 12:18:13.665390 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:13.688315 22396 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:13.694798 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1736) took 1464 ms. Trace:
I20260709 12:18:13.695158 22396 rpcz_store.cc:276] 0709 12:18:12.230696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.230859 (+   163us) service_pool.cc:224] Handling call
0709 12:18:13.694722 (+1463863us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:13.675519 25911 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:13.697100 23095 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.010s	sys 0.026s
I20260709 12:18:13.696810 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.693634 22475 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:18:13.699609 22397 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:13.680027 25994 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.676534 26026 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.698388 22472 raft_consensus.cc:2368] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11.
I20260709 12:18:13.700784 22477 raft_consensus.cc:2393] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:18:13.701375 26160 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 2.195s	user 0.014s	sys 0.033s
I20260709 12:18:13.703001 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:13.703352 25994 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.706817 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.707705 22472 raft_consensus.cc:2410] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:18:13.708518 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:13.709224 22472 raft_consensus.cc:2393] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:13.700480 22471 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:18:13.710918 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.712110 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.713151 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:13.712919 25969 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:13.701550 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.714488 22475 raft_consensus.cc:2368] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11.
I20260709 12:18:13.715359 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.715889 25969 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:13.716104 22475 raft_consensus.cc:2410] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:18:13.716651 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:13.717161 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.717517 22472 raft_consensus.cc:2410] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:18:13.718456 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.719192 22472 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:13.719933 25840 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:13.720496 25840 raft_consensus.cc:697] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:13.721342 22516 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:13.718353 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:13.722472 22471 raft_consensus.cc:2393] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 10: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:13.724033 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:13.721340 25840 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.724138 22476 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:13.726912 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.729925 26099 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.727689 22471 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 11: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:13.730536 26099 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.731213 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.731474 26035 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:13.732097 26035 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:13.732683 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:13.733372 22471 raft_consensus.cc:2376] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10. Re-sending same reply.
I20260709 12:18:13.733919 26129 raft_consensus.cc:3055] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:18:13.734184 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.722878 22475 raft_consensus.cc:2393] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:13.727823 25982 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:13.734686 26035 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:13.728200 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.734946 25982 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:13.735441 25982 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:13.736140 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.736986 22472 raft_consensus.cc:2410] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:13.738036 22472 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:18:13.701040 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 523938us
I20260709 12:18:13.729370 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:13.741750 26163 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:13.742352 26163 raft_consensus.cc:697] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:13.743252 26163 consensus_queue.cc:237] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.745018 25982 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:13.746938 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:13.747776 25754 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:13.748342 25754 raft_consensus.cc:697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:13.749291 25754 consensus_queue.cc:237] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.750612 26145 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:13.743155 22475 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:18:13.751868 22475 pending_rounds.cc:85] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 6
I20260709 12:18:13.752086 22475 pending_rounds.cc:107] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:18:13.752362 22475 raft_consensus.cc:2889] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:13.730214 22476 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 10: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:13.760305 22470 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:18:13.747967 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:13.768586 22472 raft_consensus.cc:1275] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:13.791926 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.792790 22469 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:13.690049 26139 raft_consensus.cc:740] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:18:13.806679 22442 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.029s	sys 0.033s
I20260709 12:18:13.800668 22468 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:13.808555 22470 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:18:13.809335 22442 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.029s	sys 0.033s
W20260709 12:18:13.807148 23095 leader_election.cc:336] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.504s (SENT)
I20260709 12:18:13.811911 22471 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:13.763309 26129 raft_consensus.cc:740] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:13.819303 22476 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:13.819676 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:13.819087 22546 raft_consensus.cc:1240] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:13.822069 22473 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:13.822803 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:13.766949 26026 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:13.824419 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 76524us
I20260709 12:18:13.766595 25996 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:13.829670 25905 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.032s	sys 0.030s
W20260709 12:18:13.830082 23124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.033s	sys 0.029s
W20260709 12:18:13.863608 23124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.033s	sys 0.029s
W20260709 12:18:13.836292 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:13.819077 26166 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.030s	sys 0.031s
W20260709 12:18:13.855221 25939 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.008s	sys 0.021s
I20260709 12:18:13.858856 22475 raft_consensus.cc:2376] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10. Re-sending same reply.
W20260709 12:18:13.840741 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:13.882781 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.883936 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:18:13.833863 22542 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.007s	sys 0.028s
W20260709 12:18:13.885421 22542 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.007s	sys 0.028s
I20260709 12:18:13.881567 22545 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9.
W20260709 12:18:13.861194 23123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.001s	sys 0.029s
I20260709 12:18:13.891948 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:13.892097 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:13.893178 22400 raft_consensus.cc:2410] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:18:13.899245 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.900452 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:13.893815 22296 catalog_manager.cc:5697] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:13.900071 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:13.833132 25982 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:13.864502 25931 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:13.909329 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:18:13.895051 25939 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.008s	sys 0.022s
W20260709 12:18:13.874578 26166 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.030s	sys 0.031s
W20260709 12:18:13.874969 25905 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.032s	sys 0.030s
W20260709 12:18:13.899247 26080 consensus_meta.cc:287] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.002s
W20260709 12:18:13.891693 23123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.002s	sys 0.029s
I20260709 12:18:13.921980 22475 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:18:13.913314 26021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.007s	sys 0.018s
I20260709 12:18:13.922595 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.930670 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.918895 22394 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:13.932049 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:13.935585 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:13.935701 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.902602 25996 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:13.940786 22551 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.003s	sys 0.018s
I20260709 12:18:13.922236 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:13.923040 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:18:13.948645 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 141537us
I20260709 12:18:13.902302 26026 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.953539 22296 catalog_manager.cc:5697] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 2 to 8, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 8 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:13.902480 26139 consensus_queue.cc:260] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.949491 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:13.919902 25939 raft_consensus.cc:697] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:18:14.084887 22474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.032s	sys 0.053s
W20260709 12:18:14.085569 22551 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.006s	sys 0.029s
I20260709 12:18:13.962575 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:13.971233 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.114799 22546 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:18:14.114588 22474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.033s	sys 0.053s
I20260709 12:18:13.985265 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:13.963035 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:14.107297 22366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.007s	sys 0.035s
I20260709 12:18:14.116640 22473 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:18:14.104442 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.106432 22472 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: []
W20260709 12:18:14.085415 22516 connection.cc:256] RPC call timeout handler was delayed by -1.8283337190000566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
I20260709 12:18:14.121327 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:14.106129 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:14.082895 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 595869us
I20260709 12:18:14.107734 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:14.123706 22397 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:14.130348 22399 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
W20260709 12:18:14.118559 22544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.017s	sys 0.061s
W20260709 12:18:14.116735 22366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.007s	sys 0.035s
I20260709 12:18:13.941203 25969 consensus_queue.cc:1059] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.182s
I20260709 12:18:14.135591 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:14.136572 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:14.134088 22544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.018s	sys 0.061s
I20260709 12:18:14.150708 22395 raft_consensus.cc:2393] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:14.140602 22471 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:14.142300 22470 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:14.141705 22476 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
W20260709 12:18:14.136703 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 585760us
I20260709 12:18:14.169133 22398 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:13.920673 26031 consensus_queue.cc:237] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:14.195050 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:13.944239 26129 consensus_queue.cc:260] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:14.223088 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 66265.8us
I20260709 12:18:14.234227 22366 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:14.158587 26021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.008s	sys 0.019s
I20260709 12:18:13.942387 26080 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:13.949203 26193 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.136740 25905 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:18:14.247120 23095 leader_election.cc:336] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.513s (SENT)
W20260709 12:18:14.302560 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 169485us
I20260709 12:18:14.355875 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:14.356932 22399 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
W20260709 12:18:14.361269 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 127109us
W20260709 12:18:14.232923 26077 consensus_meta.cc:287] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.550s	user 0.002s	sys 0.007s
I20260709 12:18:14.364984 22475 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:14.363446 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:14.368206 22469 raft_consensus.cc:2410] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:14.376199 22473 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:14.377753 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:14.379117 26077 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:14.381753 26077 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:14.342171 25972 consensus_meta.cc:287] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.628s	user 0.011s	sys 0.000s
W20260709 12:18:14.266685 26197 log.cc:927] Time spent T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.313s	user 0.000s	sys 0.000s
W20260709 12:18:14.466854 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.469053 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:18:14.466938 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.162279 25996 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:14.275858 26026 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:14.248891 26201 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.205s
I20260709 12:18:14.398707 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 2067) took 1038 ms. Trace:
I20260709 12:18:14.485301 22397 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:14.403640 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:14.486047 22473 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:14.362322 26139 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:14.407109 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:14.418694 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:14.488600 22469 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:14.420557 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:14.421396 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:14.422138 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:14.490320 22468 raft_consensus.cc:2376] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11. Re-sending same reply.
W20260709 12:18:14.422652 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.491653 22472 raft_consensus.cc:2393] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:14.422832 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:14.302814 26193 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:14.270807 26200 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.196s
I20260709 12:18:14.245821 26035 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.185s
I20260709 12:18:14.432760 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:14.363462 25905 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:14.433038 22296 catalog_manager.cc:5697] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:14.374457 26140 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:14.441798 26154 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:14.444147 26099 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:14.448482 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:14.516497 22549 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:14.451525 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:14.451730 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:14.517645 22542 raft_consensus.cc:2410] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:18:14.266183 26120 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:14.245477 25931 raft_consensus.cc:697] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:14.478972 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:14.402477 25972 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:14.484534 22474 rpcz_store.cc:276] 0709 12:18:13.361037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.366214 (+  5177us) service_pool.cc:224] Handling call
0709 12:18:13.397607 (+ 31393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:13.411984 (+ 14377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.412022 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:13.438079 (+ 26057us) log.cc:844] Serialized 26 byte log entry
0709 12:18:14.115576 (+677497us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:14.115637 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:14.115711 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:14.398478 (+282767us) raft_consensus.cc:1685] finished
0709 12:18:14.398498 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:14.398640 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5156,"raft.queue_time_us":23027,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":4955,"thread_start_us":607984,"threads_started":1,"wal-append.queue_time_us":881820}
I20260709 12:18:14.488895 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:14.495774 22475 raft_consensus.cc:2393] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:18:14.499845 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.501125 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:14.537426 22398 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 4.
I20260709 12:18:14.502755 22396 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:14.505136 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:14.539181 23128 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:14.501894 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:14.274101 25939 consensus_queue.cc:237] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:14.514608 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.519423 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:14.525375 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:14.517232 22543 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 4.
I20260709 12:18:14.533502 22547 raft_consensus.cc:2393] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:18:14.534134 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 311859us
I20260709 12:18:14.503577 26026 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:14.518940 25911 consensus_meta.cc:287] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.777s	user 0.009s	sys 0.000s
I20260709 12:18:14.545688 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:14.545943 26037 raft_consensus.cc:3055] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:14.547099 25931 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:14.548566 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:14.548507 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41028 (request call id 446) took 1364 ms. Trace:
W20260709 12:18:14.555673 26223 log.cc:927] Time spent T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:18:14.556681 22402 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1850) took 1481 ms (client timeout 1971 ms). Trace:
I20260709 12:18:14.509479 26140 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:14.557567 22366 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:14.558183 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 438599us
I20260709 12:18:14.559470 22542 raft_consensus.cc:2393] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 7: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:14.542774 26120 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:14.560529 26037 raft_consensus.cc:740] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:14.570158 22548 raft_consensus.cc:2393] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:14.570990 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:14.585135 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:14.565147 22473 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:14.570361 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:14.572540 22402 rpcz_store.cc:269] 0709 12:18:13.074979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.186429 (+111450us) service_pool.cc:224] Handling call
0709 12:18:14.556417 (+1369988us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000a9954. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:14.556591 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2516162816}
W20260709 12:18:14.586823 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:14.574821 23095 leader_election.cc:336] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.875s (SENT)
I20260709 12:18:14.586591 22547 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:14.587410 23095 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:14.593565 22366 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:14.596163 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.600732 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:14.571336 26191 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:14.564746 23124 rpcz_store.cc:276] 0709 12:18:13.192290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.193858 (+  1568us) service_pool.cc:224] Handling call
0709 12:18:13.194229 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:13.194721 (+   492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.194750 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:13.195258 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 12:18:13.289287 (+ 94029us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b1800345580. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:18:13.864029 (+574742us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:13.864068 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.864129 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:14.531667 (+667538us) raft_consensus.cc:1685] finished
0709 12:18:14.531689 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:14.535899 (+  4210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1050,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"spinlock_wait_cycles":28310400,"thread_start_us":660711,"threads_started":1,"wal-append.queue_time_us":735135}
I20260709 12:18:14.608232 22543 raft_consensus.cc:2368] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9.
I20260709 12:18:14.606722 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:14.609813 22547 raft_consensus.cc:2393] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 12: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:14.571208 25972 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:14.563486 25911 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:14.590171 26026 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:14.649876 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 144578us
I20260709 12:18:14.675027 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:14.760891 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 2092) took 1146 ms. Trace:
I20260709 12:18:14.723990 22549 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:14.719367 22544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2173) took 1342 ms. Trace:
I20260709 12:18:14.765625 22477 rpcz_store.cc:276] 0709 12:18:13.614693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.752934 (+138241us) service_pool.cc:224] Handling call
0709 12:18:13.801485 (+ 48551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:13.820633 (+ 19148us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:14.149404 (+328771us) log.cc:844] Serialized 14 byte log entry
0709 12:18:14.760335 (+610931us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:14.760443 (+   108us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:14.760516 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:14.760626 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:14.760811 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6952,"prepare.queue_time_us":578635,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":18375,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":10860,"thread_start_us":610672,"threads_started":2}
I20260709 12:18:14.666082 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:14.784678 22542 raft_consensus.cc:2410] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 12:18:14.791530 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 216741us
W20260709 12:18:14.665591 26223 log.cc:927] Time spent T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:18:14.583720 26140 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:14.665335 26193 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:14.799175 22516 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:14.662937 25905 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:14.603667 26154 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:14.666496 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:14.798406 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:14.599917 26120 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:14.821393 22393 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
W20260709 12:18:14.610826 22367 connection.cc:256] RPC call timeout handler was delayed by -1.0601009320000685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
I20260709 12:18:14.652886 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:14.798431 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:14.806726 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:14.699306 26035 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:14.810050 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:14.760125 26070 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:14.652408 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:14.611613 22296 catalog_manager.cc:5697] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 2 to 7, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 7 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:14.815783 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:14.587921 26021 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:18:14.757400 25969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.022s
I20260709 12:18:14.767403 22544 rpcz_store.cc:276] 0709 12:18:13.377346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.387629 (+ 10283us) service_pool.cc:224] Handling call
0709 12:18:13.395604 (+  7975us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:13.558943 (+163339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.558976 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:13.566397 (+  7421us) log.cc:844] Serialized 26 byte log entry
0709 12:18:14.146064 (+579667us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:14.146149 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:14.713365 (+567216us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54001b9754. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:14.713418 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:14.713474 (+    56us) raft_consensus.cc:1685] finished
0709 12:18:14.713489 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:14.719281 (+  5792us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2808,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":132,"spinlock_wait_cycles":329678720,"thread_start_us":559823,"threads_started":1,"wal-append.queue_time_us":797428}
I20260709 12:18:14.651955 25996 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:14.656332 25994 consensus_queue.cc:1059] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.161s
I20260709 12:18:14.848806 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:14.836874 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 180921us
I20260709 12:18:14.849864 22547 raft_consensus.cc:2410] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:14.807870 26225 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.652886 26037 consensus_queue.cc:260] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:14.839311 22546 raft_consensus.cc:2393] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:14.832208 25754 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:18:14.838882 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 329975us
I20260709 12:18:14.910023 22549 raft_consensus.cc:2393] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:18:14.862696 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.912132 22296 catalog_manager.cc:5697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:14.863102 22548 raft_consensus.cc:1240] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:18:14.870949 26242 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.862783 26070 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:14.842701 26035 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:14.917739 22366 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:14.869262 25994 raft_consensus.cc:3055] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:14.875665 22442 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:14.851065 26129 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:14.876154 26239 consensus_queue.cc:1059] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:18:14.881299 26026 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:14.841615 26021 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:18:14.843008 25969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.008s	sys 0.022s
I20260709 12:18:14.821002 26154 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:14.868954 26225 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:14.857219 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:14.881935 25911 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:14.888240 23128 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:14.901887 25919 consensus_queue.cc:1059] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:14.905454 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:14.906291 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:14.906970 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:14.907816 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:14.909036 26037 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:14.918594 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 95438.7us
I20260709 12:18:14.925487 22546 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
W20260709 12:18:14.947228 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:14.946070 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 70484.3us
I20260709 12:18:14.654814 26200 raft_consensus.cc:2955] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 5 to 8, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:18:15.285972 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.341482 23125 raft_consensus.cc:2393] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 11: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
W20260709 12:18:15.050617 26139 consensus_meta.cc:287] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.002s
W20260709 12:18:14.962430 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 44788us
I20260709 12:18:15.344528 26099 raft_consensus.cc:3055] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:15.345145 26099 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:14.960968 22548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54498
I20260709 12:18:15.346035 26099 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:14.945737 25994 raft_consensus.cc:740] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:15.347401 26099 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:15.347527 25994 consensus_queue.cc:260] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.348603 25994 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:15.345227 26185 raft_consensus.cc:3055] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:15.349483 26185 raft_consensus.cc:740] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:15.350327 26185 consensus_queue.cc:260] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:15.351745 22400 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
W20260709 12:18:15.353348 22400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1747) took 1397 ms (client timeout 1717 ms). Trace:
I20260709 12:18:15.351787 26185 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:15.359862 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.985965 22296 catalog_manager.cc:5697] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 5 to 10, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 10 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:15.363350 22296 catalog_manager.cc:5697] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
W20260709 12:18:15.341084 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.346493 22548 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:18:15.078606 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:15.365100 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.365289 22548 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:15.364988 23095 connection.cc:256] RPC call timeout handler was delayed by -1.0863219089999347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
W20260709 12:18:15.366067 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.011406 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:15.163021 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2156) took 1915 ms. Trace:
I20260709 12:18:15.062093 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:15.340014 22542 raft_consensus.cc:1240] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:15.341585 22442 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:15.358215 22400 rpcz_store.cc:269] 0709 12:18:13.956029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.118250 (+162221us) service_pool.cc:224] Handling call
0709 12:18:15.353145 (+1234895us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54000b59d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:15.353290 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2758776192}
I20260709 12:18:15.368147 23130 raft_consensus.cc:2393] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 11: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
W20260709 12:18:15.319237 26237 log.cc:927] Time spent T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.095s	user 0.001s	sys 0.001s
I20260709 12:18:15.357538 26227 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:18:15.394495 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.219792 26120 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:15.001608 25939 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:15.091184 26070 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:15.409937 26099 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.410583 26099 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:15.413024 26099 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:15.219095 26035 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:15.371850 25905 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:15.398516 22549 raft_consensus.cc:2955] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 5 to 8, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:15.212553 26080 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:15.415129 25905 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:15.376618 26222 raft_consensus.cc:3055] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:15.358565 26154 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:15.406103 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 64613.1us
W20260709 12:18:15.406702 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 549535us
I20260709 12:18:14.974817 26242 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:15.367556 22551 rpcz_store.cc:276] 0709 12:18:13.248046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.249082 (+  1036us) service_pool.cc:224] Handling call
0709 12:18:13.249474 (+   392us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:13.250035 (+   561us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:14.557388 (+1307353us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b1800405880. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f86fc4bc 00007fb4f5a4a48b 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a64455 00007fb4fc54c3c7 00007fb4f8b5e9a7 00007fb4f8b6e0bf
0709 12:18:14.557532 (+   144us) log.cc:844] Serialized 14 byte log entry
0709 12:18:14.824073 (+266541us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:14.839799 (+ 15726us) log.cc:844] Serialized 52 byte log entry
0709 12:18:14.840122 (+   323us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:14.840188 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:14.840320 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:15.151750 (+311430us) raft_consensus.cc:1685] finished
0709 12:18:15.162757 (+ 11007us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.162942 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":697225,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":22899,"raft.queue_time_us":792,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":10084,"spinlock_wait_cycles":25794816,"thread_start_us":1122344,"threads_started":2,"wal-append.queue_time_us":483519}
I20260709 12:18:15.372694 26191 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:18:15.419819 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 50377.8us
I20260709 12:18:15.358496 26021 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:15.420600 22548 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.423959 22442 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:14.975530 26193 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:15.367501 22296 catalog_manager.cc:5697] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:15.418210 22515 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:15.438184 25939 raft_consensus.cc:697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:15.439224 25939 consensus_queue.cc:237] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.440225 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:15.373137 26225 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:15.441973 25994 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:15.442107 26225 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:15.398907 26239 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.413666 26099 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:15.451421 26099 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:15.451900 26099 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:15.436560 26191 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:15.457979 26225 raft_consensus.cc:697] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:15.458642 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:15.459007 26225 consensus_queue.cc:237] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:15.459893 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:15.461055 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:15.463624 25905 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:15.464147 26191 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:15.464241 22367 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:15.466266 26239 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.468708 26239 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:15.402146 26031 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:15.470499 26031 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:15.472731 26031 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:15.470908 26140 consensus_meta.cc:287] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.652s	user 0.009s	sys 0.000s
I20260709 12:18:15.396153 25754 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:15.474808 22367 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:15.475833 22548 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:15.478094 22442 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:15.416916 26222 raft_consensus.cc:740] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:15.489648 22544 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:15.489480 26222 consensus_queue.cc:260] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.443778 26193 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:15.491218 26193 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:15.490865 26222 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:15.491745 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:15.492573 26077 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:15.493006 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:15.493848 25972 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:15.494283 22516 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:15.492969 26077 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:15.495540 26077 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:15.495761 22296 catalog_manager.cc:5697] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:15.494324 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:15.497941 25972 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:15.498724 26140 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.500800 26140 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:15.499063 23123 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:15.504187 26077 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.497430 22296 catalog_manager.cc:5697] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 1 to 4, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 4 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:15.442489 25994 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:15.495556 22516 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:15.505448 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:15.506366 22367 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:15.500829 26242 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:15.490794 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:15.424870 25996 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:15.518712 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:15.483855 25905 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:15.509958 26140 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:15.522166 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:15.520536 22296 catalog_manager.cc:5697] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
W20260709 12:18:15.532063 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.515869 25994 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:15.544714 22296 catalog_manager.cc:5697] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 5 to 6, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 6 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } }
I20260709 12:18:15.541680 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:15.525441 25996 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.551770 22367 leader_election.cc:400] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11.
I20260709 12:18:15.552662 25982 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.552827 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:15.553210 25982 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:15.521409 26037 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:15.553740 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:15.514772 25754 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:15.554924 22548 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
I20260709 12:18:15.555972 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:15.556316 25754 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:15.558207 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:15.559527 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:15.564559 25996 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:15.566008 22296 catalog_manager.cc:5697] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 8 to 9, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 9 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:15.567901 25982 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:15.517920 25972 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:15.510149 26191 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.571517 22367 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:15.596093 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:15.584467 22516 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:15.573534 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:15.597155 22551 raft_consensus.cc:2393] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:15.599316 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:15.603283 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:15.525708 26154 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.614192 25905 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:15.615298 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:15.616089 22551 raft_consensus.cc:2393] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:15.616930 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:15.619998 22296 catalog_manager.cc:5697] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:15.622614 22367 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:15.622851 26077 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:15.623462 25905 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:15.623667 26145 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:15.624161 26145 raft_consensus.cc:697] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:15.625042 26145 consensus_queue.cc:237] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.569340 26099 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.621325 22296 catalog_manager.cc:5697] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 3 to 4, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 4 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:15.625626 22367 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:15.613157 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:15.580618 26021 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.571679 26037 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:15.649705 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:15.632972 22548 raft_consensus.cc:2410] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:18:15.626263 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:15.653244 22551 raft_consensus.cc:2393] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 10: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:15.655443 22551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b42c69680a57493c942307ff09185b72"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54498
I20260709 12:18:15.655982 22551 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:15.656316 22551 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:15.670903 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:15.672222 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:15.672564 22367 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:15.673856 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 273653us
I20260709 12:18:15.648978 25972 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:18:15.685307 22548 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:15.653928 25931 consensus_queue.cc:1059] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:18:15.726226 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:15.673296 25905 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:15.731110 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.706890 22551 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:15.733496 22543 raft_consensus.cc:1240] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 10. Ops: []
I20260709 12:18:15.727089 26037 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:15.686820 26200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:57274 (request call id 0) took 4646 ms. Trace:
W20260709 12:18:15.741012 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 68521.2us
I20260709 12:18:15.686165 26225 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:18:15.743914 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 265916us
I20260709 12:18:15.732237 26191 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:15.755638 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:15.757440 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:15.758183 22544 raft_consensus.cc:2393] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:15.759487 22551 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:15.759408 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:15.734819 26154 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:15.684149 26140 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:18:15.736943 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:15.763227 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:15.765280 23126 raft_consensus.cc:2393] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:15.767717 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:15.768594 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:15.773361 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:15.774412 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:15.775265 22551 raft_consensus.cc:2410] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:18:15.750646 26222 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:15.777293 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:15.778573 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:15.792112 22441 connection.cc:256] RPC call timeout handler was delayed by -2.9237242419999347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
W20260709 12:18:15.792726 22441 connection.cc:256] RPC call timeout handler was delayed by -2.9021242419999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
I20260709 12:18:15.776034 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:15.794926 26222 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:15.796716 26265 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.798252 26193 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.763968 26225 raft_consensus.cc:697] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:15.802248 26021 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:15.802671 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:15.815495 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 144686us
I20260709 12:18:15.821979 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:15.826206 22548 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:15.826565 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:15.827756 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:15.822311 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:15.769301 26239 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:15.815444 25982 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:15.813748 26222 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:15.814615 26099 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:15.846163 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 78525.4us
I20260709 12:18:15.846939 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:15.847690 22400 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:15.847885 22398 raft_consensus.cc:1240] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:15.829356 26256 log.cc:927] Time spent T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:18:15.840057 26225 consensus_queue.cc:237] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.852716 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:15.841467 22543 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:15.818015 26265 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.854740 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:15.855159 22548 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:15.855495 22543 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:15.855783 26265 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:15.856020 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:15.844731 22550 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:15.844643 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:15.848825 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.850410 26070 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:15.860316 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:15.860904 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:15.861790 22393 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:15.835843 26154 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:15.864030 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:15.864394 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:15.841385 26129 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:15.872817 22400 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:15.875573 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:15.876181 22396 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:15.838694 25996 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.875095 22402 raft_consensus.cc:1240] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:15.879575 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.889672 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:15.890430 22399 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:15.850713 25754 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:15.892081 22442 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:15.864460 25972 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:15.893682 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:15.894349 23130 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:15.870698 25905 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:18:15.875393 26129 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:15.902127 26129 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:15.902860 26263 consensus_queue.cc:1059] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:15.878057 25939 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:18:15.885128 25996 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.907853 25996 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:15.908414 25996 raft_consensus.cc:3055] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:15.908742 25996 raft_consensus.cc:740] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:15.873878 26021 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:18:15.882273 26070 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:15.836824 26239 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:15.873584 26154 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:15.922299 23130 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
W20260709 12:18:15.927831 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.931720 26193 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:15.932655 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 53809.8us
W20260709 12:18:15.932552 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:15.942332 26261 log.cc:927] Time spent T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:18:15.943604 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2186) took 1355 ms. Trace:
I20260709 12:18:15.943970 22547 rpcz_store.cc:276] 0709 12:18:14.588326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.867658 (+279332us) service_pool.cc:224] Handling call
0709 12:18:14.924746 (+ 57088us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:14.924962 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:14.924987 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:15.338790 (+413803us) log.cc:844] Serialized 26 byte log entry
0709 12:18:15.680074 (+341284us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:15.680112 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.722869 (+ 42757us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:15.943365 (+220496us) raft_consensus.cc:1685] finished
0709 12:18:15.943390 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.943542 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":278065,"threads_started":1,"wal-append.queue_time_us":431799}
I20260709 12:18:15.944919 26239 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:15.858574 26031 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 12:18:15.955652 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 127952us
I20260709 12:18:15.958077 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:15.962095 22473 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:15.963439 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:15.964085 22474 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:15.966454 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:15.967332 22398 raft_consensus.cc:2393] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:15.968134 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:15.968693 22398 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:18:15.969266 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:15.969908 22472 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:15.970387 22395 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:15.971366 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:15.971858 22477 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:15.972103 22395 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:15.972533 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:15.973099 22468 raft_consensus.cc:3055] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:15.973394 22468 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:15.973905 22394 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:15.974133 22468 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.974936 22401 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:15.980260 22472 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:15.982117 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:15.968801 22471 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:18:15.983017 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.969543 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:15.976244 22401 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:15.982838 22473 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 6.
W20260709 12:18:15.991775 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.975140 22468 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:15.994961 26272 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.995530 26272 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:15.998096 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:15.998847 26272 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:15.996676 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 101707us
W20260709 12:18:15.992522 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 134352us
I20260709 12:18:16.000190 26272 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.001125 26272 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:16.003291 26272 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:16.004845 26272 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.002213 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.005544 26272 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:16.005798 22473 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:16.007658 22516 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:15.919512 26099 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:15.885516 26201 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:18:15.947985 26154 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:15.951550 23123 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:16.047776 22367 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:16.048249 22472 raft_consensus.cc:1240] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:16.049526 26269 log.cc:927] Time spent T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:18:16.052906 26035 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:16.041116 22474 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:16.042294 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:15.946928 25972 raft_consensus.cc:697] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:16.054503 22367 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:16.055584 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:16.056090 22477 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:16.060992 22473 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:16.040903 22470 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:15.909497 25996 consensus_queue.cc:260] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:16.063268 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:16.055917 25939 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:16.070832 26283 consensus_queue.cc:1059] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:18:16.072177 25931 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:16.036268 26099 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.069936 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:16.074131 26099 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:16.074302 22397 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:18:16.081275 25996 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:16.082020 26099 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:16.084158 22469 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:15.743562 26200 rpcz_store.cc:276] 0709 12:18:11.053834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.060040 (+  6206us) service_pool.cc:224] Handling call
0709 12:18:11.620089 (+560049us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400777f20. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8ad1520 00007fb4f8b5ab42 00007fb4f8b59800 00007fb4f8b529fa 00007fb4fdb1a4c9 00007fb4f7096c54 00007fb4f7096be2 00007fb4f7096b11 00007fb4f7096a8c 00007fb4f7095d42
0709 12:18:12.114513 (+494424us) log.cc:844] Serialized 494 byte log entry
0709 12:18:15.686714 (+3572201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45144,"raft.run_cpu_time_us":24841,"raft.run_wall_time_us":445071,"spinlock_wait_cycles":233624832,"thread_start_us":1483346,"threads_started":2,"wal-append.queue_time_us":676764,"wal-append.run_cpu_time_us":2290,"wal-append.run_wall_time_us":1150108}
I20260709 12:18:16.087157 26129 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:16.089416 26129 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:16.090420 22397 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:16.091441 22543 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:16.098146 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.100440 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.100744 22477 raft_consensus.cc:2393] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:16.064426 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.101337 22475 raft_consensus.cc:3055] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:16.101790 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.103175 22470 raft_consensus.cc:2393] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:16.105516 22468 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:16.105414 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.107605 22474 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:18:16.101655 22475 raft_consensus.cc:740] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:16.090811 26077 raft_consensus.cc:3055] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:16.112953 22367 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:16.065438 25911 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:16.104074 26145 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:18:16.133304 25754 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:16.133872 25754 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:16.111409 22475 consensus_queue.cc:260] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:16.118237 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.123018 26099 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:16.124804 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.125864 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.155514 22470 raft_consensus.cc:2376] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8. Re-sending same reply.
I20260709 12:18:16.127123 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.090936 22284 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0723691b01e2413baf71cbc73a551fdc with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
I20260709 12:18:16.104516 25939 raft_consensus.cc:697] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:16.147462 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.156061 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:16.113109 26080 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:16.157670 22468 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
W20260709 12:18:16.149914 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.174319 22469 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:16.114122 26077 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:16.171856 22477 raft_consensus.cc:2368] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 11. Current term is 12.
I20260709 12:18:16.093595 25994 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:16.164685 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:16.179318 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.180114 22470 raft_consensus.cc:2393] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:18:16.183645 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 76851.8us
W20260709 12:18:16.187593 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 145388us
I20260709 12:18:16.188817 22516 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:16.190140 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:16.190402 22399 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:16.191170 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.192950 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:16.154624 26205 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:16.193043 22442 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:16.199468 22475 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:18:16.201251 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:16.200618 22442 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:16.176716 26080 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:16.208038 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:16.208459 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:16.212293 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:16.211041 22476 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:16.212888 22400 raft_consensus.cc:2393] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:16.216199 22397 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:16.216708 22516 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:16.219825 22396 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:18:16.221961 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.224475 22470 raft_consensus.cc:2393] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:16.197533 25931 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:16.222395 22474 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:16.208559 26193 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:16.228753 22516 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
W20260709 12:18:16.188197 22284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 97448.6us
I20260709 12:18:16.215617 26099 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:16.217615 26080 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:16.232903 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.218892 25919 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:16.240398 25919 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:16.240834 25919 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:16.203795 26286 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:16.246119 26286 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:16.246577 26286 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:16.221088 26272 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:16.251551 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.211582 25982 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:16.256294 25982 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:16.230580 26077 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:16.261842 26129 consensus_queue.cc:1175] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b8621fa34be04d3fa2d68a300f858cd1" responder_term: 12 status { last_received { term: 11 index: 9 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:16.266870 26080 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:16.268303 26077 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:16.188748 26222 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:16.282234 26222 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:16.234822 26193 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.284037 26193 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:16.238227 26099 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.286036 26099 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:16.287801 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.288269 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.288470 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.289126 22471 raft_consensus.cc:2393] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:16.291654 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.292471 22476 raft_consensus.cc:2393] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:16.293346 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:16.294549 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.295327 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:16.274276 26265 consensus_queue.cc:1059] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:16.296979 26239 raft_consensus.cc:3055] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:16.297362 26239 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:16.239594 26293 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:16.181170 25972 consensus_queue.cc:237] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:16.298193 26239 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:16.301255 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:16.302145 22402 raft_consensus.cc:2393] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:16.302690 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.307525 22548 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:16.275525 26286 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:16.233062 26285 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:16.278776 22550 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:18:16.278801 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 50135.3us
I20260709 12:18:16.317939 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:16.279510 26277 log.cc:927] Time spent T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:18:16.283355 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:18:16.310735 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.322445 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:16.313432 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.270876 25919 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:16.279166 26225 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:16.325208 22366 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:16.344372 22400 raft_consensus.cc:2410] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:18:16.326259 22549 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:16.334535 22516 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:16.327642 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:16.332880 22367 connection.cc:256] RPC call timeout handler was delayed by -1.2075429480000821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
I20260709 12:18:16.347424 22476 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:18:16.325224 22470 raft_consensus.cc:2393] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:18:16.348284 22367 connection.cc:256] RPC call timeout handler was delayed by -1.18774294800005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
I20260709 12:18:16.349929 23095 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:16.344980 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.360540 26129 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:16.362377 26222 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:16.362880 26222 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.362998 25919 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:16.363289 26222 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:16.365978 26285 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:16.368208 25911 consensus_queue.cc:1059] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:16.368867 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:16.369586 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:16.369939 26191 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:16.370996 22366 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:16.371402 26191 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:16.371872 26139 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:16.373816 26031 raft_consensus.cc:3055] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:16.374203 26031 raft_consensus.cc:740] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:16.375062 26031 consensus_queue.cc:260] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:16.376216 26031 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:16.377965 25905 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:16.378928 22471 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:16.379951 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.380524 22471 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:16.382126 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:16.382815 22394 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:16.383546 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:16.385169 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.386094 22470 raft_consensus.cc:2393] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:16.389963 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.386662 26120 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:16.392570 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.393224 22477 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:16.393675 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:16.373214 26139 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:18:16.373118 26285 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:16.397655 22475 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:16.399216 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:16.348234 26035 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.393126 22402 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:16.435498 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:16.437253 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.348781 26225 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:16.438704 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.437275 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:16.443292 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:16.444777 26247 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:18:16.445521 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.446192 22474 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:16.446725 22367 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:16.447781 22473 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:16.232918 25939 consensus_queue.cc:237] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:16.448355 22367 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:16.449617 26021 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:16.445029 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:16.319169 25982 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:16.352427 26282 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:16.452426 22394 raft_consensus.cc:2393] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 5: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:16.380821 26185 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:16.455147 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.455760 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:16.343820 26253 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 12:18:16.505313 22476 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:16.483827 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:16.494653 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:16.437992 22471 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:16.507215 22548 raft_consensus.cc:2393] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:18:16.460240 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:16.467059 22367 leader_election.cc:336] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.549s (SENT)
W20260709 12:18:16.507978 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.348483 26205 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:18:16.509991 22545 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:16.355854 26201 consensus_queue.cc:1059] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
W20260709 12:18:16.523258 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 63319.9us
I20260709 12:18:16.531883 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:16.453455 26021 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:16.515547 22475 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 5.
W20260709 12:18:16.440066 26277 log.cc:927] Time spent T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:18:16.506350 22542 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:16.562772 22543 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:16.555903 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:16.571453 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:16.579952 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.580726 22468 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:16.581938 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.582569 22475 raft_consensus.cc:2376] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5. Re-sending same reply.
I20260709 12:18:16.451406 26225 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:16.481191 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.456621 26285 raft_consensus.cc:697] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:16.596068 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.598146 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.598763 22475 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 12: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:16.604025 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:16.606731 22470 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:16.435562 26099 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:16.607118 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.608533 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.614569 22473 raft_consensus.cc:2368] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11.
I20260709 12:18:16.609215 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.615511 22477 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:16.616595 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:16.616842 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 54749.6us
W20260709 12:18:16.619117 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 381618us
I20260709 12:18:16.620069 22476 raft_consensus.cc:2393] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:18:16.620633 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.613700 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.621241 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:16.621824 22394 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:16.623643 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:16.570106 26282 raft_consensus.cc:697] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:16.625078 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.626420 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:16.627226 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:16.621605 22442 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:16.635142 22470 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 10: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:18:16.635871 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 264922us
I20260709 12:18:16.638309 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.450311 26035 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:16.639635 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:16.640110 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 116102us
I20260709 12:18:16.640599 22366 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:16.600404 25994 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:16.655123 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:16.655582 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.649205 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.649662 22474 raft_consensus.cc:2393] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:16.652180 22470 raft_consensus.cc:2393] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:16.659936 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.660734 22470 raft_consensus.cc:2368] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10.
I20260709 12:18:16.661448 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.661989 22470 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:16.662202 22394 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:16.662823 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.663652 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.664175 22473 raft_consensus.cc:2393] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:16.664383 22468 raft_consensus.cc:2393] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 14: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:16.665637 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.664822 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:16.668432 22470 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:18:16.667455 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 48412us
I20260709 12:18:16.669413 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:16.669032 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.670591 22477 raft_consensus.cc:2393] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:16.670888 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.671541 22475 raft_consensus.cc:2368] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10.
I20260709 12:18:16.665994 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:16.669756 22367 leader_election.cc:336] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.823s (SENT)
I20260709 12:18:16.632702 25919 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:16.676110 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:16.678073 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:16.669262 26206 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:16.682874 22475 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:16.688812 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.637140 26248 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:18:16.675241 25931 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:18:16.684211 25754 consensus_meta.cc:287] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.550s	user 0.005s	sys 0.005s
I20260709 12:18:16.681247 26205 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:16.704890 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.684662 25994 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:16.705708 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 84177.2us
I20260709 12:18:16.706849 22475 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:18:16.709309 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 44578.9us
I20260709 12:18:16.709913 22442 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:16.710668 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:16.710832 22394 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:16.673712 26272 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:18:16.689040 23123 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:18:16.715314 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.686910 26303 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.679461 25972 consensus_queue.cc:1059] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:18:16.719762 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.729954 22475 raft_consensus.cc:2393] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:16.730088 22470 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:16.722555 26145 raft_consensus.cc:3055] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:18:16.722795 26298 log.cc:927] Time spent T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:18:16.723964 26297 log.cc:927] Time spent T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:18:16.724711 26239 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:16.705463 26286 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:16.715140 26080 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:16.756943 26129 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:16.759944 26129 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:16.730894 22395 raft_consensus.cc:1275] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:16.731912 22471 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:18:16.700496 25931 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.739746 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:16.684088 25919 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:16.682061 26292 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:18:16.708146 25994 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:16.739935 26291 log.cc:927] Time spent T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 12:18:16.717233 26270 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:16.765733 22475 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:16.740319 26145 raft_consensus.cc:740] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:18:16.767390 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.716929 26205 raft_consensus.cc:697] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:16.770381 22441 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:16.760418 26129 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:16.765163 25982 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:16.706827 25754 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:16.766685 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 54474.4us
I20260709 12:18:16.803743 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:16.769760 25931 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:16.814706 22516 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:16.765973 25905 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:18:16.812708 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.764909 26263 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:18:16.810343 22398 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:16.813572 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:16.765668 26253 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:16.785264 26227 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:16.760278 26286 consensus_queue.cc:1059] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:18:16.790005 25994 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:16.830013 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:16.831148 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 61009us
I20260709 12:18:16.929198 22475 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:16.763331 26309 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:18:16.740259 26303 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:16.914809 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 236785us
I20260709 12:18:16.918318 26185 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:16.919363 25919 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:16.717897 26285 consensus_queue.cc:237] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:16.933177 22550 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:16.934888 22548 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:16.741385 26282 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:16.909619 26099 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:16.965665 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:16.919435 25754 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:16.975399 23130 raft_consensus.cc:1240] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:16.911062 26293 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:18:17.038831 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 208878us
I20260709 12:18:17.065584 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:16.962533 26193 consensus_meta.cc:287] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.678s	user 0.005s	sys 0.005s
W20260709 12:18:17.061376 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 96514.2us
W20260709 12:18:17.067591 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 142597us
I20260709 12:18:17.071215 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:16.984180 26154 consensus_meta.cc:287] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.921s	user 0.011s	sys 0.000s
W20260709 12:18:17.062798 26295 log.cc:927] Time spent T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
I20260709 12:18:16.965453 26270 raft_consensus.cc:697] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:17.110359 23095 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:17.069670 25996 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:17.111642 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:17.116828 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.065207 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:17.106626 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:17.075388 26293 raft_consensus.cc:697] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:17.065057 25911 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:18:17.071740 26080 consensus_queue.cc:1059] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
W20260709 12:18:17.143656 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 72662.3us
I20260709 12:18:17.144724 22441 leader_election.cc:400] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9.
I20260709 12:18:17.145057 22441 leader_election.cc:403] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:18:17.146435 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.114441 26263 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.114017 26035 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:17.147295 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:16.911028 26205 consensus_queue.cc:237] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:17.076715 26193 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:17.149125 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:17.081339 26154 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:17.130470 26286 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:17.151872 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:18:17.156917 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 53114.5us
I20260709 12:18:17.161374 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:17.144862 26309 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:17.167966 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.073796 26145 consensus_queue.cc:260] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:17.165757 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:17.169204 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:17.077927 26318 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:17.123251 26317 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:17.141180 26292 consensus_queue.cc:1059] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:18:17.169305 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:17.172705 22393 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: []
W20260709 12:18:17.206332 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 61774.9us
I20260709 12:18:17.207249 22441 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:17.154685 25919 consensus_queue.cc:1059] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:18:17.162137 26320 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:17.174062 26305 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:17.154309 26263 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:17.180152 26248 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:18:17.214277 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 45011.7us
I20260709 12:18:17.182713 26325 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.186196 26272 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:17.185654 26317 raft_consensus.cc:697] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:17.170816 25972 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:18:17.233047 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1873) took 1182 ms. Trace:
W20260709 12:18:17.244346 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.247584 23095 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:17.229367 26321 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:18:17.240854 22472 rpcz_store.cc:276] 0709 12:18:16.052569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.063951 (+ 11382us) service_pool.cc:224] Handling call
0709 12:18:16.068498 (+  4547us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:16.110156 (+ 41658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:16.110190 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:16.155557 (+ 45367us) log.cc:844] Serialized 52 byte log entry
0709 12:18:16.311911 (+156354us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:16.311957 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.312028 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:17.232787 (+920759us) raft_consensus.cc:1685] finished
0709 12:18:17.232810 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:17.232972 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30939,"raft.queue_time_us":41066,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":23934,"thread_start_us":108443,"threads_started":1,"wal-append.queue_time_us":374884}
I20260709 12:18:17.258327 26315 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.226805 26332 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:17.226356 26324 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:17.259846 26324 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:17.260221 26324 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:17.261384 26315 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:17.262230 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 55068.8us
I20260709 12:18:17.221830 26302 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9.
W20260709 12:18:17.226542 26299 log.cc:927] Time spent T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.397s	user 0.001s	sys 0.000s
I20260709 12:18:17.243772 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:17.266573 22441 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:17.220410 26145 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:17.233978 26305 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:17.269788 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 100643us
I20260709 12:18:17.301569 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:17.251634 26139 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.229553 26303 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:17.237372 26248 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:17.234572 26099 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:17.298610 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:17.229491 26310 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:18:17.270993 26037 consensus_meta.cc:287] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 1.516s	user 0.014s	sys 0.005s
W20260709 12:18:17.311512 26335 log.cc:927] Time spent T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:18:17.315230 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 48764.9us
I20260709 12:18:17.267369 26309 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:17.267827 26272 raft_consensus.cc:697] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:17.343622 26272 consensus_queue.cc:237] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:17.348656 26328 log.cc:927] Time spent T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:18:17.252969 26325 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:17.351694 26330 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.373s	user 0.001s	sys 0.000s
I20260709 12:18:17.352049 26325 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:17.226454 26329 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.161s
I20260709 12:18:17.320647 22548 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:18:17.278515 26320 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:17.331501 22397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 393) took 1103 ms. Trace:
I20260709 12:18:17.307313 26305 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:17.320950 26139 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:17.333120 26154 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:17.333720 26317 consensus_queue.cc:237] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:17.184427 26270 consensus_queue.cc:237] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:17.336144 26263 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:17.337090 26193 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:17.360281 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1759) took 1397 ms. Trace:
I20260709 12:18:17.323005 26248 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:17.366256 22397 rpcz_store.cc:276] 0709 12:18:16.227658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.227814 (+   156us) service_pool.cc:224] Handling call
0709 12:18:16.228147 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:16.228384 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:16.228407 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:16.233889 (+  5482us) log.cc:844] Serialized 26 byte log entry
0709 12:18:16.506242 (+272353us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:16.506276 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.506336 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:17.331240 (+824904us) raft_consensus.cc:1685] finished
0709 12:18:17.331266 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:17.331428 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":236424,"threads_started":1,"wal-append.queue_time_us":414592}
I20260709 12:18:17.377388 22393 rpcz_store.cc:276] 0709 12:18:15.962668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.970707 (+  8039us) service_pool.cc:224] Handling call
0709 12:18:15.970983 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:17.176473 (+1205490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.360002 (+183529us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400225454. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:17.360212 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2762596224}
W20260709 12:18:17.341684 26225 consensus_meta.cc:287] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.728s	user 0.007s	sys 0.000s
W20260709 12:18:17.365335 22468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.004s	sys 0.005s
W20260709 12:18:17.386534 22468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.005s	sys 0.005s
I20260709 12:18:17.332172 26315 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:17.360507 26037 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:17.366477 26021 consensus_meta.cc:287] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.784s	user 0.011s	sys 0.000s
W20260709 12:18:17.384925 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 60116us
I20260709 12:18:17.332123 26332 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:17.389573 22441 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:17.375113 26279 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.376751 26185 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:17.373888 26320 raft_consensus.cc:697] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:17.229624 26293 consensus_queue.cc:237] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:17.419536 26077 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:17.421131 22441 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:17.445714 22396 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
W20260709 12:18:17.428258 26300 log.cc:927] Time spent T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.637s	user 0.001s	sys 0.003s
I20260709 12:18:17.410660 26021 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:17.430140 26315 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:17.411624 26035 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:18:17.452252 22549 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.004s	sys 0.020s
W20260709 12:18:17.473678 22549 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.008s	sys 0.020s
W20260709 12:18:17.473738 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 52722.2us
W20260709 12:18:17.458956 22515 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.018s	sys 0.018s
W20260709 12:18:17.474546 22515 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.019s	sys 0.019s
I20260709 12:18:17.474584 22441 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:17.474967 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 796626us
I20260709 12:18:17.478763 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:17.448082 26077 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.485991 26077 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:17.486783 26296 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:17.385972 26225 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:17.537729 22542 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:17.498889 22548 raft_consensus.cc:1240] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:17.476509 26193 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:17.554351 22547 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 11. Current term is 12. Ops: []
W20260709 12:18:17.539018 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 49341.2us
I20260709 12:18:17.534358 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:17.441885 26279 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:17.480232 26263 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:17.498481 22400 raft_consensus.cc:2955] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 5 to 8, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:18:17.584537 26222 consensus_meta.cc:287] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 1.221s	user 0.013s	sys 0.000s
I20260709 12:18:17.585057 26222 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:17.588197 26206 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.588800 26206 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:17.589359 25994 consensus_meta.cc:287] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.627s	user 0.005s	sys 0.005s
I20260709 12:18:17.589839 25994 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:17.452581 26339 log.cc:927] Time spent T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:18:17.590780 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.536943 25919 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.537418 25754 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.471027 26318 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:18:17.598457 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.480440 26037 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:17.607080 26306 consensus_queue.cc:1059] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:18:17.608254 25919 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:17.573333 26193 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:17.609915 25754 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:17.620278 26222 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:17.487648 26308 consensus_queue.cc:1059] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 12:18:17.632732 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 2125) took 1056 ms. Trace:
I20260709 12:18:17.565099 26200 consensus_queue.cc:1059] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:18:17.481971 26035 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:17.604229 26129 consensus_meta.cc:287] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.783s	user 0.010s	sys 0.001s
I20260709 12:18:17.571920 26345 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 12:18:17.637616 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:18:17.648557 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 347070us
I20260709 12:18:17.665189 23126 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:17.645951 22474 rpcz_store.cc:276] 0709 12:18:16.576520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.576646 (+   126us) service_pool.cc:224] Handling call
0709 12:18:17.614117 (+1037471us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b5400046354. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:17.632660 (+ 18543us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81418112}
I20260709 12:18:17.638707 25982 raft_consensus.cc:3055] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:17.667438 22366 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:17.667670 22441 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:17.668867 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:17.650537 25931 consensus_meta.cc:287] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.826s	user 0.007s	sys 0.003s
I20260709 12:18:17.641901 26227 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.674445 26343 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:17.675201 25754 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:17.677731 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:17.678382 26120 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:17.678622 22542 raft_consensus.cc:2393] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 8: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:17.679687 25994 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:17.685027 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:17.666993 26129 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:17.686705 22472 raft_consensus.cc:1275] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:17.687882 26120 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.688701 22545 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:17.685783 22477 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:17.741041 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:17.640792 26037 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:17.705863 22441 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:17.638218 26324 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:17.692759 26120 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:17.687959 26129 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:17.671146 25982 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:17.675071 26343 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:17.771065 26355 log.cc:927] Time spent T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:18:17.800403 26343 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:17.800597 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49290 (request call id 443) took 1133 ms. Trace:
I20260709 12:18:17.801008 22547 rpcz_store.cc:276] 0709 12:18:16.667017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.667184 (+   167us) service_pool.cc:224] Handling call
0709 12:18:16.667510 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:17.567406 (+899896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.800352 (+232946us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b54001e9954. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:17.800524 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2039189760}
I20260709 12:18:17.771209 25994 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:17.765704 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:17.691123 26222 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:17.692955 26296 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:17.737664 22474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:17.944886 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:17.745106 26070 raft_consensus.cc:3055] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:17.945986 22470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 2155) took 1218 ms. Trace:
I20260709 12:18:17.694475 25931 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:17.622605 26320 consensus_queue.cc:237] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.058753 22472 raft_consensus.cc:2368] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8.
W20260709 12:18:17.774514 26286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.011s	sys 0.011s
W20260709 12:18:17.859050 26344 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:18:18.065061 22470 rpcz_store.cc:276] 0709 12:18:16.727891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.730765 (+  2874us) service_pool.cc:224] Handling call
0709 12:18:16.731060 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:17.313737 (+582677us) spinlock_profiling.cc:243] Waited 7.11 ms on lock 0x7b18003fb3e0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f86fc4bc 00007fb4f5a4a48b 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a64455 00007fb4f8b4c060 00007fb4f8b4cbfb 00007fb4f8b5764b
0709 12:18:17.313895 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:17.313921 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:17.314456 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 12:18:17.537895 (+223439us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:17.596554 (+ 58659us) log.cc:844] Serialized 14 byte log entry
0709 12:18:17.597086 (+   532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.597204 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:17.802110 (+204906us) raft_consensus.cc:1685] finished
0709 12:18:17.942493 (+140383us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:17.945921 (+  3428us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24398,"prepare.queue_time_us":58263,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":18000,"raft.queue_time_us":86341,"raft.run_cpu_time_us":7747,"raft.run_wall_time_us":86598,"spinlock_wait_cycles":25869952,"thread_start_us":380934,"threads_started":2,"wal-append.queue_time_us":296228}
I20260709 12:18:18.089337 26316 raft_consensus.cc:3055] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:17.858323 25919 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:18.140045 22470 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:18:18.020394 26343 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:18:18.031644 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.749752 26248 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:18.194902 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:18.221269 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 515503us
W20260709 12:18:18.222059 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.222391 22441 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:18.200676 22477 consensus_meta.cc:287] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.001s
I20260709 12:18:18.223011 22477 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:17.693588 26227 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:18.231594 22441 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:18.235673 22551 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14. Ops: [11.6-13.7]
I20260709 12:18:18.238175 26185 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.066808 26070 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:18.238714 26185 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:18.239219 26070 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.240248 26070 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:18.240845 26185 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:18.241171 26239 consensus_meta.cc:287] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 1.476s	user 0.009s	sys 0.000s
I20260709 12:18:18.091682 25939 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.230062 26292 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:18.242039 25939 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.242126 26292 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:18.244167 25939 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:18.056888 26222 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:18.246681 26337 log.cc:927] Time spent T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.988s	user 0.010s	sys 0.018s
I20260709 12:18:18.220567 26343 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.248008 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 2151) took 1521 ms. Trace:
I20260709 12:18:18.110420 26316 raft_consensus.cc:740] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:18.220305 26279 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:18.226805 26305 consensus_meta.cc:287] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.851s	user 0.005s	sys 0.005s
I20260709 12:18:18.223747 26225 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:18.272035 26227 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:18.193513 26139 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:18.248430 22476 rpcz_store.cc:276] 0709 12:18:16.726739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.729151 (+  2412us) service_pool.cc:224] Handling call
0709 12:18:16.760797 (+ 31646us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:16.817208 (+ 56411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:16.817249 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:16.829599 (+ 12350us) log.cc:844] Serialized 26 byte log entry
0709 12:18:17.136672 (+307073us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:17.277957 (+141285us) log.cc:844] Serialized 14 byte log entry
0709 12:18:17.301738 (+ 23781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.301838 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.245855 (+944017us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:18.247673 (+  1818us) raft_consensus.cc:1685] finished
0709 12:18:18.247786 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.247943 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78772,"prepare.queue_time_us":194822,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":195867,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":65216,"spinlock_wait_cycles":13919616,"thread_start_us":341416,"threads_started":3,"wal-append.queue_time_us":297089}
I20260709 12:18:18.258279 22475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 2157) took 1529 ms. Trace:
I20260709 12:18:17.942847 25982 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.273379 22475 rpcz_store.cc:276] 0709 12:18:16.728339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.947229 (+218890us) service_pool.cc:224] Handling call
0709 12:18:16.963276 (+ 16047us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:17.146048 (+182772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:17.146081 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:17.157731 (+ 11650us) log.cc:844] Serialized 26 byte log entry
0709 12:18:17.454101 (+296370us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:17.497003 (+ 42902us) log.cc:844] Serialized 14 byte log entry
0709 12:18:17.497318 (+   315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.497401 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.258016 (+760615us) raft_consensus.cc:1685] finished
0709 12:18:18.258037 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.258199 (+   162us) inbound_call.cc:177] Queueing success response
0709 12:18:18.272503 (+ 14304us) spinlock_profiling.cc:243] Waited 7.3 ms on lock 0x7b18003a93c0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a67522 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
Metrics: {"mutex_wait_us":222160,"prepare.queue_time_us":97815,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":227262,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":23739,"spinlock_wait_cycles":16779136,"thread_start_us":271912,"threads_started":1,"wal-append.queue_time_us":427452}
I20260709 12:18:18.238214 26193 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:18.266418 25996 consensus_meta.cc:287] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 1.141s	user 0.006s	sys 0.005s
W20260709 12:18:18.249333 26077 consensus_meta.cc:287] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.763s	user 0.009s	sys 0.001s
I20260709 12:18:17.803593 26318 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.266489 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:18.248641 26145 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:18.237056 26263 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:18.228704 26285 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:18:18.223619 26342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.002s	sys 0.007s
W20260709 12:18:18.272192 26360 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 12:18:18.252374 26324 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:18.270715 26225 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.264832 22473 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
W20260709 12:18:18.132974 26286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.011s	sys 0.011s
I20260709 12:18:18.278170 26191 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.267765 23123 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:18.288637 22475 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:18.295487 22441 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:18.261971 26305 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.305553 22474 raft_consensus.cc:606] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:18.316908 22474 raft_consensus.cc:614] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:18.293883 25996 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:18.297674 25982 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:18.288848 26077 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:18.300485 26342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.002s	sys 0.008s
I20260709 12:18:18.297091 25994 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:18.314960 22441 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:18.306847 26362 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:18:18.324393 22475 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:18.317169 26263 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:18.300850 26285 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.334208 22441 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:18.308208 26286 raft_consensus.cc:697] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:18.318615 26037 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:18.333189 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2227) took 1058 ms. Trace:
I20260709 12:18:18.296473 26316 consensus_queue.cc:260] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.358871 22550 rpcz_store.cc:276] 0709 12:18:17.275275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.275517 (+   242us) service_pool.cc:224] Handling call
0709 12:18:17.275897 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:17.276248 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:17.276280 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:17.309478 (+ 33198us) log.cc:844] Serialized 26 byte log entry
0709 12:18:17.594475 (+284997us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:17.594523 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.594615 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.328765 (+734150us) raft_consensus.cc:1685] finished
0709 12:18:18.328795 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.333120 (+  4325us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143034,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"thread_start_us":220057,"threads_started":1,"wal-append.queue_time_us":376479}
I20260709 12:18:18.309860 26225 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:18.319720 26292 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:18.340492 23126 consensus_meta.cc:287] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.000s
I20260709 12:18:18.366277 23126 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:18.335019 25996 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:18.316939 26191 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.335333 26319 raft_consensus.cc:3055] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:18.374522 26319 raft_consensus.cc:740] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:18.375177 26310 raft_consensus.cc:3055] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:18.375661 26310 raft_consensus.cc:740] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:18.376231 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2218) took 1694 ms. Trace:
I20260709 12:18:18.376667 26310 consensus_queue.cc:260] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:18.377043 26319 consensus_queue.cc:260] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.378134 26319 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:18.381969 25996 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.382521 25996 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:18.373661 26191 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:18.386638 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 52539.5us
I20260709 12:18:18.376614 22551 rpcz_store.cc:276] 0709 12:18:16.682215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.682673 (+   458us) service_pool.cc:224] Handling call
0709 12:18:16.683018 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:18.236158 (+1553140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.375931 (+139773us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400178c54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:18.376168 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3570227968}
I20260709 12:18:18.389559 22441 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:18.394124 26374 consensus_queue.cc:1059] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:18.396361 26191 raft_consensus.cc:3055] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:18.396966 26191 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:18.397132 26225 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:18.398044 26222 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:18.398375 26191 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.399986 26263 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:18.401278 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:18.407202 22396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1772) took 2026 ms (client timeout 2015 ms). Trace:
I20260709 12:18:18.407471 26263 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:18.408308 22473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 2146) took 1720 ms (client timeout 1861 ms). Trace:
W20260709 12:18:18.408739 22473 rpcz_store.cc:269] 0709 12:18:16.688457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.688577 (+   120us) service_pool.cc:224] Handling call
0709 12:18:18.408145 (+1719568us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b540016e754. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:18.408249 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3569960192}
W20260709 12:18:18.409252 26348 log.cc:927] Time spent T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.760s	user 0.004s	sys 0.004s
I20260709 12:18:18.410138 22473 raft_consensus.cc:1240] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:18.410656 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41028 (request call id 458) took 1166 ms. Trace:
I20260709 12:18:18.410801 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2213) took 1734 ms. Trace:
I20260709 12:18:18.411176 22549 rpcz_store.cc:276] 0709 12:18:16.676494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.677397 (+   903us) service_pool.cc:224] Handling call
0709 12:18:16.686958 (+  9561us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:16.716624 (+ 29666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:16.716662 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:16.731290 (+ 14628us) log.cc:844] Serialized 52 byte log entry
0709 12:18:17.474231 (+742941us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:17.474272 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.474335 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.408621 (+934286us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:18.410522 (+  1901us) raft_consensus.cc:1685] finished
0709 12:18:18.410542 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.410747 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":851,"raft.queue_time_us":71892,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":32448384,"thread_start_us":716244,"threads_started":2,"wal-append.queue_time_us":837456}
I20260709 12:18:18.406890 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:18.413368 26206 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:18.414402 22441 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:18.415680 22441 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:18.416144 26145 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:18.362094 25994 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:18.417834 22441 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:18.417433 22396 rpcz_store.cc:269] 0709 12:18:16.380921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.393413 (+ 12492us) service_pool.cc:224] Handling call
0709 12:18:18.407009 (+2013596us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540005d7d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:18.407121 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2418059520}
I20260709 12:18:18.423882 26372 raft_consensus.cc:3055] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:18.424366 26372 raft_consensus.cc:740] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:18.425401 26372 consensus_queue.cc:260] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:18.426842 25996 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.421281 26193 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:18.431092 25996 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:18.433058 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.433071 25996 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:18.434357 26377 consensus_queue.cc:1059] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:18.435777 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:18.436525 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:18.437194 23125 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:18.437140 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:18.438989 22441 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:18.440367 26368 log.cc:927] Time spent T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:18:18.441040 25996 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:18.442626 26285 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:18.444303 26364 log.cc:927] Time spent T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:18:18.444188 22441 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:18.448817 26077 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:18.451150 26145 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:18.422988 26263 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:18.456569 26365 log.cc:927] Time spent T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:18:18.367941 26316 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:18.460738 22441 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:18.395506 26370 log.cc:927] Time spent T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:18:18.467262 22441 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:18.433574 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.470896 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:18.471541 22551 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
I20260709 12:18:18.402911 26248 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:18.472055 22515 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:18.473457 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:18.370370 26343 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:18.482509 22515 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:18.476635 22441 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:18.485646 22549 raft_consensus.cc:1240] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:18.488222 23094 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:18.486807 22441 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:18.510934 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.527278 22441 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:18.547317 23095 leader_election.cc:336] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.213s (SENT)
I20260709 12:18:18.547847 23095 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:18.469998 26263 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:18.360090 26342 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 12:18:18.562387 26296 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:18.563374 26227 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:18.563855 26227 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.564257 26227 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:18.478456 26193 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:18.531297 26239 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:18.532065 26285 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:18.576665 26285 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.577111 26285 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:18.581049 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 397) took 1325 ms. Trace:
I20260709 12:18:18.531569 26332 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:18.569332 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:18.436128 26376 consensus_queue.cc:1059] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
I20260709 12:18:18.411120 23123 rpcz_store.cc:276] 0709 12:18:17.243841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.251371 (+  7530us) service_pool.cc:224] Handling call
0709 12:18:17.300817 (+ 49446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.316866 (+1016049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.410355 (+ 93489us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b5400660154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:18.410584 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2174212992}
I20260709 12:18:18.581506 22400 rpcz_store.cc:276] 0709 12:18:17.255538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.255706 (+   168us) service_pool.cc:224] Handling call
0709 12:18:17.256212 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:17.256547 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:17.256570 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:17.277495 (+ 20925us) log.cc:844] Serialized 494 byte log entry
0709 12:18:17.498336 (+220841us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:17.648412 (+150076us) log.cc:844] Serialized 14 byte log entry
0709 12:18:17.649159 (+   747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.649234 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.578675 (+929441us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b1800354d00. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:18:18.580695 (+  2020us) raft_consensus.cc:1685] finished
0709 12:18:18.580839 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.580981 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":475,"raft.queue_time_us":774,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":3846,"spinlock_wait_cycles":44534656,"thread_start_us":187488,"threads_started":1,"wal-append.queue_time_us":358514}
W20260709 12:18:18.595990 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.586042 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:18.591588 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:18.600823 26363 log.cc:927] Time spent T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.343s	user 0.003s	sys 0.000s
I20260709 12:18:18.604530 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 2153) took 1877 ms. Trace:
I20260709 12:18:18.604969 22468 rpcz_store.cc:276] 0709 12:18:16.727336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.729232 (+  1896us) service_pool.cc:224] Handling call
0709 12:18:16.761486 (+ 32254us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:17.387299 (+625813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:17.387335 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:17.415659 (+ 28324us) log.cc:844] Serialized 52 byte log entry
0709 12:18:17.670013 (+254354us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:17.738309 (+ 68296us) log.cc:844] Serialized 14 byte log entry
0709 12:18:18.194499 (+456190us) log.cc:844] Serialized 14 byte log entry
0709 12:18:18.194713 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.194788 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.600101 (+405313us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:18.604286 (+  4185us) raft_consensus.cc:1685] finished
0709 12:18:18.604311 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.604461 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":459880,"prepare.queue_time_us":530383,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":84,"raft.queue_time_us":283064,"raft.run_cpu_time_us":527,"raft.run_wall_time_us":79952,"spinlock_wait_cycles":32572928,"thread_start_us":813048,"threads_started":2,"wal-append.queue_time_us":664576}
I20260709 12:18:18.615386 26306 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:18.616312 26306 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:18.616827 26306 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:18.617419 26037 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:18:18.618428 26347 log.cc:927] Time spent T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.980s	user 0.018s	sys 0.000s
I20260709 12:18:18.618111 26037 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:18.620790 26037 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:18.621109 26263 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:18.621495 26037 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:18.622159 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.621971 26037 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:18.622727 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.624017 26037 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:18.624518 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 2149) took 1898 ms. Trace:
I20260709 12:18:18.624926 22469 rpcz_store.cc:276] 0709 12:18:16.726087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.732307 (+  6220us) service_pool.cc:224] Handling call
0709 12:18:16.762748 (+ 30441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:16.813319 (+ 50571us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:17.175314 (+361995us) log.cc:844] Serialized 14 byte log entry
0709 12:18:17.412727 (+237413us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:17.445668 (+ 32941us) log.cc:844] Serialized 26 byte log entry
0709 12:18:17.446009 (+   341us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:17.446243 (+   234us) log.cc:844] Serialized 14 byte log entry
0709 12:18:17.452072 (+  5829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.452142 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.617751 (+1165609us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:18.624289 (+  6538us) raft_consensus.cc:1685] finished
0709 12:18:18.624314 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.624452 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104735,"prepare.queue_time_us":494677,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":98,"raft.queue_time_us":253477,"raft.run_cpu_time_us":438,"raft.run_wall_time_us":128303,"spinlock_wait_cycles":5741952,"thread_start_us":571558,"threads_started":3,"wal-append.queue_time_us":360675}
I20260709 12:18:18.627597 26375 consensus_queue.cc:1059] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:18.628015 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:18.629331 26329 raft_consensus.cc:3055] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:18.629690 26139 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:18.629792 26329 raft_consensus.cc:740] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:18.630163 26139 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:18.630780 26329 consensus_queue.cc:260] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.631028 26139 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.631958 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:18.632153 26139 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:18.636176 26306 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:18.636245 26329 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:18.637492 26356 log.cc:927] Time spent T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.282s	user 0.003s	sys 0.002s
I20260709 12:18:18.638115 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:18.639864 26309 raft_consensus.cc:3055] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:18.640278 26309 raft_consensus.cc:740] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:18.641104 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 2156) took 1913 ms. Trace:
I20260709 12:18:18.631497 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:18.530519 26319 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:18.644341 26319 raft_consensus.cc:697] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:18.645213 26319 consensus_queue.cc:237] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:18.647334 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:18.648053 26035 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:18.649005 26309 consensus_queue.cc:260] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:18.650113 26309 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:18.650930 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:18.651856 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.652220 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:18.652848 22543 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:18.656566 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:18.657377 22543 raft_consensus.cc:2393] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 10: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:18.657533 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:18.659901 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:18.660099 22470 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:18:18.641497 22471 rpcz_store.cc:276] 0709 12:18:16.728125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.762312 (+ 34187us) service_pool.cc:224] Handling call
0709 12:18:16.784979 (+ 22667us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:16.785184 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:16.785207 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:17.314971 (+529764us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b2c00001368. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f744da11 00007fb4f745d372 00007fb4f8b8fa01 00007fb4f8b5443a 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2
0709 12:18:17.315397 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 12:18:17.637863 (+322466us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:17.637902 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.637967 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.636858 (+998891us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:18.640899 (+  4041us) raft_consensus.cc:1685] finished
0709 12:18:18.640920 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.641047 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13655040,"thread_start_us":321994,"threads_started":1,"wal-append.queue_time_us":991604}
I20260709 12:18:18.660082 22543 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:18:18.652561 22367 leader_election.cc:336] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.561s (SENT)
I20260709 12:18:18.661204 22367 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
W20260709 12:18:18.662417 22367 leader_election.cc:336] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.576s (SENT)
W20260709 12:18:18.663177 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.662914 25905 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:18.664155 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.663537 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:18.665758 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:18.666122 22469 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
W20260709 12:18:18.666280 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.666420 22545 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:18.648056 22547 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:18.662700 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:18.673120 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:18.681542 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 322152us
I20260709 12:18:18.689571 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:18.690310 22476 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:18.687877 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:18.691143 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:18.691430 22470 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:18.695871 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:18.698498 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:18.698825 22395 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:18.699340 22473 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:18.701989 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:18.702793 22399 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:18.665845 26035 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:18.704612 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:18.713568 22441 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:18.705310 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:18.706211 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:18.714885 22394 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:18.706241 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:18.711544 22472 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:18.712826 22473 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:18:18.724668 22401 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:18.727198 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:18.691323 26021 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.752722 22545 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:18.726486 22399 raft_consensus.cc:2393] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:18.734596 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:18.756866 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:18.757182 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.690593 25939 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:18:18.758057 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 87589.9us
I20260709 12:18:18.769261 22367 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:18.758760 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:18.770129 26353 consensus_queue.cc:1048] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:18.771036 22516 leader_election.cc:400] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8.
I20260709 12:18:18.771370 22516 leader_election.cc:403] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:18:18.770978 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:18.772446 22516 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:18.772686 22471 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:18:18.763976 22476 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:18:18.765906 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:18.774008 22395 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:18.766351 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:18.774869 22468 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:18.777343 22394 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
W20260709 12:18:18.778033 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.780036 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:18.711470 26145 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.702168 26315 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.726074 26283 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.726157 25996 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.726056 26305 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:18.770570 26239 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:18.787182 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:18.751780 26325 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:18.789095 22367 leader_election.cc:400] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10.
W20260709 12:18:18.946748 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 157764us
I20260709 12:18:18.791766 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:18.796275 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:18.796455 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:18.948909 22468 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:18.799933 22472 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:18.805064 22476 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:18.784657 26329 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8.
I20260709 12:18:18.784982 26282 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:18.795647 26358 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:18.831720 26372 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:18.770942 26035 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:18.772541 26021 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:18.797845 26145 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.853390 25996 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:18.787982 25754 consensus_queue.cc:1059] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:18:18.596658 26286 consensus_queue.cc:237] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.950438 22394 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:18.952844 22470 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:18:18.781685 25939 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:18.956701 22544 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:18.849222 26283 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.957070 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:18.959371 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50990 (request call id 25) took 1273 ms. Trace:
I20260709 12:18:19.039028 22474 rpcz_store.cc:276] 0709 12:18:17.677365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.692870 (+ 15505us) service_pool.cc:224] Handling call
0709 12:18:18.826506 (+1133636us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b540016e754. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b4e853 00007fb4fdb1c60a 00007fb4f70a27d4 00007fb4f70a2762 00007fb4f70a2691 00007fb4f70a260c 00007fb4f70a18c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:18.950806 (+124300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587075840}
W20260709 12:18:18.960536 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.996115 22473 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:18:18.996933 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:18.957156 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 160779us
I20260709 12:18:19.041435 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:19.043407 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:19.000252 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 452946us
W20260709 12:18:19.001286 23094 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.017s	sys 0.055s
I20260709 12:18:18.965603 22367 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:19.044342 23094 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.017s	sys 0.055s
W20260709 12:18:19.045069 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 553249us
W20260709 12:18:18.959511 25982 consensus_meta.cc:287] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.642s	user 0.005s	sys 0.006s
I20260709 12:18:19.042052 22476 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
W20260709 12:18:19.047001 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:19.081986 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:19.046424 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 80898.1us
I20260709 12:18:19.052781 22395 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:18.987511 26373 raft_consensus.cc:3055] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:18.803731 26129 consensus_queue.cc:1059] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.234s
I20260709 12:18:18.985909 26305 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:18.959141 26120 consensus_meta.cc:287] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 1.086s	user 0.007s	sys 0.007s
I20260709 12:18:19.083540 22397 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:19.084868 22367 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:18.807785 26315 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:18.963693 26311 raft_consensus.cc:3055] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:19.087412 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:19.091760 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.092795 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:19.094540 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:19.097325 22367 leader_election.cc:400] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10.
I20260709 12:18:19.099033 22367 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:19.045238 26191 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:19.101882 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:19.102587 22468 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:18:19.106438 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:19.107641 22474 raft_consensus.cc:2393] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 5: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:19.111315 22397 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:18:19.113430 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:19.114342 22474 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:19.115509 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:19.116299 22474 raft_consensus.cc:2393] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:19.075003 26282 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:19.119809 22394 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:19.075296 26200 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:18:19.124567 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 83244.5us
W20260709 12:18:19.125427 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.124655 22367 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:19.081835 25931 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:19.134699 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:19.135574 22476 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 9: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:19.133788 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:19.089216 26373 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:19.097492 26311 raft_consensus.cc:740] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:19.097958 26305 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.112614 26140 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:19.142509 22367 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:19.164057 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:19.144285 22394 raft_consensus.cc:1275] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:19.190367 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:19.096212 26037 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:18:19.151006 26129 raft_consensus.cc:3055] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:18:19.201134 22551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.016s	sys 0.013s
W20260709 12:18:19.156944 26227 consensus_meta.cc:287] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.592s	user 0.002s	sys 0.007s
I20260709 12:18:19.157863 26260 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:18:19.158390 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.134068 26374 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:19.192198 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:19.189298 22549 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:19.137236 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:19.132359 26035 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:19.198783 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 68819.8us
I20260709 12:18:19.198108 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:19.155323 26021 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:19.105540 26120 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:19.202878 22551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.016s	sys 0.014s
I20260709 12:18:19.216420 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:19.236548 22394 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:19.215261 22468 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 12: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:18.751763 26332 consensus_queue.cc:1059] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.439s
W20260709 12:18:19.218086 22366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.016s	sys 0.020s
W20260709 12:18:19.212157 22469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.023s	sys 0.034s
W20260709 12:18:19.237869 22366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.017s	sys 0.020s
W20260709 12:18:19.238592 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 536835us
W20260709 12:18:19.204375 26319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.012s	sys 0.017s
W20260709 12:18:19.239243 26319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.012s	sys 0.017s
I20260709 12:18:19.127677 26384 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:19.240142 26384 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.221323 22476 raft_consensus.cc:2410] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:19.140632 26200 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:19.223806 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.138962 26070 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:18:19.166872 26358 raft_consensus.cc:697] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:19.224057 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:19.203419 26374 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:19.181699 26282 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:19.167755 26305 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:19.222672 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:19.220408 26316 consensus_meta.cc:287] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.763s	user 0.005s	sys 0.004s
W20260709 12:18:19.260578 22442 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.1:37927 timed out after 1.898s (SENT) [suppressed 25 similar messages]
W20260709 12:18:19.224102 26320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.025s	sys 0.035s
I20260709 12:18:19.201439 26129 raft_consensus.cc:740] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:19.182945 26279 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 12:18:19.274884 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 50914.7us
I20260709 12:18:19.304322 22542 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:19.304939 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:18:19.238034 22469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.023s	sys 0.035s
I20260709 12:18:19.276544 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:19.282413 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:19.233350 26140 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:19.283706 22474 raft_consensus.cc:2393] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:19.284993 22544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2229) took 1981 ms. Trace:
I20260709 12:18:19.590063 22544 rpcz_store.cc:276] 0709 12:18:17.303887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.305021 (+  1134us) service_pool.cc:224] Handling call
0709 12:18:17.305332 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.998597 (+1693265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.100317 (+101720us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b540012f820. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8acbdc0 00007fb4f8b57a02 00007fb4f8b53dd6 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2
0709 12:18:19.284705 (+184388us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b540042b654. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:19.284925 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3899427072}
I20260709 12:18:19.290480 22470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
W20260709 12:18:19.292906 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.591378 22470 raft_consensus.cc:606] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:19.302297 22473 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:19.203342 25982 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 12:18:19.409510 26381 log.cc:927] Time spent T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 12:18:19.239514 22366 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:19.283578 26374 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:19.539762 26393 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.297s	user 0.001s	sys 0.005s
I20260709 12:18:19.540202 26391 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:18:19.392666 26383 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 12:18:19.319779 26263 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:18:19.319388 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:19.298774 25754 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:19.542735 26145 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:19.473013 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.240648 26384 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:19.301172 26320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.025s	sys 0.036s
I20260709 12:18:19.306695 22468 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:19.281719 26358 consensus_queue.cc:237] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:19.546294 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:18:19.496960 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:19.617327 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.546766 22476 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:19.215440 26227 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:19.308012 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 49601.1us
I20260709 12:18:19.319478 26373 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:19.324383 26077 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:19.550530 26200 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:19.555778 22469 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:19.557233 26382 raft_consensus.cc:3055] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:19.560956 26315 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:19.563040 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.571254 26310 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:19.576258 23130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.000s	sys 0.022s
W20260709 12:18:19.576633 22396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.004s	sys 0.019s
W20260709 12:18:19.688339 23130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.000s	sys 0.023s
W20260709 12:18:19.688436 22396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.004s	sys 0.019s
W20260709 12:18:19.626528 26285 consensus_meta.cc:287] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 1.049s	user 0.007s	sys 0.015s
I20260709 12:18:19.587718 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:19.588769 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:19.300371 26205 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.004s	sys 0.047s
I20260709 12:18:19.591734 22470 raft_consensus.cc:614] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:19.605439 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 439779us
I20260709 12:18:19.566883 22299 catalog_manager.cc:5697] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 6 to 8, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 8 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:19.615849 22472 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 12: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:19.589419 26376 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.626876 22544 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:19.692871 22399 raft_consensus.cc:2393] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:19.622790 26120 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:19.630568 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 391104us
I20260709 12:18:19.697337 22366 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:19.630599 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:18:19.633037 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 322893us
W20260709 12:18:19.616793 26139 consensus_meta.cc:287] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.984s	user 0.012s	sys 0.007s
W20260709 12:18:19.674737 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.698645 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:18:19.685439 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 424880us
I20260709 12:18:19.586337 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:19.611271 25754 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:19.621053 26318 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:19.622869 22441 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:19.682916 26342 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:19.633626 26077 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:19.698025 22401 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:19.633093 26283 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:19.630463 26140 raft_consensus.cc:697] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:19.720304 22367 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:19.625591 26319 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:19.704459 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 81671.5us
I20260709 12:18:19.731496 22367 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:19.731930 22441 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:19.706665 26332 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:19.707532 22395 raft_consensus.cc:2410] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 12:18:19.694809 26205 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.005s	sys 0.048s
I20260709 12:18:19.701646 26376 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:19.609980 26391 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:19.740494 26376 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:19.740832 26391 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:19.708295 26404 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:18:19.708673 26318 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:19.744725 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:19.680243 26382 raft_consensus.cc:740] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:19.689842 26373 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:19.717008 26225 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:19.717568 26400 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.718462 26037 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:19.759594 26037 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:19.760053 26037 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:19.682312 26129 consensus_queue.cc:260] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:19.761467 26129 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:19.723075 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:19.717165 22366 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:19.735496 26140 consensus_queue.cc:237] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:19.736343 26311 consensus_queue.cc:260] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:19.782178 26311 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:19.783531 26282 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:19.763770 26315 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 12:18:19.784508 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 67410.6us
I20260709 12:18:19.699223 26285 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:19.736790 25905 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:19.786258 25905 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:19.786710 26285 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:19.788031 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:19.737339 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.694693 26402 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:19.744457 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:19.706223 25754 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:19.750135 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:19.695168 26383 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:18:19.748633 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:19.793723 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:19.798349 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:19.798533 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:19.714838 26077 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:19.758760 26400 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:19.764012 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 48788.9us
W20260709 12:18:19.786279 26309 consensus_meta.cc:287] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 1.136s	user 0.007s	sys 0.011s
I20260709 12:18:19.720669 25931 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:19.768744 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:19.809630 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:19.810151 22394 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:19.768752 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1780) took 1085 ms. Trace:
I20260709 12:18:19.810940 22400 rpcz_store.cc:276] 0709 12:18:18.683524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.693463 (+  9939us) service_pool.cc:224] Handling call
0709 12:18:18.693818 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.707966 (+ 14148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:18.708003 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:18.708541 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 12:18:19.203900 (+495359us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:19.203949 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.204014 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:19.768537 (+564523us) raft_consensus.cc:1685] finished
0709 12:18:19.768573 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.768699 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5762,"raft.queue_time_us":7896,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":12526,"thread_start_us":422648,"threads_started":1,"wal-append.queue_time_us":796680}
I20260709 12:18:19.812740 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:19.771664 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1782) took 1076 ms. Trace:
I20260709 12:18:19.812889 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:19.776269 25982 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:19.779234 26382 consensus_queue.cc:260] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:19.787365 22545 raft_consensus.cc:1240] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:19.818058 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:19.820320 22394 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:19.821357 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:19.822119 22394 raft_consensus.cc:2393] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 10: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:19.791610 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:19.746682 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:19.795689 22470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:19.823422 22469 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:19.823580 22470 raft_consensus.cc:606] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:19.823956 22470 raft_consensus.cc:614] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:19.797221 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:19.798280 22543 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:19.798971 22396 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:19.800230 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:19.800432 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:19.754302 26263 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:19.804584 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:19.832465 23124 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:19.805830 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:19.766943 22367 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:19.805449 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:19.807456 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:19.834102 22549 raft_consensus.cc:2393] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 14: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:19.786648 25905 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:19.810595 23129 raft_consensus.cc:1240] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:19.813303 22393 rpcz_store.cc:276] 0709 12:18:18.694994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.695094 (+   100us) service_pool.cc:224] Handling call
0709 12:18:18.695384 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:19.182823 (+487439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.182854 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:19.215343 (+ 32489us) log.cc:844] Serialized 26 byte log entry
0709 12:18:19.687629 (+472286us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:19.687667 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.687729 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:19.771454 (+ 83725us) raft_consensus.cc:1685] finished
0709 12:18:19.771474 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.771606 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7354,"raft.queue_time_us":62496,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":12549,"thread_start_us":822405,"threads_started":2,"wal-append.queue_time_us":519824}
I20260709 12:18:19.810421 23128 raft_consensus.cc:2393] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:19.816540 23127 raft_consensus.cc:2410] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:18:19.788393 26227 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:19.794472 26402 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.831461 23125 raft_consensus.cc:2393] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 8: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:19.802429 26315 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:19.842098 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:19.842440 22402 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:18:19.841113 26191 consensus_meta.cc:287] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.724s	user 0.011s	sys 0.005s
I20260709 12:18:19.830928 26283 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.809578 25931 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.752821 26319 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:19.802762 25996 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:19.846902 22400 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:19.869274 22396 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:19.869995 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:19.870152 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:19.873162 22396 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
W20260709 12:18:19.851423 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 84576.7us
I20260709 12:18:19.875202 23129 raft_consensus.cc:1240] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:19.875664 22367 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:19.852662 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:19.830765 26332 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.855618 22550 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:19.863471 22474 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:18:19.806015 26139 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.866274 22470 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:19.849093 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:19.891362 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:19.931102 22469 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:19.836108 25905 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:19.893673 22367 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:19.894237 22398 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 5.
W20260709 12:18:19.894606 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.898430 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:19.933835 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 1890) took 2241 ms. Trace:
I20260709 12:18:19.868678 25931 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:19.841619 26402 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:19.810237 26282 consensus_queue.cc:1059] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:18:19.925731 23125 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:19.926214 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:19.850806 26286 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:19.856276 25911 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:19.873384 26399 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 12:18:19.854568 26263 raft_consensus.cc:697] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:18:19.864626 26394 log.cc:927] Time spent T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
I20260709 12:18:19.934204 22477 rpcz_store.cc:276] 0709 12:18:17.692408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.223897 (+531489us) service_pool.cc:224] Handling call
0709 12:18:18.224236 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.235069 (+ 10833us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:18.266687 (+ 31618us) log.cc:844] Serialized 14 byte log entry
0709 12:18:18.377473 (+110786us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b18003b3ce0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a49e07 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b 00007fb4f86f3d23 00007fb4f86f423a 00007fb4f8b5ea2a
0709 12:18:18.592284 (+214811us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:18.692268 (+ 99984us) log.cc:844] Serialized 26 byte log entry
0709 12:18:18.692427 (+   159us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:18.692461 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.692527 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:19.933543 (+1241016us) raft_consensus.cc:1685] finished
0709 12:18:19.933628 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.933757 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16502,"prepare.queue_time_us":33057,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":10496,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":88993,"spinlock_wait_cycles":8504576,"thread_start_us":213289,"threads_started":1,"wal-append.queue_time_us":836835}
I20260709 12:18:19.909185 22474 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:19.857307 25982 raft_consensus.cc:697] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:19.938179 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:19.846673 26382 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:19.940397 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:19.867481 26283 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:19.922501 26375 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:20.012987 22398 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:18:19.940919 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 47331.6us
I20260709 12:18:19.971647 23094 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:19.933182 26316 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.855821 26315 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:19.999182 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:20.001109 22469 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:18:19.874761 26191 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.095s
W20260709 12:18:20.009984 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.016010 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 44419.1us
I20260709 12:18:20.014881 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:19.940369 26342 raft_consensus.cc:697] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:19.968678 26070 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:20.020337 23129 raft_consensus.cc:2393] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 12: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:19.975590 26154 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:20.023289 22367 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:20.032545 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 93569.8us
I20260709 12:18:20.032461 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:20.042169 26342 consensus_queue.cc:237] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:19.936713 26139 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.044198 22476 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:19.936853 26332 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:20.035790 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 103670us
I20260709 12:18:20.021509 26375 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:20.051771 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 156342us
I20260709 12:18:20.020291 26227 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:20.054893 22442 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:20.028375 26279 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:20.056538 26282 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.042584 26154 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:20.066895 22396 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:20.048506 25911 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:20.059247 26375 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:20.069970 26423 log.cc:927] Time spent T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:18:20.071885 26332 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.075160 22442 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:20.068216 26412 log.cc:927] Time spent T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:18:20.068493 22401 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
W20260709 12:18:20.068892 26420 log.cc:927] Time spent T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:18:20.086781 22476 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:20.024583 26145 consensus_queue.cc:1059] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:18:20.028755 26316 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.095882 26430 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:20.096382 22442 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:20.097132 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 54455us
W20260709 12:18:20.101401 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 69050.7us
I20260709 12:18:20.065974 26140 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:20.105279 22442 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:20.069465 26432 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:20.107347 22442 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:20.111954 22543 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:20.113000 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:20.115965 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.116427 26283 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:20.100713 26305 consensus_meta.cc:287] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.793s	user 0.013s	sys 0.003s
I20260709 12:18:20.122911 22545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2252) took 1438 ms. Trace:
I20260709 12:18:20.126519 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:20.127586 22543 raft_consensus.cc:2393] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 12: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:20.123404 22545 rpcz_store.cc:276] 0709 12:18:18.684545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.754549 (+ 70004us) service_pool.cc:224] Handling call
0709 12:18:18.755108 (+   559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.817373 (+1062265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.122628 (+305255us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54004213d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:20.122835 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2373547904}
I20260709 12:18:20.111632 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:20.118340 26400 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.064853 26282 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.131029 26154 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:20.101418 26263 consensus_queue.cc:237] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.132882 26315 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:20.134842 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 2160) took 1342 ms. Trace:
I20260709 12:18:20.129026 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.135789 22471 rpcz_store.cc:276] 0709 12:18:18.792876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.303678 (+510802us) service_pool.cc:224] Handling call
0709 12:18:19.327230 (+ 23552us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:19.539855 (+212625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.539883 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:19.540392 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 12:18:19.686902 (+146510us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:19.687264 (+   362us) log.cc:844] Serialized 14 byte log entry
0709 12:18:19.702537 (+ 15273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.702612 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:20.134587 (+431975us) raft_consensus.cc:1685] finished
0709 12:18:20.134609 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.134780 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19077,"prepare.queue_time_us":148,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":15082,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":146110,"threads_started":1,"wal-append.queue_time_us":302427}
I20260709 12:18:20.139559 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:18:20.117930 26422 log.cc:927] Time spent T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:18:20.109506 25996 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:20.112969 26325 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:20.144853 26325 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:20.145309 26325 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:20.147531 26375 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:20.143383 26372 consensus_meta.cc:287] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 1.158s	user 0.006s	sys 0.012s
W20260709 12:18:20.150942 26403 log.cc:927] Time spent T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.567s	user 0.001s	sys 0.006s
W20260709 12:18:20.152583 26406 log.cc:927] Time spent T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.574s	user 0.000s	sys 0.002s
I20260709 12:18:20.154590 23130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34092 (request call id 439) took 1719 ms. Trace:
I20260709 12:18:20.154980 23130 rpcz_store.cc:276] 0709 12:18:18.435139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.435264 (+   125us) service_pool.cc:224] Handling call
0709 12:18:18.435645 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:18.690749 (+255104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:18.690778 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:18.705303 (+ 14525us) log.cc:844] Serialized 52 byte log entry
0709 12:18:19.688793 (+983490us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:19.688829 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.688891 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:20.151977 (+463086us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:20.154268 (+  2291us) raft_consensus.cc:1685] finished
0709 12:18:20.154289 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.154523 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120613,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":10935,"spinlock_wait_cycles":26498432,"thread_start_us":1148939,"threads_started":2,"wal-append.queue_time_us":800863}
I20260709 12:18:20.157945 26139 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.143054 25996 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.160472 25996 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:20.161605 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1815) took 1487 ms. Trace:
I20260709 12:18:20.088644 25982 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:20.162057 22546 rpcz_store.cc:276] 0709 12:18:18.674473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.678264 (+  3791us) service_pool.cc:224] Handling call
0709 12:18:18.678584 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.678814 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:18.678837 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:18.679232 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 12:18:19.224380 (+545148us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:19.224435 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.224530 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:20.150306 (+925776us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:20.161316 (+ 11010us) raft_consensus.cc:1685] finished
0709 12:18:20.161339 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.161543 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53127040,"thread_start_us":459382,"threads_started":1,"wal-append.queue_time_us":815723}
I20260709 12:18:20.163981 22546 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:20.165220 22546 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:20.154827 26325 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.166754 26319 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:20.167479 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.168052 26325 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.131707 26282 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.112247 26331 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:18:20.143658 26427 log.cc:927] Time spent T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:18:20.173017 26077 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:20.176975 26374 consensus_meta.cc:287] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.000s
W20260709 12:18:20.181243 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.127243 26305 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.186134 26305 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:20.192720 26408 log.cc:927] Time spent T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.614s	user 0.000s	sys 0.005s
I20260709 12:18:20.193032 26037 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.169992 26376 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.171742 26248 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:20.179088 26429 log.cc:927] Time spent T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:18:20.204069 25996 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.198076 26332 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:20.210029 26248 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:20.212639 26077 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:20.196410 26374 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:20.215618 26374 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:20.218755 26070 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:20.221446 26376 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:20.222524 25931 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:20.182816 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 70237.7us
W20260709 12:18:20.225757 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.242919 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.223675 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 200505us
I20260709 12:18:20.249817 22367 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:20.253149 26434 log.cc:927] Time spent T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:18:20.183467 26282 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:20.260231 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:20.260914 23128 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:20.261193 25931 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:20.261718 26139 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:20.256287 26427 log.cc:927] Time spent T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:18:20.266517 26375 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.259155 26070 consensus_queue.cc:1059] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:18:20.197094 26331 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.268077 26375 raft_consensus.cc:3055] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:20.267926 26331 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.268483 26375 raft_consensus.cc:740] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:20.269261 26375 consensus_queue.cc:260] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:20.273200 26390 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 1.002s	user 0.004s	sys 0.015s
W20260709 12:18:20.294745 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.299227 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:20.300150 22550 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 1813) took 1628 ms (client timeout 1794 ms). Trace:
I20260709 12:18:20.295637 26430 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.295653 26325 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:18:20.302054 22550 rpcz_store.cc:269] 0709 12:18:18.671940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.672831 (+   891us) service_pool.cc:224] Handling call
0709 12:18:20.272501 (+1599670us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001b8854. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:20.300093 (+ 27592us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2695250816}
I20260709 12:18:20.302230 26430 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.303529 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1797) took 1216 ms. Trace:
I20260709 12:18:20.300835 26375 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:20.303963 22395 rpcz_store.cc:276] 0709 12:18:19.087434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.094238 (+  6804us) service_pool.cc:224] Handling call
0709 12:18:20.273902 (+1179664us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54000a9954. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:20.303472 (+ 29570us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404249344}
W20260709 12:18:20.305369 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 55713.9us
W20260709 12:18:20.307291 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 198010us
I20260709 12:18:20.307917 22367 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:20.310781 22367 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:20.311244 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.311517 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.312047 22393 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:20.312433 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:20.312844 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.313514 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:20.314095 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.318374 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.317960 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:20.319847 22551 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:20.297175 25754 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.321784 26315 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:20.323194 26332 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:20.323246 26439 consensus_queue.cc:1059] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:18:20.324033 26332 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.325630 25754 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:20.322359 26315 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:20.326508 26439 raft_consensus.cc:3055] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:20.326891 26439 raft_consensus.cc:740] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:20.327771 26315 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:18:20.327711 26439 consensus_queue.cc:260] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.322057 26279 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:20.305148 26154 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:20.331018 22398 raft_consensus.cc:2393] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:20.330837 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.328930 26248 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.334882 22543 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:20.332922 26154 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:20.336509 26154 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:20.338420 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.339645 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.340260 22395 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 14.
I20260709 12:18:20.341172 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:20.338469 26411 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.757s	user 0.007s	sys 0.002s
I20260709 12:18:20.342394 26430 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.343089 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:20.344219 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:20.344983 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:20.345208 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.346241 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.347580 22395 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:20.347950 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:20.348182 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:20.348932 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:20.350211 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:20.350781 22470 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:18:20.351524 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:20.352046 22470 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:20.346179 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:20.353526 22476 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:18:20.357487 22469 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:20.362303 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:20.316422 26282 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:20.368448 23095 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:20.378328 22477 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:18:20.379477 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:20.380017 22477 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:20.330742 26331 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.382272 26373 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:20.373531 22469 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:20.328948 26439 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:20.382310 22471 raft_consensus.cc:1240] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:18:20.384096 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:20.385381 22469 raft_consensus.cc:2393] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 8: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:20.370651 26282 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.388437 22469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:20.390349 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.385907 26311 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.392335 26311 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:20.369524 26037 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.394438 26311 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.395051 26282 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:20.359426 26432 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:20.398171 26432 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.399084 25905 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.400372 26432 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.359978 26430 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:20.401103 26430 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.401690 25905 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.384724 26318 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:20.403173 26430 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.404188 26387 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:20.404615 26387 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.305083 26325 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:20.404937 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:20.405454 22469 raft_consensus.cc:606] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:20.409370 22469 raft_consensus.cc:614] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:20.409139 22442 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:20.414110 22442 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:20.417112 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.417506 22442 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:20.418062 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.418668 22395 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:20.418890 22442 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:20.421362 22469 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:20.421355 22475 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 12: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:20.406337 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:20.406967 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.429097 23127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41012 (request call id 368) took 1764 ms. Trace:
I20260709 12:18:20.429497 23127 rpcz_store.cc:276] 0709 12:18:18.657159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.657306 (+   147us) service_pool.cc:224] Handling call
0709 12:18:20.408626 (+1751320us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000424d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:20.421439 (+ 12813us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2663458688}
I20260709 12:18:20.430390 22477 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
W20260709 12:18:20.431439 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.404937 26387 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:20.434602 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:20.408911 26332 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.415108 26248 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.438668 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:20.430568 26432 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:20.423803 26447 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:20.430717 26430 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:20.425726 22442 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:20.448832 26430 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:20.449216 26430 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.449550 26430 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:20.430706 26331 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.443528 26447 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:20.452185 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.435037 26311 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:20.455396 22542 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:20.457297 26260 raft_consensus.cc:3055] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:20.461685 26260 raft_consensus.cc:740] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:20.441241 26373 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:20.462646 26260 consensus_queue.cc:260] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:20.463783 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.459908 22393 raft_consensus.cc:2410] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:18:20.464044 26296 raft_consensus.cc:3055] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:20.464479 26296 raft_consensus.cc:740] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:20.465314 26296 consensus_queue.cc:260] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:20.463703 26260 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:20.474795 26402 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.477020 25939 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:20.442082 26432 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:20.477965 22394 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:20.442342 26332 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.479720 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:20.477087 26402 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.444927 26248 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:20.503456 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.484774 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:20.487530 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:20.505328 26248 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:20.505674 22477 raft_consensus.cc:606] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:20.506050 22477 raft_consensus.cc:614] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:20.507859 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.502522 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:20.509387 22476 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:20.485584 26432 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:20.472697 26331 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.508369 26315 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:20.517619 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:20.505970 26332 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.528581 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:20.517005 26296 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:20.517143 26430 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.541216 26430 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.527104 26447 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:20.512391 26154 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:20.548512 26325 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:20.550477 26331 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.544653 26279 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:20.551501 26447 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:20.554545 26447 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:20.555203 26332 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.555888 26282 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.559054 22400 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:20.556468 26384 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:20.562620 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.565299 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.563611 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.564234 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.558207 26332 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.541237 26387 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:20.565945 22398 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:20.568297 22395 raft_consensus.cc:2410] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:18:20.569901 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:20.572841 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:20.588430 22402 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:20.575700 26432 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.577014 26282 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.590651 22442 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:20.578967 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.594981 23127 raft_consensus.cc:2368] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15.
I20260709 12:18:20.591097 26447 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.599495 26447 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.601197 26316 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:20.601964 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.603222 26154 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:20.597232 26455 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:20.606215 26455 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.606586 26455 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:20.609375 25996 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.611294 22367 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:20.612722 22367 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:20.613570 26282 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:20.601668 26447 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.615056 26447 consensus_queue.cc:1059] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:20.615864 26447 raft_consensus.cc:3055] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:20.616168 26447 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:20.616909 26447 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.620700 22367 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:20.621071 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.621583 22402 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:20.623690 22442 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:20.624939 22367 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:20.586328 26332 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.626056 26260 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:20.626633 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:20.626917 26384 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:20.627342 26384 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.627738 26384 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:20.628279 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41012 (request call id 369) took 1035 ms. Trace:
I20260709 12:18:20.626662 26260 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.629316 26260 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:20.630782 22367 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:20.632488 23095 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:18:20.635089 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:20.635454 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:20.636579 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.626020 25996 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:20.637590 22402 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:18:20.637751 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:20.642095 26279 consensus_queue.cc:1059] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:20.642903 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:20.643474 23130 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:20.644025 26387 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.644742 26037 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:20.645999 26279 raft_consensus.cc:3055] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:20.644162 26439 consensus_queue.cc:1059] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:18:20.647159 26439 raft_consensus.cc:3055] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:20.647475 26439 raft_consensus.cc:740] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:20.648207 26439 consensus_queue.cc:260] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.649021 26311 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:20.646303 25905 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:20.649448 26311 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.649960 26311 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:20.644191 22367 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:20.652276 26432 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.653546 26384 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.653738 22367 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:20.654341 22476 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 7.
I20260709 12:18:20.657212 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:20.658382 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:20.658784 22400 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:20.659054 22470 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:18:20.661614 22442 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:20.649916 25905 raft_consensus.cc:697] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:20.624217 26154 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:20.662390 26154 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.662734 25905 consensus_queue.cc:237] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.663576 26283 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:20.663960 26283 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.664356 26283 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:20.666716 23122 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:20.667734 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.668720 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:20.668998 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:20.670265 22401 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:20.670446 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:20.668928 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.670984 22477 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:20.673103 22551 raft_consensus.cc:2393] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 12: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:20.669369 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.677393 26037 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:20.677654 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.678309 22542 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:18:20.679188 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.680714 26384 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.646376 26279 raft_consensus.cc:740] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:20.681895 26279 consensus_queue.cc:260] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.655148 26376 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.683081 26279 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:20.655390 26285 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:20.684464 26285 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:20.686616 26285 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:20.687088 26285 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:20.687518 26285 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.687744 26455 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.689157 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:20.689378 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:20.690029 22473 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:20.690117 25996 raft_consensus.cc:697] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:20.653884 26286 raft_consensus.cc:697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:20.690676 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:20.691008 25996 consensus_queue.cc:237] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.691426 26286 consensus_queue.cc:237] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.691876 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:20.692433 22469 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:20.678216 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.691448 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:20.627420 26332 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.695305 22474 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:20.680956 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 596265us
I20260709 12:18:20.706187 26316 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:20.707856 22548 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:20.709223 22542 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:20.710189 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:20.711565 23094 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:20.628661 23123 rpcz_store.cc:276] 0709 12:18:19.592836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.601270 (+  8434us) service_pool.cc:224] Handling call
0709 12:18:19.627325 (+ 26055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.777728 (+150403us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:18:19.991964 (+214236us) log.cc:844] Serialized 14 byte log entry
0709 12:18:20.169296 (+177332us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b18004924c0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a49e07 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b 00007fb4f86f3d23 00007fb4f86f423a 00007fb4f8b5ea2a
0709 12:18:20.297368 (+128072us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:20.303906 (+  6538us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:20.304932 (+  1026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.628042 (+323110us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54005f1c54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:20.628093 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.628221 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":227486,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":6846,"raft.queue_time_us":802,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":2314,"spinlock_wait_cycles":261553792,"thread_start_us":246009,"threads_started":2,"wal-append.queue_time_us":252996}
I20260709 12:18:20.662747 26154 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:20.714030 22468 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:20.653934 26205 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:20.649284 26439 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:20.714974 26205 raft_consensus.cc:697] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:20.725353 22400 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
W20260709 12:18:20.715623 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.699478 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:20.717892 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.718694 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.727970 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.696535 22477 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:18:20.637391 26447 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:20.729904 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:20.729595 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:20.730676 23129 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:20.712759 23094 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:20.732151 23094 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:20.655653 26129 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:20.735780 22401 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:18:20.719892 22469 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:20.714911 26206 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:20.748540 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:20.750878 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:20.751081 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:20.751488 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:20.752302 22544 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:20.752305 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:20.753882 22366 leader_election.cc:400] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15.
I20260709 12:18:20.754201 22366 leader_election.cc:403] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:20.762128 22442 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:20.762976 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:20.763634 22401 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:20.758318 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:20.765534 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.766706 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:20.767172 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:20.767689 22544 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:20.768157 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:20.769086 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.769739 22393 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:20.770783 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.771382 22400 raft_consensus.cc:2376] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11. Re-sending same reply.
I20260709 12:18:20.715337 26387 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:20.795454 22396 raft_consensus.cc:2393] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:20.796243 22441 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:20.797662 26296 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:20.802259 22299 catalog_manager.cc:5697] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:20.803881 22299 catalog_manager.cc:5697] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 5 to 6, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 6 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:20.725517 26376 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.767827 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:20.766317 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:20.750722 26319 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.778679 22550 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:20.779321 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:20.779924 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.812397 22394 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:20.780870 26282 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:20.781391 26455 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.782021 26205 consensus_queue.cc:237] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.744503 26310 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:20.744269 26391 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:20.785307 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:20.785971 22474 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:20.833823 22543 raft_consensus.cc:2393] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 12: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:20.787139 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:20.834352 22549 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:20.787492 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.835012 22546 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9.
I20260709 12:18:20.789956 26193 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:20.744611 26248 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:20.804869 22551 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:20.802295 26285 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:20.772648 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:20.846575 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 148313us
I20260709 12:18:20.848577 22477 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:20.805234 22299 catalog_manager.cc:5697] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:20.813452 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:20.819038 22544 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:18:20.850976 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.850576 22299 catalog_manager.cc:5697] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 5 to 8, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New cstate: current_term: 8 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:20.852262 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.853396 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.821672 22542 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:20.823278 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.824983 22367 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:20.825748 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 72041.5us
I20260709 12:18:20.854503 22550 raft_consensus.cc:2393] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:20.826431 23095 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:20.831738 22394 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:20.828485 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:20.835305 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.835970 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:20.838811 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.856004 22547 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:20.856549 22546 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:20.856007 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.857404 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:20.844580 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.854645 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.807204 22401 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:20.862124 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.862042 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.864253 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:20.823990 25939 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:20.872893 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.876969 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.862809 22550 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:20.877123 22548 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:20.877812 22544 raft_consensus.cc:2393] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:20.758239 26129 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.873816 22299 catalog_manager.cc:5697] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:20.880528 22299 catalog_manager.cc:5697] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:20.881618 22299 catalog_manager.cc:5697] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:20.885612 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:20.886664 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.832494 26035 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15.
I20260709 12:18:20.887678 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.888316 22544 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:18:20.892843 22549 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:18:20.894562 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.895052 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:20.895519 22547 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:20.839398 26248 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.827719 26311 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:20.829358 26376 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:20.828524 26319 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.875941 26310 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:20.870445 26193 raft_consensus.cc:697] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:20.875221 26206 raft_consensus.cc:697] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:20.912200 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:20.932499 22441 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:20.909724 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.913968 22296 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50176 (request call id 185) took 29138 ms (client timeout 15000 ms). Trace:
I20260709 12:18:20.914573 26373 consensus_queue.cc:1059] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:20.914703 23094 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:20.915743 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:20.926353 26129 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:20.909071 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:20.905359 26248 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:20.905205 26414 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:20.942157 22441 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:20.942976 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:20.952014 22546 raft_consensus.cc:2410] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:18:20.954672 22549 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:20.955888 22545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1822) took 1134 ms. Trace:
I20260709 12:18:20.956351 22545 rpcz_store.cc:276] 0709 12:18:19.821822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.137243 (+315421us) service_pool.cc:224] Handling call
0709 12:18:20.137634 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:20.655630 (+517996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:20.655662 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:20.656099 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 12:18:20.759808 (+103709us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:20.759856 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.759932 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:20.955631 (+195699us) raft_consensus.cc:1685] finished
0709 12:18:20.955650 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.955814 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":517538,"raft.queue_time_us":523974,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":103388,"threads_started":1,"wal-append.queue_time_us":294859}
W20260709 12:18:20.933936 22296 rpcz_store.cc:269] 0709 12:17:51.775221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.778288 (+  3067us) service_pool.cc:224] Handling call
0709 12:17:51.891285 (+112997us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b5400030890. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a300b2 00007fb4fe9a9759 00007fb4fe941a76 00007fb4fe912d58 00007fb4fea1104e 00007fb4fced22a4 00007fb4fced2232 00007fb4fced2161 00007fb4fced20dc
0709 12:18:20.913883 (+29022598us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:16.187052 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:16.255734 (+ 68682us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:16.255784 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:18:16.255803 (+    19us) tablet.cc:662] Decoding operations
0709 12:18:16.257250 (+  1447us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:16.257332 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:16.257358 (+    26us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:18:16.693123 (+435765us) tablet.cc:701] Row locks acquired
0709 12:18:16.707304 (+ 14181us) write_op.cc:260] PREPARE: finished
0709 12:18:16.760930 (+ 53626us) write_op.cc:270] Start()
0709 12:18:16.807202 (+ 46272us) write_op.cc:276] Timestamp: P: 1783599496739544 usec, L: 0
0709 12:18:16.811542 (+  4340us) op_driver.cc:348] REPLICATION: starting
0709 12:18:16.824403 (+ 12861us) log.cc:844] Serialized 6310 byte log entry
0709 12:18:17.228467 (+404064us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b540038b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b4fe28 00007fb4fc58a581 00007fb4fc589d58 00007fb4fc58e9f1 00007fb4fc58e9a9 00007fb4fc58e939 00007fb4fc58e901 00007fb4fc58db2d 0000000000388634 0000000000388479
0709 12:18:17.746035 (+517568us) op_driver.cc:464] REPLICATION: finished
0709 12:18:18.272719 (+526684us) write_op.cc:301] APPLY: starting
0709 12:18:18.272803 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:18.278102 (+  5299us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:18.278125 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:18.562506 (+284381us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:18.562798 (+   292us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:18:18.562842 (+    44us) write_op.cc:312] APPLY: finished
0709 12:18:18.563171 (+   329us) log.cc:844] Serialized 113 byte log entry
0709 12:18:19.039610 (+476439us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:19.079841 (+ 40231us) write_op.cc:454] Released schema lock
0709 12:18:19.087754 (+  7913us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:19.168037 (+ 80283us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:19.182375 (+ 14338us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":275230,"reported_tablets":52,"spinlock_wait_cycles":29570304,"child_traces":[["op",{"apply.queue_time_us":508336,"apply.run_cpu_time_us":55967,"apply.run_wall_time_us":855847,"num_ops":16,"prepare.queue_time_us":288340,"prepare.run_cpu_time_us":59314,"prepare.run_wall_time_us":1053259,"raft.queue_time_us":408486,"raft.run_cpu_time_us":39505,"raft.run_wall_time_us":504115,"replication_time_us":858026,"spinlock_wait_cycles":8622976,"thread_start_us":1453724,"threads_started":5,"wal-append.queue_time_us":977399,"wal-append.run_cpu_time_us":23250,"wal-append.run_wall_time_us":2764646}]]}
I20260709 12:18:20.895838 26260 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.968152 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:20.897816 25939 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:20.941097 26296 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:20.969497 22441 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:20.952085 26441 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:20.974260 26376 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.974426 25939 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:20.979487 22549 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:20.966531 26414 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:20.958367 26310 raft_consensus.cc:697] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:20.972595 26455 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:20.972391 26332 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:21.030896 26391 raft_consensus.cc:3055] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:20.998360 22441 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:21.031414 26391 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:21.032720 26447 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:20.986945 26373 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:21.007072 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 70247.1us
I20260709 12:18:21.033279 26373 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.033735 26373 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:20.997547 26441 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:21.034062 26129 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:21.034711 26441 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:21.032349 26391 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:21.027863 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 202964us
I20260709 12:18:21.036224 26391 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:21.038297 26316 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:21.032428 22441 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:21.044647 22441 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:21.023452 26206 consensus_queue.cc:237] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:21.049722 26455 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:21.043326 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:21.051990 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:21.011013 26296 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:21.034168 26460 log.cc:927] Time spent T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:18:21.058867 22441 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:21.062460 22397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1809) took 1291 ms. Trace:
I20260709 12:18:21.030946 26332 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:20.992632 26283 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.050746 26447 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.052879 26430 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:21.064729 22397 rpcz_store.cc:276] 0709 12:18:19.771394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.772024 (+   630us) service_pool.cc:224] Handling call
0709 12:18:19.772304 (+   280us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:19.788254 (+ 15950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.788293 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:19.788924 (+   631us) log.cc:844] Serialized 52 byte log entry
0709 12:18:20.690327 (+901403us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b1800280060. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a49e07 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b 00007fb4f86f3d23 00007fb4f86f40d1 00007fb4f8b0fa0f
0709 12:18:20.838031 (+147704us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:20.847766 (+  9735us) log.cc:844] Serialized 14 byte log entry
0709 12:18:20.898039 (+ 50273us) log.cc:844] Serialized 14 byte log entry
0709 12:18:21.013559 (+115520us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b1800280060. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:18:21.018612 (+  5053us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b1800280060. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a67522 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:18:21.057079 (+ 38467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:21.062191 (+  5112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:21.062238 (+    47us) raft_consensus.cc:1685] finished
0709 12:18:21.062253 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:21.062398 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93155,"prepare.queue_time_us":26514,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":4036,"raft.queue_time_us":84055,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":8803,"spinlock_wait_cycles":26050560,"thread_start_us":306233,"threads_started":2,"wal-append.queue_time_us":1105974}
I20260709 12:18:21.067718 22366 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:21.053004 26424 raft_consensus.cc:2764] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
W20260709 12:18:21.081655 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 167023us
I20260709 12:18:21.095989 26037 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:21.060156 25919 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:21.060156 26401 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:21.078610 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:21.097441 22402 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:21.066905 22442 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:21.079993 22441 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:21.009853 26193 consensus_queue.cc:237] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.103021 22471 raft_consensus.cc:2368] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8.
I20260709 12:18:21.103842 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:21.095078 26455 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:21.090669 26332 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:21.140028 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:21.143112 22441 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:21.152319 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:21.154713 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.106302 26191 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:21.106014 26331 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:21.159129 22441 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:21.097289 26447 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:21.115262 25919 raft_consensus.cc:697] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:21.138202 26315 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:21.162801 22441 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:21.166077 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:21.139497 26311 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:21.159014 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:18:21.172142 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.115772 26286 consensus_queue.cc:1059] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:18:21.138401 26319 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:21.162454 26077 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:21.175226 22545 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:21.158025 26191 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.160466 26430 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:21.155392 26382 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:21.162691 26455 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:21.102869 26414 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.173854 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:21.170845 25996 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:21.183523 23128 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:21.105466 26310 consensus_queue.cc:237] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:21.104875 26401 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.186995 22476 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:21.180365 26424 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:21.209074 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:21.184115 26191 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:21.211731 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:21.220942 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:21.223325 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:21.224002 22474 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:21.223558 26466 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:18:21.221803 22470 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 7.
I20260709 12:18:21.206689 25931 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:21.238467 22474 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
I20260709 12:18:21.241482 26384 consensus_queue.cc:1059] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:21.242409 26375 raft_consensus.cc:3055] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:21.242787 26375 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:21.243171 26282 consensus_queue.cc:1059] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:21.243551 26375 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.244812 26375 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:21.245368 26205 raft_consensus.cc:3055] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:21.246254 26205 raft_consensus.cc:740] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:21.246829 23095 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:21.247027 26205 consensus_queue.cc:260] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.210739 26077 raft_consensus.cc:697] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:21.249491 23095 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:21.225876 26374 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:18:21.252655 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.254249 22546 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:21.258805 26441 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:21.252023 26035 consensus_queue.cc:1175] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "25ebf14868c042dca42f54b3e251e1b2" responder_term: 13 status { last_received { term: 11 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:21.261121 26283 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:21.240667 25931 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.255401 26311 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:21.219338 26424 raft_consensus.cc:697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:21.272656 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:21.273362 22545 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:21.216971 26316 consensus_queue.cc:1059] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:18:21.210985 26373 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:21.226173 25919 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.256131 26472 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:18:21.248134 26205 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:21.271595 25931 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:21.277447 26077 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.305378 26260 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:21.316922 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:21.302109 22546 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:21.301800 26315 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:18:21.309130 25982 raft_consensus.cc:3055] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:21.248199 26387 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:21.310720 26316 raft_consensus.cc:3055] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:18:21.304039 26154 consensus_meta.cc:287] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.001s
I20260709 12:18:21.262287 26374 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:18:21.248425 26358 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 12:18:21.303634 26439 consensus_meta.cc:287] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.000s
W20260709 12:18:21.320209 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.297966 26311 raft_consensus.cc:697] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 11 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:21.364146 26343 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:21.338920 26331 raft_consensus.cc:697] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:21.317952 25996 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:21.364316 26375 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:18:21.421017 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 175367us
W20260709 12:18:21.420418 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 175560us
I20260709 12:18:21.362094 22545 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:21.366460 25982 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:21.368538 26387 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.426294 22366 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:21.371127 26296 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:21.432744 22366 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:21.394259 26316 raft_consensus.cc:740] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:21.429718 26343 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:21.448110 26441 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:21.447738 26316 consensus_queue.cc:260] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:21.449062 26316 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:21.450407 26311 consensus_queue.cc:237] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:21.451694 22427 heartbeater.cc:646] Failed to heartbeat to 127.20.191.62:37293 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.191.62:37293 timed out after 15.000s (SENT)
I20260709 12:18:21.453663 26191 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:21.437986 26375 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:21.457914 26375 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:21.462073 26430 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:21.462728 26430 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:21.464898 26430 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:21.438578 25996 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.431855 26387 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:21.467984 25996 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:21.468906 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:21.471504 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:21.472249 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:21.475484 22474 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:21.477896 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:21.480252 26439 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:21.482225 26469 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:18:21.483788 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 51114.7us
I20260709 12:18:21.487197 22366 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:21.485337 25982 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.488139 25982 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:21.494593 26469 raft_consensus.cc:2764] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:18:21.494958 22366 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:21.495889 26469 raft_consensus.cc:2764] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
W20260709 12:18:21.500694 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 274018us
I20260709 12:18:21.502007 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:21.505259 22366 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:21.507987 22545 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:21.395768 26154 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.511333 22516 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:21.515362 26305 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:21.515760 26305 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:21.516110 26305 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:21.518415 26455 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:21.519968 26447 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:21.521075 26487 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:21.521591 26487 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.521850 26382 consensus_queue.cc:1048] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:21.522397 26332 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.523758 26487 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:21.524565 26332 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:21.425419 26424 consensus_queue.cc:237] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.529585 26154 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:21.442097 26296 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.530937 26305 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.531857 26296 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:21.543536 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:21.544800 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:21.440292 26402 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:21.548441 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:21.550527 26487 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:21.533005 26305 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:21.553357 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:21.556385 22474 raft_consensus.cc:2393] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 6: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:21.550266 26469 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:21.568861 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:21.569597 22471 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:21.573865 26331 consensus_queue.cc:237] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:21.576231 26248 consensus_meta.cc:287] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.605s	user 0.005s	sys 0.002s
I20260709 12:18:21.576685 26248 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:21.583134 22441 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:21.585500 26248 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:21.587606 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:21.588265 22474 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:21.558382 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:21.596175 22474 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:18:21.602337 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:21.605167 22402 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:21.551294 26487 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.603376 26332 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:21.615186 26487 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:21.615638 26332 raft_consensus.cc:697] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:21.616503 26332 consensus_queue.cc:237] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.618767 22544 raft_consensus.cc:1240] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:21.619771 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:21.614636 26373 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:21.609247 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:18:21.620762 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:21.630877 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:21.622040 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:21.622140 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:21.622702 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:21.625443 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:21.633347 22471 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:18:21.631261 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:21.626849 22402 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:18:21.634462 22544 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 10: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:21.635331 23094 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:21.638283 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:21.638871 22474 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:21.637670 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:21.638062 22367 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:21.639992 22471 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 10: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:18:21.640561 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 105570us
I20260709 12:18:21.643431 22516 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:21.648939 22471 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:21.612228 26305 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.603899 26296 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:18:21.653241 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:21.658344 22474 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:21.658111 22366 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:21.641316 26391 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:21.640726 26248 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:21.691574 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:21.704531 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.653097 26154 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:21.674630 26316 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:21.654246 26402 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:21.705557 26260 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:21.675765 26077 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:21.713004 26459 log.cc:927] Time spent T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.055s	user 0.000s	sys 0.009s
I20260709 12:18:21.640862 26455 consensus_queue.cc:1059] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
W20260709 12:18:21.718617 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 46608.1us
I20260709 12:18:21.709944 26248 raft_consensus.cc:697] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:21.659444 26305 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:21.726765 26484 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:18:21.674672 26469 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 12:18:21.730495 26492 log.cc:927] Time spent T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.113s	user 0.003s	sys 0.000s
I20260709 12:18:21.718907 26384 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.740996 22366 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:21.718473 26154 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:18:21.726784 26490 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:18:21.717128 26402 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.744930 26154 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.745832 22551 raft_consensus.cc:2410] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:18:21.745905 26487 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:21.746980 22366 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:21.747655 26401 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:21.742928 26296 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.741618 26488 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:18:21.749100 26384 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:21.751781 26465 log.cc:927] Time spent T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.551s	user 0.002s	sys 0.000s
I20260709 12:18:21.720259 26316 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:18:21.718400 26387 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:21.782904 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:21.782541 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:21.768730 26479 log.cc:927] Time spent T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
W20260709 12:18:21.810834 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 88928us
I20260709 12:18:21.767180 26375 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:21.762377 26402 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:21.764019 26343 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:21.953809 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 65965.7us
I20260709 12:18:21.974479 23130 raft_consensus.cc:2393] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 8: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:21.764097 25931 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.882966 26455 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.810832 26296 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:21.887104 26468 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.943626 26305 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:22.006261 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 51737.9us
I20260709 12:18:22.017490 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:22.018805 23129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34092 (request call id 449) took 1272 ms. Trace:
I20260709 12:18:21.763116 26248 consensus_queue.cc:237] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:21.943625 26193 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:22.038472 22548 raft_consensus.cc:2368] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 10. Current term is 11.
I20260709 12:18:22.042706 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.044083 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:22.045310 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:22.046659 22472 raft_consensus.cc:1240] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:18:22.050684 22516 leader_election.cc:400] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8.
I20260709 12:18:22.051157 22516 leader_election.cc:403] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:18:22.051460 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.052457 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:22.053015 22394 raft_consensus.cc:2368] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15.
I20260709 12:18:22.053664 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:22.054592 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:22.055235 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.055694 22399 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:22.056355 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:22.056775 22400 raft_consensus.cc:2376] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8. Re-sending same reply.
I20260709 12:18:22.058148 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.058799 22399 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 13: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:22.058872 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.059427 22400 raft_consensus.cc:2376] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10. Re-sending same reply.
I20260709 12:18:22.060096 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.061645 22470 raft_consensus.cc:1240] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: [9.5-10.6]
I20260709 12:18:22.062436 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:22.063001 22473 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:22.064092 22393 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:22.019183 23129 rpcz_store.cc:276] 0709 12:18:20.746854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.746993 (+   139us) service_pool.cc:224] Handling call
0709 12:18:20.747326 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:20.747547 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:20.747575 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:20.752925 (+  5350us) log.cc:844] Serialized 26 byte log entry
0709 12:18:20.981959 (+229034us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:20.982003 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.982070 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:21.751194 (+769124us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:22.006532 (+255338us) raft_consensus.cc:1685] finished
0709 12:18:22.006558 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.018729 (+ 12171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8762752,"thread_start_us":191822,"threads_started":1,"wal-append.queue_time_us":370902}
I20260709 12:18:21.989856 26430 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:22.009613 26037 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.069461 22476 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:22.018164 26487 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:22.075317 22475 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:18:22.039270 25754 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:22.078212 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.078888 22398 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:22.082360 22398 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:22.016537 26424 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:18:22.010396 26455 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:22.016505 26505 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:18:22.065758 26193 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:22.100855 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 50313.6us
I20260709 12:18:22.035773 26468 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:22.087487 26129 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.003s	sys 0.027s
I20260709 12:18:22.108176 22546 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:18:22.109910 22546 pending_rounds.cc:85] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 8
I20260709 12:18:22.110177 22546 pending_rounds.cc:107] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:18:22.110404 22546 raft_consensus.cc:2889] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:22.137393 26129 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.003s	sys 0.027s
I20260709 12:18:22.075858 26037 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:22.152343 26384 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:22.153164 26508 log.cc:927] Time spent T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:18:22.081681 26487 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:22.159097 25931 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:22.160933 26193 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:22.162720 26296 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.166014 26387 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.099406 26332 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.102545 26077 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8.
I20260709 12:18:22.074703 26430 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:22.173929 26507 log.cc:927] Time spent T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:18:22.166009 26447 raft_consensus.cc:3055] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:22.182659 26447 raft_consensus.cc:740] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:22.182075 26332 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:22.191982 26468 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.193084 26332 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.193324 26455 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.194231 26430 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:22.191743 26447 consensus_queue.cc:260] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:22.195883 26487 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:22.197240 26516 log.cc:927] Time spent T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:18:22.198731 26375 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:22.195823 26447 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:22.230815 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:22.087630 22393 raft_consensus.cc:1240] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:18:22.254333 22394 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: [8.6-9.7]
I20260709 12:18:22.256862 22394 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:22.259771 22396 raft_consensus.cc:2368] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8.
I20260709 12:18:22.259580 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.260756 22395 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:22.084034 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:22.267297 22398 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:18:22.279911 22398 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:22.085176 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.287083 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:18:22.299579 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.301889 22473 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:22.383805 26331 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.384455 26331 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:22.303802 22472 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:18:22.305485 22477 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:22.309710 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:22.310719 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.385406 22473 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:22.387890 25996 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.388690 25996 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:22.390404 23122 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:22.392117 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:22.393165 23125 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 10: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:22.393805 26154 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:22.394200 26331 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.394630 26154 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:22.320093 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:22.331933 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:22.336592 25931 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:18:22.337916 26310 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.000s	sys 0.022s
W20260709 12:18:22.403431 26310 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.000s	sys 0.023s
I20260709 12:18:22.337944 26037 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:22.339509 26311 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:22.405146 26311 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:22.407829 26311 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:22.340387 26332 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.408397 26311 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.348206 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:22.349365 26070 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.353590 25905 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:22.353538 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:22.358392 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:22.359313 26191 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:22.403674 25931 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:22.362159 22546 raft_consensus.cc:3055] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:22.363703 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:22.367260 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:22.397341 22475 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:22.398720 26282 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:22.410691 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:22.414299 26342 consensus_queue.cc:1059] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:22.410164 26283 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:18:22.346733 26375 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.417374 26332 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:22.418860 23127 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:22.419293 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:22.455753 22546 raft_consensus.cc:740] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:22.423389 25996 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.487389 25931 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:22.418999 22516 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:22.495194 26311 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:22.476781 26154 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:22.498026 22543 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:22.498642 23129 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:18:22.419003 26070 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:22.498911 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:22.498097 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:22.481110 22546 consensus_queue.cc:260] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:22.506624 26342 raft_consensus.cc:3055] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:22.509523 26070 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.410079 26373 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 12:18:22.534154 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.535996 22398 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 7.
I20260709 12:18:22.520212 25931 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:22.537539 22543 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:22.552726 26311 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:22.554843 26332 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.558002 26154 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.558759 26154 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:22.561154 26154 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.562043 22470 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:22.565425 26513 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.566387 22397 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:18:22.566190 26513 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:22.566761 22397 pending_rounds.cc:85] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 6
I20260709 12:18:22.567091 22397 pending_rounds.cc:107] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:18:22.567396 22397 raft_consensus.cc:2889] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:22.520337 26282 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:22.569130 22398 raft_consensus.cc:1240] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:18:22.570007 26282 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:22.522377 26375 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:22.573061 26375 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.578401 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:22.582011 26513 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.585918 26331 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:22.586196 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:22.586987 23122 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:22.586789 26331 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:22.558722 26472 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.588238 26472 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:22.590220 26331 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:22.527091 26342 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:22.594532 22398 raft_consensus.cc:1240] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:18:22.594931 26342 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:22.595868 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:22.596580 26342 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:22.597492 22400 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:18:22.595477 22394 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:18:22.598443 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:22.599100 22396 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:22.596518 22397 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:22.621800 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.590559 26472 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.505487 25905 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:22.621250 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:22.617214 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:22.633538 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:22.634246 22476 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:22.635718 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:22.634117 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:22.643137 22397 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:22.644551 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:22.647763 22546 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:22.637660 22398 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:22.651173 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:22.652535 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:22.653267 22469 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:22.654351 26531 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:22.659813 22396 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:22.662006 22397 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:22.646975 22299 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32988 (request call id 94) took 6234 ms. Trace:
I20260709 12:18:22.667809 26531 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:22.670516 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:22.672252 22550 raft_consensus.cc:1240] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:22.673241 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:22.674041 26475 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:22.659859 26154 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:22.674562 26475 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:22.674748 26154 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.675182 26154 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:22.676298 22474 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.017s	sys 0.007s
I20260709 12:18:22.674986 26475 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:22.680799 26331 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:22.681591 26331 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:22.668278 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.685351 22472 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:18:22.684618 22474 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.017s	sys 0.007s
I20260709 12:18:22.685983 26331 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.692229 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.693166 22393 raft_consensus.cc:2393] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 10: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:22.693981 26468 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:22.694617 26468 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:22.638787 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 150651us
I20260709 12:18:22.697990 22399 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 13.
I20260709 12:18:22.698168 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:22.699079 23122 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:22.699203 22544 raft_consensus.cc:2410] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:18:22.684119 22299 rpcz_store.cc:276] 0709 12:18:16.239642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.246118 (+  6476us) service_pool.cc:224] Handling call
0709 12:18:22.466927 (+6220809us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:21.196259 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:21.196820 (+   561us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:21.196851 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:18:21.196868 (+    17us) tablet.cc:662] Decoding operations
0709 12:18:21.197731 (+   863us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:21.197815 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:21.197844 (+    29us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:18:21.198460 (+   616us) tablet.cc:701] Row locks acquired
0709 12:18:21.198473 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:18:21.198641 (+   168us) write_op.cc:270] Start()
0709 12:18:21.198757 (+   116us) write_op.cc:276] Timestamp: P: 1783599501198584 usec, L: 0
0709 12:18:21.198774 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:18:21.241095 (+ 42321us) log.cc:844] Serialized 3256 byte log entry
0709 12:18:22.157951 (+916856us) op_driver.cc:464] REPLICATION: finished
0709 12:18:22.200422 (+ 42471us) write_op.cc:301] APPLY: starting
0709 12:18:22.200565 (+   143us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:22.200836 (+   271us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:22.201015 (+   179us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:22.202500 (+  1485us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:22.202835 (+   335us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:18:22.203254 (+   419us) write_op.cc:312] APPLY: finished
0709 12:18:22.203470 (+   216us) log.cc:844] Serialized 65 byte log entry
0709 12:18:22.203638 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:22.203762 (+   124us) write_op.cc:454] Released schema lock
0709 12:18:22.203809 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:22.204174 (+   365us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:22.204204 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1436883,"reported_tablets":11,"spinlock_wait_cycles":49280,"child_traces":[["op",{"apply.queue_time_us":29837,"apply.run_cpu_time_us":2945,"apply.run_wall_time_us":3754,"num_ops":8,"prepare.queue_time_us":283324,"prepare.run_cpu_time_us":20245,"prepare.run_wall_time_us":315160,"raft.queue_time_us":328933,"raft.run_cpu_time_us":3712,"raft.run_wall_time_us":96159,"replication_time_us":945439,"thread_start_us":552072,"threads_started":4,"wal-append.queue_time_us":335148}]]}
I20260709 12:18:22.699935 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:22.720094 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:22.720922 22470 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
W20260709 12:18:22.715656 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 297009us
W20260709 12:18:22.729930 23093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.023s	sys 0.031s
W20260709 12:18:22.730402 23093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.024s	sys 0.031s
I20260709 12:18:22.689370 26373 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:22.746811 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:22.747682 26387 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.747942 26391 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:22.748435 26391 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.748843 26391 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:22.746989 26530 log.cc:927] Time spent T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.240s	user 0.000s	sys 0.002s
I20260709 12:18:22.751258 26531 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.752565 22399 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:22.754215 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:22.755314 26331 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:22.731483 26311 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:22.775949 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:22.777058 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:22.776552 26489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.039s	user 0.007s	sys 0.012s
I20260709 12:18:22.786007 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.786660 22399 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:22.795993 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.797004 22399 raft_consensus.cc:2410] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:18:22.791325 26489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.199s	user 0.007s	sys 0.013s
I20260709 12:18:22.803658 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:22.806348 22550 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:22.809633 22516 leader_election.cc:400] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15.
I20260709 12:18:22.810030 22516 leader_election.cc:403] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:18:22.803767 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:22.811103 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:22.780572 26387 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:22.809355 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:22.820955 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:22.821081 22544 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:22.821135 22548 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 5.
I20260709 12:18:22.820993 22549 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:18:22.823505 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:22.824446 22543 raft_consensus.cc:2393] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:22.821462 25931 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15.
I20260709 12:18:22.830015 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:22.781798 26373 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:22.830842 22550 raft_consensus.cc:2393] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:22.832157 25931 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.832840 26373 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.832768 25931 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:22.821405 22545 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:22.836664 25931 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:22.784984 26311 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:22.838071 22470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "277d262725804effb16ede64e81d19c8"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:22.838888 22470 raft_consensus.cc:606] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:22.839464 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.839339 22470 raft_consensus.cc:614] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:22.840008 25905 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.840754 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:22.851922 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.838786 26311 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.867959 22470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:22.868733 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.869546 22397 raft_consensus.cc:2410] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:18:22.871740 22393 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:22.865638 22366 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:22.873126 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 117541us
I20260709 12:18:22.879658 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:22.880894 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:22.873989 26311 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:22.883919 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:22.885054 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.881817 22470 raft_consensus.cc:606] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:22.893028 26472 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:22.893877 26154 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:22.896293 26154 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:22.896764 22297 catalog_manager.cc:5697] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 5 to 6, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 6 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:22.900384 22470 raft_consensus.cc:614] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:22.911353 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:18:22.890522 26468 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.915776 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.918622 22397 raft_consensus.cc:2410] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:18:22.917701 22393 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
W20260709 12:18:22.935431 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 85279.6us
W20260709 12:18:22.937734 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 160279us
W20260709 12:18:22.940704 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.898404 26475 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:22.922295 26283 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.945196 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.908782 26311 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:22.946071 22297 catalog_manager.cc:5697] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 5 to 8, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 8 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:22.949836 22393 raft_consensus.cc:2410] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:18:22.954043 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:22.935477 26456 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:22.956883 26456 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:22.957402 22297 catalog_manager.cc:5697] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:22.958552 22473 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:22.959556 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:22.960407 22477 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 10: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:22.960218 22297 catalog_manager.cc:5697] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 6 to 9, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 9 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:22.962647 26387 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:22.956221 26283 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:22.966027 22472 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:22.968361 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.969935 22402 raft_consensus.cc:1275] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:22.970099 22441 leader_election.cc:400] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 10. Current term is 11.
I20260709 12:18:22.970398 22441 leader_election.cc:403] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:18:22.957345 26456 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:22.976908 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.976821 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:22.978856 22516 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:22.980837 22470 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:22.983558 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:22.987317 22393 raft_consensus.cc:2410] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:22.985680 22547 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:18:22.993413 26384 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:23.005292 22469 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:23.016042 22472 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
W20260709 12:18:23.015662 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.004176 26342 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:23.017409 22366 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:23.018081 22297 catalog_manager.cc:5697] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 3 to 7, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 7 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:23.027340 22297 catalog_manager.cc:5697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:23.023557 22476 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 8.
I20260709 12:18:23.004455 26283 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:23.014343 26376 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:23.021559 26430 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:23.018591 26332 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 10. Current term is 11.
I20260709 12:18:23.045912 23094 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:23.046409 22442 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:23.047080 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 90406.1us
I20260709 12:18:23.026441 26375 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:18:23.062029 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 62635.9us
I20260709 12:18:23.053292 22366 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:23.034178 26331 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:23.066942 22546 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:18:23.068349 22546 pending_rounds.cc:85] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 5
I20260709 12:18:23.058966 26342 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.077015 22546 pending_rounds.cc:107] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:18:23.061287 26283 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:23.076473 26447 consensus_meta.cc:287] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.875s	user 0.001s	sys 0.014s
I20260709 12:18:23.077593 22546 raft_consensus.cc:2889] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:23.065979 26375 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.067462 26376 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:23.068692 26373 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:23.103870 26373 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.104298 26373 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:23.094421 26311 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:23.096114 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:23.098313 22458 tablet_service.cc:1558] Processing DeleteTablet for tablet 0723691b01e2413baf71cbc73a551fdc with delete_type TABLET_DATA_TOMBSTONED (TS 25ebf14868c042dca42f54b3e251e1b2 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:51846
W20260709 12:18:23.099454 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 51136.8us
I20260709 12:18:23.067916 26430 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.103068 25905 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:23.102921 26375 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:23.123694 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:23.124450 22468 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:23.128376 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:23.141297 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 137545us
I20260709 12:18:23.116650 26391 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:23.145253 26540 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:23.145535 26283 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:23.146034 26540 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.147178 26283 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:23.148315 22442 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:23.148536 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 69981.8us
I20260709 12:18:23.148875 26382 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:23.149327 26382 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.149443 26472 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:23.149793 26382 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:23.151405 26430 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:23.151589 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:23.158141 26455 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:23.159886 22442 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:23.162724 25931 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:23.164541 25931 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:23.164966 26539 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.215s	user 0.002s	sys 0.001s
I20260709 12:18:23.165969 26472 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.166460 26472 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.168651 26472 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:23.169849 22366 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:23.170265 26468 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:23.107401 26342 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:23.131286 25905 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.126355 26513 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 12:18:23.181856 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 171205us
I20260709 12:18:23.148236 26540 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:23.177047 26447 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:23.179690 26455 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.186843 25905 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:23.178184 26070 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 12:18:23.204173 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 44425.4us
I20260709 12:18:23.195060 26468 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.210090 26540 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.234215 22441 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:23.207803 26430 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
W20260709 12:18:23.240978 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 89510us
I20260709 12:18:23.218463 26468 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.252461 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:23.253304 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:23.243294 26513 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:23.218921 26455 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.255774 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:23.260563 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 90830.6us
I20260709 12:18:23.243512 26382 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.258611 26513 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.276590 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:23.281648 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:23.245931 26540 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.313162 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:23.315312 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:23.317533 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 100734us
I20260709 12:18:23.317425 22543 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:18:23.320737 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:23.312265 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:23.321427 23122 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:23.321875 22551 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:23.322916 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 102977us
W20260709 12:18:23.312387 26548 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:18:23.324227 22442 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:23.333463 22549 raft_consensus.cc:2393] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 12: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:23.312639 26342 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:23.279413 26376 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:23.312222 26558 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.315652 26513 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:23.351570 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:23.351837 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:23.352445 22471 raft_consensus.cc:2393] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:23.352625 22473 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:18:23.353327 26472 consensus_queue.cc:1059] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:23.348328 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:23.349458 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:23.355086 22476 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:23.349036 22547 raft_consensus.cc:3055] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:23.353825 22367 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:23.358145 22547 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:23.361343 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:23.362176 22470 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:18:23.337929 26154 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.369020 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:23.368084 26554 tablet_replica.cc:333] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:18:23.369786 22473 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:23.371835 26562 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:18:23.372159 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:23.374038 26571 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:23.375516 23095 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:23.376408 26531 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:23.377117 26531 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:23.378054 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:23.379613 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 1955) took 1078 ms. Trace:
I20260709 12:18:23.380009 22468 rpcz_store.cc:276] 0709 12:18:22.301205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.308999 (+  7794us) service_pool.cc:224] Handling call
0709 12:18:23.379429 (+1070430us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b5400110154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:23.379532 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1655937920}
I20260709 12:18:23.382707 25931 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:23.385129 22367 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:23.365365 22547 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.312273 26552 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 12:18:23.354127 26556 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:23.401188 22474 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:18:23.401836 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:23.405277 22471 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:23.407660 22470 raft_consensus.cc:2393] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 12: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:23.409950 26567 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:23.410116 26562 raft_consensus.cc:3055] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:23.410590 26455 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:23.411228 26472 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:23.412896 26562 raft_consensus.cc:740] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:23.416035 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:23.418919 26540 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:23.400724 26154 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.422080 22547 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:23.421486 26154 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:23.419152 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:23.423362 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 168092us
I20260709 12:18:23.424266 26561 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.424841 26561 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.410485 26567 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.425871 26567 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:23.426200 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:23.426855 23130 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:23.427081 26561 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:23.433904 22472 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:23.386176 26391 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:23.441701 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:23.404594 26556 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:23.443885 23122 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:18:23.445217 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:23.446628 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:23.447237 22543 raft_consensus.cc:2410] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:18:23.447947 23095 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:23.364171 26558 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.451416 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:23.453712 22550 raft_consensus.cc:2410] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:23.450935 25931 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:18:23.455997 26562 consensus_queue.cc:260] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.457500 26562 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:23.440623 26430 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:23.469460 22366 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:23.471999 22515 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:23.449628 26556 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:23.473495 22471 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:18:23.473469 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 154328us
I20260709 12:18:23.487675 22442 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:23.487783 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:23.489997 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 104986us
I20260709 12:18:23.490711 22367 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:23.485816 22544 raft_consensus.cc:3055] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:23.496137 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:23.494128 22544 raft_consensus.cc:740] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:18:23.499306 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.493649 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:23.504189 22547 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
W20260709 12:18:23.494163 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 46271.8us
I20260709 12:18:23.505980 22549 raft_consensus.cc:2410] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:18:23.506368 26382 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:23.506855 26248 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:23.507530 26248 raft_consensus.cc:697] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:18:23.507887 26542 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.557s	user 0.000s	sys 0.003s
I20260709 12:18:23.508550 26248 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:23.509480 22442 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:23.510337 26331 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:23.510679 22442 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:23.511603 26331 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:23.512539 26569 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:23.513934 26455 consensus_queue.cc:1048] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:23.507820 26472 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:23.516388 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:23.516780 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:23.517902 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.518137 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:23.519518 22543 raft_consensus.cc:1275] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:23.520891 22473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "444001888258449e8c4f5fd4ad540389"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:23.521466 22473 raft_consensus.cc:606] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:23.521811 22473 raft_consensus.cc:614] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:23.522243 26559 consensus_queue.cc:1059] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:23.523025 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:23.523492 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:23.524123 22397 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:23.525296 26382 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:23.526849 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:23.528368 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:23.528999 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:23.529590 22397 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:23.529013 22398 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:23.488621 26070 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:23.531569 26070 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:23.531980 26070 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:23.486985 26489 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:23.516292 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:23.545549 22551 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:18:23.504760 22547 pending_rounds.cc:85] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 7
I20260709 12:18:23.546414 22547 pending_rounds.cc:107] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:18:23.546718 22547 raft_consensus.cc:2889] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:23.470705 26430 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:23.527329 26342 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:23.505208 26456 consensus_meta.cc:287] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.003s
I20260709 12:18:23.567899 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:23.526909 26382 raft_consensus.cc:3055] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:23.573522 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:23.582263 26332 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.582794 26332 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.584880 26332 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:23.585414 26332 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:23.548979 26489 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.580008 22442 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:23.507098 26474 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.134s
W20260709 12:18:23.588761 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 98127.6us
I20260709 12:18:23.592535 22367 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:23.593546 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:23.574904 26342 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.570449 26430 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:23.506644 26513 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:23.593895 22442 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:23.597146 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 72967.6us
I20260709 12:18:23.574451 26468 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:23.571941 26455 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:23.589413 22544 consensus_queue.cc:260] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.581422 26382 raft_consensus.cc:740] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:23.587121 26531 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.594005 26489 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:23.592994 26475 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:23.613102 22549 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:23.616940 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:23.614485 22442 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:23.597638 26283 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:23.620704 23095 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:23.643263 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:23.620151 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:23.609510 26342 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:23.616868 26568 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:23.625787 26474 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:18:23.645300 26558 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:23.633126 23130 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:23.653151 22516 leader_election.cc:400] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 7. Current term is 8.
I20260709 12:18:23.654803 26447 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:23.654964 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:23.656059 26570 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:23.640020 26382 consensus_queue.cc:260] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.580060 26456 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:23.644346 26572 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.657266 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:23.658018 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 43615.1us
I20260709 12:18:23.643357 22441 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:23.661016 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:23.665678 25996 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:18:23.669756 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 101201us
I20260709 12:18:23.672878 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:23.672506 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:23.676295 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:23.624519 26564 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.691324 23095 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:23.700380 22367 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:23.642009 26283 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.689065 26474 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:23.622972 26559 consensus_queue.cc:1059] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:18:23.656545 26570 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.702710 22367 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:23.614537 26332 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:23.705439 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:23.689275 26387 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:23.662461 26561 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:23.698056 26475 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:23.715751 22398 raft_consensus.cc:2410] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:23.628959 26455 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.723601 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:23.735317 22475 raft_consensus.cc:606] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:23.735719 22475 raft_consensus.cc:614] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:23.706633 26283 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:23.741151 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 97866.9us
I20260709 12:18:23.657258 26531 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:23.702979 26447 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:23.722097 26376 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:23.744596 22441 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:23.715971 26571 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:23.714500 26570 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:23.722183 26561 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.752215 22441 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:23.722295 26154 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:18:23.757090 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 65853.3us
I20260709 12:18:23.698410 26572 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:23.764978 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 78187.5us
I20260709 12:18:23.702677 26564 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:23.802727 25996 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:23.803198 26569 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:23.774348 26447 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.749984 26577 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:23.756183 26571 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.772800 26561 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:23.777211 26568 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:18:23.823773 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 121128us
W20260709 12:18:23.824838 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 72708.8us
I20260709 12:18:23.824582 22367 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:23.826327 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:23.786681 26382 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:23.826967 22475 raft_consensus.cc:606] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:23.831705 22475 raft_consensus.cc:614] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:23.834612 22441 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:23.830226 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 97807.2us
I20260709 12:18:23.840627 22366 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:23.819175 26571 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:23.823966 26568 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.846578 22367 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:23.847514 22441 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:23.842445 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:23.831171 26447 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:23.855973 26154 raft_consensus.cc:697] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:23.849573 26602 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:23.851665 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:23.863600 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:23.842736 26565 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:23.883116 22396 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:23.832998 26540 consensus_queue.cc:1059] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:18:23.850917 26568 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:23.853780 26472 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:18:23.855333 26513 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:23.862713 25996 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:23.854799 26577 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:23.895373 26590 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.139s
I20260709 12:18:23.896653 22544 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:23.898128 26599 consensus_queue.cc:1059] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:23.902554 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:23.842871 26558 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:18:23.858814 26447 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:23.890336 26375 consensus_meta.cc:287] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.710s	user 0.007s	sys 0.004s
I20260709 12:18:23.934194 26384 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:23.934656 26384 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.934998 26384 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:23.937296 26567 consensus_meta.cc:287] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.000s
I20260709 12:18:23.888233 26456 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:23.893613 26070 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.932741 26375 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.939881 26070 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:23.940469 26375 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:23.941319 25931 raft_consensus.cc:3055] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:23.941705 25931 raft_consensus.cc:740] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:18:23.932281 26582 log.cc:927] Time spent T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:18:23.942696 25931 consensus_queue.cc:260] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.943921 25931 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:23.945886 26557 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:23.861395 26154 consensus_queue.cc:237] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:23.951442 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 93795.8us
I20260709 12:18:23.952121 22367 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:23.861378 26602 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.886384 26578 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:23.868736 26342 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:23.975749 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 181698us
I20260709 12:18:23.954461 26569 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:23.984104 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:23.890938 26589 consensus_queue.cc:1048] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.121s
I20260709 12:18:23.927934 26583 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 12:18:23.996735 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 149293us
W20260709 12:18:23.998297 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 143145us
I20260709 12:18:23.937713 26567 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:23.983279 25996 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:23.993113 26375 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:23.914263 26565 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:24.005904 22441 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:24.018625 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:24.021231 23122 raft_consensus.cc:2393] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 14: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:24.012574 26375 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.008725 26455 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.033011 26601 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:24.062137 26601 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:24.065263 26601 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:24.040130 26600 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.085556 26600 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.088238 26600 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:24.089020 26373 consensus_meta.cc:287] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.984s	user 0.003s	sys 0.010s
I20260709 12:18:24.089797 26608 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:24.046736 26342 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:24.090737 26608 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.073051 26489 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:24.038470 26564 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:24.097185 26489 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:24.097741 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:18:24.039525 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 52210.8us
I20260709 12:18:24.003301 26569 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.051147 26531 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.004864 26556 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.008118 25996 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.053961 26613 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:24.054723 26609 consensus_queue.cc:1059] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 12:18:24.056094 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:24.124035 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:24.124675 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.126303 22393 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:24.127439 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:24.128173 22398 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:24.056689 26565 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:24.018770 26552 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:24.058900 26567 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.139209 22542 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:24.068234 26579 raft_consensus.cc:3055] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:24.069455 26602 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.037647 26375 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:24.070369 26580 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 12:18:24.150110 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:24.151360 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:24.151979 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:24.152256 22472 raft_consensus.cc:2410] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:18:24.074802 26572 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:24.075829 26430 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:23.985532 26578 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:24.078836 26384 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.089541 26373 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:24.097231 22544 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:24.042956 26283 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.108700 22516 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:24.047889 26332 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
W20260709 12:18:24.165699 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:24.167383 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:24.148072 26562 consensus_meta.cc:287] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.690s	user 0.004s	sys 0.007s
I20260709 12:18:24.115322 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:24.113391 22442 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:24.129310 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:24.172876 22397 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:24.132776 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:24.133903 26557 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:24.135082 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:24.166194 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:24.135243 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:24.136406 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:24.137428 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:24.144637 26579 raft_consensus.cc:740] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:24.137969 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:24.068271 26554 raft_consensus.cc:2243] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 12:18:24.121898 25905 consensus_meta.cc:287] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.906s	user 0.010s	sys 0.002s
I20260709 12:18:24.144404 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:24.144088 26567 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.147512 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:24.152621 22474 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
W20260709 12:18:24.192772 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.153673 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:24.155247 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:24.150919 22469 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:24.150511 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:24.157899 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:24.115360 26455 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:24.158838 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:24.140000 26613 raft_consensus.cc:697] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:24.176594 22470 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:24.093549 26608 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.180163 22401 raft_consensus.cc:2393] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 14: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:24.184832 22477 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:24.250741 26455 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.252188 26447 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:24.252748 26447 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.253090 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:24.254330 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:24.254963 26447 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.255435 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:24.256585 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:24.257154 22548 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:24.187582 26602 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:24.259234 22477 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 14.
I20260709 12:18:24.167910 26468 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.260142 26468 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.260896 25996 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:24.261525 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 148225us
I20260709 12:18:24.262300 26468 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.263180 26603 raft_consensus.cc:3055] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:24.263595 22442 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:24.265110 26332 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:24.265525 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 228190us
I20260709 12:18:24.122160 26568 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.250463 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:24.207249 22549 raft_consensus.cc:2368] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10.
I20260709 12:18:24.251140 26384 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.215545 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:24.230448 22473 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:24.228984 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:24.231950 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:24.295774 22551 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:18:24.229403 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:24.228615 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:24.297199 23129 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:24.271883 23127 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:18:24.278090 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:24.298251 22547 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 12: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:24.272691 22398 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:24.299540 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:24.194473 22396 raft_consensus.cc:2368] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 12. Current term is 13.
I20260709 12:18:24.193884 22476 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:24.305789 22397 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:24.294189 23125 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
W20260709 12:18:24.297963 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 68647us
W20260709 12:18:24.229877 26587 log.cc:927] Time spent T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.255s	user 0.001s	sys 0.005s
I20260709 12:18:24.312485 22393 raft_consensus.cc:2393] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:18:24.213877 26594 log.cc:927] Time spent T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.178s	user 0.000s	sys 0.002s
I20260709 12:18:24.315207 22366 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:24.311471 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:24.225885 26614 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
W20260709 12:18:24.222072 26586 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.281s	user 0.003s	sys 0.001s
I20260709 12:18:24.186507 26552 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:24.325591 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:24.320477 22548 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:24.264926 26283 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.228229 26556 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:24.231276 26578 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:24.238335 26569 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.265525 26332 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:18:24.331482 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 66800.2us
I20260709 12:18:24.329453 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:24.349835 22473 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:24.263617 26603 raft_consensus.cc:740] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:18:24.317457 26539 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:18:24.339893 22551 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:24.299243 26248 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:24.334839 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:24.238656 26571 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.346886 23122 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:24.382411 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:24.357610 22476 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:24.259690 26602 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.325994 26577 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:24.213603 26567 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.249979 25905 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:24.373878 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 56749.5us
I20260709 12:18:24.383378 22470 raft_consensus.cc:2410] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:18:24.314466 26456 consensus_queue.cc:1059] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:18:24.395702 26568 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:24.396262 26612 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:18:24.264986 26613 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.400056 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:24.336146 26552 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.400878 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:24.345371 26608 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:24.400930 23095 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:24.370105 26604 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.405403 22367 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:24.438478 22367 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
W20260709 12:18:24.378886 26587 log.cc:927] Time spent T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:18:24.371593 26332 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:24.415748 22397 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:24.236804 26570 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.397107 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:24.371423 26619 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:24.424049 26591 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:24.424603 26555 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.428223 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:24.451280 22477 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:18:24.383430 26554 raft_consensus.cc:2272] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:24.293821 26557 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:24.442466 22473 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 6.
I20260709 12:18:24.441123 22476 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:24.453068 22367 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:24.429970 26561 consensus_meta.cc:287] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.000s
I20260709 12:18:24.550683 26561 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.556787 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:24.435937 26382 consensus_meta.cc:287] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.000s
W20260709 12:18:24.568799 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 115820us
I20260709 12:18:24.570246 22367 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:24.572153 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 106486us
I20260709 12:18:24.578024 22545 raft_consensus.cc:2410] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:18:24.437727 26455 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.376037 26579 consensus_queue.cc:260] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.441259 26387 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:24.580646 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:24.440507 26611 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:24.448585 26604 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.564111 26472 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:24.599217 25996 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:24.606492 26579 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:24.589017 26387 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.611557 26387 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:24.579950 26562 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:24.579779 26620 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:18:24.614257 26623 log.cc:927] Time spent T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:18:24.440361 26248 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.153s
I20260709 12:18:24.596398 26430 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:24.620168 25931 consensus_meta.cc:287] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.673s	user 0.011s	sys 0.001s
I20260709 12:18:24.637672 22477 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
W20260709 12:18:24.640157 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 46259.9us
I20260709 12:18:24.621937 26620 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.618582 26562 raft_consensus.cc:697] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:24.626279 26589 consensus_queue.cc:1059] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:18:24.670513 25905 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.665490 26561 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.600462 26603 consensus_queue.cc:260] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:24.676627 22549 raft_consensus.cc:2410] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:24.677285 26627 raft_consensus.cc:3055] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:24.677791 26627 raft_consensus.cc:740] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:18:24.678318 26630 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:18:24.678902 26627 consensus_queue.cc:260] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.646641 26373 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.682812 26604 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.576577 26555 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:24.685130 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:24.685801 22542 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:24.687187 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:24.686057 26557 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:24.687485 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:24.689934 22543 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:24.688328 23127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41028 (request call id 475) took 1289 ms. Trace:
I20260709 12:18:24.692428 23127 rpcz_store.cc:276] 0709 12:18:23.399270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.399896 (+   626us) service_pool.cc:224] Handling call
0709 12:18:23.408631 (+  8735us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:24.314314 (+905683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.688048 (+373734us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b540012b454. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:24.688246 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1972420352}
W20260709 12:18:24.695457 26622 log.cc:927] Time spent T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:18:24.665170 26620 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:24.697671 26332 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:24.710467 26624 log.cc:927] Time spent T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:18:24.712041 26625 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 12:18:24.718468 26571 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.697724 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1972) took 1170 ms. Trace:
I20260709 12:18:24.722491 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:24.724253 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:24.725668 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:24.728665 22543 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
W20260709 12:18:24.699849 26375 consensus_meta.cc:287] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.525s	user 0.003s	sys 0.005s
I20260709 12:18:24.720649 22394 rpcz_store.cc:276] 0709 12:18:23.526814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.543371 (+ 16557us) service_pool.cc:224] Handling call
0709 12:18:23.573051 (+ 29680us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:18:23.608436 (+ 35385us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:23.955317 (+346881us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b18004049e0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a49e07 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a64455 00007fb4fc54c3c7 00007fb4f8b5e9a7 00007fb4f8b6e0bf 00007fb4f8b6e038
0709 12:18:24.124536 (+169219us) log.cc:844] Serialized 14 byte log entry
0709 12:18:24.340416 (+215880us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:18:24.417327 (+ 76911us) log.cc:844] Serialized 78 byte log entry
0709 12:18:24.417487 (+   160us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:24.417817 (+   330us) log.cc:844] Serialized 14 byte log entry
0709 12:18:24.418239 (+   422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.418310 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:24.697398 (+279088us) raft_consensus.cc:1685] finished
0709 12:18:24.697429 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:24.697615 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11653,"prepare.queue_time_us":35720,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":19290,"raft.run_cpu_time_us":409,"raft.run_wall_time_us":43731,"spinlock_wait_cycles":19486336,"thread_start_us":344587,"threads_started":2,"wal-append.queue_time_us":435970}
I20260709 12:18:24.739741 22548 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:18:24.741801 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:24.701035 26602 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.712069 26332 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.746675 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:24.773953 22542 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:24.776070 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:24.777551 22542 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:24.779726 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:24.788522 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:18:24.790123 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:24.790627 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:24.790956 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:24.791318 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.792837 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:24.791606 22442 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:24.790031 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:24.794999 22393 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:24.701517 26562 consensus_queue.cc:237] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.748942 26552 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.813548 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:24.814186 22394 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:24.797441 26625 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:24.798858 26387 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:24.792423 26571 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:24.831008 22548 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:18:24.831535 22548 pending_rounds.cc:85] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 7
I20260709 12:18:24.809810 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:24.831784 22548 pending_rounds.cc:107] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:18:24.832073 22548 raft_consensus.cc:2889] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:24.832237 22398 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:24.811980 22542 raft_consensus.cc:2410] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:18:24.813063 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:24.743342 26375 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.827240 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:24.832984 22397 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:24.835956 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:24.831305 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:18:24.834378 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 52536.1us
I20260709 12:18:24.838914 22395 raft_consensus.cc:2368] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14.
W20260709 12:18:24.840137 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 283673us
I20260709 12:18:24.832899 26342 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.844729 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:24.849428 22401 raft_consensus.cc:2393] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 12: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:24.850689 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:24.851356 22395 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:24.853976 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.842224 22441 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:24.833575 26625 raft_consensus.cc:697] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:24.856230 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:24.857789 22442 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:24.861346 22441 leader_election.cc:400] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10.
I20260709 12:18:24.861675 22441 leader_election.cc:403] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:18:24.867277 22395 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:24.844147 26387 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.874071 22441 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:24.885291 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.873068 22442 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:24.893332 22441 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:24.900651 22398 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:24.858803 26552 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:24.858299 26342 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:24.903757 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.838518 26571 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:24.895516 22442 leader_election.cc:400] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14.
I20260709 12:18:24.915979 22442 leader_election.cc:403] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:18:24.918576 22441 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:24.894125 26635 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:24.895826 26283 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:24.894980 26561 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:24.912196 26331 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:18:24.928957 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 141127us
I20260709 12:18:24.915129 22397 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:24.932116 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:24.932746 22550 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:24.936308 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:24.936861 22394 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:24.924041 26635 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:24.925952 26283 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:24.949388 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:24.923200 26579 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:18:24.937983 26626 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:24.930392 26331 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:24.935015 26552 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14.
I20260709 12:18:24.937630 26375 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:24.958547 23094 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:24.933102 26640 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:24.959517 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:24.950474 26283 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:24.948194 26635 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:24.959545 26637 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:24.960639 26331 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:24.965024 26640 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.939445 26625 consensus_queue.cc:237] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:24.975986 26552 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:24.976869 26637 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:24.978704 26640 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:24.992331 26638 log.cc:927] Time spent T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:18:24.990435 26636 log.cc:927] Time spent T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:18:25.002532 26613 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.003070 26620 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.003111 26613 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.005967 22393 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:25.007315 26613 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:25.008518 26620 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:25.009605 22516 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:25.018523 26382 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:24.989701 26637 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:25.020473 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:24.977645 26387 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:18:25.022269 26619 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:25.023820 26613 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:25.024649 25996 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:25.025133 25996 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:25.015899 26571 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:25.016559 26342 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:25.031105 26556 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:18:25.033535 26616 log.cc:927] Time spent T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.876s	user 0.004s	sys 0.000s
I20260709 12:18:25.034197 22516 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:25.035111 26556 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:25.035797 26556 raft_consensus.cc:697] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:25.030028 22394 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
I20260709 12:18:25.035862 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:25.022341 26565 raft_consensus.cc:3055] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:25.037503 26565 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:25.037699 22542 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 13: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:24.985426 26650 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:25.035358 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:25.036867 26556 consensus_queue.cc:237] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.038893 22548 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:18:25.038897 26567 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:25.041131 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:25.037150 22550 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
I20260709 12:18:25.043113 26619 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:25.044497 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:25.045123 22400 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 6.
I20260709 12:18:25.044523 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:25.046586 26561 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10.
I20260709 12:18:25.048939 26627 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:25.055866 26603 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:25.062126 22442 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:25.063496 22442 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:25.064432 26430 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:25.013417 26640 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:25.070621 26430 raft_consensus.cc:697] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:25.067245 26561 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:25.075595 26635 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.076248 26283 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.038408 26565 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:25.077931 26618 log.cc:927] Time spent T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.941s	user 0.002s	sys 0.001s
W20260709 12:18:25.088347 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 125310us
W20260709 12:18:25.091913 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 57774.8us
I20260709 12:18:25.093149 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:25.094512 26554 ts_tablet_manager.cc:1916] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:25.102574 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:25.102794 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:25.103214 22442 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:25.104316 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:25.108640 22548 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:18:25.106781 22442 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:25.116426 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:25.117132 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:25.116633 23122 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:25.119819 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:25.122315 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:25.123195 22544 raft_consensus.cc:2410] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:25.123559 23127 raft_consensus.cc:2368] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14.
I20260709 12:18:25.126458 26635 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:25.093473 26331 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.128028 22367 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:25.128571 26620 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.103644 26626 consensus_queue.cc:1059] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:18:25.114641 26561 raft_consensus.cc:697] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:25.129155 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:25.129550 26621 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:25.131469 26621 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:25.131881 26621 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:25.132223 26621 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:25.134308 22366 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:25.136301 26568 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:25.136818 26568 raft_consensus.cc:697] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:25.137696 26568 consensus_queue.cc:237] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.140609 26561 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.141386 22367 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:25.142238 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:25.142736 22545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 2331) took 1471 ms. Trace:
I20260709 12:18:25.136818 22366 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:25.135277 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:25.143083 22545 rpcz_store.cc:276] 0709 12:18:23.671446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.675980 (+  4534us) service_pool.cc:224] Handling call
0709 12:18:25.142499 (+1466519us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b54001ead54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:25.142657 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2071463680}
I20260709 12:18:25.150251 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:25.067601 26637 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:25.129038 26570 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:25.159845 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:25.160197 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:25.159396 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:25.165215 22471 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:25.121456 26578 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:25.163264 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:25.167659 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:25.168563 22474 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:25.159741 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:25.170692 22475 raft_consensus.cc:2368] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12.
I20260709 12:18:25.156272 26557 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:25.159471 26567 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.157708 26387 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:25.182314 26654 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:25.183060 26654 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.163693 26552 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:25.164005 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:25.128481 26331 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:25.162822 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 205124us
W20260709 12:18:25.191361 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.129057 26620 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.162953 26447 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:25.194212 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:25.198283 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1982) took 1084 ms. Trace:
I20260709 12:18:25.194554 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:25.197978 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:25.197486 22475 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:25.198714 22396 rpcz_store.cc:276] 0709 12:18:24.106181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.115646 (+  9465us) service_pool.cc:224] Handling call
0709 12:18:25.189835 (+1074189us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b540006e854. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:25.189999 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24239360}
I20260709 12:18:25.174870 26557 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.221611 23094 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:25.218266 22471 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:25.222186 23122 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:18:25.224691 22441 leader_election.cc:400] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14.
I20260709 12:18:25.176086 26578 raft_consensus.cc:697] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:25.229619 22441 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:25.188017 26552 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.188423 26472 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:25.203533 22288 maintenance_manager.cc:419] P fd30aaad5b9140cf904466d9eb78783a: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033359
I20260709 12:18:25.196048 26387 raft_consensus.cc:697] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 14 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:25.166502 26430 consensus_queue.cc:237] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.284173 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:25.301020 26633 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.301462 26603 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.219688 26447 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:25.302857 26589 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:25.230808 26557 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:25.304116 26637 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:25.306453 26387 consensus_queue.cc:237] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:25.215984 26600 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:25.308198 26640 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:25.309162 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:25.188124 26567 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.281406 26248 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:25.320536 26472 raft_consensus.cc:697] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:18:25.333915 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 197140us
I20260709 12:18:25.336532 22474 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:25.282451 26552 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:25.364969 22476 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:25.383596 22471 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:25.315029 26654 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:25.404295 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 174764us
I20260709 12:18:25.382678 26613 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.389432 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:25.285020 26382 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:25.395309 22366 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:25.407783 22469 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:25.391057 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.409346 22441 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:25.409533 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 266484us
I20260709 12:18:25.419840 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:25.366775 26603 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.392215 26600 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.408681 26248 raft_consensus.cc:697] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 11 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:25.444828 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:25.393049 25996 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:25.411299 26283 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:25.459013 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:25.448812 23122 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:25.439505 22366 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:25.365643 26633 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.447810 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2341) took 1267 ms. Trace:
I20260709 12:18:25.454793 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:25.455724 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:25.457811 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:25.466069 22547 rpcz_store.cc:276] 0709 12:18:24.169631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.394338 (+224707us) service_pool.cc:224] Handling call
0709 12:18:24.394700 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.563790 (+169090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:24.563822 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:24.563865 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:24.563903 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.436335 (+872432us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b5400179154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:25.436387 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.436517 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388375936}
I20260709 12:18:25.413918 26613 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.446897 26579 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:25.448050 26589 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:25.469405 22473 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:25.469575 22468 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:25.449106 26562 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:25.497996 26662 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:18:25.500679 26663 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.421037 26382 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.510311 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:18:25.523281 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 67630.7us
I20260709 12:18:25.535724 22516 leader_election.cc:400] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12.
I20260709 12:18:25.536073 22516 leader_election.cc:403] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:25.474072 26608 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:25.410894 26578 consensus_queue.cc:237] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.539188 23122 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:25.541462 22516 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:25.529585 26591 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.515146 26619 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:25.555092 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:25.465201 26664 consensus_queue.cc:1059] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 12:18:25.528702 26650 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:25.555855 26591 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.551808 26562 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:25.562628 26248 consensus_queue.cc:237] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:25.543146 25905 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:18:25.566794 26342 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:25.541934 26663 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.534507 26555 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:25.535823 26611 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.573366 22473 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:25.473806 26472 consensus_queue.cc:237] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.523289 26579 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.583950 22468 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:18:25.569499 26382 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:25.594154 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:25.594980 22473 raft_consensus.cc:2393] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 12: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:18:25.597905 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:25.611630 26556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.015s	sys 0.039s
I20260709 12:18:25.587422 26564 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:25.597597 25931 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:25.597075 26283 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.628087 25931 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.628850 25931 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:25.583961 26562 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:25.628844 26556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.015s	sys 0.039s
I20260709 12:18:25.568890 26619 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:25.623157 26567 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:25.651800 26661 log.cc:927] Time spent T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 12:18:25.653239 26670 log.cc:927] Time spent T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:18:25.654249 26676 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12.
W20260709 12:18:25.655551 26668 log.cc:927] Time spent T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 12:18:25.656805 26669 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
W20260709 12:18:25.657757 26657 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:18:25.581943 26650 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:25.661167 22469 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:25.663798 25931 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:25.662882 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 107883us
I20260709 12:18:25.600382 26611 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.641708 26531 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:18:25.651188 26621 consensus_meta.cc:287] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.001s
I20260709 12:18:25.633529 26283 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.627909 26564 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.704571 25931 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:25.705902 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:25.708902 26556 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:25.709306 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:25.709446 26556 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.710054 26556 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:25.661022 26603 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:25.718940 26671 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:25.723261 22471 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 7.
I20260709 12:18:25.726675 25931 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:25.705992 26613 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:25.720108 26676 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:25.755836 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:25.757149 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:25.757725 26600 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:25.761983 26676 raft_consensus.cc:697] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:25.762416 26557 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.763020 26676 consensus_queue.cc:237] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.716495 26531 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:25.734375 26591 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:25.737300 26674 log.cc:927] Time spent T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:18:25.738564 26562 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:25.731405 25931 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:25.707556 26621 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.747174 26579 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:25.747589 26633 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:25.758421 26619 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:25.768249 26611 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:25.775316 26557 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:25.796654 25931 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:25.797086 22543 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:18:25.775691 26552 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.798681 26531 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:25.799257 26552 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:25.779978 26556 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.801812 26621 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:25.782586 26663 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:25.790513 26613 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:25.802847 26613 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.803695 26556 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:25.804898 26613 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:25.799754 22475 raft_consensus.cc:2393] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:25.799393 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43060 (request call id 380) took 1656 ms. Trace:
I20260709 12:18:25.807945 22472 rpcz_store.cc:276] 0709 12:18:24.143205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.268414 (+125209us) service_pool.cc:224] Handling call
0709 12:18:24.308940 (+ 40526us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:24.436414 (+127474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:24.436443 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:25.385723 (+949280us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b2c00001368. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f744da11 00007fb4f745d372 00007fb4f8b8fa01 00007fb4f8b5443a 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2
0709 12:18:25.400719 (+ 14996us) log.cc:844] Serialized 52 byte log entry
0709 12:18:25.470707 (+ 69988us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:25.524504 (+ 53797us) log.cc:844] Serialized 14 byte log entry
0709 12:18:25.526437 (+  1933us) log.cc:844] Serialized 14 byte log entry
0709 12:18:25.526764 (+   327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.526958 (+   194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:25.799168 (+272210us) raft_consensus.cc:1685] finished
0709 12:18:25.799190 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.799315 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34706,"prepare.queue_time_us":41259,"prepare.run_wall_time_us":7306,"raft.queue_time_us":44802,"raft.run_cpu_time_us":482,"raft.run_wall_time_us":35974,"spinlock_wait_cycles":15485184,"thread_start_us":156237,"threads_started":2,"wal-append.queue_time_us":144218}
I20260709 12:18:25.810604 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:25.811203 22472 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:25.781908 26554 ts_tablet_manager.cc:1929] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.7
I20260709 12:18:25.815927 26554 log.cc:1199] T 0723691b01e2413baf71cbc73a551fdc P 25ebf14868c042dca42f54b3e251e1b2: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-1-root/wals/0723691b01e2413baf71cbc73a551fdc
I20260709 12:18:25.819512 26554 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51846 (request call id 0) took 2725 ms. Trace:
I20260709 12:18:25.820039 26554 rpcz_store.cc:276] 0709 12:18:23.094178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.098004 (+  3826us) service_pool.cc:224] Handling call
0709 12:18:23.247530 (+149526us) ts_tablet_manager.cc:1151] Deleting tablet 0723691b01e2413baf71cbc73a551fdc
0709 12:18:23.258369 (+ 10839us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:18:25.582383 (+2324014us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:25.781739 (+199356us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:25.819403 (+ 37664us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1115337,"tablet-delete.queue_time_us":127807,"thread_start_us":75436,"threads_started":1}
I20260709 12:18:25.821892 26556 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:25.822471 26556 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:25.824640 26556 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:25.825887 26552 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:25.826563 26552 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.828740 26552 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:25.844193 25996 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:25.592837 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:25.879979 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:25.882447 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:25.883459 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:25.883689 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:25.884243 22396 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:25.888029 26565 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:25.891119 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:25.891803 22468 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:25.892683 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:25.893373 22468 raft_consensus.cc:2393] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 12: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:25.897472 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:25.900315 22474 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:25.899708 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:25.902266 22468 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 11: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:25.903362 22468 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:25.904767 26613 consensus_queue.cc:1059] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:25.898337 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:25.906957 22468 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:25.909039 22468 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:18:25.914572 22441 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:25.963063 26689 log.cc:927] Time spent T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:18:25.963402 26552 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:25.977800 26552 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.905884 26613 raft_consensus.cc:3055] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:18:25.966995 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 52528.3us
I20260709 12:18:25.968067 22396 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:25.980558 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:25.981201 22396 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:25.982051 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:25.968879 22468 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 12:18:25.982596 22396 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:25.972743 23130 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:25.975009 26683 consensus_queue.cc:1059] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:18:25.977138 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 55724.5us
I20260709 12:18:25.969969 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:25.967556 26633 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:25.974073 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.989568 22472 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:25.990845 22468 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:18:25.991005 22396 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:26.001919 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:26.003224 22396 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:26.021709 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:25.992072 22474 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:25.995559 25931 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:25.996698 26578 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.022527 25931 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:25.985715 26613 raft_consensus.cc:740] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:26.000871 26552 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:26.023034 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:26.024048 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:26.024183 22474 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:26.011339 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:26.010509 22396 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:26.019258 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:26.019544 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:26.020087 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:26.021421 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:26.051050 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:26.054383 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:26.059304 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:26.059360 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:26.061220 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:26.062897 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:26.063647 22396 raft_consensus.cc:2393] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:26.064643 22474 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15. Ops: [13.7-14.8]
I20260709 12:18:25.995401 26430 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:26.079794 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:26.097023 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:26.076905 22474 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:26.066640 22477 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:18:26.101003 22549 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 11: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:26.066154 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:26.066901 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:26.066339 25931 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:26.065943 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:26.066471 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:26.102648 22550 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:26.100035 22396 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:26.103955 22548 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:26.005712 26283 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:26.105650 22551 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:26.011188 26455 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:26.011354 26620 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:26.011528 26591 consensus_queue.cc:1059] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:18:26.106690 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:26.028493 26564 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:26.108392 25931 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:26.109637 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:26.110236 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:26.110834 22470 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:26.121728 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:26.066989 26676 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:26.019713 26579 consensus_queue.cc:1059] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 12:18:26.114248 26455 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.115056 22547 raft_consensus.cc:3055] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:26.116353 26673 consensus_queue.cc:1059] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:26.101301 26552 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.105635 26683 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:26.128227 26552 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.130987 26552 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:26.127840 22547 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:26.132407 22547 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.029037 26619 consensus_queue.cc:1059] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:18:26.120411 22550 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:26.051823 26578 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:26.137207 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:26.105479 26430 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.126513 26382 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:26.143260 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:26.144860 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:26.155104 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:26.159586 22441 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:26.160185 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:26.157704 22470 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:26.136435 26680 consensus_queue.cc:1059] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:18:26.164788 22441 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:26.166173 22441 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:26.168823 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:26.170444 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:26.171285 22546 raft_consensus.cc:2410] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:18:26.172454 22441 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:26.175868 22550 raft_consensus.cc:2410] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:26.162375 26283 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:26.190465 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:26.184155 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:26.147882 26382 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.275188 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:26.183717 26633 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:26.276088 22470 raft_consensus.cc:1275] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:26.171802 26565 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:26.182081 26332 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:26.285939 25931 raft_consensus.cc:697] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:26.287765 22470 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:26.187659 26671 consensus_queue.cc:1059] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
W20260709 12:18:26.284780 26668 log.cc:927] Time spent T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.100s	user 0.000s	sys 0.008s
I20260709 12:18:26.291152 25931 consensus_queue.cc:237] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.278045 26685 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.283757 26633 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:26.287233 26677 log.cc:927] Time spent T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:18:26.295109 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:26.288996 26565 raft_consensus.cc:697] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:18:26.302650 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 142521us
I20260709 12:18:26.303718 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:26.298210 26633 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:26.294426 26671 consensus_queue.cc:1243] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:26.307196 22516 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:26.292979 26578 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:26.300746 26591 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:26.298408 26685 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.306792 26619 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:26.319480 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:26.313728 26620 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:26.324429 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:26.318657 26591 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.326395 26591 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:26.322291 26694 log.cc:927] Time spent T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:18:26.317237 26702 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:26.318289 26430 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:26.330986 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:26.332151 22396 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:26.323956 26697 raft_consensus.cc:3055] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:26.321813 26700 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:26.332139 26591 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:26.321985 26565 consensus_queue.cc:237] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.343677 26382 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:26.342149 26702 raft_consensus.cc:697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:26.319741 26619 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.346807 26701 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:26.347373 26706 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:26.344165 26704 consensus_queue.cc:1059] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:18:26.332612 26703 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:26.334424 26697 raft_consensus.cc:740] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:26.327581 26620 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.356791 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:26.343444 26591 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.361064 22396 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:26.364908 22475 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:26.363526 26591 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:26.369416 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:26.370285 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.371847 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:26.372490 22474 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:26.361114 26676 raft_consensus.cc:697] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:26.380923 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:26.381212 22475 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:18:26.383544 26447 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:26.385046 25931 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:26.385471 25931 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:26.385918 25931 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:26.387041 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:26.363198 26704 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:18:26.363615 26701 consensus_queue.cc:1059] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:18:26.398309 22396 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:26.411393 25931 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.380317 26604 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:26.380564 26382 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:26.415652 25931 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:26.396420 26685 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:26.416615 26709 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:26.377132 26702 consensus_queue.cc:237] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.417562 22516 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:26.425911 26382 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:26.397972 26430 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:26.452518 25931 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:26.438238 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:26.455883 25931 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:26.456275 25931 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:26.456336 22396 raft_consensus.cc:2410] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:18:26.415712 26283 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:26.414405 26697 consensus_queue.cc:260] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.461112 26697 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:26.463646 22399 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:18:26.419588 26456 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:26.464644 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:26.465211 22399 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:26.468909 26591 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.474898 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:26.451364 26705 consensus_queue.cc:1059] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:18:26.478278 26620 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:26.430648 26619 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:26.457070 26701 consensus_queue.cc:1059] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 12:18:26.482291 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 65999.7us
I20260709 12:18:26.483302 22442 leader_election.cc:400] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 12. Current term is 13.
I20260709 12:18:26.483556 22442 leader_election.cc:403] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:26.479337 22396 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:26.484963 22399 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:26.484802 25931 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.485211 22442 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:26.487645 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:26.465317 26430 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.488312 22399 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:26.478677 26456 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:26.490307 26430 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:26.490715 26650 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:26.490934 26430 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 12. Current term is 13.
I20260709 12:18:26.491935 26430 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:26.492413 26430 raft_consensus.cc:697] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:26.492980 26248 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.493947 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:26.493496 26248 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:26.495172 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:26.495594 26455 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:26.493430 26430 consensus_queue.cc:237] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.496307 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:26.497512 22399 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:26.497594 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:26.498193 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:26.498677 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:26.498386 22396 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 12: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:26.499178 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:26.499773 23130 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:26.501579 25931 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:26.503197 22441 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:18:26.420028 26604 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:26.506579 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:26.507505 22396 raft_consensus.cc:2393] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 7: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:26.470077 26283 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.501137 26387 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.509096 26387 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:26.509797 26591 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:26.510349 26283 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:26.511098 26455 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:26.490238 26456 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:26.484843 26685 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:26.513393 26685 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:26.515467 26685 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:26.419708 26676 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:26.511584 26455 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.522297 26455 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:26.525826 26565 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:26.526580 26565 raft_consensus.cc:697] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:26.527612 26565 consensus_queue.cc:237] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:26.530261 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:26.508371 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:26.531867 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 46765.6us
I20260709 12:18:26.533875 22442 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:26.534732 22442 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:26.535624 22442 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:26.538313 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:26.496392 26248 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:26.504324 26650 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.511201 26387 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:26.540170 26283 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:26.544756 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:26.526017 26604 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:26.555886 26710 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:26.545931 22442 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:27.440236 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 896152us
I20260709 12:18:26.545861 26705 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:27.442078 26705 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.444308 26705 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:27.444841 26561 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:26.546720 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:26.541936 26704 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:26.582202 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:27.447333 22402 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1855) took 1548 ms (client timeout 1961 ms). Trace:
W20260709 12:18:27.447679 22402 rpcz_store.cc:269] 0709 12:18:25.898475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.577666 (+679191us) service_pool.cc:224] Handling call
0709 12:18:27.447256 (+869590us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.448720 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.449903 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.450959 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.452065 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:26.569831 26283 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.455606 26283 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:26.556574 25931 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:26.554407 26633 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:26.545866 26650 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:27.478204 26633 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:27.478820 26650 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:26.649472 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:26.589727 26683 raft_consensus.cc:697] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:26.683452 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 2273) took 1461 ms. Trace:
I20260709 12:18:26.651826 26375 raft_consensus.cc:3055] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:18:26.696424 22469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 1973) took 1544 ms (client timeout 1651 ms). Trace:
I20260709 12:18:26.770038 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:26.843922 26685 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:26.891366 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:26.856725 26716 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.030628 26707 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:27.031179 26709 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:27.068733 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:27.479898 26375 raft_consensus.cc:740] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:27.481104 22400 raft_consensus.cc:2393] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:27.480851 26707 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.133296 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.155886 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:27.198120 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:27.480116 22469 rpcz_store.cc:269] 0709 12:18:25.151802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.152829 (+  1027us) service_pool.cc:224] Handling call
0709 12:18:26.696180 (+1543351us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b5400210554. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:26.696350 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":547611392}
I20260709 12:18:27.481382 26375 consensus_queue.cc:260] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:27.481935 26709 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:27.482760 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:27.482934 26375 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:27.483338 22469 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:27.484074 26709 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:27.199301 26696 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.871s	user 0.006s	sys 0.003s
I20260709 12:18:27.207708 26387 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:27.484606 22398 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
W20260709 12:18:27.481562 22400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 2018) took 1601 ms (client timeout 1791 ms). Trace:
I20260709 12:18:27.214049 26720 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:27.223060 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:27.227371 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:27.238620 26565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.014s	sys 0.009s
W20260709 12:18:27.485607 26565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.015s	sys 0.010s
W20260709 12:18:27.250517 26430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.000s	sys 0.012s
I20260709 12:18:27.255401 26604 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.270054 22515 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:27.485651 22396 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 7.
I20260709 12:18:27.479785 22476 rpcz_store.cc:276] 0709 12:18:25.222003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.012924 (+790921us) service_pool.cc:224] Handling call
0709 12:18:26.013328 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:26.151714 (+138386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:26.151744 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:26.151788 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:26.151830 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.683166 (+531336us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b5400160154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:26.683220 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:26.683380 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317805824}
W20260709 12:18:27.487183 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 217228us
I20260709 12:18:27.281044 26699 raft_consensus.cc:3055] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:27.485357 26716 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.288784 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:27.289587 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:27.225162 22285 catalog_manager.cc:5028] TS 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): tablet 0723691b01e2413baf71cbc73a551fdc (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
W20260709 12:18:27.487500 26430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.000s	sys 0.012s
I20260709 12:18:27.298202 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2017) took 1418 ms. Trace:
I20260709 12:18:27.489049 26699 raft_consensus.cc:740] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:27.487828 26676 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:27.320760 22367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.776s	user 0.025s	sys 0.034s
W20260709 12:18:27.324676 26687 log.cc:927] Time spent T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 1.280s	user 0.005s	sys 0.006s
I20260709 12:18:27.333038 26556 raft_consensus.cc:3055] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:27.342378 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.351774 26613 consensus_queue.cc:260] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:27.359356 22477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 1970) took 2210 ms (client timeout 2032 ms). Trace:
I20260709 12:18:27.361179 26620 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:27.364962 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 2280) took 2141 ms. Trace:
W20260709 12:18:27.367159 22475 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.010s	sys 0.007s
I20260709 12:18:27.381280 26382 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:27.489300 22395 rpcz_store.cc:276] 0709 12:18:25.880167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.297211 (+1417044us) service_pool.cc:224] Handling call
0709 12:18:27.297594 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.297809 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.297838 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:27.297882 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:27.297914 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.297966 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.298129 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.403422 22547 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:27.491451 26613 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:27.485291 22401 raft_consensus.cc:2393] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:27.492198 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 2014) took 1612 ms. Trace:
I20260709 12:18:27.416208 26672 raft_consensus.cc:3055] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:27.490224 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 2016) took 1610 ms. Trace:
I20260709 12:18:27.492926 26672 raft_consensus.cc:740] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:26.583618 26248 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.540285 26456 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:27.492427 26707 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:27.452662 22402 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:27.493045 22398 rpcz_store.cc:276] 0709 12:18:25.879900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.197828 (+1317928us) service_pool.cc:224] Handling call
0709 12:18:27.490157 (+292329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.494966 26456 raft_consensus.cc:697] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:27.495911 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.493997 26672 consensus_queue.cc:260] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.496361 22397 raft_consensus.cc:2410] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:27.495391 22402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 2023) took 1104 ms. Trace:
I20260709 12:18:27.459709 26706 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:27.489744 26716 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:27.490815 22477 rpcz_store.cc:269] 0709 12:18:25.149269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.149909 (+   640us) service_pool.cc:224] Handling call
0709 12:18:27.359133 (+2209224us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b54002008d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:27.359256 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2105786112}
I20260709 12:18:27.496984 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.500871 22398 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:27.501050 22477 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:27.501314 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 2021) took 1115 ms. Trace:
I20260709 12:18:27.492499 22401 rpcz_store.cc:276] 0709 12:18:25.879385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.890988 (+1011603us) service_pool.cc:224] Handling call
0709 12:18:27.492142 (+601154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.497699 26706 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:27.502465 22285 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 277437us
I20260709 12:18:27.438443 26637 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:27.473151 26572 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.479008 22472 raft_consensus.cc:2368] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13.
I20260709 12:18:27.495931 26620 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:27.503666 26456 consensus_queue.cc:237] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:27.504108 26706 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:27.501684 22398 rpcz_store.cc:276] 0709 12:18:26.386118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.496778 (+1110660us) service_pool.cc:224] Handling call
0709 12:18:27.501257 (+  4479us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.505223 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 2010) took 1049 ms. Trace:
W20260709 12:18:27.021689 22516 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.651s (SENT) [suppressed 13 similar messages]
W20260709 12:18:27.491034 22367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.946s	user 0.025s	sys 0.034s
I20260709 12:18:27.505534 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:27.458178 22399 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
W20260709 12:18:27.270922 26455 consensus_meta.cc:287] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.748s	user 0.013s	sys 0.005s
W20260709 12:18:27.485059 22400 rpcz_store.cc:269] 0709 12:18:25.880418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.068378 (+1187960us) service_pool.cc:224] Handling call
0709 12:18:27.481501 (+413123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.506827 26455 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:27.507246 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.507651 22400 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:18:27.508263 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1859) took 1608 ms. Trace:
I20260709 12:18:27.508553 22400 rpcz_store.cc:276] 0709 12:18:25.899599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.507129 (+1607530us) service_pool.cc:224] Handling call
0709 12:18:27.507441 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:27.508033 (+   592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.508212 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.508971 26455 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:27.208434 26713 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:27.488654 23130 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:27.307982 22551 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:18:27.509939 22473 raft_consensus.cc:2393] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:27.502962 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.505857 26572 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.511216 22401 raft_consensus.cc:2410] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:18:27.511315 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49290 (request call id 503) took 1356 ms. Trace:
I20260709 12:18:27.511667 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 2033) took 1007 ms. Trace:
I20260709 12:18:27.511694 22551 rpcz_store.cc:276] 0709 12:18:26.155200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.200069 (+ 44869us) service_pool.cc:224] Handling call
0709 12:18:26.200429 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:27.509943 (+1309514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.511088 (+  1145us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540031c4d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:27.511259 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2546379520}
W20260709 12:18:27.303331 26673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.145s	user 0.014s	sys 0.004s
I20260709 12:18:27.497013 22402 rpcz_store.cc:276] 0709 12:18:26.390875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.451854 (+1060979us) service_pool.cc:224] Handling call
0709 12:18:27.495324 (+ 43470us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:27.513484 26673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.362s	user 0.015s	sys 0.004s
I20260709 12:18:27.509692 26713 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:27.495357 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.515933 22395 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:18:27.516183 26673 consensus_queue.cc:1243] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:27.516500 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1864) took 1615 ms. Trace:
I20260709 12:18:27.516857 22395 rpcz_store.cc:276] 0709 12:18:25.901417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.515417 (+1614000us) service_pool.cc:224] Handling call
0709 12:18:27.515726 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:27.516284 (+   558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.516450 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.508849 22398 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:27.517971 26637 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:27.520421 26698 raft_consensus.cc:3055] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:27.520684 26375 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:27.487742 26720 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:27.521205 26375 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:27.490083 26556 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:27.501742 26672 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:27.522912 26556 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.524031 26556 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:27.497213 22475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.010s	sys 0.008s
I20260709 12:18:27.488092 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 2012) took 1018 ms. Trace:
I20260709 12:18:27.526420 22476 rpcz_store.cc:276] 0709 12:18:26.470034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.487342 (+1017308us) service_pool.cc:224] Handling call
0709 12:18:27.487622 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.487794 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.487820 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:27.487860 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:27.487895 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.487944 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.488041 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.479631 22394 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 11: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:27.485153 22470 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:27.488040 26604 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.508597 22399 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:18:27.522500 22472 rpcz_store.cc:276] 0709 12:18:26.455425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.497954 (+ 42529us) service_pool.cc:224] Handling call
0709 12:18:27.505050 (+1007096us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b54002b2854. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:27.505172 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2252701568}
I20260709 12:18:27.529179 22399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1861) took 1628 ms. Trace:
I20260709 12:18:27.529488 22399 rpcz_store.cc:276] 0709 12:18:25.900414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.508050 (+1607636us) service_pool.cc:224] Handling call
0709 12:18:27.508376 (+   326us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:27.528916 (+ 20540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.529132 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.529894 22472 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:27.487298 22474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "277d262725804effb16ede64e81d19c8"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:27.530772 22474 raft_consensus.cc:606] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:27.531147 22474 raft_consensus.cc:614] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:27.480340 26685 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.532545 22294 catalog_manager.cc:5697] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 6 to 9, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 9 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:27.487360 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.541561 26720 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:27.494059 26248 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:27.486286 23095 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:18:27.436450 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43060 (request call id 384) took 2216 ms. Trace:
I20260709 12:18:27.493695 22515 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:27.512377 26572 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:27.528121 22470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 2011) took 1072 ms. Trace:
I20260709 12:18:27.382272 26579 raft_consensus.cc:3055] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:27.530676 22399 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:27.546295 26579 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:18:27.546193 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 59991.2us
I20260709 12:18:27.547088 22399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1868) took 1644 ms. Trace:
I20260709 12:18:27.544560 26728 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.547847 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:27.547428 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:27.548485 26673 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:27.548897 23130 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:27.545933 22470 rpcz_store.cc:276] 0709 12:18:26.455609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.155565 (+699956us) service_pool.cc:224] Handling call
0709 12:18:27.528064 (+372499us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:27.547245 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 53632.6us
I20260709 12:18:27.545984 26698 raft_consensus.cc:740] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:27.550264 22515 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:27.550779 26604 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:27.551352 26604 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.551849 26604 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:27.553416 26248 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:27.546424 26650 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:27.548167 26579 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.501638 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 2013) took 1027 ms. Trace:
I20260709 12:18:27.542057 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 2026) took 1127 ms. Trace:
I20260709 12:18:27.548230 26728 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.484342 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:27.536408 26430 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:27.555183 23122 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:27.484908 26387 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:27.554877 22396 rpcz_store.cc:276] 0709 12:18:26.415145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.487107 (+1071962us) service_pool.cc:224] Handling call
0709 12:18:27.541980 (+ 54873us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.556859 22396 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:18:27.527911 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 2015) took 1648 ms. Trace:
I20260709 12:18:27.557116 26673 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:18:27.496877 22397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1858) took 1597 ms (client timeout 2082 ms). Trace:
I20260709 12:18:27.557420 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1869) took 1654 ms. Trace:
I20260709 12:18:27.554673 26579 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:27.557344 22394 rpcz_store.cc:276] 0709 12:18:25.879648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.649188 (+769540us) service_pool.cc:224] Handling call
0709 12:18:27.527857 (+878669us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.558352 26698 consensus_queue.cc:260] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:27.557636 22397 rpcz_store.cc:269] 0709 12:18:25.899327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.342073 (+1442746us) service_pool.cc:224] Handling call
0709 12:18:27.496796 (+154723us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.559569 26698 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:27.560144 22397 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:27.560719 22397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1873) took 1572 ms. Trace:
I20260709 12:18:27.515954 26713 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:27.555572 26430 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.534216 26685 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:27.526438 22475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 2009) took 1071 ms. Trace:
I20260709 12:18:27.561831 26455 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:27.505427 26620 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:27.557137 26387 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:27.479975 26683 consensus_queue.cc:237] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.563265 26620 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:27.562282 26685 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.561012 22397 rpcz_store.cc:276] 0709 12:18:25.988408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.559736 (+1571328us) service_pool.cc:224] Handling call
0709 12:18:27.560000 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.560505 (+   505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.560668 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.562407 26455 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.472685 26564 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.490947 26699 consensus_queue.cc:260] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.549837 26722 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:27.563608 22469 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:27.566016 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43060 (request call id 388) took 1058 ms. Trace:
I20260709 12:18:27.553512 23094 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:27.566406 22469 rpcz_store.cc:276] 0709 12:18:26.507894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.484122 (+976228us) service_pool.cc:224] Handling call
0709 12:18:27.565961 (+ 81839us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.567116 26722 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:27.567387 22396 rpcz_store.cc:276] 0709 12:18:25.902784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.556312 (+1653528us) service_pool.cc:224] Handling call
0709 12:18:27.556659 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:27.557198 (+   539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.557370 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.565392 26699 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:27.554265 26650 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.530093 22393 raft_consensus.cc:2393] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 15: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:27.569051 26650 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:27.569832 22393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1856) took 1671 ms (client timeout 2032 ms). Trace:
I20260709 12:18:27.570515 26706 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:27.571069 26706 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.512120 22401 rpcz_store.cc:276] 0709 12:18:26.504045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.502710 (+998665us) service_pool.cc:224] Handling call
0709 12:18:27.511613 (+  8903us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:27.570253 22393 rpcz_store.cc:269] 0709 12:18:25.898773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.769655 (+870882us) service_pool.cc:224] Handling call
0709 12:18:27.569610 (+799955us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b54000375d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:27.569755 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114214272}
I20260709 12:18:27.568661 22396 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:27.558998 22394 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:27.573869 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1876) took 1529 ms. Trace:
I20260709 12:18:27.574259 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1872) took 1588 ms. Trace:
I20260709 12:18:27.574417 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1867) took 1672 ms. Trace:
I20260709 12:18:27.494917 22471 rpcz_store.cc:276] 0709 12:18:25.223370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.018539 (+795169us) service_pool.cc:224] Handling call
0709 12:18:26.018821 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:26.142359 (+123538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:26.142389 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:26.142430 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:26.142461 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.364706 (+1222245us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400211e54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:27.364752 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.364890 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283581312}
I20260709 12:18:27.568522 26673 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.574698 22394 rpcz_store.cc:276] 0709 12:18:25.986135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.558577 (+1572442us) service_pool.cc:224] Handling call
0709 12:18:27.558838 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.574046 (+ 15208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.574211 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.575356 26673 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:27.576153 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2019) took 1190 ms. Trace:
I20260709 12:18:27.563930 26620 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.576480 22394 rpcz_store.cc:276] 0709 12:18:26.385507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.575419 (+1189912us) service_pool.cc:224] Handling call
0709 12:18:27.575696 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.575855 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.575878 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:27.575919 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:27.575964 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.576012 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.576108 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.577356 26455 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:27.578195 26673 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:27.578325 26430 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:27.562661 22468 rpcz_store.cc:276] 0709 12:18:25.220489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.984254 (+763765us) service_pool.cc:224] Handling call
0709 12:18:25.990563 (+  6309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:25.991401 (+   838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.436216 (+1444815us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b54003e2950. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:27.436381 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13538048}
I20260709 12:18:27.573578 22393 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:27.565014 26564 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:27.579427 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1889) took 1209 ms. Trace:
I20260709 12:18:27.579772 22393 rpcz_store.cc:276] 0709 12:18:26.369615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.572872 (+1203257us) service_pool.cc:224] Handling call
0709 12:18:27.573258 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.579196 (+  5938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.579373 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39424}
I20260709 12:18:27.581000 26564 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:27.581262 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2024) took 1187 ms. Trace:
I20260709 12:18:27.581911 22476 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:18:27.573580 22401 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:27.582412 26685 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:27.583323 23127 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:27.583504 26706 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:27.583897 26620 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:27.595265 26685 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:27.596951 22423 debug-util.cc:398] Leaking SignalData structure 0x7b08003dae80 after lost signal to thread 21247
I20260709 12:18:27.562248 22475 rpcz_store.cc:276] 0709 12:18:26.455214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.455375 (+   161us) service_pool.cc:224] Handling call
0709 12:18:26.459709 (+  4334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:26.466338 (+  6629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:26.466359 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:26.474088 (+  7729us) log.cc:844] Serialized 26 byte log entry
0709 12:18:27.526108 (+1052020us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:27.526149 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.526216 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:27.526259 (+    43us) raft_consensus.cc:1685] finished
0709 12:18:27.526269 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.526385 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6287,"raft.queue_time_us":6396,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5329,"thread_start_us":1009104,"threads_started":1,"wal-append.queue_time_us":102324}
W20260709 12:18:27.598038 22423 debug-util.cc:398] Leaking SignalData structure 0x7b08002bf580 after lost signal to thread 22333
W20260709 12:18:27.599368 22423 debug-util.cc:398] Leaking SignalData structure 0x7b0800304ac0 after lost signal to thread 22426
W20260709 12:18:27.600452 22423 debug-util.cc:398] Leaking SignalData structure 0x7b0800133460 after lost signal to thread 22501
W20260709 12:18:27.600714 22423 debug-util.cc:398] Leaking SignalData structure 0x7b08001c6a40 after lost signal to thread 22502
I20260709 12:18:27.584167 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43060 (request call id 387) took 1076 ms. Trace:
W20260709 12:18:27.601722 22423 debug-util.cc:398] Leaking SignalData structure 0x7b08002f5360 after lost signal to thread 22575
W20260709 12:18:27.602180 22423 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5be0 after lost signal to thread 22576
I20260709 12:18:27.601631 22476 rpcz_store.cc:276] 0709 12:18:26.507643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.527424 (+1019781us) service_pool.cc:224] Handling call
0709 12:18:27.527753 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.582357 (+ 54604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.583965 (+  1608us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x7b54002b3754. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:27.584115 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123756416}
I20260709 12:18:27.584797 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2022) took 1198 ms. Trace:
I20260709 12:18:27.581590 22393 rpcz_store.cc:276] 0709 12:18:26.393424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.580548 (+1187124us) service_pool.cc:224] Handling call
0709 12:18:27.580815 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.580979 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.581003 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:27.581043 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:27.581072 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.581123 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.581215 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.574277 22396 rpcz_store.cc:276] 0709 12:18:26.044591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.568200 (+1523609us) service_pool.cc:224] Handling call
0709 12:18:27.568505 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.573595 (+  5090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.573812 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.586377 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1885) took 1539 ms. Trace:
I20260709 12:18:27.603698 22472 raft_consensus.cc:1240] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:27.603266 22423 debug-util.cc:398] Leaking SignalData structure 0x7b080039ce00 after lost signal to thread 23155
I20260709 12:18:27.604343 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.604694 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.605047 22473 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:27.596436 22395 rpcz_store.cc:276] 0709 12:18:25.902247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.517516 (+1615269us) service_pool.cc:224] Handling call
0709 12:18:27.573999 (+ 56483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.574147 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.574170 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:27.574207 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:27.574236 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.574284 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.574372 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.605981 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:27.554611 22477 rpcz_store.cc:276] 0709 12:18:26.473759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.500424 (+1026665us) service_pool.cc:224] Handling call
0709 12:18:27.500751 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.501396 (+   645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.501585 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.538733 26637 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:27.606357 22396 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:18:27.603474 22394 rpcz_store.cc:276] 0709 12:18:26.386364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.577357 (+1190993us) service_pool.cc:224] Handling call
0709 12:18:27.577636 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.583968 (+  6332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.583998 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:27.584035 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:27.584062 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.584604 (+   542us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b540006fc54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:27.584645 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.584747 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14140800}
I20260709 12:18:27.606429 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:27.604086 22401 rpcz_store.cc:276] 0709 12:18:26.046822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.572866 (+1526044us) service_pool.cc:224] Handling call
0709 12:18:27.573258 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.586146 (+ 12888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.586328 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72960}
I20260709 12:18:27.538983 26375 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:27.609529 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2025) took 1211 ms. Trace:
I20260709 12:18:27.592861 22442 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:27.586906 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:27.609663 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:27.610487 23129 raft_consensus.cc:2393] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 13: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:27.590835 22547 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:18:27.605118 22393 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:27.610073 22396 rpcz_store.cc:276] 0709 12:18:26.398449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.605753 (+1207304us) service_pool.cc:224] Handling call
0709 12:18:27.606067 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.607542 (+  1475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.609471 (+  1929us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9472}
W20260709 12:18:27.604354 22423 debug-util.cc:398] Leaking SignalData structure 0x7b08002bbe20 after lost signal to thread 23156
I20260709 12:18:27.612612 22547 pending_rounds.cc:85] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 6
I20260709 12:18:27.612936 22547 pending_rounds.cc:107] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:18:27.613234 22547 raft_consensus.cc:2889] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:27.565393 22397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1874) took 1542 ms. Trace:
I20260709 12:18:27.613798 22397 rpcz_store.cc:276] 0709 12:18:26.022869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.564543 (+1541674us) service_pool.cc:224] Handling call
0709 12:18:27.564826 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.565093 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.565118 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:27.565160 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:27.565198 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.565249 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.565345 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29126,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101}
I20260709 12:18:27.606593 22395 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:18:27.569218 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.617204 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.525498 22398 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:27.610193 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:27.617988 22394 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:18:27.618624 22475 raft_consensus.cc:2393] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 10: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:27.618688 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2028) took 1199 ms. Trace:
I20260709 12:18:27.619241 22394 rpcz_store.cc:276] 0709 12:18:26.419382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.608214 (+1188832us) service_pool.cc:224] Handling call
0709 12:18:27.608520 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.618450 (+  9930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.618629 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.531920 26283 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.626899 22442 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:27.630730 22442 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:27.632921 22442 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:27.627064 23122 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:27.547451 22399 rpcz_store.cc:276] 0709 12:18:25.902546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.530263 (+1627717us) service_pool.cc:224] Handling call
0709 12:18:27.530527 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.546841 (+ 16314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.547033 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.638522 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:27.640197 22397 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:27.649657 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1921) took 1614 ms. Trace:
I20260709 12:18:27.648811 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:27.650072 22547 rpcz_store.cc:276] 0709 12:18:26.036447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.099446 (+ 62999us) service_pool.cc:224] Handling call
0709 12:18:26.109228 (+  9782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.402976 (+1293748us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b58004f70d0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8ab00aa 00007fb4f8b32447 00007fb4f8b4afe7 00007fb4f8b4c7de 00007fb4f8b56b49 00007fb4f8b57416 00007fb4f8b53d8f 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4
0709 12:18:27.649428 (+246452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.649606 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25715968}
I20260709 12:18:27.651679 22468 raft_consensus.cc:2393] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 7: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:27.652443 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2040) took 1119 ms. Trace:
W20260709 12:18:27.648842 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 627170us
I20260709 12:18:27.653812 22401 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:27.653837 22393 rpcz_store.cc:276] 0709 12:18:26.533471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.612144 (+1078673us) service_pool.cc:224] Handling call
0709 12:18:27.649294 (+ 37150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.652142 (+  2848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.652167 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:27.652207 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:27.652237 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.652289 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.652388 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.656819 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:27.656966 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:27.654743 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2036) took 1134 ms. Trace:
I20260709 12:18:27.659433 22547 raft_consensus.cc:1240] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:27.659761 22401 rpcz_store.cc:276] 0709 12:18:26.520428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.609268 (+1088840us) service_pool.cc:224] Handling call
0709 12:18:27.649652 (+ 40384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.654481 (+  4829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.654685 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:27.595671 26728 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:27.645876 26564 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:27.651639 22442 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:27.664798 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:27.664613 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.665750 22395 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:27.645558 26637 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:27.667189 22398 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:27.667270 22543 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:27.650585 26430 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:27.648347 26456 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:27.670367 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.671731 22393 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:27.670186 22468 raft_consensus.cc:1240] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:18:27.672741 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.673350 22545 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:27.673517 22548 raft_consensus.cc:2393] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 10: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:27.674283 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.677064 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:27.679953 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.652227 26579 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:27.651971 26556 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:27.685838 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.686094 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.683678 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.687655 22545 raft_consensus.cc:2410] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:18:27.680634 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.683604 22475 raft_consensus.cc:2393] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:27.684500 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.683648 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.685506 26720 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:18:27.690075 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:27.690557 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.679533 26430 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:27.691325 26430 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:27.693892 26579 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.694955 26283 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:27.679484 26332 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:18:27.696090 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:27.697325 22542 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:27.690828 22472 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 12:18:27.683054 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.670529 22442 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:27.699913 22398 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:27.666689 26564 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:27.701198 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.701361 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.680207 26561 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:27.696583 22458 tablet_service.cc:1558] Processing DeleteTablet for tablet 0723691b01e2413baf71cbc73a551fdc with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:51846
I20260709 12:18:27.702785 22399 raft_consensus.cc:1275] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:27.706533 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.696036 26579 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:27.718149 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1862) took 1817 ms. Trace:
I20260709 12:18:27.683409 26673 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.708976 22470 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:18:27.709650 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.725010 22398 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:27.706126 26564 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:27.704167 22294 catalog_manager.cc:5697] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 8 to 11, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 11 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:27.712029 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.707937 26283 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:27.713271 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.686137 26248 consensus_queue.cc:1059] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:18:27.714020 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:27.714128 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:27.714567 26604 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:27.714804 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:27.706869 26561 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.679916 26633 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:18:27.715461 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:27.699479 26556 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.683908 26613 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.719919 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:27.708786 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.720710 22471 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:27.722756 22472 raft_consensus.cc:1275] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:27.753615 22550 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:27.737869 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:27.755187 22297 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50166 (request call id 208) took 36169 ms (client timeout 15000 ms). Trace:
I20260709 12:18:27.727967 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:27.718544 22400 rpcz_store.cc:276] 0709 12:18:25.900744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.509454 (+1608710us) service_pool.cc:224] Handling call
0709 12:18:27.509710 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.509911 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:27.595900 (+ 85989us) log.cc:844] Serialized 14 byte log entry
0709 12:18:27.717827 (+121927us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:27.717878 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:27.717920 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.717993 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.718097 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17279,"prepare.queue_time_us":85221,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":189935,"threads_started":2}
I20260709 12:18:27.732647 22470 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:27.740293 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:27.757021 22469 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:27.757992 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:27.758657 22542 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:27.758605 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:27.759536 22476 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:27.741021 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:27.761191 22473 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:18:27.741717 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:27.762253 22475 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:27.742452 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:27.763180 22474 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:18:27.744554 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:27.745360 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.747661 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.749451 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.750551 22442 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:27.753590 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:27.761591 22468 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:27.754500 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.767089 22549 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:27.727619 26728 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.752887 26561 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:27.778333 22402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1863) took 1877 ms. Trace:
I20260709 12:18:27.751125 26685 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.798722 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.798837 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:27.754706 26283 raft_consensus.cc:697] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:27.736909 26332 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:18:27.797875 22402 rpcz_store.cc:276] 0709 12:18:25.900995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.513228 (+1612233us) service_pool.cc:224] Handling call
0709 12:18:27.513493 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.513687 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:27.681169 (+167482us) log.cc:844] Serialized 14 byte log entry
0709 12:18:27.777572 (+ 96403us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:27.777621 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:27.777660 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.778189 (+   529us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.778286 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":369,"prepare.queue_time_us":81644,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":262887,"threads_started":2}
I20260709 12:18:27.769145 26248 consensus_queue.cc:1243] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:27.737330 26673 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:27.789075 26572 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:27.786204 26578 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.860426 22547 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:18:27.884110 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.884485 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.885074 22547 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
W20260709 12:18:27.755600 22297 rpcz_store.cc:269] 0709 12:17:51.620761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.621847 (+  1086us) service_pool.cc:224] Handling call
0709 12:17:52.148269 (+526422us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b5400030890. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a300b2 00007fb4fe9a9759 00007fb4fe941a76 00007fb4fe912d58 00007fb4fea1104e 00007fb4fced22a4 00007fb4fced2232 00007fb4fced2161 00007fb4fced20dc
0709 12:17:52.222208 (+ 73939us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b540038b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abe090 00007fb4f8b5cf3a 00007fb4fe912e9c 00007fb4fea1104e 00007fb4fced22a4 00007fb4fced2232 00007fb4fced2161 00007fb4fced20dc 00007fb4fced1392 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:27.747302 (+35525094us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:23.436397 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:23.530283 (+ 93886us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:23.530342 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:18:23.530362 (+    20us) tablet.cc:662] Decoding operations
0709 12:18:23.531299 (+   937us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:23.531374 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:23.531396 (+    22us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:18:23.532028 (+   632us) tablet.cc:701] Row locks acquired
0709 12:18:23.532084 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:18:23.532300 (+   216us) write_op.cc:270] Start()
0709 12:18:23.532455 (+   155us) write_op.cc:276] Timestamp: P: 1783599503532211 usec, L: 0
0709 12:18:23.532476 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:18:23.595471 (+ 62995us) log.cc:844] Serialized 2464 byte log entry
0709 12:18:24.912365 (+1316894us) op_driver.cc:464] REPLICATION: finished
0709 12:18:25.061238 (+148873us) write_op.cc:301] APPLY: starting
0709 12:18:25.061344 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:25.061527 (+   183us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:25.061650 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:25.080270 (+ 18620us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:25.080591 (+   321us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:18:25.080636 (+    45us) write_op.cc:312] APPLY: finished
0709 12:18:25.081008 (+   372us) log.cc:844] Serialized 53 byte log entry
0709 12:18:25.081202 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:25.081325 (+   123us) write_op.cc:454] Released schema lock
0709 12:18:25.081387 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:25.081869 (+   482us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:25.081900 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":295,"reported_tablets":53,"spinlock_wait_cycles":144903168,"child_traces":[["op",{"apply.queue_time_us":142110,"apply.run_cpu_time_us":6007,"apply.run_wall_time_us":20559,"num_ops":6,"prepare.queue_time_us":112529,"prepare.run_cpu_time_us":5606,"prepare.run_wall_time_us":266504,"raft.queue_time_us":270112,"raft.run_cpu_time_us":19883,"raft.run_wall_time_us":138579,"replication_time_us":1332050,"thread_start_us":219774,"threads_started":4,"wal-append.queue_time_us":165237,"wal-append.run_cpu_time_us":38068,"wal-append.run_wall_time_us":2317180}]]}
I20260709 12:18:27.871588 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:27.886657 22472 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:27.784825 26602 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.871838 22542 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:27.784314 26637 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:27.888057 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:27.888960 22542 raft_consensus.cc:2410] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:27.889999 22477 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:27.891225 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.872978 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.892995 22543 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:27.876698 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.877324 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.894353 22398 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:27.786553 26387 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 12:18:27.856433 22546 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:27.857599 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:27.882077 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 91564.8us
I20260709 12:18:27.878280 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:27.886053 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.902271 22548 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:27.884737 22550 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:27.906458 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.907104 22550 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:18:27.908068 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:27.773473 26455 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:18:27.768679 26613 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.916010 22476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:27.916958 22476 raft_consensus.cc:606] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:27.916976 22544 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 13.
I20260709 12:18:27.915978 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.918583 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.918793 22549 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:18:27.919164 22547 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:27.920778 22550 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:27.924276 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.925197 22545 raft_consensus.cc:2410] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 12:18:27.927757 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.929068 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:27.922855 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:27.789696 26728 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.879523 26572 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:27.938030 22396 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:27.935153 22442 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:27.933260 26709 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.913805 26578 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.939841 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:27.940055 26579 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:27.940836 22400 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:27.888090 22294 catalog_manager.cc:5697] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 7 to 10, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 10 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:27.944702 22516 leader_election.cc:400] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13.
I20260709 12:18:27.916472 26672 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:27.960335 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.948175 22547 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:27.961588 22516 leader_election.cc:403] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:18:27.873695 26685 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.957473 26456 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:18:27.966003 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.973456 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.964994 22294 catalog_manager.cc:5697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 5 to 11, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 11 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:27.967706 26672 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.968375 26685 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:27.969528 26728 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:27.969987 26283 consensus_queue.cc:237] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:27.925587 26637 raft_consensus.cc:697] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:27.932984 26716 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:27.974320 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.953354 26572 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:27.972471 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:27.776168 26733 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 12:18:27.879854 26713 consensus_queue.cc:1059] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:18:27.914731 26602 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:27.980388 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 198693us
I20260709 12:18:27.786686 26724 consensus_queue.cc:1059] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 12:18:27.922925 26735 consensus_queue.cc:1059] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:18:27.963407 26709 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.001642 22543 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:27.973136 26456 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.974741 26683 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13.
I20260709 12:18:27.965976 26579 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:28.014158 26736 log.cc:927] Time spent T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:18:28.015626 26602 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:28.016777 22441 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:28.003017 26706 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:27.959235 26620 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:28.019316 22367 connection.cc:256] RPC call timeout handler was delayed by -1.4492665309999211s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 12:18:28.023080 22548 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:18:28.013677 26737 log.cc:927] Time spent T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:18:28.004107 26382 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 12:18:28.021483 22287 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.346s	user 0.041s	sys 0.068s
I20260709 12:18:28.032233 22396 raft_consensus.cc:1240] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:28.003985 26676 consensus_queue.cc:1059] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:18:28.018484 26456 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:28.019896 26724 consensus_queue.cc:1243] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:28.034642 22441 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:28.001870 26716 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:28.037182 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:28.041218 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:28.045447 22441 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:28.060967 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 303581us
I20260709 12:18:28.062197 22366 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:28.062268 22400 raft_consensus.cc:2393] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:18:28.062718 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 127642us
I20260709 12:18:28.028754 26706 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:28.040808 26602 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:28.075070 22398 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:18:28.082000 26750 raft_consensus.cc:2764] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 12:18:28.086900 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.098840 26613 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:28.099447 26613 raft_consensus.cc:3055] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:28.099812 26613 raft_consensus.cc:740] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:28.057971 22285 catalog_manager.cc:5028] TS 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): tablet 0723691b01e2413baf71cbc73a551fdc (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:18:28.065162 26603 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:28.031265 26620 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.064615 26706 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:28.103896 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.061941 26565 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:28.107287 22441 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:28.064960 26733 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:18:28.103276 26739 log.cc:927] Time spent T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 12:18:28.115680 26722 raft_consensus.cc:3055] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:28.115130 26733 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:28.116072 26722 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:28.116916 26722 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:28.117992 26733 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:28.119647 26698 consensus_meta.cc:287] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.560s	user 0.000s	sys 0.010s
I20260709 12:18:28.120767 22549 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:28.121460 26456 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:28.123581 26456 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:28.124517 26604 raft_consensus.cc:3055] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:28.124924 26604 raft_consensus.cc:740] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:28.126355 22294 catalog_manager.cc:5697] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:28.128687 26556 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:28.128114 22294 catalog_manager.cc:5697] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 4 to 10, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 10 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:28.130285 26579 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:28.032027 26637 consensus_queue.cc:237] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:28.112790 22441 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:28.133675 22398 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:28.097565 26673 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:28.138564 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:28.100589 26613 consensus_queue.cc:260] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.115202 26578 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:28.148697 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 181805us
I20260709 12:18:28.150875 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:28.110164 22285 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 67203.8us
I20260709 12:18:28.115684 26672 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:28.153604 22402 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:18:28.064498 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 75596.2us
I20260709 12:18:28.158174 26742 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:28.158938 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 46216.7us
I20260709 12:18:28.183353 22441 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:28.111846 26602 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:18:28.166049 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:28.135999 26747 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:28.188310 22394 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:28.152992 23094 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:28.063963 22366 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:28.184274 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:28.187208 26578 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:28.186005 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:28.189915 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 126016us
I20260709 12:18:28.193842 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:28.192178 22441 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:28.196344 22367 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:28.195356 22399 raft_consensus.cc:2410] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:18:28.200711 22441 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:28.223187 22441 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:28.221971 22366 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:28.191083 26613 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:28.151315 26561 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.232231 22367 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:28.235944 26709 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:28.230542 26672 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.247679 26672 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.248353 26561 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:28.249713 26672 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:28.237463 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:28.230213 22294 catalog_manager.cc:5697] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 4 to 5, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 5 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:28.136433 26604 consensus_queue.cc:260] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.190810 26578 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:28.195421 26248 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:28.192421 26733 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:28.193121 26603 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:28.253058 26698 consensus_queue.cc:1048] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:18:28.244527 22548 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:18:28.188738 26565 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:18:28.246485 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:28.246651 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:28.231860 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:28.251008 22367 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:28.251819 22441 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:28.185175 26456 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:18:28.221738 26742 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:28.254619 22366 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:28.353128 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 98595.7us
I20260709 12:18:28.353861 22366 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:28.247776 26650 consensus_meta.cc:287] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.000s
I20260709 12:18:28.231628 26751 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:28.193250 26430 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.230800 26743 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:28.241426 26685 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:28.266604 22476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "444001888258449e8c4f5fd4ad540389"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:28.274044 26716 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:28.274971 26604 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:28.255770 26759 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:28.278256 26572 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:28.284795 22516 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:28.256719 26283 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:28.365506 26728 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:28.289637 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:18:28.354861 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 103124us
W20260709 12:18:28.354803 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 103875us
W20260709 12:18:28.358312 26564 consensus_meta.cc:287] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.000s
I20260709 12:18:28.390172 26564 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.392263 26564 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:28.358923 22366 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:28.262398 26578 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:28.262271 26248 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:28.393929 26248 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:28.401062 26248 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:28.368253 22442 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:28.401990 26716 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:28.402495 26716 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:28.402871 26716 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:28.258059 26756 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:28.403563 26756 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:28.403968 26756 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:28.404846 26578 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.353410 26556 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:28.410066 26556 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.410514 26556 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:28.411566 26756 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:28.289971 26733 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:28.361275 26735 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:18:28.290796 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.413968 22294 catalog_manager.cc:5697] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 2 to 10. New cstate: current_term: 10 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:28.415885 22294 catalog_manager.cc:5697] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 5 to 9, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 9 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:28.415787 26735 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:28.418777 26735 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:28.419153 26735 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:28.420295 26637 consensus_queue.cc:1059] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:18:28.420849 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.421937 26756 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:28.423214 26637 raft_consensus.cc:3055] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:28.423679 26637 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:28.365454 26603 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:18:28.387154 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 102474us
I20260709 12:18:28.429677 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:28.192312 22287 maintenance_manager.cc:643] P fd30aaad5b9140cf904466d9eb78783a: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 2.869s	user 0.195s	sys 0.080s Metrics: {"bytes_written":29256,"cfile_init":1,"dirs.queue_time_us":32391,"dirs.run_cpu_time_us":391,"dirs.run_wall_time_us":5251,"drs_written":1,"lbm_read_time_us":370,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5320,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":28,"peak_mem_usage":0,"rows_written":63,"thread_start_us":247973,"threads_started":2,"wal-append.queue_time_us":275965}
I20260709 12:18:28.405666 26564 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:28.420495 26248 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:28.423324 26572 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:28.366047 26751 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:28.441789 26751 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:28.442808 22288 maintenance_manager.cc:419] P fd30aaad5b9140cf904466d9eb78783a: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7936 bytes on disk
I20260709 12:18:28.374229 22476 raft_consensus.cc:606] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:28.386566 22367 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:28.385985 22441 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:28.444686 22476 raft_consensus.cc:614] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:28.445330 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 59460.2us
W20260709 12:18:28.446457 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.432971 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:28.433514 26637 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.467842 26375 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:28.434777 26755 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:18:28.437367 26760 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:18:28.413986 26733 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:28.430923 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:28.369196 26750 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:28.479439 26750 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:28.468832 26572 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:18:28.479907 26750 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:28.439978 26603 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:28.449395 22548 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:28.451426 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 64952us
I20260709 12:18:28.482185 26722 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:28.482718 22367 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:28.269680 26706 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.368824 26650 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:28.382187 26283 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:28.485352 26706 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:28.485658 26283 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:28.485898 26756 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:28.479514 26676 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:28.385171 26728 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:28.472687 26755 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:28.468344 26637 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:28.513233 26728 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:28.514060 26750 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.514827 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:28.515961 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:28.516199 26750 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:28.477913 26746 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:28.519742 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:18:28.475438 26761 log.cc:927] Time spent T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:18:28.478556 26552 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:28.448657 26747 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:28.480491 26603 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:28.475142 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 44287.9us
W20260709 12:18:28.488780 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.488586 22287 maintenance_manager.cc:643] P fd30aaad5b9140cf904466d9eb78783a: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.043s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":365,"lbm_reads_lt_1ms":4}
I20260709 12:18:28.422067 26620 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:28.491559 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:28.492352 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:28.493640 22470 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:18:28.538266 22516 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:28.496407 22549 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:18:28.497982 22543 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:28.439846 26564 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.500077 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:28.501355 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:28.548264 22551 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:28.503947 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:28.505095 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:28.505889 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:28.550467 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.486232 26733 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.510741 26387 raft_consensus.cc:3055] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:28.510764 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:28.490677 26676 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:28.563408 26676 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:28.512250 26755 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:28.517115 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:28.478637 26430 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:28.517549 26375 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:18:28.577378 26578 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:28.539438 26706 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.531270 22548 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 14.
I20260709 12:18:28.532445 22367 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:28.519935 26757 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.533951 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:28.535514 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:28.592796 22396 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:28.593788 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:28.594358 22396 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:28.485432 26650 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:28.538409 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.544157 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:28.540711 22516 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:18:28.595803 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 63453.8us
I20260709 12:18:28.550386 23095 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:28.596951 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 46638.2us
I20260709 12:18:28.597265 22367 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:28.528256 26743 raft_consensus.cc:697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:28.550369 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:28.568572 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:28.569347 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:28.601670 22395 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:28.536286 26332 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.538975 26759 raft_consensus.cc:697] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:18:28.598908 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 240055us
I20260709 12:18:28.526583 26685 raft_consensus.cc:697] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:28.552940 26564 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:28.552178 26707 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:28.587781 22401 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:28.589978 23094 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:28.595783 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:28.598278 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 57645.9us
I20260709 12:18:28.558534 26387 raft_consensus.cc:740] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:28.601848 22393 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:28.604105 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 53805.5us
I20260709 12:18:28.614938 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:28.606142 22367 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:28.631156 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:28.610348 22398 raft_consensus.cc:1240] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:28.604455 22366 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:28.426497 22294 catalog_manager.cc:5697] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 5 to 8, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 8 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:28.641350 23127 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:28.623087 22396 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:28.622044 22474 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:28.604176 26683 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:18:28.678063 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 61968.4us
I20260709 12:18:28.609731 26332 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:28.682173 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 56838.4us
I20260709 12:18:28.648538 23095 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:28.773166 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 124707us
I20260709 12:18:28.605147 26578 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:28.779245 22441 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:28.688530 22395 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:28.608739 26620 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:28.651165 26756 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:28.642194 22366 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:28.696820 26765 log.cc:927] Time spent T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:18:28.697093 26773 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:18:28.697124 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.700889 26685 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.810118 22442 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:28.696671 26728 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.701833 22393 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:28.600021 26757 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:28.641554 26752 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:28.722751 26733 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:28.683889 26713 consensus_queue.cc:1059] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:18:28.782469 26650 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:28.595136 26706 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:28.742323 26754 log.cc:927] Time spent T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:18:28.743479 26673 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.612035 26772 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:28.861030 26673 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.863517 26673 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:28.871884 26706 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:28.880175 26752 raft_consensus.cc:697] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 14 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:28.881218 26752 consensus_queue.cc:237] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:28.887878 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.892233 22397 raft_consensus.cc:1240] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:28.805621 26552 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:28.613713 26707 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:28.605530 26724 consensus_queue.cc:1059] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 12:18:28.781450 26683 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:18:28.787099 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 145005us
I20260709 12:18:28.902558 22366 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:28.767373 26613 consensus_meta.cc:287] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.525s	user 0.004s	sys 0.005s
W20260709 12:18:28.903502 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 131942us
I20260709 12:18:28.784678 26716 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:28.812506 22395 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:28.818622 22398 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:28.819690 22442 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:28.782092 26758 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.831100 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:28.831349 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:28.833408 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:28.908259 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 88659.5us
I20260709 12:18:28.909135 22477 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:28.803654 26759 consensus_queue.cc:237] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.836457 26332 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:28.836894 26561 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:28.837690 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:28.838822 26603 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.840065 26755 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.785357 26742 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:18:28.835438 26633 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:28.845463 26698 consensus_queue.cc:1059] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:28.787761 26743 consensus_queue.cc:237] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.852213 26283 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.859095 26556 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.599828 26248 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:28.818410 26773 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.896315 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:28.896754 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:28.898499 22542 raft_consensus.cc:2393] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 10: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:28.899117 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:28.899631 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:28.766459 26751 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.805441 26769 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:18:28.910948 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.912307 22442 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:28.963316 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 53610.9us
I20260709 12:18:28.817939 26572 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 12:18:28.911885 22366 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:28.915812 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:28.915999 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:28.900015 26707 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:28.928143 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 154238us
I20260709 12:18:28.907189 26683 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:28.916087 26456 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:28.893581 26735 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.916316 26756 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:28.924438 26752 raft_consensus.cc:3055] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:28.925053 26633 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.964272 22472 raft_consensus.cc:2393] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 15: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:28.967574 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:18:28.996702 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 58506us
W20260709 12:18:28.996841 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 85035us
I20260709 12:18:28.964028 22442 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:29.005420 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:28.922905 26430 consensus_queue.cc:1059] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:18:29.023545 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:29.011862 22367 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:29.014636 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:29.014992 22474 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:28.996160 26602 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:29.015683 26565 raft_consensus.cc:993] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:29.016319 26603 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:28.915951 26758 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.018756 22470 raft_consensus.cc:1240] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:29.019237 22477 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:29.019483 22473 raft_consensus.cc:1240] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:29.021158 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:29.023059 22544 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:29.023634 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:29.157569 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 114295us
I20260709 12:18:29.158145 22550 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
W20260709 12:18:29.158648 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 126409us
I20260709 12:18:29.024068 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:28.964422 26773 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:29.015671 26776 log.cc:927] Time spent T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:18:28.965909 26769 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:29.013078 26770 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:18:29.055449 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 91484.3us
I20260709 12:18:29.008041 26604 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:29.199993 26604 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:29.150768 22401 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:29.016261 26283 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:29.202458 26283 raft_consensus.cc:1081] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:29.203438 26283 consensus_queue.cc:1059] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:29.203972 26332 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:18:29.154292 26676 consensus_meta.cc:287] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
I20260709 12:18:29.204623 26332 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.205063 26676 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.207309 26676 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:29.209093 26676 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:29.155421 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 124754us
I20260709 12:18:29.211242 23095 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:29.029364 26633 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:29.213894 26561 raft_consensus.cc:3055] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:29.214359 26561 raft_consensus.cc:740] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:29.215231 26561 consensus_queue.cc:260] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:28.939771 26706 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:18:29.020207 26752 raft_consensus.cc:740] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:29.218176 26332 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:29.220046 22442 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:29.189482 22468 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 15. Current term is 16. Ops: []
W20260709 12:18:29.195737 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 183934us
I20260709 12:18:29.153795 26744 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:29.192836 22441 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:29.197351 22516 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:29.227774 22516 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:29.231032 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:29.151410 26248 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:18:29.238970 22442 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:29.241499 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:29.236321 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:29.255836 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:29.255483 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:29.255014 22398 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:18:29.273341 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 245556us
W20260709 12:18:29.305351 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 69108.5us
I20260709 12:18:29.246240 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:29.220417 26456 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:29.163112 26713 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 12:18:29.328516 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.328076 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.237546 26706 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:29.209579 26676 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:29.390612 26783 log.cc:927] Time spent T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.235s	user 0.000s	sys 0.000s
I20260709 12:18:29.391408 26676 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:29.190095 26769 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:29.392503 26779 log.cc:927] Time spent T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
W20260709 12:18:29.394001 26782 log.cc:927] Time spent T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:18:29.189365 26613 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 12:18:29.335084 26786 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:29.243824 26742 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:29.246289 26332 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:29.272334 26430 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:29.021714 22294 catalog_manager.cc:5697] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:29.242543 26784 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:29.276571 26756 consensus_queue.cc:1059] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 12:18:29.318356 26728 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:29.242506 26604 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.140s
I20260709 12:18:29.373528 26724 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:29.277294 26750 consensus_queue.cc:1059] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.124s
I20260709 12:18:29.383124 26698 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:29.394774 26375 consensus_queue.cc:1059] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:18:29.416139 26706 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:29.374013 26780 consensus_queue.cc:1059] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.138s
I20260709 12:18:29.414176 26742 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.410554 26786 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:18:29.498152 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 256730us
I20260709 12:18:29.415912 26603 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:18:29.424111 26332 raft_consensus.cc:697] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:29.423530 26757 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:29.515295 23095 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:29.478417 26755 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:29.420256 26602 consensus_queue.cc:1059] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 12:18:29.496299 26706 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:29.522846 26795 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:29.523983 26332 consensus_queue.cc:237] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.511427 26786 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:29.420593 26796 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.139s
W20260709 12:18:29.525981 26781 log.cc:927] Time spent T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:18:29.526189 22294 catalog_manager.cc:5697] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:29.478279 26797 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:29.423288 26785 consensus_queue.cc:1048] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.114s
W20260709 12:18:29.521878 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.423668 26556 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:29.509542 26742 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:29.494587 26751 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:29.518365 26778 log.cc:927] Time spent T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.487s	user 0.000s	sys 0.001s
I20260709 12:18:29.580993 22402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2068) took 1038 ms. Trace:
I20260709 12:18:29.581380 22402 rpcz_store.cc:276] 0709 12:18:28.542983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.543108 (+   125us) service_pool.cc:224] Handling call
0709 12:18:28.543377 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.573342 (+ 29965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:28.573371 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:28.573826 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 12:18:28.759426 (+185600us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:28.759468 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:28.759533 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.580763 (+821230us) raft_consensus.cc:1685] finished
0709 12:18:29.580783 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.580922 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33928,"raft.queue_time_us":31357,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3820,"thread_start_us":176163,"threads_started":1,"wal-append.queue_time_us":347644}
I20260709 12:18:29.509932 26698 raft_consensus.cc:697] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:29.424392 26784 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:29.577351 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.565063 26706 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:29.566922 26757 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:18:29.587749 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 277679us
I20260709 12:18:29.467547 26387 consensus_queue.cc:260] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:29.575573 26794 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:29.591565 26757 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.597229 26757 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:29.606515 26802 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:18:29.611244 26735 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:29.612926 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49290 (request call id 524) took 1106 ms. Trace:
I20260709 12:18:29.613363 22542 rpcz_store.cc:276] 0709 12:18:28.506892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.516753 (+  9861us) service_pool.cc:224] Handling call
0709 12:18:29.612716 (+1095963us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b540040f454. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:29.612863 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700814592}
I20260709 12:18:29.566449 26430 raft_consensus.cc:697] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:29.621089 22402 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:18:29.587339 26758 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:29.590459 26602 raft_consensus.cc:3055] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:29.627390 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.628376 26578 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:29.628937 26578 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:29.631417 26810 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:29.632179 26283 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:29.632714 26283 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.633407 26784 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:29.634418 22468 raft_consensus.cc:1217] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Deduplicated request from leader. Original: 6.7->[8.8-8.8]   Dedup: 8.8->[]
I20260709 12:18:29.634891 22468 raft_consensus.cc:1240] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:18:29.639573 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:29.640479 22468 raft_consensus.cc:2393] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 16: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:18:29.642331 26788 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:18:29.642643 26564 consensus_meta.cc:287] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 1.000s	user 0.010s	sys 0.000s
I20260709 12:18:29.623623 26780 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.643033 26564 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.643231 26780 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:29.645251 26780 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:29.644968 22294 catalog_manager.cc:5697] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:29.645920 26578 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:29.646781 22294 catalog_manager.cc:5697] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:29.648388 22294 catalog_manager.cc:5697] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 9 to 12, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 12 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:29.623781 26604 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.650152 26604 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:29.652122 26604 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:29.651849 26633 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.642084 26752 consensus_queue.cc:260] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:29.649158 22476 raft_consensus.cc:2393] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 16: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:29.655915 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43060 (request call id 396) took 1164 ms. Trace:
I20260709 12:18:29.656309 22471 rpcz_store.cc:276] 0709 12:18:28.491712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.491825 (+   113us) service_pool.cc:224] Handling call
0709 12:18:28.492119 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.517748 (+ 25629us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:28.517794 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:28.534755 (+ 16961us) log.cc:844] Serialized 26 byte log entry
0709 12:18:28.925595 (+390840us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:28.925634 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:28.925696 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.655728 (+730032us) raft_consensus.cc:1685] finished
0709 12:18:29.655746 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.655861 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26783,"raft.queue_time_us":25752,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":13183,"thread_start_us":341414,"threads_started":1,"wal-append.queue_time_us":680383}
W20260709 12:18:29.659330 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 353437us
I20260709 12:18:29.660224 22366 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:29.662900 22402 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:29.665060 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.666273 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.666503 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.667344 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.667542 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.668288 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.670302 22398 raft_consensus.cc:2393] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 10: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:29.670967 22366 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:29.673218 22398 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:29.676949 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:29.680233 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.682974 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.636132 26602 raft_consensus.cc:740] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:29.682260 23095 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:18:29.669778 26604 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:29.688928 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:29.691323 26552 consensus_meta.cc:287] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.790s	user 0.005s	sys 0.005s
I20260709 12:18:29.691448 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.687392 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.680402 26722 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.683895 26752 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:29.687981 26780 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:29.699191 22477 raft_consensus.cc:2376] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13. Re-sending same reply.
I20260709 12:18:29.699260 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.619230 26794 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.721046 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:29.719799 22395 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:18:29.720091 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:29.725203 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.725832 22398 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:29.726352 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.727973 22395 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:18:29.746102 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:29.747661 22393 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:18:29.718237 26552 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:29.719084 26722 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:29.750204 26430 consensus_queue.cc:237] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:29.750825 26722 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:29.721858 26707 consensus_meta.cc:287] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.001s
I20260709 12:18:29.763324 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:29.761065 26785 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.692883 22366 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:29.764557 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:29.715354 26578 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:29.700309 26456 raft_consensus.cc:697] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:29.766494 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:29.768671 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:29.769294 22543 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:29.768947 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:29.772042 22547 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:29.776885 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:29.718544 26800 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:29.781121 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:29.785620 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:29.788705 22546 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:18:29.789027 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:29.777796 26578 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.792120 26578 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:29.662169 22294 catalog_manager.cc:5697] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 8 to 11, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 11 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:29.795454 22294 catalog_manager.cc:5697] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:29.798106 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.767072 26755 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.798972 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:29.799256 26755 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.801409 26755 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:29.805546 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:29.809052 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:18:29.818949 26818 log.cc:927] Time spent T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:18:29.769749 22548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54498
I20260709 12:18:29.819870 22548 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:29.820250 22548 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:29.825157 26722 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:18:29.828658 26773 consensus_meta.cc:287] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.000s
I20260709 12:18:29.828830 22548 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.829123 26773 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.831113 26794 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:29.767270 26556 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.831856 26556 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.833948 26556 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:29.797363 22294 catalog_manager.cc:5697] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:29.834880 22294 catalog_manager.cc:5697] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:29.835351 26769 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:29.762996 26602 consensus_queue.cc:260] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.838672 26602 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:29.692363 26698 consensus_queue.cc:237] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.837504 26769 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:29.846387 22547 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:29.855502 22396 raft_consensus.cc:2368] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16.
W20260709 12:18:29.776041 26683 consensus_meta.cc:287] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.748s	user 0.010s	sys 0.000s
W20260709 12:18:29.784279 26802 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:18:29.775794 26707 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.860483 26716 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:29.863610 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:29.864805 26798 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.866779 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:29.867985 22516 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:29.867173 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.874712 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.883137 22395 raft_consensus.cc:2393] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:29.874362 26456 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.875231 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:29.875398 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:29.883980 22547 raft_consensus.cc:2393] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 10: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:29.878159 22469 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:18:29.884089 23122 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:18:29.884445 23122 pending_rounds.cc:85] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: Aborting all ops after (but not including) 7
I20260709 12:18:29.836340 22294 catalog_manager.cc:5697] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:29.847677 26800 raft_consensus.cc:697] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 10 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:29.885984 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.881831 22548 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:29.884713 23122 pending_rounds.cc:107] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:18:29.890309 23122 raft_consensus.cc:2889] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:29.876293 26561 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:29.774889 26785 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.888718 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:29.886874 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:29.894282 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:29.903517 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:29.904145 22469 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:29.904798 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:29.906909 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:29.907523 22471 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:29.911825 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:29.911798 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:29.912711 22395 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:29.912161 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:29.895876 26794 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:29.913525 22516 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:29.920264 22471 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:29.922717 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:29.923580 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:29.878536 26683 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.924130 22471 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:29.897102 26757 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:29.926685 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:29.927070 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:29.927634 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:29.927678 22469 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:29.931691 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:29.881692 26706 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:29.936156 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:29.931030 22516 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:29.939251 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:29.940162 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:29.913986 22294 catalog_manager.cc:5697] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 6 to 9, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 9 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } }
I20260709 12:18:29.970716 22441 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:29.925791 26556 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:29.977927 26707 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:29.980176 26706 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:29.980700 22543 raft_consensus.cc:1240] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 11. Current term is 12. Ops: []
W20260709 12:18:29.981599 26823 log.cc:927] Time spent T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:18:29.891916 26798 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.985356 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:29.987295 26794 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:29.988374 26742 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:29.989703 26785 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:29.992030 26387 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:29.992368 26811 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:29.933986 26757 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.998941 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:29.999817 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:30.000870 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:29.902700 26716 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:18:29.974434 26800 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:30.007891 22395 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:18:29.938063 26673 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:29.970881 26755 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:29.908545 26786 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:30.014945 22393 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:29.970185 26773 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:30.010016 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:30.023947 22477 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 14: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:30.019763 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:30.025019 22469 raft_consensus.cc:3055] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:30.025337 22469 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:30.017961 22441 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:30.005782 26556 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.027884 26456 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:30.030674 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:30.031147 26755 raft_consensus.cc:697] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:30.012380 26794 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.015805 26603 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:30.013825 26811 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.016969 26757 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:30.041204 26603 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:30.046670 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:30.116454 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.038700 26556 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:30.045346 22469 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.044852 26603 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:30.041141 26794 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:30.043474 26811 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:30.199374 26831 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:18:30.045158 26456 raft_consensus.cc:697] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:30.164372 26673 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:30.234975 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:30.251134 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:30.252049 22470 raft_consensus.cc:2393] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:30.252849 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:30.253430 22470 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9.
I20260709 12:18:30.201332 22294 catalog_manager.cc:5697] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:30.256013 22294 catalog_manager.cc:5697] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 4 to 11, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 11 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:30.258400 26683 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:30.265478 26747 raft_consensus.cc:3055] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:30.266057 26747 raft_consensus.cc:740] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:30.266844 26747 consensus_queue.cc:260] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.267359 26742 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:30.268014 26699 raft_consensus.cc:3055] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:30.268405 26699 raft_consensus.cc:740] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:30.268646 26283 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:30.273976 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 2297) took 1443 ms. Trace:
I20260709 12:18:30.274469 22476 rpcz_store.cc:276] 0709 12:18:28.830989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.831114 (+   125us) service_pool.cc:224] Handling call
0709 12:18:30.273711 (+1442597us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b54002008d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:30.273902 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1704267136}
I20260709 12:18:30.279798 26750 raft_consensus.cc:3055] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:30.280300 26750 raft_consensus.cc:740] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:30.281107 26750 consensus_queue.cc:260] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.275735 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:30.286541 26456 consensus_queue.cc:237] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.287943 22471 raft_consensus.cc:1240] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:30.288237 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 595406us
I20260709 12:18:30.289069 26375 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:30.290324 22395 raft_consensus.cc:1240] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:30.291272 22399 raft_consensus.cc:3055] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:30.293182 22470 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:30.275641 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:30.301849 22475 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 7.
I20260709 12:18:30.300426 22399 raft_consensus.cc:740] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:30.295858 22476 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:30.308934 22471 raft_consensus.cc:1240] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:18:30.311432 22470 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:30.314080 22470 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:30.315896 22470 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:30.313484 26375 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.323153 26784 consensus_queue.cc:1059] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:30.306628 22399 consensus_queue.cc:260] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:30.325698 22476 raft_consensus.cc:1240] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:30.330602 22471 raft_consensus.cc:1240] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:30.367982 22471 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:18:30.371615 22395 raft_consensus.cc:1240] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:30.307942 26747 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:30.290609 26673 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:30.385038 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 85806.8us
I20260709 12:18:30.326896 26784 raft_consensus.cc:3055] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:30.375460 22475 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:30.393304 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:30.396974 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:30.398037 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:30.368500 26769 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:18:30.376703 26765 log.cc:927] Time spent T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:18:30.403623 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:30.406167 22548 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:18:30.378968 26750 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:30.412113 22550 raft_consensus.cc:2410] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:18:30.413714 22551 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:30.235096 26755 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:30.408630 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:30.400910 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:30.441679 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:30.443284 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:30.445199 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:30.453917 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:30.457101 22546 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:30.454025 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:30.391506 26784 raft_consensus.cc:740] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:30.458951 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:30.459808 22547 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:30.401051 26780 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:30.458932 26787 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:18:30.455227 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:30.376118 26722 consensus_queue.cc:1059] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:18:30.411350 26375 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:30.476709 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:30.520182 26673 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:30.508327 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:30.520906 23128 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:18:30.521183 26650 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.521665 26650 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:30.510768 26768 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:18:30.523864 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:30.524765 26784 consensus_queue.cc:260] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:30.515188 26722 raft_consensus.cc:3055] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:30.526212 26722 raft_consensus.cc:740] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:30.391881 26699 consensus_queue.cc:260] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.528136 26699 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:30.527652 22294 catalog_manager.cc:5697] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 7 to 10, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 10 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:30.528332 26811 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.530339 26556 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.532449 26556 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:30.533341 26722 consensus_queue.cc:260] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:30.534655 26722 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:30.538503 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:30.517963 26603 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.461915 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:30.541440 22442 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:30.516801 22546 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:30.539973 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:30.526753 26832 log.cc:927] Time spent T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:18:30.542572 22400 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:18:30.542078 22548 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:18:30.543128 22546 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:30.549011 22546 raft_consensus.cc:1240] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:30.549556 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:30.550261 22546 raft_consensus.cc:1240] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:30.474361 26781 log.cc:927] Time spent T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:18:30.473696 26828 log.cc:927] Time spent T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:18:30.554877 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:30.556211 26810 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:30.556634 22542 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:30.556758 26797 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:30.560688 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:30.523818 26650 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:30.570384 22476 raft_consensus.cc:1240] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:30.470580 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:30.574236 26801 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:30.574882 26801 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.559379 22294 catalog_manager.cc:5697] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 2 to 7, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 7 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:30.575752 26387 consensus_meta.cc:287] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.000s
I20260709 12:18:30.576193 26724 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.576637 26724 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:30.577248 26801 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:30.578187 23125 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:30.544082 26578 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.581936 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:30.553844 26805 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:30.582880 22402 raft_consensus.cc:2393] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 16: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:30.564163 22547 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
W20260709 12:18:30.586154 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.591681 26603 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:30.570152 26797 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.593422 26797 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:30.594502 26756 raft_consensus.cc:3055] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:30.471187 26780 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.606596 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2078) took 1797 ms. Trace:
I20260709 12:18:30.606993 22401 rpcz_store.cc:276] 0709 12:18:28.809466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.811238 (+  1772us) service_pool.cc:224] Handling call
0709 12:18:28.886132 (+ 74894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.201976 (+315844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.606349 (+1404373us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b540006fc54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:30.606532 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":608213760}
I20260709 12:18:30.608587 22548 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:18:30.616676 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:30.596364 26784 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:30.594882 26756 raft_consensus.cc:740] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:30.623047 26756 consensus_queue.cc:260] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.618647 22546 raft_consensus.cc:1240] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:30.619127 22393 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:30.599143 26772 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.626030 26792 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.632359 22401 raft_consensus.cc:1240] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:30.621508 26561 consensus_meta.cc:287] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.723s	user 0.004s	sys 0.006s
I20260709 12:18:30.639807 22396 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:30.637486 26792 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.596604 26578 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.642161 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:30.650321 22551 raft_consensus.cc:1217] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 10.9->[11.10-13.11]   Dedup: 13.11->[]
I20260709 12:18:30.655969 22551 raft_consensus.cc:1240] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 12:18:30.641064 26772 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.651935 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:30.663005 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:30.663692 22397 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:30.652261 22472 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:18:30.665357 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:30.668231 22401 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:30.668422 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:30.670993 22402 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:30.672111 26792 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:30.673529 26780 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:30.675971 26797 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:30.678139 26578 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:30.679517 22397 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:30.687278 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:30.681905 22394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:18:30.687371 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:30.688210 22397 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:30.688187 22548 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:30.689436 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:30.690963 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:30.691794 22544 raft_consensus.cc:2410] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 12:18:30.692886 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.680821 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:30.694144 22366 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:30.696553 22545 raft_consensus.cc:1240] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:30.696938 22366 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:30.700258 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:30.700680 22397 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 16.
I20260709 12:18:30.701242 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:30.701831 22471 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:30.703322 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:30.704070 22470 raft_consensus.cc:2393] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:30.699277 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:30.699012 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:30.705256 22476 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 11: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:30.700911 22477 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:30.707521 22394 raft_consensus.cc:606] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:30.707943 22394 raft_consensus.cc:614] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:30.706457 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:30.713158 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:30.714161 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:30.717250 22470 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:30.719591 22542 raft_consensus.cc:1240] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:30.710603 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:30.728987 26820 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:30.705319 26578 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.738157 26578 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:30.726787 26673 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:30.739885 26673 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.740288 26673 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:30.729154 26683 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:30.742059 26683 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.742449 26683 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:30.679447 26794 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.744829 26794 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:30.740339 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:30.748939 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:30.749575 22393 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:30.752244 22469 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:30.756868 22473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 2319) took 1105 ms. Trace:
I20260709 12:18:30.749197 26728 raft_consensus.cc:3055] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:30.757908 26728 raft_consensus.cc:740] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:30.758728 26728 consensus_queue.cc:260] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.696476 26792 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:30.760435 26792 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.760897 26792 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:30.761181 26375 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:30.761787 26375 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.757298 22473 rpcz_store.cc:276] 0709 12:18:29.651084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.655542 (+  4458us) service_pool.cc:224] Handling call
0709 12:18:29.762436 (+106894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.802546 (+ 40110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.802576 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:29.802617 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:29.802645 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.756671 (+954026us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b5400211e54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:30.756710 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.756811 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91697536}
I20260709 12:18:30.705453 26750 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:30.763770 26772 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:30.764154 26375 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:30.765292 26845 log.cc:927] Time spent T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:18:30.766495 26728 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:30.740274 26578 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:30.774439 26798 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:30.774905 26797 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:30.726202 26774 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:30.779791 23124 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
W20260709 12:18:30.780648 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 67584.6us
I20260709 12:18:30.782034 22366 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:30.784659 22471 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:18:30.787855 22366 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:30.802819 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 74143us
I20260709 12:18:30.698056 26561 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.819705 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:30.822613 22469 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:18:30.820761 26375 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:30.821893 26785 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:18:30.825650 26794 consensus_queue.cc:1059] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:30.826711 26794 raft_consensus.cc:3055] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:30.827086 26794 raft_consensus.cc:740] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:30.827884 26794 consensus_queue.cc:260] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.829005 26794 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:30.831077 22366 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:30.832265 22366 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:30.814782 26774 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:30.833730 26791 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:18:30.841109 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 63993.8us
I20260709 12:18:30.718504 26699 consensus_queue.cc:1059] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 12:18:30.831506 26750 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:30.814090 26676 consensus_queue.cc:1059] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:18:30.834161 26791 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:30.845165 22366 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:30.834618 26375 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:30.818023 26722 consensus_queue.cc:1059] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:18:30.848239 22366 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:30.849221 22366 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:30.840744 26820 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:18:30.854348 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.822230 26772 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:18:30.820811 26798 consensus_queue.cc:1059] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:18:30.845045 26456 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.821135 26561 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.842183 26780 consensus_queue.cc:1059] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:18:30.855512 26814 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:30.847357 26604 consensus_queue.cc:1059] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:18:30.852887 26773 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:18:30.858493 26757 consensus_meta.cc:287] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.001s
I20260709 12:18:30.855945 26759 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:30.847520 26769 consensus_queue.cc:1059] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 12:18:30.971918 26839 log.cc:927] Time spent T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:18:30.946781 26814 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.980508 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:30.982041 23095 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:30.864663 26820 raft_consensus.cc:697] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:30.928772 26578 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.929052 26797 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:30.979077 26791 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:30.863309 26375 consensus_queue.cc:1059] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.123s
I20260709 12:18:31.004136 22471 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:31.004824 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:30.878161 26456 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.018800 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:31.005810 26850 log.cc:927] Time spent T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:18:31.006026 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:31.009613 26814 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:31.033828 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:31.011894 23095 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:31.020679 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:31.034762 22472 raft_consensus.cc:2393] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:30.971040 26613 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:18:31.019474 22474 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:31.010362 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:31.036276 22473 raft_consensus.cc:2393] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 16: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:31.035074 22471 raft_consensus.cc:2410] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:18:31.006500 26673 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.015010 26800 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:31.000751 26792 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:31.000211 26757 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.002579 26683 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:31.080802 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:31.082297 26728 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.083279 22545 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:31.082942 26728 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.086169 26728 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:31.063580 26849 log.cc:927] Time spent T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:18:31.016180 26578 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.093083 22401 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16. Ops: []
W20260709 12:18:31.093669 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 240098us
I20260709 12:18:31.017830 26797 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:31.055572 26722 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:31.089954 26791 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:31.062397 26784 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 12:18:31.102010 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 243710us
I20260709 12:18:31.114367 22548 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:31.115502 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:31.116015 26456 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.117062 26724 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:31.117511 26792 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:31.116060 22548 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:31.118750 26673 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:31.120939 26757 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:31.102609 26820 consensus_queue.cc:237] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.122941 26578 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.106851 26561 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.107992 26772 raft_consensus.cc:3055] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:31.108690 26864 consensus_queue.cc:1059] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:31.127303 26772 raft_consensus.cc:740] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:31.130892 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:31.111160 26780 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:31.126024 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:31.112325 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.098861 26798 consensus_queue.cc:1243] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:31.095646 26773 raft_consensus.cc:697] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:31.111846 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:31.138200 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:31.143086 22400 raft_consensus.cc:2410] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:18:31.135937 22548 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:31.144390 22441 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:31.145596 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:31.146311 22548 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:31.149416 22441 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:18:31.150246 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.151252 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:31.155591 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:31.156441 22548 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:31.100075 26722 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:31.141870 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:31.168318 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:31.169173 22548 raft_consensus.cc:2393] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 9: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:18:31.169931 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 346885us
I20260709 12:18:31.172858 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:31.177039 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:31.178185 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:31.178721 22548 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:31.179472 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:31.181792 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:31.183879 22441 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:31.186092 22398 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:31.186024 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:31.131346 26772 consensus_queue.cc:260] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.167719 26722 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:31.172371 26561 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:31.197849 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:31.202584 22542 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:31.194588 22516 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:31.199205 22366 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:31.168619 26603 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:31.172142 26746 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:31.167454 26784 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:31.207141 22366 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:31.184482 26864 consensus_queue.cc:1243] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:31.183215 26809 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:31.210420 26603 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.185916 26578 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:31.174821 26755 consensus_queue.cc:1059] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:18:31.227092 26603 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.190359 26801 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:31.229588 26801 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.230007 26801 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:31.189965 26759 raft_consensus.cc:697] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:31.141729 26780 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.211309 26676 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:31.204293 26561 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.228833 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:31.215128 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:31.210881 26772 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.243093 22542 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
W20260709 12:18:31.248454 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.224828 26769 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:31.214854 26784 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:31.239996 26561 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:31.235654 26676 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.248193 26755 consensus_queue.cc:1243] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:31.236807 26603 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:31.266896 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:31.232672 26867 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:18:31.257289 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 48649.8us
I20260709 12:18:31.217398 26809 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.260145 26676 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:31.246371 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:31.266176 22442 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.281625 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:31.284373 26578 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:31.289731 26561 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.283488 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:31.255885 26683 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:31.306747 22441 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:31.262744 26861 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:31.309983 26780 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.312237 26766 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:31.313737 26797 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:31.240917 26773 consensus_queue.cc:237] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.324057 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:31.322881 22442 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.261823 26871 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:31.324409 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:31.294685 26755 raft_consensus.cc:2764] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:18:31.307813 23123 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:31.319408 26867 raft_consensus.cc:697] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:31.340340 26683 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:31.378808 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:31.293707 26603 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.336035 26746 raft_consensus.cc:697] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:31.319188 26798 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:18:31.389407 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:31.393908 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:31.390873 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:31.343211 26861 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:31.393151 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:31.269942 26873 consensus_queue.cc:1059] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:18:31.394328 22401 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.391291 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:31.397244 22474 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.393945 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:31.397957 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.398077 22472 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:31.400913 26873 consensus_queue.cc:1243] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:31.401521 26873 raft_consensus.cc:3055] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:31.401882 26873 raft_consensus.cc:740] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:31.402648 26873 consensus_queue.cc:260] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.403887 26873 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:31.404518 26872 log.cc:927] Time spent T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:18:31.405823 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:31.406654 22400 raft_consensus.cc:3055] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:31.406649 22471 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:31.406159 26578 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:31.410811 26603 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.387486 26820 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:31.407251 22400 raft_consensus.cc:740] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:31.338578 26759 consensus_queue.cc:237] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.395803 26798 consensus_queue.cc:1243] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:31.395591 26683 raft_consensus.cc:697] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:31.402951 26881 consensus_queue.cc:1059] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:18:31.436401 22474 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:31.433908 26884 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:31.437692 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:31.440939 26676 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.442270 26561 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.413440 26861 raft_consensus.cc:697] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:18:31.477993 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 138750us
I20260709 12:18:31.479990 22475 raft_consensus.cc:1240] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:31.418222 22400 consensus_queue.cc:260] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:31.448846 26809 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.451593 26794 raft_consensus.cc:3055] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:31.454711 26633 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.446096 26867 consensus_queue.cc:237] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:31.434502 26820 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:31.459404 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2393) took 1066 ms. Trace:
I20260709 12:18:31.490497 22551 rpcz_store.cc:276] 0709 12:18:30.393227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.520145 (+126918us) service_pool.cc:224] Handling call
0709 12:18:30.650116 (+129971us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:30.656349 (+  6233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.459186 (+802837us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54004213d0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:31.459337 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297937280}
I20260709 12:18:31.461354 23123 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:18:31.462358 26784 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:31.404927 26746 consensus_queue.cc:237] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.463265 26860 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:31.465158 26604 raft_consensus.cc:3055] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:31.465479 26757 raft_consensus.cc:3055] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:31.466257 26564 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.469686 26884 raft_consensus.cc:697] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:31.510432 26884 consensus_queue.cc:237] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.470180 26878 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:31.443142 26774 raft_consensus.cc:3055] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:31.485190 26794 raft_consensus.cc:740] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:31.514024 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:31.475108 22401 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 8.
I20260709 12:18:31.475493 22471 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:18:31.476734 22474 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:31.342986 26871 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.483129 22442 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.458609 26756 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:31.483279 22475 raft_consensus.cc:1240] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:18:31.485847 22400 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:31.496014 22472 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
W20260709 12:18:31.507160 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 109280us
I20260709 12:18:31.509171 26820 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:31.489157 26800 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:31.518458 22393 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:18:31.522454 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:31.523769 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:31.524309 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.524923 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.505177 26604 raft_consensus.cc:740] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:31.528476 22516 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.505162 26757 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:31.531906 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.513305 26774 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:31.516705 26733 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:31.518460 26743 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:31.536422 22442 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.541323 26757 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.542244 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:31.543416 26676 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:31.543785 26871 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:31.545156 26879 log.cc:927] Time spent T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:18:31.532809 26798 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:31.529165 26870 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:31.531870 26633 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:31.531191 26716 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:18:31.531311 26820 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.531247 26755 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:31.518582 26878 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:31.581672 22400 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:31.567816 26757 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:31.563529 26743 raft_consensus.cc:697] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:31.555114 26572 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:18:31.547350 26722 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:31.523530 26683 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.554464 26733 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:31.590770 26862 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:18:31.601840 22399 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:31.561977 26794 consensus_queue.cc:260] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.610476 26786 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:31.595177 26746 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:31.618060 26676 consensus_queue.cc:1059] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:18:31.622795 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:31.570448 26604 consensus_queue.cc:260] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.583781 26820 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:31.627825 22549 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 1980) took 1850 ms (client timeout 1581 ms). Trace:
W20260709 12:18:31.631027 22549 rpcz_store.cc:269] 0709 12:18:29.786466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.786608 (+   142us) service_pool.cc:224] Handling call
0709 12:18:31.622682 (+1836074us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b5800010b98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2feee 000000000036eb39 00007fb4fdaa31e0 00007fb4fdb6c0c4 00007fb4fdb6c131 00007fb4fdb1a0a0 00007fb4fdb19984 00007fb4f70946d4 00007fb4f7094662
0709 12:18:31.627747 (+  5065us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7338880}
I20260709 12:18:31.636544 26604 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:31.532934 26861 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.577651 26774 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.615190 26811 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:31.642616 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:31.647326 26733 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.650410 26774 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:31.663892 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 127543us
I20260709 12:18:31.665539 22442 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:31.680150 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41012 (request call id 419) took 3167 ms. Trace:
I20260709 12:18:31.680573 23125 rpcz_store.cc:276] 0709 12:18:28.512678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.527489 (+ 14811us) service_pool.cc:224] Handling call
0709 12:18:28.539367 (+ 11878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:30.578542 (+2039175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.679886 (+1101344us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b540047c054. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:31.680056 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4688198528}
I20260709 12:18:31.681624 22398 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
I20260709 12:18:31.639298 26743 consensus_queue.cc:237] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:31.674314 26456 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.688886 22442 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.689633 26722 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.684490 22399 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:18:31.682549 26887 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.678508 26564 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:31.706363 23125 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:31.707595 26895 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:31.710903 26564 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.711367 26564 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:31.714751 26820 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.714519 26887 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.716711 26633 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:31.730211 22399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 464) took 1445 ms. Trace:
I20260709 12:18:31.732642 22399 rpcz_store.cc:276] 0709 12:18:30.284848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.289496 (+  4648us) service_pool.cc:224] Handling call
0709 12:18:30.291140 (+  1644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.601365 (+1310225us) spinlock_profiling.cc:243] Waited 60.1 ms on lock 0x7b5800790ad0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8ab00aa 00007fb4f8b32447 00007fb4f8b4afe7 00007fb4f8b4c7de 00007fb4f8b56b49 00007fb4f8b57416 00007fb4f8b53d8f 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4
0709 12:18:31.692293 (+ 90928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.730131 (+ 37838us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138259200}
I20260709 12:18:31.734257 22442 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:31.740903 26860 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:31.741518 26805 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:31.742022 26805 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:31.742472 26805 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:31.744357 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:31.745662 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 211916us
I20260709 12:18:31.716712 26887 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.723122 26820 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.746568 22516 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.689306 26456 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:31.743911 26814 consensus_meta.cc:287] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.689s	user 0.008s	sys 0.003s
I20260709 12:18:31.685380 26889 consensus_queue.cc:1059] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:18:31.727881 26248 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:31.752496 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:31.754453 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.728116 26878 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.756148 22472 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:31.758576 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.759840 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.753279 26724 raft_consensus.cc:3055] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:31.762760 26724 raft_consensus.cc:740] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:31.763417 26757 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:31.765717 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.745595 26455 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:18:31.767997 26892 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:31.770537 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.766307 26862 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.748492 26572 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:18:31.756103 26683 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:31.764521 26860 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:31.752059 26820 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:31.780352 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.766237 26811 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:31.763703 26724 consensus_queue.cc:260] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:31.755462 26814 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.811020 22468 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: []
W20260709 12:18:31.807291 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.808192 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:31.816315 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:31.815989 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.786000 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.785259 26867 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:18:31.790143 26901 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.085s	user 0.003s	sys 0.000s
I20260709 12:18:31.792486 22473 raft_consensus.cc:1240] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:31.794130 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:31.795508 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:31.835887 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:31.837504 22474 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:18:31.796473 22471 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:31.838698 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:31.839699 22471 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:31.799610 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:31.800324 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:31.841099 22549 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:31.813930 26798 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:31.801717 22551 raft_consensus.cc:1240] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:31.801951 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:31.802886 22546 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:18:31.804266 26572 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:31.756582 26248 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:31.766925 26887 consensus_queue.cc:1059] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:18:31.775075 26716 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:31.804955 26892 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:31.855650 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:31.856556 22543 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:31.836392 26650 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:31.835693 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:31.833947 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 48032.8us
I20260709 12:18:31.846069 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:31.849612 26903 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:18:31.849102 26456 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.779359 26862 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.813463 26564 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.861747 26820 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:31.862249 22545 raft_consensus.cc:1240] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: []
W20260709 12:18:31.862771 26801 consensus_meta.cc:287] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.632s	user 0.006s	sys 0.006s
I20260709 12:18:31.843792 26860 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:31.864161 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:31.837420 26637 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.859601 22472 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:31.843696 26683 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:31.834372 26746 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:31.864389 26248 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:31.844995 26867 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.907699 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 2392) took 1514 ms. Trace:
I20260709 12:18:31.908113 22550 rpcz_store.cc:276] 0709 12:18:30.392911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.393032 (+   121us) service_pool.cc:224] Handling call
0709 12:18:31.907497 (+1514465us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b540008cfd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:31.907639 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40957312}
I20260709 12:18:31.909148 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:31.867154 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:31.866511 22516 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.858078 26887 consensus_queue.cc:1243] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer 65951063312d4a1e9123f92354101c71 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:18:31.867062 26650 raft_consensus.cc:697] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 16 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:31.910563 22547 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:18:31.911664 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:31.911489 26650 consensus_queue.cc:237] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:31.853988 26572 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.909492 26867 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.914769 26572 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.877372 26862 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.872686 26801 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.879629 22471 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:31.887437 26637 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.891390 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2104) took 1170 ms. Trace:
W20260709 12:18:31.918596 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 52203.9us
I20260709 12:18:31.893103 26814 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.896061 26564 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.906771 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50398 (request call id 11) took 1228 ms. Trace:
I20260709 12:18:31.909569 26805 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.874402 26683 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:31.922281 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:31.913467 22547 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:31.923812 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:31.919024 22395 rpcz_store.cc:276] 0709 12:18:30.720725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.720902 (+   177us) service_pool.cc:224] Handling call
0709 12:18:30.730078 (+  9176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:30.730439 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:30.730470 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:30.730941 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.853997 (+123056us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:30.863691 (+  9694us) log.cc:844] Serialized 14 byte log entry
0709 12:18:31.890646 (+1026955us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b18004a7340. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f59e1c0a 00007fb4ff121219 00007fb4f870ad70 00007fb4f86fe293 00007fb4f86f3cea 00007fb4f86f423a 00007fb4f8b5ea2a 00007fb4f8b6e0bf 00007fb4f8b6e038
0709 12:18:31.890947 (+   301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.891025 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:31.891064 (+    39us) raft_consensus.cc:1685] finished
0709 12:18:31.891177 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.891324 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":841572,"prepare.queue_time_us":10333,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":3464,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":150,"spinlock_wait_cycles":5023104,"thread_start_us":122661,"threads_started":1,"wal-append.queue_time_us":127870}
I20260709 12:18:31.925906 23095 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:18:31.946833 22468 raft_consensus.cc:2368] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13.
I20260709 12:18:31.945393 22516 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.945426 22550 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:31.924649 26572 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.948622 22394 rpcz_store.cc:276] 0709 12:18:30.678790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.681743 (+  2953us) service_pool.cc:224] Handling call
0709 12:18:31.906564 (+1224821us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b54002d9454. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b4e853 00007fb4fdb1c60a 00007fb4f70a27d4 00007fb4f70a2762 00007fb4f70a2691 00007fb4f70a260c 00007fb4f70a18c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:31.906677 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44572416}
I20260709 12:18:31.950740 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:31.951233 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:31.951388 22550 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:31.954504 26801 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.924360 26698 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:31.957302 26556 raft_consensus.cc:3055] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:31.957741 26556 raft_consensus.cc:740] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:31.958632 26556 consensus_queue.cc:260] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:31.959584 26556 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:31.959730 26698 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:31.960955 26814 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:31.962102 26683 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:31.963680 26805 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.960336 22516 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:31.966784 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:31.949080 26387 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:31.969960 22547 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:31.970547 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:31.961539 26814 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:31.973335 26637 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:31.952356 26572 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:31.975320 26814 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:31.975831 26572 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:18:31.978703 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:31.979432 23130 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:31.980432 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:31.981065 22401 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:31.983446 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:31.984403 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.984872 22401 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:31.981070 22400 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:31.987720 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:31.988829 22401 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:31.986853 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:31.990271 22400 raft_consensus.cc:2368] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10.
I20260709 12:18:31.991423 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:31.993480 22400 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:31.994586 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:31.995342 22400 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:31.996346 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:31.991645 22550 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:31.997665 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:31.999409 22400 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:18:32.002540 22442 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:32.003237 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:32.004426 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.008526 22401 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:32.010135 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:32.012566 22549 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
W20260709 12:18:32.015138 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 54863us
I20260709 12:18:32.021605 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:32.016662 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.016242 22442 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:32.028043 22547 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14. Ops: []
W20260709 12:18:32.030114 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 213005us
I20260709 12:18:32.031100 22442 leader_election.cc:400] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10.
I20260709 12:18:32.031458 22442 leader_election.cc:403] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:18:31.976528 26387 raft_consensus.cc:697] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 10 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:32.034749 22516 leader_election.cc:400] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16.
I20260709 12:18:32.036350 22516 leader_election.cc:403] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:32.034174 22442 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:32.039317 22442 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:32.040159 22442 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:32.029241 26860 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:32.039795 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:32.010716 26572 consensus_queue.cc:1059] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:18:32.035729 26698 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:32.045224 22394 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:32.043174 26774 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.030261 26801 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:32.037622 26564 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:32.037348 26897 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:32.044107 26813 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:32.051633 22367 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:32.051788 22401 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:32.043476 26456 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:32.043340 26455 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:32.037482 26766 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:32.050815 22547 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:32.041213 26892 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16.
I20260709 12:18:32.045579 26785 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:32.078120 22549 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:32.079182 22470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:32.087427 22470 raft_consensus.cc:606] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:32.087800 22470 raft_consensus.cc:614] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:32.050328 26798 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:32.076584 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:32.082636 22367 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:32.051637 26564 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:32.088402 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.052582 26801 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:32.076213 26813 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:32.078990 26820 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.080754 26456 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.050009 26791 consensus_queue.cc:1059] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:18:32.095973 22472 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:18:32.086443 22400 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:32.098692 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:32.105059 22473 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:32.099380 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:32.105897 22549 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:32.096575 26889 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:18:32.093040 26698 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:32.101147 22469 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: [6.7-9.8]
I20260709 12:18:32.086292 26867 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:32.076434 26861 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:18:32.083393 26814 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:32.108038 23124 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:18:32.052481 26774 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.111590 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:32.093720 26564 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:32.109643 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:32.093273 26801 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:32.090029 26455 raft_consensus.cc:697] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:32.094507 26862 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:32.095811 26813 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:32.106179 22475 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:32.103358 26456 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:32.129245 22367 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:32.131994 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:32.094823 26798 raft_consensus.cc:697] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:32.134323 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:32.087996 26766 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:32.122294 26906 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.068s	user 0.001s	sys 0.001s
I20260709 12:18:32.141750 22400 raft_consensus.cc:2393] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 13: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:32.145161 22473 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:18:32.146231 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:32.102248 26863 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:18:32.147612 22367 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:32.125341 26673 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.103161 26820 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.134450 26750 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:32.203843 26706 raft_consensus.cc:3055] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:32.204306 26706 raft_consensus.cc:740] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:32.152426 26604 consensus_queue.cc:1059] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:18:32.205783 26604 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:32.206352 26604 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:32.205291 26706 consensus_queue.cc:260] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:32.207655 26706 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:32.208141 26774 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:32.208436 26604 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:32.209000 26604 raft_consensus.cc:3055] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:32.209323 26604 raft_consensus.cc:740] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:32.151110 22473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:32.129887 26860 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:32.158319 26455 consensus_queue.cc:237] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.160444 26766 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:32.160820 26791 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:32.150405 26862 consensus_queue.cc:1059] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:18:32.172370 26897 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10.
I20260709 12:18:32.089570 26387 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:32.131826 26698 raft_consensus.cc:697] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:32.183068 26733 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:32.183733 26673 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.190546 26728 raft_consensus.cc:3055] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:32.145471 26743 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:32.246223 26728 raft_consensus.cc:740] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:32.251569 26728 consensus_queue.cc:260] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.252763 26728 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:32.194007 26798 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.194957 22516 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:32.200500 26910 log.cc:927] Time spent T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:18:32.210781 22473 raft_consensus.cc:606] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:32.126950 26814 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.222388 22398 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:18:32.250095 22475 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:32.149194 26772 consensus_queue.cc:1059] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:18:32.258648 22473 raft_consensus.cc:614] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:32.265002 22396 raft_consensus.cc:3055] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:32.268079 22396 raft_consensus.cc:740] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:32.229283 26578 raft_consensus.cc:3055] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:32.267045 22398 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: []
W20260709 12:18:32.274488 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 79609.2us
I20260709 12:18:32.276772 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:32.240346 26862 raft_consensus.cc:3055] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:32.268884 22396 consensus_queue.cc:260] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.281152 22396 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:32.288250 26772 consensus_queue.cc:1243] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:18:32.274178 26578 raft_consensus.cc:740] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:18:32.288842 26907 log.cc:927] Time spent T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:18:32.280133 26861 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:32.290156 26878 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.290457 26791 raft_consensus.cc:3055] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:32.290880 26791 raft_consensus.cc:740] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:32.291705 26791 consensus_queue.cc:260] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.292995 26791 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:32.293323 26816 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.283308 26869 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:32.293916 26816 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:32.294757 26869 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:32.296185 26816 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:32.296900 26869 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:32.298215 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:18:32.300093 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:32.300242 26892 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:32.300976 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:32.280712 26862 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:32.302444 26862 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.303659 26862 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:32.304186 23127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41012 (request call id 431) took 1326 ms. Trace:
I20260709 12:18:32.257505 26604 consensus_queue.cc:260] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.219012 26860 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:32.306238 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 1994) took 1189 ms. Trace:
I20260709 12:18:32.236177 26698 consensus_queue.cc:237] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.306655 22542 rpcz_store.cc:276] 0709 12:18:31.116721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.303304 (+186583us) service_pool.cc:224] Handling call
0709 12:18:31.909667 (+606363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.909882 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:31.909907 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:31.909947 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:31.909992 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.910045 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:32.306019 (+395974us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b540008cfd0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:32.306167 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1354743680}
I20260709 12:18:32.298259 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:32.312244 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 2110) took 1144 ms. Trace:
I20260709 12:18:32.312628 22393 rpcz_store.cc:276] 0709 12:18:31.167506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.168857 (+  1351us) service_pool.cc:224] Handling call
0709 12:18:32.312097 (+1143240us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54000a9954. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:32.312187 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760670464}
I20260709 12:18:32.319454 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:32.304615 23127 rpcz_store.cc:276] 0709 12:18:30.978216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.986475 (+  8259us) service_pool.cc:224] Handling call
0709 12:18:31.002328 (+ 15853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.127883 (+125555us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:18:31.169990 (+ 42107us) log.cc:844] Serialized 14 byte log entry
0709 12:18:31.237091 (+ 67101us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:31.237135 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:31.237173 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.149475 (+912302us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b18003846a0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a352a6 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419
0709 12:18:32.303897 (+154422us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54005f0fd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:32.303953 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:32.304108 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":343,"prepare.queue_time_us":13386,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":85,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4476,"spinlock_wait_cycles":298119168,"thread_start_us":66745,"threads_started":1,"wal-append.queue_time_us":171178}
I20260709 12:18:32.333209 22516 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:32.334080 26556 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:18:32.317683 26892 raft_consensus.cc:697] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:32.339125 26892 consensus_queue.cc:237] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.325932 26750 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:32.343222 26724 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:32.353020 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.367240 22396 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:18:32.375581 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:32.378536 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.347298 26861 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:32.306865 26860 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:32.382006 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.283119 26903 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:32.354672 22442 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:32.300097 26673 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:32.388437 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 55347.2us
I20260709 12:18:32.389528 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:32.393244 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:32.397339 22550 raft_consensus.cc:2393] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 8: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:18:32.393352 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 245792us
W20260709 12:18:32.397974 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.400810 22473 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:32.403692 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:32.405370 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:32.408450 22549 raft_consensus.cc:1240] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:32.396823 22442 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:32.412588 22442 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:32.380645 26604 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:32.414191 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:32.414600 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:32.415983 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:32.416105 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:32.417742 22550 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:32.418174 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:32.417151 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:32.420506 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:32.426080 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:32.431456 22546 raft_consensus.cc:2393] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 16: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:32.429255 22548 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:32.430053 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:32.425141 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.436630 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:32.437566 22397 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:32.436736 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:32.385439 26556 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.326602 26878 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:32.408099 26860 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.412859 26572 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:32.373685 26683 consensus_queue.cc:1059] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:18:32.471903 22550 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
W20260709 12:18:32.447468 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.445569 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:32.451339 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:32.582963 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:32.460961 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:32.461490 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.428519 26810 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:32.466394 26814 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:32.467947 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.584120 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:32.458679 26867 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:32.583084 22544 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:32.412283 26861 raft_consensus.cc:697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:32.289700 26578 consensus_queue.cc:260] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.447355 22546 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:32.471838 22469 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:18:32.587906 22470 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: [9.7-12.8]
I20260709 12:18:32.587131 22550 raft_consensus.cc:2368] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10.
I20260709 12:18:32.589931 22396 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:32.437317 26747 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:32.429479 26758 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:32.487383 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:32.407861 26903 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:32.452975 26572 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.509410 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:32.515036 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:32.515513 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 67448.9us
I20260709 12:18:32.450628 26556 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:32.439489 26456 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:32.440471 26676 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:18:32.465593 26801 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.650748 22515 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:32.652345 26801 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:32.653066 22475 raft_consensus.cc:1240] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:18:32.514101 26750 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.653923 26750 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.656005 26750 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:32.475036 26860 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:32.520856 26805 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:18:32.475409 26895 consensus_queue.cc:1059] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:18:32.579167 22477 raft_consensus.cc:1217] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Deduplicated request from leader. Original: 9.6->[11.7-11.7]   Dedup: 11.7->[]
I20260709 12:18:32.658011 22477 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:18:32.583108 22549 raft_consensus.cc:2393] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 15: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:32.585655 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:32.659301 22544 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:32.659675 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:32.660109 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:32.660341 22549 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9.
I20260709 12:18:32.660009 26676 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:32.660573 26860 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:32.661197 26456 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:18:32.586192 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:32.662210 22400 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 13.
I20260709 12:18:32.469581 22395 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: [9.7-12.8]
I20260709 12:18:32.411285 26707 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:32.663060 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:32.663525 26707 raft_consensus.cc:697] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:32.664031 26878 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:32.664440 26707 consensus_queue.cc:237] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.587183 26564 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.665905 22402 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:18:32.666029 26556 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:32.667258 26564 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:32.592530 22399 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:32.668066 23094 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:32.668831 26878 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:32.592988 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:32.673156 22551 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:32.673425 23125 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 10 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:32.667439 26884 raft_consensus.cc:3055] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:32.674757 26884 raft_consensus.cc:740] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:32.675570 26884 consensus_queue.cc:260] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:32.594009 26578 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:32.594877 26861 consensus_queue.cc:237] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.635880 26758 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.679800 26758 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:32.638549 26572 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:32.598510 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:32.681178 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 82753.1us
I20260709 12:18:32.661243 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:32.681914 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:32.682161 23094 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:32.682379 23123 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:32.583722 26885 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:32.602193 26820 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:32.603729 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.587198 26811 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.683061 26885 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.683382 26811 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:32.588593 26919 log.cc:927] Time spent T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.070s	user 0.000s	sys 0.003s
I20260709 12:18:32.605389 26716 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:18:32.632148 26810 raft_consensus.cc:697] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:18:32.609841 26889 consensus_queue.cc:1175] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b8621fa34be04d3fa2d68a300f858cd1" responder_term: 14 status { last_received { term: 13 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:32.685597 26810 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.687760 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:32.688335 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:32.688889 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:32.611759 26735 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:18:32.616243 26813 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.619026 26794 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:32.581032 26673 raft_consensus.cc:3055] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:32.691031 26673 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:32.621796 22394 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:18:32.691954 22394 pending_rounds.cc:85] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 8
I20260709 12:18:32.692526 22475 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:32.692816 22394 pending_rounds.cc:107] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:18:32.629436 22545 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:32.632722 22542 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
W20260709 12:18:32.640962 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 58985.3us
I20260709 12:18:32.689647 22472 raft_consensus.cc:2393] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 16: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:32.641672 26932 consensus_queue.cc:1059] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:32.644419 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:32.694221 23094 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:32.696593 23127 raft_consensus.cc:2368] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14.
I20260709 12:18:32.698005 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:32.689985 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:32.650166 26561 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:32.599123 26784 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:32.683851 26920 log.cc:927] Time spent T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.194s	user 0.000s	sys 0.004s
I20260709 12:18:32.668110 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:32.695700 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:32.698256 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:32.700404 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:32.710287 22542 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:18:32.647202 22543 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:32.702524 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:32.702428 22551 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:32.630642 26747 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:32.706174 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:32.623663 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:32.712250 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:32.718925 22475 raft_consensus.cc:2393] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 12: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:32.713160 26816 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:32.667971 26903 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:32.715322 26706 consensus_queue.cc:1059] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:18:32.715898 26933 log.cc:927] Time spent T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.075s	user 0.001s	sys 0.001s
I20260709 12:18:32.743505 26706 raft_consensus.cc:3055] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:32.716281 22476 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:32.716437 26813 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:32.743930 26706 raft_consensus.cc:740] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:32.694711 26869 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:32.714593 26758 consensus_queue.cc:1059] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:32.722078 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:32.744910 26706 consensus_queue.cc:260] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:32.714633 23095 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:32.734504 26455 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.718324 26878 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:32.773516 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 58954.3us
I20260709 12:18:32.774013 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:32.742635 26885 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:32.744865 26758 consensus_queue.cc:1243] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:32.776049 26724 raft_consensus.cc:3055] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:32.776504 26724 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:32.777428 26724 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:32.778685 26724 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:32.776106 26816 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:32.780419 26816 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.780782 26816 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:32.782536 26927 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.142s	user 0.002s	sys 0.000s
I20260709 12:18:32.748947 26811 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:32.751247 22469 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:32.774084 26878 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.784961 26878 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:32.753721 26932 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:32.753948 26884 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:32.754513 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 60367.4us
I20260709 12:18:32.717676 26673 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:32.717346 26561 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:32.720319 26747 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:32.718122 26797 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:32.770383 26716 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:32.793586 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:18:32.814020 26860 consensus_queue.cc:1175] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "65951063312d4a1e9123f92354101c71" responder_term: 10 status { last_received { term: 10 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:18:32.594170 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 448384us
W20260709 12:18:32.885193 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.889281 22366 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:32.890780 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:32.893079 22366 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:32.693186 22394 raft_consensus.cc:2889] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:32.724390 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:32.702428 22399 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:18:32.902530 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:32.904126 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:32.904249 22472 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:18:32.905596 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:32.907008 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:32.909548 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:32.912329 22475 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:32.793973 22515 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:32.915205 22468 raft_consensus.cc:1275] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:18:32.916117 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 122119us
W20260709 12:18:32.917747 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.921456 22515 leader_election.cc:400] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14.
I20260709 12:18:32.921949 22515 leader_election.cc:403] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:18:32.924048 22515 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:32.927083 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:32.928279 22543 raft_consensus.cc:2393] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 15: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:32.928196 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:32.930455 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:32.931434 22544 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:32.932432 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:32.933351 22542 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:32.934017 22551 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:18:32.934387 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:32.931481 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:32.935209 22545 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:18:32.935834 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:32.935881 22549 raft_consensus.cc:2410] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:18:32.929601 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:32.931479 22547 raft_consensus.cc:1275] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:18:32.948452 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.950492 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:32.812870 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:32.956837 23122 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 16 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:18:32.774044 26455 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.963773 26561 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:32.814334 26556 raft_consensus.cc:3055] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:32.965286 26556 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:32.966348 22544 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:32.967227 26455 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:32.968181 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:32.970321 22397 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
W20260709 12:18:32.970670 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.970858 26565 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:32.814787 26716 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.973804 26676 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:32.975195 26706 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:32.976080 26698 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14.
I20260709 12:18:32.977274 26758 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:32.826187 26673 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:32.985149 26791 consensus_meta.cc:287] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.692s	user 0.010s	sys 0.004s
I20260709 12:18:32.972102 26556 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:32.966214 22470 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
W20260709 12:18:32.998929 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 75114.7us
I20260709 12:18:33.000077 26676 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:33.027848 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:33.031392 26676 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:33.041074 26733 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.041883 26733 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.044624 26733 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.045311 26733 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.046088 26885 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.046854 26885 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.050141 26750 raft_consensus.cc:2764] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:18:33.050899 22546 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:18:33.051121 26750 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:33.051363 22546 pending_rounds.cc:85] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 6
I20260709 12:18:33.051672 22546 pending_rounds.cc:107] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:18:33.051949 26750 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:33.053247 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 160421us
I20260709 12:18:33.054423 22366 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:33.055773 26766 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:33.056303 26885 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.051613 22441 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:33.057170 26565 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:33.060389 26810 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:33.061667 26810 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:33.059096 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:33.062930 26810 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:33.064956 26578 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:33.065163 22441 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:33.068606 26810 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:33.069334 26810 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:33.070485 26578 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:33.074970 22441 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:33.081257 26805 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:33.081976 26805 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:33.083325 26805 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.088435 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:33.052032 22546 raft_consensus.cc:2889] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:33.090157 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:33.090891 22398 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:33.091913 22367 leader_election.cc:400] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13.
I20260709 12:18:33.092455 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:33.092818 26867 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.093590 26867 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.056227 26766 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:18:33.094533 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 57796.6us
I20260709 12:18:33.094821 26766 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:33.095924 26867 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.098878 26890 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:33.101681 22441 leader_election.cc:400] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10.
I20260709 12:18:33.107813 22441 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:33.108733 22393 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:18:33.109133 22393 pending_rounds.cc:85] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 8
I20260709 12:18:33.109378 22393 pending_rounds.cc:107] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:18:33.109617 22393 raft_consensus.cc:2889] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:33.106173 22402 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:33.112468 22393 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:33.115286 26556 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:33.116176 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.061448 26565 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:33.056267 22366 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:33.122213 26561 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:33.126754 26561 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.128822 26561 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:33.134938 26716 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:33.136864 26572 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.137409 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:33.147907 26572 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.148792 26572 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.138168 22367 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:33.127398 26733 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:33.163825 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 107757us
I20260709 12:18:33.164202 22473 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:33.164714 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:33.165200 26733 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.164999 26683 consensus_queue.cc:1059] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:33.166298 26683 raft_consensus.cc:3055] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:33.166709 26683 raft_consensus.cc:740] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:33.149346 26572 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:33.187219 22366 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:33.193819 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:33.186916 22515 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:33.187644 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:33.193233 22470 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:33.169961 26810 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:18:33.219740 26816 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:33.170392 26456 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.167979 26683 consensus_queue.cc:260] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.190199 22398 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:33.194182 22471 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:33.169716 22441 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:33.187304 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:33.174824 22399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 1949) took 1078 ms. Trace:
I20260709 12:18:33.183511 22442 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:33.223497 26878 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:33.200546 26750 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:33.176144 26248 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.236256 22366 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:33.197924 26735 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:33.241956 26869 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.242725 26869 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:33.237994 26791 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:33.249944 26743 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:33.250512 26743 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.250900 26743 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:33.251006 26456 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.199860 26747 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.255858 26747 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.229498 26716 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:33.231199 26561 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.258739 23130 raft_consensus.cc:2393] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 10: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:33.259725 26561 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.259548 26248 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:33.263432 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 93931us
I20260709 12:18:33.253528 26456 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.260511 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:33.265934 22550 raft_consensus.cc:2410] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:18:33.185019 26766 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.267699 23129 raft_consensus.cc:1240] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:33.169857 26922 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
W20260709 12:18:33.270973 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 84169.5us
I20260709 12:18:33.168224 26455 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 12:18:33.265666 26750 raft_consensus.cc:697] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:33.276937 26248 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.271811 26810 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:33.229277 22399 rpcz_store.cc:276] 0709 12:18:32.095951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.133976 (+ 38025us) service_pool.cc:224] Handling call
0709 12:18:33.174402 (+1040426us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b540005d2d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:33.174605 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034285952}
W20260709 12:18:33.290163 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 54001.8us
I20260709 12:18:33.275470 26561 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:33.294217 22394 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:33.294723 26728 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:33.297690 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:33.300088 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 116820us
I20260709 12:18:33.292342 26706 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:33.289888 26733 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:18:33.298199 26716 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:18:33.293381 26810 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:33.307873 26706 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.322924 26572 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:33.324352 26798 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:18:33.325384 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.302323 26561 raft_consensus.cc:697] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:33.306486 26869 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.334606 26820 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:33.335449 22366 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:33.334368 26750 consensus_queue.cc:237] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.337977 26820 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:33.342005 22543 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:33.327210 26706 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:33.351001 26766 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.352972 26676 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:33.359377 26676 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:33.353865 22442 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:33.360925 26572 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:33.367479 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.361706 26572 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:33.378547 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 80995.3us
I20260709 12:18:33.375290 26572 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:33.367463 26455 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:18:33.382827 22515 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:33.384059 26706 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.387771 26706 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:33.388619 26810 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.395910 26816 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.396117 26561 consensus_queue.cc:237] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.397598 26878 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.398855 22395 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:18:33.392064 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:33.402284 26743 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.406616 22476 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:18:33.408779 26743 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.411700 26572 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.414788 26572 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.418058 26676 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:33.401624 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:33.439149 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:33.440639 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:33.441345 22542 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:33.443332 23095 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:33.443842 22473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 2095) took 1040 ms. Trace:
I20260709 12:18:33.444233 22473 rpcz_store.cc:276] 0709 12:18:32.403296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.403447 (+   151us) service_pool.cc:224] Handling call
0709 12:18:33.443600 (+1040153us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b5400160b54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:33.443773 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726505216}
W20260709 12:18:33.441372 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.444072 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:33.448141 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:33.448583 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:33.450206 22476 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
I20260709 12:18:33.461992 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:33.462561 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:33.463327 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:33.465502 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:33.466250 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:33.465615 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:33.466538 22545 raft_consensus.cc:2393] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:33.445005 26869 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:18:33.474759 22470 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:33.478487 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:33.447934 26706 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:33.448871 26878 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:33.467772 22367 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:33.467061 23125 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:33.467219 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:33.449988 26733 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:18:33.474162 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:33.479351 22545 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:33.479310 22366 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:33.482154 23129 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
W20260709 12:18:33.486924 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 95268.8us
I20260709 12:18:33.492177 26728 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:33.492682 26728 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.493005 26728 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:33.496739 22542 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 14.
I20260709 12:18:33.497189 22401 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:33.500581 22547 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 9.
I20260709 12:18:33.501828 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:33.503084 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:33.503763 22547 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:33.504513 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:33.505110 22547 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:33.506011 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:33.506696 23122 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:33.506989 26724 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:33.507642 26724 consensus_queue.cc:1243] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:18:33.509508 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 2006) took 1069 ms. Trace:
I20260709 12:18:33.510812 22366 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:33.509939 22548 rpcz_store.cc:276] 0709 12:18:32.441438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.441641 (+   203us) service_pool.cc:224] Handling call
0709 12:18:32.442019 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:32.666261 (+224242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:32.666292 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:32.666718 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 12:18:32.926831 (+260113us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:33.038195 (+111364us) log.cc:844] Serialized 14 byte log entry
0709 12:18:33.119876 (+ 81681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.508997 (+389121us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400064ad4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:33.509039 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:33.509088 (+    49us) raft_consensus.cc:1685] finished
0709 12:18:33.509196 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:33.509334 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54135,"prepare.queue_time_us":204690,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":72,"raft.queue_time_us":82385,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":8392,"spinlock_wait_cycles":514859776,"thread_start_us":369106,"threads_started":2,"wal-append.queue_time_us":181315}
I20260709 12:18:33.511523 26706 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:33.514736 26766 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:33.515960 22548 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:18:33.519220 26716 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:33.519703 26955 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:18:33.520416 22544 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:18:33.523747 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:33.521062 22367 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:33.517690 22366 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:33.520931 22548 pending_rounds.cc:85] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 7
I20260709 12:18:33.527298 22545 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 12: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:33.530457 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:33.510041 26743 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:33.532799 22548 pending_rounds.cc:107] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:18:33.533392 22548 raft_consensus.cc:2889] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:33.535498 22401 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 14.
I20260709 12:18:33.522290 22551 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:33.535421 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:33.538861 26820 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.542420 22476 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:33.543926 26820 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.544345 26716 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.546535 22473 raft_consensus.cc:1275] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:33.547283 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:33.514638 26867 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:18:33.547508 26820 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.535241 26735 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:33.548306 26820 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:33.520692 26766 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:33.544121 26733 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:33.510831 26613 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:18:33.547967 22544 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:33.550489 22474 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:33.550894 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:33.536875 26743 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:33.551576 22544 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:33.549254 26766 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:33.551730 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:33.553133 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:33.553892 26743 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:33.546648 26716 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:33.553998 26683 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:33.559772 26676 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:33.564469 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:33.565459 23128 raft_consensus.cc:2368] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14.
I20260709 12:18:33.553650 22551 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:33.568744 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:33.539912 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:33.584553 22546 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:33.592147 26716 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:33.593336 26766 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.599845 22549 raft_consensus.cc:2468] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:33.599720 22544 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:33.601953 22544 raft_consensus.cc:1240] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:33.603350 22542 raft_consensus.cc:2393] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 8: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:33.607501 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:33.608381 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:33.623973 22551 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:33.608328 22471 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:33.631402 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:33.635582 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 89735.4us
I20260709 12:18:33.636914 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:33.638921 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:33.540197 26750 consensus_queue.cc:1048] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:18:33.639561 22544 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:33.639492 22475 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:33.641520 22367 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:33.644623 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:33.644833 26867 consensus_queue.cc:1048] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:33.645466 22471 raft_consensus.cc:2393] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 10: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:33.596640 26728 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.650496 26728 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.655943 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:33.656140 23094 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:33.656942 22551 raft_consensus.cc:2393] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 10: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:33.657817 26724 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:33.658362 26724 raft_consensus.cc:697] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 14 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:33.659260 26724 consensus_queue.cc:237] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:33.597577 26706 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:18:33.666618 23094 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:33.667595 22441 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:33.675431 22515 leader_election.cc:400] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14.
I20260709 12:18:33.675706 22515 leader_election.cc:403] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:18:33.677220 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:33.678403 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 160802us
I20260709 12:18:33.670053 26816 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:33.681838 22544 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:33.680827 22441 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:33.683758 22441 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:33.677145 26676 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.676433 26885 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:18:33.688223 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 46838.1us
I20260709 12:18:33.672931 26613 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:18:33.693457 22366 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:33.695225 26961 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:33.670650 26890 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:18:33.673087 26798 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:18:33.688246 26747 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:33.681994 26816 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.688304 26728 consensus_queue.cc:1059] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:18:33.688539 26561 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:33.709281 26728 raft_consensus.cc:3055] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:33.709910 26766 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.709820 26728 raft_consensus.cc:740] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:33.699110 26923 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:33.712392 22441 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:33.696506 26750 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.700243 26747 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.710989 26923 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.731382 26860 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14.
I20260709 12:18:33.731773 26923 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:33.735145 26766 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.735729 26766 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.737881 26766 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.704440 26816 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:33.730707 26572 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:33.740221 26743 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.740443 26747 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:33.694700 26676 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.741871 26869 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:33.742156 26750 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.742306 26961 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.704223 26561 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.748420 22441 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:33.770673 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:33.769340 26561 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:33.711143 26728 consensus_queue.cc:260] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:33.782977 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:33.771934 26890 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.779448 26885 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:33.783399 26810 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:33.795035 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:33.797233 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:33.815930 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:33.800491 26810 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.827741 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:33.778947 26961 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.789877 26572 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:18:33.809008 26766 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:33.835600 22394 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:33.812018 26885 raft_consensus.cc:697] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:33.839444 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:33.831395 26810 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:33.842145 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 59128.3us
I20260709 12:18:33.807225 26890 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.844767 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:33.839214 26728 raft_consensus.cc:3060] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:33.850805 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.859067 22441 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:33.859215 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:33.834951 26884 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 12:18:33.868078 22397 raft_consensus.cc:2393] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 10: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:33.869590 26974 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:33.870260 26974 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:33.872179 26733 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.872763 26733 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.889978 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:33.893915 22396 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:33.895277 26743 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:33.866832 22516 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.1:37927 timed out after 1.716s (SENT) [suppressed 8 similar messages]
I20260709 12:18:33.872498 26974 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.886188 26456 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:33.899221 26750 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.846812 26766 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.883038 26884 consensus_queue.cc:1243] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:33.900596 26676 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:33.922937 22470 pending_rounds.cc:85] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 9
I20260709 12:18:33.928342 22470 pending_rounds.cc:107] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:18:33.930358 22470 raft_consensus.cc:2889] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:33.934027 22395 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 8.
W20260709 12:18:33.925318 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 58522.7us
I20260709 12:18:33.935866 23095 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:33.914403 26456 raft_consensus.cc:697] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:33.937479 22402 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:33.945122 22367 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:33.887396 26923 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.951694 26860 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.952360 26860 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:33.953892 26966 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:18:33.955125 26860 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:33.956072 26890 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.955862 26456 consensus_queue.cc:237] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:33.955313 26766 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:33.958266 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:33.958618 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:33.962487 26969 log.cc:927] Time spent T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:18:33.968677 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:33.955268 26954 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.456s	user 0.004s	sys 0.002s
W20260709 12:18:34.011454 26967 log.cc:927] Time spent T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:18:33.948436 26706 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.012333 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:33.951714 22396 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 14. Current term is 15. Ops: []
W20260709 12:18:34.013227 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 58956.1us
I20260709 12:18:33.938849 26572 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.940953 26974 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:34.033890 22398 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 12: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:34.027388 22367 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:34.031632 22366 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:34.036576 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 87775.4us
I20260709 12:18:33.965121 26922 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:34.016889 26676 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.040567 22395 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:34.038431 22367 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:34.053525 22542 raft_consensus.cc:1240] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:18:33.929512 26885 consensus_queue.cc:237] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.058781 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:34.059448 22475 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:34.035630 26974 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.046312 26766 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:34.079366 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:34.046715 26735 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:34.082345 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:34.079406 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.049564 26683 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:34.106272 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 70180.5us
I20260709 12:18:34.108775 23094 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:34.109184 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:34.109788 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:34.110214 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:34.110582 26968 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:18:34.046082 26572 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.036990 26869 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:18:34.113186 22547 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:34.039987 26820 consensus_queue.cc:1059] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:18:34.057701 26706 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.079882 26974 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:34.134585 22394 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:34.071025 26961 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.143637 22402 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 12:18:34.135154 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 86746us
I20260709 12:18:34.208564 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2148) took 1229 ms. Trace:
I20260709 12:18:34.209293 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:34.113965 26735 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.112534 26766 raft_consensus.cc:697] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:34.080165 26860 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:18:34.211042 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 102365us
I20260709 12:18:34.069032 26676 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.220726 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:34.229177 22547 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:34.205332 26248 raft_consensus.cc:2804] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:18:34.230223 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 148700us
I20260709 12:18:34.237843 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:34.238796 22549 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:34.244256 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:34.245036 22397 raft_consensus.cc:2368] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14.
I20260709 12:18:34.212314 22400 rpcz_store.cc:276] 0709 12:18:32.914243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.917049 (+  2806us) service_pool.cc:224] Handling call
0709 12:18:32.917626 (+   577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:33.038302 (+120676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:33.038332 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:33.149970 (+111638us) log.cc:844] Serialized 26 byte log entry
0709 12:18:33.298918 (+148948us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:33.298970 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.299037 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:33.909821 (+610784us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:34.113561 (+203740us) raft_consensus.cc:1685] finished
0709 12:18:34.113585 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.143972 (+ 30387us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107090,"raft.queue_time_us":132169,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":7694208,"thread_start_us":139917,"threads_started":1,"wal-append.queue_time_us":313955}
I20260709 12:18:34.244661 22393 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:34.125522 26683 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.262583 26613 raft_consensus.cc:476] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Not starting pre-election -- already a leader
I20260709 12:18:34.143989 26747 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.252475 26962 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.263759 26683 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:34.263810 26962 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.229640 26816 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:34.265074 26747 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.266386 26816 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.266551 26962 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.220542 26735 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:34.253249 26991 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:34.253484 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:34.254098 26978 log.cc:927] Time spent T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
W20260709 12:18:34.254474 26979 log.cc:927] Time spent T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:18:34.255164 26798 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:34.271335 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:34.271848 26798 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.271991 22551 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:18:34.274081 26798 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:34.274317 22551 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:34.274652 26733 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.274968 26676 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:34.276557 26892 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.277061 26892 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.277521 26991 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:34.278146 26991 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.278589 26750 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.278895 26572 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.279211 26892 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:34.279541 26743 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:34.222913 26561 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.280153 26743 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:34.281490 26561 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:34.249073 26984 log.cc:927] Time spent T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:18:34.281904 26791 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.259229 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:34.282512 26791 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.284564 26791 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.284868 26613 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:34.262708 22544 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:34.245090 26248 raft_consensus.cc:697] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 10 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:34.288292 26743 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:34.288738 26248 consensus_queue.cc:237] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:34.270984 26706 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:34.279150 26750 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:34.279309 26986 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:18:34.292348 26923 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.292775 26991 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:34.293702 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:34.294324 22401 raft_consensus.cc:2376] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14. Re-sending same reply.
I20260709 12:18:34.249754 22402 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:18:34.307636 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 74622.4us
I20260709 12:18:34.308557 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.308954 26750 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.314823 22477 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:34.308219 26987 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:34.314908 22366 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:34.260893 26810 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:34.309867 26766 consensus_queue.cc:237] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.318198 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:34.366918 22398 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:34.322454 22366 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:34.372994 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 50609.8us
I20260709 12:18:34.373819 22366 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:34.377230 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:34.378113 26990 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:34.378576 26990 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.378981 26990 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:34.378732 26706 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:34.380276 26706 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.381699 26976 consensus_queue.cc:1059] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:18:34.382477 26706 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:34.383826 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:34.384336 22474 raft_consensus.cc:2393] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 10: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:18:34.385107 26728 consensus_meta.cc:287] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.526s	user 0.005s	sys 0.004s
I20260709 12:18:34.237438 26860 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.387897 26860 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:34.378042 26923 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:18:34.389027 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:34.370069 26750 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:34.378511 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:34.390929 22549 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:34.383666 26810 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:34.392438 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:34.377655 22366 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:34.390313 26750 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.413971 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:34.403520 22366 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:34.321440 22442 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:34.418426 26922 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:34.422096 26922 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.422434 26922 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:34.402498 26987 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:34.432771 22395 raft_consensus.cc:1275] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:34.433820 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:34.436662 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:34.438503 22545 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 12: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:34.415328 26961 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:34.413729 26860 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.417757 26750 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:34.448550 22549 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:34.435155 26987 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.455560 26987 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:34.453862 26961 raft_consensus.cc:697] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:18:34.466657 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 182766us
W20260709 12:18:34.486141 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 264403us
I20260709 12:18:34.453470 26860 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:34.487820 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:34.495417 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:34.495985 22546 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:18:34.496006 22545 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:34.500483 26683 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:34.503813 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:34.510015 26673 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:34.510576 26673 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:34.502595 26683 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.530164 26961 consensus_queue.cc:237] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.532778 22516 leader_election.cc:400] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14.
I20260709 12:18:34.516959 26683 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:34.549845 26798 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:34.550463 26989 raft_consensus.cc:3055] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:34.550860 26989 raft_consensus.cc:740] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:34.551724 26989 consensus_queue.cc:260] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.552696 26989 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:34.529563 26977 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:18:34.553500 26974 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:34.508867 26735 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.559058 23129 raft_consensus.cc:2368] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13.
I20260709 12:18:34.564913 26987 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.568913 22398 raft_consensus.cc:2393] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 11: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:34.576855 26996 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.585523 22545 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:34.588299 22395 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:34.591252 23094 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:34.598989 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:34.599800 22402 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:18:34.560907 26892 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:18:34.602903 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:34.605801 22402 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 15: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:34.609967 26976 raft_consensus.cc:3055] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:34.610452 26976 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:34.611331 26976 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:34.613691 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 76495.6us
I20260709 12:18:34.614490 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:34.615656 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:34.616554 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:34.589115 26996 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:34.618062 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 296687us
I20260709 12:18:34.600589 26248 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:34.619683 22442 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:34.621670 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:34.623232 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:34.624320 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:34.605065 26860 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:34.607098 26892 consensus_queue.cc:1243] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer b8621fa34be04d3fa2d68a300f858cd1 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:34.638151 22442 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:34.626618 26716 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:34.627861 27001 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.639004 26735 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.639166 27001 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.641217 26996 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.619582 26820 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:34.628870 26990 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.641503 27001 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.642023 26820 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:34.643440 26990 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.629390 26798 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:34.629796 26248 raft_consensus.cc:697] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 10 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:34.627236 26728 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:34.644641 26728 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.645032 26248 consensus_queue.cc:237] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:34.645939 26992 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:34.646765 26728 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.635433 26976 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:34.644898 26983 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:34.650606 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:34.635325 26922 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.655086 26922 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.635982 26805 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:34.637085 26561 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:34.655843 26805 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:34.629119 26991 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:34.641680 22402 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:34.657212 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.658088 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.644178 22442 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:34.672462 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.662320 22469 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 8.
I20260709 12:18:34.619586 26556 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:34.683743 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:34.683944 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:34.684450 22473 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:34.684582 22469 raft_consensus.cc:2393] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 12: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:34.625883 26747 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:34.685417 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.679035 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:34.656301 26805 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:34.644110 26820 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:34.689627 22472 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:34.688546 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.659794 26987 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.673574 26991 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.691236 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.692147 26707 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:34.693802 22472 raft_consensus.cc:1240] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:34.690692 22470 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:34.709604 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:34.710367 22545 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:34.715298 26766 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:34.715917 26766 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:34.720312 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.722163 22477 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:34.726353 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.727720 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.728830 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:34.729321 27006 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:18:34.731449 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:34.732664 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:34.733338 22400 raft_consensus.cc:2368] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15.
I20260709 12:18:34.733865 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:34.734467 22395 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:18:34.735617 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:34.736310 27013 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:18:34.736814 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:34.737841 26455 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:34.740248 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:34.740975 22396 raft_consensus.cc:2393] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 9: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:34.720269 26747 consensus_queue.cc:1059] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:18:34.741998 26747 raft_consensus.cc:3055] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:34.742386 26747 raft_consensus.cc:740] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:34.743260 26747 consensus_queue.cc:260] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:34.726521 27015 log.cc:927] Time spent T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:18:34.690274 26884 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:34.749089 22442 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:34.751075 22516 leader_election.cc:400] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15.
I20260709 12:18:34.751608 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:34.705796 26991 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:34.749899 22366 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:34.754612 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:34.764809 22549 raft_consensus.cc:2410] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 14 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:18:34.755196 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:34.765328 22546 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:34.757208 22516 leader_election.cc:403] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:34.758211 22473 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:18:34.753226 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.758271 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:34.756968 22545 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 13.
W20260709 12:18:34.770773 27010 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:18:34.774133 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:34.775653 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:34.776360 22550 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:34.777305 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:34.778083 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:34.778826 22543 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:34.779374 22477 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:34.779868 23095 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:34.780390 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.780973 26248 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:34.781132 22477 raft_consensus.cc:2393] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 11: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:34.783325 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:34.783898 22542 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:34.785961 26556 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:18:34.786484 22400 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:34.787936 22548 raft_consensus.cc:1240] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:34.789034 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:34.789949 26999 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 12:18:34.794456 26922 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:34.794739 26673 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:34.760872 26892 consensus_queue.cc:1059] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:18:34.797012 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:34.798687 22470 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 12: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:34.799564 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:34.800516 22545 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:34.802047 22367 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:34.809556 22546 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
I20260709 12:18:34.757473 22393 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:34.812646 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:34.806914 22366 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:34.814374 22367 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:34.817983 22543 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:34.821022 22395 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 13.
I20260709 12:18:34.720551 26996 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.719185 26974 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.822968 22546 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:34.826749 22549 raft_consensus.cc:1217] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 7.5->[8.6-13.8]   Dedup: 8.6->[11.7-13.8]
I20260709 12:18:34.830008 22549 pending_rounds.cc:85] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 6
I20260709 12:18:34.830250 22549 pending_rounds.cc:107] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:18:34.830497 22549 raft_consensus.cc:2889] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:34.827925 26884 raft_consensus.cc:697] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:34.825341 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:34.828542 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 79551.3us
I20260709 12:18:34.828785 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.832890 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.752491 26766 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:34.766786 26747 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:34.834632 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:34.845625 22546 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 12: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:34.843297 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:34.797293 26990 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.828084 27001 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:34.857429 22548 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:34.840171 22516 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:34.864735 22542 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:34.834829 26892 consensus_queue.cc:1243] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer b8621fa34be04d3fa2d68a300f858cd1 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:34.834898 26735 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:34.836114 26987 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:34.880157 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:34.884667 22546 raft_consensus.cc:2410] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:18:34.884994 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:34.882020 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:34.890292 22548 raft_consensus.cc:2393] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 10: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
W20260709 12:18:34.897039 27021 log.cc:927] Time spent T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:18:34.907922 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.909323 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:34.912640 27004 log.cc:927] Time spent T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.383s	user 0.002s	sys 0.001s
I20260709 12:18:34.914718 26884 consensus_queue.cc:237] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.916577 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.917330 22476 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:18:34.860078 26820 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:34.918294 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.918946 22476 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:34.919603 26750 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.922091 22397 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 12: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:34.843701 26996 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.924536 26996 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.882478 26455 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:18:34.831833 26728 consensus_queue.cc:1059] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 12:18:34.945376 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 130141us
W20260709 12:18:34.958230 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 143938us
I20260709 12:18:34.928788 26683 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.958907 22367 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:34.877064 27001 raft_consensus.cc:697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:34.884135 26987 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:34.965173 22396 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:18:34.962776 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:34.860563 26990 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:34.921694 26750 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:34.977272 26996 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:34.978021 27003 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:34.982684 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:34.997403 27003 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.997884 27003 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:35.007014 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:34.977440 27018 log.cc:927] Time spent T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:18:34.992808 26922 raft_consensus.cc:697] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:35.013263 22550 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 12: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:35.015447 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:35.007680 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:35.020293 22367 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:35.016629 22366 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:35.021889 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:35.023763 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:35.024115 26820 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:35.026270 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:35.027230 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:34.975634 26987 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:35.025898 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:35.030923 22474 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:35.022493 22396 pending_rounds.cc:85] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 7
I20260709 12:18:35.031507 22396 pending_rounds.cc:107] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:18:35.031787 22470 raft_consensus.cc:2368] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15.
I20260709 12:18:35.031875 22396 raft_consensus.cc:2889] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:35.036077 22367 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:35.025978 26993 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
W20260709 12:18:35.025914 27024 log.cc:927] Time spent T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:18:35.040568 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:34.944576 26805 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:35.044127 23095 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:35.038728 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:35.027827 26996 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:35.029747 26810 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.047848 22366 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:35.056443 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:35.023705 26455 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:18:35.063467 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:35.063971 22366 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:35.065737 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:35.065423 27028 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:35.055421 26728 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:35.047668 26750 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:35.067420 22470 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:35.056145 27009 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:35.097981 26820 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:35.098564 26820 raft_consensus.cc:697] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:35.099524 26820 consensus_queue.cc:237] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.044360 26992 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:35.101385 27028 raft_consensus.cc:697] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:35.060196 26735 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:35.103525 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:35.097527 22366 leader_election.cc:400] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13.
I20260709 12:18:35.104303 22548 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 12: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:35.104264 22366 leader_election.cc:403] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:35.105208 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:35.069031 26989 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:35.058807 26724 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:18:35.060259 26810 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:35.125290 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.100582 26992 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:35.133673 27025 log.cc:927] Time spent T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:18:35.134106 26994 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.134732 26994 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.135004 27028 consensus_queue.cc:237] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.135560 26810 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:35.137151 26994 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:35.122997 26989 raft_consensus.cc:697] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:35.137818 26988 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13.
I20260709 12:18:35.138666 26989 consensus_queue.cc:237] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.140403 26556 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15.
I20260709 12:18:35.144416 26805 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:35.145416 26683 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:35.146111 26683 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:35.146603 26683 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:35.148758 26683 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:35.119830 26750 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:35.149478 22397 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:35.150604 26750 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.103714 26922 consensus_queue.cc:237] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.152124 22397 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:35.145506 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:35.135138 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2460) took 1092 ms. Trace:
I20260709 12:18:35.166241 22547 rpcz_store.cc:276] 0709 12:18:34.042996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.232626 (+189630us) service_pool.cc:224] Handling call
0709 12:18:34.251194 (+ 18568us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:34.262459 (+ 11265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:34.262493 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:34.723029 (+460536us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b2c001328c8. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f744da11 00007fb4f745d372 00007fb4f8b8fa01 00007fb4f8b5443a 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2
0709 12:18:34.723413 (+   384us) log.cc:844] Serialized 26 byte log entry
0709 12:18:34.873134 (+149721us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:34.873175 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.873249 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:35.134837 (+261588us) raft_consensus.cc:1685] finished
0709 12:18:35.134857 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:35.135077 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":895,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":77965568,"thread_start_us":149317,"threads_started":1,"wal-append.queue_time_us":298041}
I20260709 12:18:35.188552 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:35.189424 22401 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 12: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:35.088311 27001 consensus_queue.cc:237] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.193856 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:35.194656 22476 raft_consensus.cc:2393] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 10: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:18:35.199924 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 54500.4us
I20260709 12:18:35.202641 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:35.208680 22547 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
W20260709 12:18:35.192148 26561 consensus_meta.cc:287] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 12:18:35.202663 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:35.217243 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:35.193207 26990 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:35.232760 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:35.234364 22366 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:35.241083 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:35.241760 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:35.243402 22397 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:35.221725 26561 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:35.268761 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:35.202312 27032 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:35.234872 26716 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:35.275882 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:35.230597 26860 raft_consensus.cc:3055] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:35.230751 26820 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.268427 26990 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:35.217440 26991 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.241439 26683 raft_consensus.cc:2764] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:18:35.282640 22516 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:35.287449 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:35.291986 26724 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.292553 26724 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:35.294991 26977 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:35.295818 26673 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:35.295517 26977 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:35.299157 26961 raft_consensus.cc:3055] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:35.299611 22516 leader_election.cc:400] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15.
I20260709 12:18:35.299618 26961 raft_consensus.cc:740] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:35.300513 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:35.304069 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 2181) took 1061 ms. Trace:
I20260709 12:18:35.304493 22398 rpcz_store.cc:276] 0709 12:18:34.242906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.416099 (+173193us) service_pool.cc:224] Handling call
0709 12:18:35.303874 (+887775us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54000aa354. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:35.304008 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302196096}
I20260709 12:18:35.306596 26706 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:35.307121 26706 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:35.307530 26706 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:35.281818 26860 raft_consensus.cc:740] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:35.285034 26990 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.266273 26456 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:18:35.361620 22546 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16. Ops: []
W20260709 12:18:35.365280 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 83696.4us
I20260709 12:18:35.286115 27033 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:35.373737 26860 consensus_queue.cc:260] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:35.356276 26982 log.cc:927] Time spent T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:18:35.377965 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:35.379221 22548 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:35.354360 27027 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:18:35.370711 27012 log.cc:927] Time spent T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.757s	user 0.001s	sys 0.003s
I20260709 12:18:35.395371 22468 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:35.330469 27009 raft_consensus.cc:697] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:35.384250 26794 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:35.388099 26860 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:35.388619 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:35.358909 26455 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:18:35.389582 26747 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:35.390411 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:35.388203 26248 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
W20260709 12:18:35.392724 27034 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:18:35.394340 26961 consensus_queue.cc:260] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.449450 26961 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:35.395299 27029 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:35.363415 26990 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:35.398607 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 120198us
I20260709 12:18:35.382580 26766 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:35.286127 26820 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:35.414448 27038 log.cc:927] Time spent T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:18:35.416592 26991 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:35.419881 27023 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.446s	user 0.002s	sys 0.000s
W20260709 12:18:35.392067 27035 log.cc:927] Time spent T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:18:34.977663 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:35.391978 26987 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:35.376257 27033 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:35.543776 27033 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:35.547983 22474 consensus_meta.cc:287] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.000s
I20260709 12:18:35.548368 22474 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:35.453033 22542 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
W20260709 12:18:35.412058 27043 log.cc:927] Time spent T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260709 12:18:35.398659 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 164292us
W20260709 12:18:35.456336 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.555716 22442 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:35.556047 26766 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:35.556830 26724 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:35.558599 26766 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:35.560247 26766 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:35.560803 26766 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.562836 26992 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:35.455350 26988 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:35.576932 26996 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:35.553537 26977 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:35.412711 27027 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.580747 26884 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:35.599750 27008 log.cc:927] Time spent T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.980s	user 0.003s	sys 0.003s
W20260709 12:18:35.618624 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 237494us
I20260709 12:18:35.599511 26724 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:35.530645 27029 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.602742 27051 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:35.632160 22441 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:35.635489 22393 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:18:35.632844 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 2052) took 1526 ms. Trace:
I20260709 12:18:35.594254 26988 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.636410 22551 rpcz_store.cc:276] 0709 12:18:34.106900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.294265 (+187365us) service_pool.cc:224] Handling call
0709 12:18:34.294582 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:34.305427 (+ 10845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:34.305469 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:34.308027 (+  2558us) log.cc:844] Serialized 26 byte log entry
0709 12:18:34.685346 (+377319us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b18004278a0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a49e07 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b 00007fb4f86f3d23 00007fb4f86f40d1 00007fb4f8b0fa0f
0709 12:18:34.748692 (+ 63346us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:34.748727 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.748850 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:35.418985 (+670135us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:35.632638 (+213653us) raft_consensus.cc:1685] finished
0709 12:18:35.632659 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:35.632785 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9359,"raft.queue_time_us":10979,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":19142272,"thread_start_us":63168,"threads_started":1,"wal-append.queue_time_us":665136}
W20260709 12:18:35.635710 27003 consensus_meta.cc:287] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.003s
W20260709 12:18:35.722468 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.615288 26996 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.619230 26706 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:35.771011 26706 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:35.771517 26923 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.771865 22547 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:35.631517 26724 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:35.749637 26989 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.003s	sys 0.009s
I20260709 12:18:35.713752 26750 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:35.786916 22544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2476) took 1369 ms. Trace:
I20260709 12:18:35.799443 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:35.789031 22544 rpcz_store.cc:276] 0709 12:18:34.417420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.417587 (+   167us) service_pool.cc:224] Handling call
0709 12:18:34.420306 (+  2719us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:34.420691 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:34.420717 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:34.421183 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:18:34.499828 (+ 78645us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:34.499864 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.499929 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:35.557483 (+1057554us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:35.779806 (+222323us) raft_consensus.cc:1685] finished
0709 12:18:35.779830 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:35.786845 (+  7015us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5636,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":1613,"spinlock_wait_cycles":11010816,"thread_start_us":77962,"threads_started":1,"wal-append.queue_time_us":165295}
W20260709 12:18:35.793591 26989 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.004s	sys 0.009s
I20260709 12:18:35.628031 27009 consensus_queue.cc:237] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:35.811123 27058 log.cc:927] Time spent T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:18:35.853991 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.798457 26892 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.801901 26706 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:35.810679 26794 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:35.755898 27003 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:35.859009 27056 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:35.891099 27056 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.893365 27056 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:35.638713 27051 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.860184 27065 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.862092 27068 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:35.862751 27064 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:18:35.888347 26724 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:35.888818 26892 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.889833 26987 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:35.859787 26766 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:35.785723 26923 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:35.878706 26996 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:35.906924 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 489) took 1610 ms. Trace:
I20260709 12:18:35.907648 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1992) took 1282 ms. Trace:
I20260709 12:18:35.878019 27027 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:35.879892 27003 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:35.894917 26988 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:35.826983 26820 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:35.875787 27057 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:18:35.913640 27065 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.887373 26706 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.936028 27065 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:35.936524 26706 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:35.856864 26989 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:35.937597 26989 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:35.801525 26750 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:35.940321 26923 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:35.926501 22394 rpcz_store.cc:276] 0709 12:18:34.625620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.951434 (+325814us) service_pool.cc:224] Handling call
0709 12:18:34.974780 (+ 23346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:35.019124 (+ 44344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:35.019159 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:35.033980 (+ 14821us) log.cc:844] Serialized 52 byte log entry
0709 12:18:35.188416 (+154436us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:35.266237 (+ 77821us) log.cc:844] Serialized 14 byte log entry
0709 12:18:35.875703 (+609466us) log.cc:844] Serialized 14 byte log entry
0709 12:18:35.907364 (+ 31661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:35.907430 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:35.907469 (+    39us) raft_consensus.cc:1685] finished
0709 12:18:35.907480 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:35.907601 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":652920,"prepare.queue_time_us":1295317,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":63369,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":9603,"spinlock_wait_cycles":5088512,"thread_start_us":170688,"threads_started":2,"wal-append.queue_time_us":210410}
I20260709 12:18:35.927318 22395 rpcz_store.cc:276] 0709 12:18:34.296995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.826954 (+529959us) service_pool.cc:224] Handling call
0709 12:18:34.863063 (+ 36109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.863260 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:18:35.187516 (+324256us) log.cc:844] Serialized 14 byte log entry
0709 12:18:35.872032 (+684516us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b180031ee20. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f59e1c0a 00007fb4ff121219 00007fb4f5a69a40 00007fb4f5a644e4 00007fb4f5a64455 00007fb4fc54c3c7 00007fb4f8b5e9a7 00007fb4f8b6e0bf 00007fb4f8b6e038
0709 12:18:35.872305 (+   273us) log.cc:844] Serialized 14 byte log entry
0709 12:18:35.906579 (+ 34274us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:35.906642 (+    63us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:35.906689 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:35.906751 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:35.906872 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47795,"prepare.queue_time_us":1692523,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":71,"raft.queue_time_us":39696,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":7670,"spinlock_wait_cycles":15467904,"thread_start_us":300809,"threads_started":1}
I20260709 12:18:35.913972 22547 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:18:35.942272 27042 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.474s	user 0.006s	sys 0.006s
I20260709 12:18:35.915875 27068 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:35.943661 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:35.944324 22395 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:35.944842 27068 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:35.945331 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:35.945649 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1994) took 1265 ms. Trace:
I20260709 12:18:35.946002 22395 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:35.948091 26750 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:35.948374 26993 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:35.948618 27045 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:35.948987 26993 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:35.949824 27045 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:35.951277 26977 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:35.951529 26993 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:35.949056 23094 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:35.953131 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:18:35.920209 27066 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.052s	user 0.003s	sys 0.000s
W20260709 12:18:35.941913 27067 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.003s
I20260709 12:18:35.948767 22396 rpcz_store.cc:276] 0709 12:18:34.680577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.988224 (+307647us) service_pool.cc:224] Handling call
0709 12:18:35.014438 (+ 26214us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:35.047671 (+ 33233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:35.047700 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:35.060081 (+ 12381us) log.cc:844] Serialized 52 byte log entry
0709 12:18:35.243347 (+183266us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:35.243386 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:35.243450 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:35.893323 (+649873us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:35.945338 (+ 52015us) raft_consensus.cc:1685] finished
0709 12:18:35.945358 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:35.945576 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18284,"raft.queue_time_us":10689,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6143,"spinlock_wait_cycles":24419200,"thread_start_us":134052,"threads_started":1,"wal-append.queue_time_us":286542}
I20260709 12:18:35.940245 26989 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:35.962731 27003 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:35.977541 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:35.978440 22394 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:35.983444 22395 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:35.964545 26993 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:35.969693 27045 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:35.958963 26977 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:36.015095 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:35.973662 27003 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:36.025228 27003 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:35.979509 26707 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.029069 26707 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.031204 26707 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:36.032655 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 2136) took 1125 ms. Trace:
I20260709 12:18:36.016243 26993 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.034729 26993 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:36.041067 27051 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:36.044250 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:36.045246 22402 raft_consensus.cc:2410] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:18:36.019366 27074 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:18:36.022619 26892 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:36.023240 26977 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:36.023504 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2193) took 1006 ms. Trace:
I20260709 12:18:36.033021 22469 rpcz_store.cc:276] 0709 12:18:34.907396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.910509 (+  3113us) service_pool.cc:224] Handling call
0709 12:18:34.910972 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.911301 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:34.911594 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 12:18:35.624794 (+713200us) log.cc:844] Serialized 14 byte log entry
0709 12:18:35.630591 (+  5797us) log.cc:844] Serialized 14 byte log entry
0709 12:18:36.032082 (+401491us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b18004870c0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f59e1c0a 00007fb4ff121219 00007fb4f5a69a40 00007fb4f5a644e4 00007fb4f5a64455 00007fb4f8b4c060 00007fb4f8b5e716 00007fb4f8b6f287 00007fb4f8b6f208
0709 12:18:36.032237 (+   155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:36.032287 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:36.032330 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.032400 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.032568 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7820,"prepare.queue_time_us":101890,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":131,"raft.queue_time_us":41345,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":4199,"spinlock_wait_cycles":20376192,"thread_start_us":695739,"threads_started":3,"wal-append.queue_time_us":257471}
W20260709 12:18:36.024821 27044 log.cc:927] Time spent T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.629s	user 0.000s	sys 0.012s
I20260709 12:18:36.052675 22397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1997) took 1021 ms. Trace:
I20260709 12:18:36.053539 22398 rpcz_store.cc:276] 0709 12:18:35.017537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.305471 (+287934us) service_pool.cc:224] Handling call
0709 12:18:35.312042 (+  6571us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:35.634581 (+322539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:35.634637 (+    56us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:35.713621 (+ 78984us) log.cc:844] Serialized 52 byte log entry
0709 12:18:35.913141 (+199520us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:35.913187 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:35.913253 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:36.023251 (+109998us) raft_consensus.cc:1685] finished
0709 12:18:36.023275 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.023438 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46348,"raft.queue_time_us":70774,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":49623,"thread_start_us":426152,"threads_started":2,"wal-append.queue_time_us":221669}
I20260709 12:18:36.054235 22397 rpcz_store.cc:276] 0709 12:18:35.030998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.546528 (+515530us) service_pool.cc:224] Handling call
0709 12:18:35.546848 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:35.547062 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:35.880107 (+333045us) log.cc:844] Serialized 14 byte log entry
0709 12:18:36.052297 (+172190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:36.052350 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:36.052399 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.052485 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.052620 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":332744,"prepare.queue_time_us":333587,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"thread_start_us":171838,"threads_started":1}
I20260709 12:18:36.058143 22401 raft_consensus.cc:1275] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:18:36.058493 22401 pending_rounds.cc:85] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 8
I20260709 12:18:36.058709 22401 pending_rounds.cc:107] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:18:36.058945 22401 raft_consensus.cc:2889] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:36.050462 27062 log.cc:927] Time spent T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.003s
W20260709 12:18:36.050635 26860 consensus_meta.cc:287] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.001s
I20260709 12:18:36.061352 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:36.057396 27033 consensus_meta.cc:287] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.000s
I20260709 12:18:36.060792 26985 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:36.073664 26985 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.073467 26716 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:36.075150 26716 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:36.075976 26985 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:36.070526 27033 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.078928 27033 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:36.081530 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 449433us
I20260709 12:18:36.082238 27029 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:36.082906 22441 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:36.083359 27037 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:36.084043 27037 consensus_queue.cc:1059] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:36.084889 27040 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:36.087242 26556 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.087613 22398 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
W20260709 12:18:36.088282 27061 log.cc:927] Time spent T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.226s	user 0.001s	sys 0.001s
I20260709 12:18:36.088696 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:36.091360 26990 consensus_meta.cc:287] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.000s
I20260709 12:18:36.091804 26990 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.084051 22441 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:36.093335 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:36.096575 26985 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:36.099272 26977 consensus_queue.cc:1048] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:36.099359 26993 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:36.101372 26993 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:36.101781 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:36.095870 22441 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:36.103657 27001 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:36.107031 26747 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:36.107616 26747 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:36.110703 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:36.111351 22476 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:36.114084 27003 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.116212 27003 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:36.116838 26990 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:36.116632 26724 consensus_queue.cc:1059] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:36.118515 26724 raft_consensus.cc:3055] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:36.118866 26724 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:36.119704 26724 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:36.120841 26724 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:36.122485 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:36.123412 22516 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:36.123612 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:36.124529 26991 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:36.125027 26991 raft_consensus.cc:697] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:36.124460 27033 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:36.125916 26991 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:36.126376 27033 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:36.126806 27033 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:36.108116 22401 raft_consensus.cc:1240] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:36.129822 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:36.114113 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:36.132300 27072 log.cc:927] Time spent T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.271s	user 0.002s	sys 0.000s
W20260709 12:18:36.136176 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.141072 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:36.141729 22542 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:36.142081 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:36.144469 26892 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:36.150041 22398 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 15: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:36.145068 26892 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.152309 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:36.154863 22542 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:18:36.156036 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2197) took 1003 ms. Trace:
I20260709 12:18:36.162948 22400 rpcz_store.cc:276] 0709 12:18:35.152847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.803673 (+650826us) service_pool.cc:224] Handling call
0709 12:18:35.851934 (+ 48261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:35.895480 (+ 43546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:35.895514 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:35.896023 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 12:18:35.967970 (+ 71947us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:35.968010 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:35.968096 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:36.155786 (+187690us) raft_consensus.cc:1685] finished
0709 12:18:36.155808 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.155970 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":495,"raft.queue_time_us":49893,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":7513,"thread_start_us":71488,"threads_started":1,"wal-append.queue_time_us":257866}
I20260709 12:18:36.164052 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:18:36.156338 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.166702 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:36.173491 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:36.174293 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:36.176098 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:36.164748 23128 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:36.185130 22544 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:36.185616 22393 raft_consensus.cc:1240] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:18:36.145210 26735 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:36.186744 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:36.186920 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:36.185530 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 44368.1us
W20260709 12:18:36.188539 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 53710.4us
I20260709 12:18:36.189347 22399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1995) took 1502 ms. Trace:
I20260709 12:18:36.214389 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:36.214812 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:36.228670 22550 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:18:36.230064 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 88689.8us
I20260709 12:18:36.230542 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:36.109704 26747 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:36.233786 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:36.233112 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:36.226514 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 1998) took 1031 ms. Trace:
I20260709 12:18:36.237496 22394 rpcz_store.cc:276] 0709 12:18:35.153835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.007049 (+853214us) service_pool.cc:224] Handling call
0709 12:18:36.017206 (+ 10157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.017426 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:36.041826 (+ 24400us) log.cc:844] Serialized 14 byte log entry
0709 12:18:36.167049 (+125223us) log.cc:844] Serialized 14 byte log entry
0709 12:18:36.184797 (+ 17748us) log.cc:844] Serialized 14 byte log entry
0709 12:18:36.184978 (+   181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:36.185020 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:36.185066 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.185131 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.185230 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6154,"prepare.queue_time_us":24416,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":91,"raft.queue_time_us":160165,"thread_start_us":118456,"threads_started":1,"wal-append.queue_time_us":117515}
I20260709 12:18:36.233021 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:36.234555 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:36.150674 27003 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:36.243049 22366 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:36.244961 22543 raft_consensus.cc:2393] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:36.245253 22477 raft_consensus.cc:2393] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 10: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:36.236920 22475 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:36.087809 26556 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.263734 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:36.160169 27033 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:36.269166 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 48377.8us
I20260709 12:18:36.273512 22544 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:36.221028 22399 rpcz_store.cc:276] 0709 12:18:34.686766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.067936 (+381170us) service_pool.cc:224] Handling call
0709 12:18:35.068295 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:35.108787 (+ 40492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:35.109600 (+   813us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:35.123594 (+ 13994us) log.cc:844] Serialized 52 byte log entry
0709 12:18:35.270353 (+146759us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:35.878048 (+607695us) log.cc:844] Serialized 14 byte log entry
0709 12:18:35.908219 (+ 30171us) log.cc:844] Serialized 14 byte log entry
0709 12:18:36.035752 (+127533us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b18002cd280. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a67522 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:18:36.169428 (+133676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.169501 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:36.189134 (+ 19633us) raft_consensus.cc:1685] finished
0709 12:18:36.189155 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.189290 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":706062,"prepare.queue_time_us":603544,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":67675,"raft.run_cpu_time_us":479,"raft.run_wall_time_us":21561,"spinlock_wait_cycles":4028032,"thread_start_us":338777,"threads_started":2,"wal-append.queue_time_us":220244}
I20260709 12:18:36.267617 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:36.275907 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:36.275969 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:36.276826 22549 raft_consensus.cc:2368] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12.
I20260709 12:18:36.277084 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:36.277789 23130 raft_consensus.cc:2368] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12.
I20260709 12:18:36.278555 23094 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:36.218907 26456 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:36.281041 22516 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:36.282059 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:36.264482 22550 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:36.284003 23128 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:36.218576 26976 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:18:36.265364 27086 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:18:36.288070 22551 raft_consensus.cc:1275] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:36.290692 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:36.294569 22545 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:18:36.278901 27063 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:18:36.297529 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:36.309985 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:36.298775 26983 consensus_queue.cc:1059] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:18:36.301430 26556 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:36.285941 26456 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:36.304481 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:36.317319 22543 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:36.305212 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:36.266063 27056 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:36.305935 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:36.306617 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:36.320044 22542 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:36.235459 26810 consensus_queue.cc:1059] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:18:36.268431 27070 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:36.316314 22550 raft_consensus.cc:1275] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:36.312677 22366 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:36.319480 22547 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:36.311344 26976 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.355909 26976 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:36.356173 26810 consensus_queue.cc:1243] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer b8621fa34be04d3fa2d68a300f858cd1 log is divergent from this leader: its last log entry 18.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:18:36.356426 26735 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:36.319650 26728 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.328305 27001 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:36.335371 22476 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:36.337335 23122 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:36.337745 27033 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:36.344565 27084 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 12:18:36.289978 26884 consensus_queue.cc:1059] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:18:36.291814 27054 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:36.353739 26706 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:36.358857 22366 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:36.357731 26735 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:18:36.275149 27003 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.361142 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:36.368145 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2198) took 1183 ms. Trace:
W20260709 12:18:36.369678 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 238861us
I20260709 12:18:36.353575 26983 consensus_queue.cc:1243] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer b8621fa34be04d3fa2d68a300f858cd1 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:18:36.350279 27070 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:36.398097 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:36.288938 27045 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:36.401072 22366 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:36.394263 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:36.403690 22542 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:36.395078 22395 rpcz_store.cc:276] 0709 12:18:35.184899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.007051 (+822152us) service_pool.cc:224] Handling call
0709 12:18:36.007417 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.007647 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:18:36.013323 (+  5676us) log.cc:844] Serialized 14 byte log entry
0709 12:18:36.367797 (+354474us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:36.367845 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:36.367894 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.367956 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.368073 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28167,"prepare.queue_time_us":6454,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":4602,"thread_start_us":349708,"threads_started":1}
I20260709 12:18:36.341593 26716 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.459098 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:36.459403 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:36.461056 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:36.353189 27056 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.362145 27029 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 12:18:36.474411 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 191744us
I20260709 12:18:36.469409 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:36.480664 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:36.480029 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 197167us
W20260709 12:18:36.512485 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.387670 26683 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:36.386547 27082 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:36.367928 26728 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.423265 27070 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:36.461666 27028 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:36.426397 26892 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:36.462172 27059 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.519145 22544 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:36.465924 27045 raft_consensus.cc:697] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 12 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:36.425222 26706 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.514715 26766 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:36.534328 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:36.536712 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:36.523669 27033 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:18:36.580257 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 282927us
W20260709 12:18:36.581281 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 297509us
I20260709 12:18:36.523792 26707 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.471029 26750 consensus_queue.cc:1048] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 12:18:36.590662 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 56403.7us
I20260709 12:18:36.394376 26456 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.591418 22516 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:36.621611 22398 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:18:36.622067 22398 pending_rounds.cc:85] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 5
I20260709 12:18:36.622290 22398 pending_rounds.cc:107] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 9.6
W20260709 12:18:36.621652 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 100088us
I20260709 12:18:36.622627 22398 raft_consensus.cc:2889] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:36.573979 27028 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:36.524204 26683 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.613215 26735 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:18:36.619434 27008 log.cc:927] Time spent T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:18:36.645103 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:36.550040 27059 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.648617 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:36.613076 26860 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:36.652300 22367 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:36.708662 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 56431.9us
I20260709 12:18:36.709477 22367 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:36.710775 22367 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:36.619354 27036 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:18:36.661113 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 124913us
W20260709 12:18:36.684548 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:36.706228 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 57696.5us
I20260709 12:18:36.728127 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:36.728991 22476 raft_consensus.cc:2393] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 10: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:36.535183 27082 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:36.634281 26892 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:36.718241 27081 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:36.731882 22441 leader_election.cc:400] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12.
I20260709 12:18:36.745126 22441 leader_election.cc:403] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:18:36.650408 26992 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:36.567418 26923 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:18:36.650884 27033 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:36.740226 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:36.740617 27092 log.cc:927] Time spent T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:18:36.741232 27088 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 12:18:36.741725 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:36.741942 27095 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:18:36.742710 27083 log.cc:927] Time spent T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:18:36.633975 22299 catalog_manager.cc:5697] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 12 to 14, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 14 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:36.817788 22473 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
W20260709 12:18:36.816098 22470 consensus_meta.cc:287] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.000s
I20260709 12:18:36.615092 26707 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:36.730769 27064 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:18:36.857601 22470 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:18:36.720958 27054 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:36.818588 27080 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:18:36.862347 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 398277us
I20260709 12:18:36.818455 27033 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:36.819486 26991 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:36.827509 27076 log.cc:927] Time spent T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:18:36.904381 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:36.892730 22366 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:36.655304 27028 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.909384 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:36.909999 22542 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:36.910862 22550 raft_consensus.cc:1240] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:18:36.911991 26707 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:36.912273 26890 raft_consensus.cc:3055] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:36.912729 26890 raft_consensus.cc:740] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:18:36.914480 27089 log.cc:927] Time spent T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 12:18:36.916193 22402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 494) took 1521 ms. Trace:
I20260709 12:18:36.916563 22402 rpcz_store.cc:276] 0709 12:18:35.394505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.046546 (+652041us) service_pool.cc:224] Handling call
0709 12:18:36.050644 (+  4098us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:36.052821 (+  2177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.052853 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:36.053364 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:18:36.112294 (+ 58930us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b1800395080. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a49e07 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b 00007fb4f86f3d23 00007fb4f86f40d1 00007fb4f8b0fa0f
0709 12:18:36.361149 (+248855us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:36.366865 (+  5716us) log.cc:844] Serialized 14 byte log entry
0709 12:18:36.368910 (+  2045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.368984 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:36.915870 (+546886us) raft_consensus.cc:1685] finished
0709 12:18:36.915974 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.916041 (+    67us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b1800395080. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a352a6 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fda7daa1 00007fb4fda74b37 00007fb4fda749ca 00007fb4fdb6c26f
0709 12:18:36.916126 (+    85us) inbound_call.cc:177] Queueing success response
0709 12:18:36.916465 (+   339us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b4800003e58. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fda7daa1 00007fb4fda74b37 00007fb4fda749ca 00007fb4fdb6c26f 00007fb4fdb6bf37 00007fb4fdb8055c 00007fb4fdb80508 00007fb4fdb80488 00007fb4fdb80443 00007fb4fdb7f6ec 00007fb4fcaa9a96
Metrics: {"mutex_wait_us":1764,"prepare.queue_time_us":5377,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":1935,"raft.queue_time_us":12989,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":7578,"spinlock_wait_cycles":48449408,"thread_start_us":248674,"threads_started":1,"wal-append.queue_time_us":456077}
I20260709 12:18:36.919824 27003 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:36.923064 27085 log.cc:927] Time spent T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.399s	user 0.002s	sys 0.000s
I20260709 12:18:36.924295 26747 raft_consensus.cc:3055] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:36.924729 26747 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:36.925525 26747 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.926561 26747 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:36.930510 27087 log.cc:927] Time spent T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:18:36.931372 27056 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:36.931704 22397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2205) took 1317 ms. Trace:
I20260709 12:18:36.932646 26683 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:36.933892 26716 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:36.938073 27028 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:36.938652 27028 consensus_queue.cc:1048] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:36.914405 26706 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:36.940580 22469 consensus_meta.cc:287] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.561s	user 0.006s	sys 0.000s
I20260709 12:18:36.941030 22469 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:36.828408 26750 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:36.909056 27081 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:36.817670 26892 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.898018 27033 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:36.946631 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:36.735909 27036 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:36.947587 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 201703us
I20260709 12:18:36.947873 22366 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:36.932096 22397 rpcz_store.cc:276] 0709 12:18:35.614769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.075455 (+460686us) service_pool.cc:224] Handling call
0709 12:18:36.075748 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:36.076111 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.076138 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:36.076589 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:18:36.472412 (+395823us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:36.472471 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.472539 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:36.931501 (+458962us) raft_consensus.cc:1685] finished
0709 12:18:36.931521 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.931647 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":395463,"threads_started":1,"wal-append.queue_time_us":558967}
W20260709 12:18:36.956058 27101 log.cc:927] Time spent T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:18:36.816558 27045 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:36.933750 27059 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:36.946714 26810 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:36.973744 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.946471 27081 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.874372 27095 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:36.965551 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 253721us
I20260709 12:18:36.955919 27037 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:36.985922 26716 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.913571 26890 consensus_queue.cc:260] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.906256 26991 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.974781 26683 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.994484 22515 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:36.995285 22550 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:36.995671 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:36.998131 22475 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:36.981480 27081 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:36.998579 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.001677 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:36.998246 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:36.993068 26716 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:36.987128 27109 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:37.017127 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.017704 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:37.017084 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 69287.1us
I20260709 12:18:37.023267 22366 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:37.006132 26556 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:37.026485 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.026716 26556 raft_consensus.cc:697] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:37.027736 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:37.027979 26869 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:37.025959 26716 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:37.034412 27120 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:37.034943 27120 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:37.035317 27095 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:37.002328 26683 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.020931 27080 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:37.038689 22477 raft_consensus.cc:2368] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12.
I20260709 12:18:37.040117 26683 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:37.027617 26556 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:37.008672 26728 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:37.050163 22366 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:37.051765 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.059474 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:37.059489 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.060609 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:37.061250 22550 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:18:36.991569 27037 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:37.063634 27037 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:37.019984 26890 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:37.065121 22468 raft_consensus.cc:1275] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:37.066582 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.024236 27109 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.069154 26766 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:37.070359 27109 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:37.078716 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.068045 22366 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:37.079914 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.080685 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.081414 26991 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:37.051589 26923 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:37.052121 27082 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:37.038758 27080 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:37.064504 27107 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:37.090081 22550 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:18:37.087339 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:37.095422 22549 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:37.069621 26766 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:37.099372 27036 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:37.102625 27094 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.220s	user 0.000s	sys 0.002s
I20260709 12:18:37.141656 22468 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:37.144974 22366 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:37.126827 27107 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:37.150236 27107 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:37.125555 27080 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:37.158927 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.160504 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:37.161373 22477 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 12: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:37.162092 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:37.163090 22468 raft_consensus.cc:1275] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:37.163250 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.163872 22471 raft_consensus.cc:2376] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11. Re-sending same reply.
I20260709 12:18:37.164105 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.164590 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.164798 22468 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:18:37.166199 27028 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:37.166643 27028 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.166991 27028 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:37.125886 26750 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:37.105017 27120 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:37.183185 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.141085 26923 raft_consensus.cc:697] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:37.183866 22475 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:37.188174 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.188694 22475 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:18:37.181674 26750 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:18:37.239396 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 93354.5us
I20260709 12:18:37.250370 26750 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:37.325526 22477 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:37.244091 26892 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:37.313380 22400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:18:37.329432 22400 raft_consensus.cc:606] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:37.314241 27132 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:18:37.331171 27081 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:37.336144 27070 consensus_meta.cc:287] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.795s	user 0.008s	sys 0.000s
I20260709 12:18:37.336642 27070 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:37.329885 22400 raft_consensus.cc:614] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:37.338079 26923 consensus_queue.cc:237] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.253299 26728 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:37.337812 22399 raft_consensus.cc:2393] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 10: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:37.359719 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.369503 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 2072) took 1075 ms. Trace:
I20260709 12:18:37.369989 22551 rpcz_store.cc:276] 0709 12:18:36.294403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.294583 (+   180us) service_pool.cc:224] Handling call
0709 12:18:36.321369 (+ 26786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.429101 (+107732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.429138 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:36.429188 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:36.429232 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.369250 (+940018us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400064ad4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:37.369297 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.369434 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247018752}
I20260709 12:18:37.375981 27033 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.378041 22546 raft_consensus.cc:1240] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:37.378629 27033 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:37.378648 26456 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:37.380541 26810 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12.
I20260709 12:18:37.359087 26728 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.381847 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 2149) took 1269 ms. Trace:
I20260709 12:18:37.382220 22469 rpcz_store.cc:276] 0709 12:18:36.090832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.152018 (+ 61186us) service_pool.cc:224] Handling call
0709 12:18:37.360261 (+1208243us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b5400201cd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:37.360374 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498831232}
I20260709 12:18:37.383701 27082 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.384266 27082 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.383948 22299 catalog_manager.cc:5697] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 6 to 8, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 8 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:37.385200 27081 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:37.384644 26728 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:37.385707 22299 catalog_manager.cc:5697] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:37.387588 27082 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:37.387233 22299 catalog_manager.cc:5697] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 9 to 11, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 11 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:37.388643 22299 catalog_manager.cc:5697] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:37.389979 27082 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:37.390658 27082 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.393424 27082 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:37.395147 27033 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:37.395709 27033 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.396741 22474 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 12:18:37.397126 22474 pending_rounds.cc:85] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 8
I20260709 12:18:37.397348 22474 pending_rounds.cc:107] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:18:37.397588 22474 raft_consensus.cc:2889] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:37.397871 27033 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:37.389948 22477 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:18:37.400847 26456 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.400972 26810 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:37.401456 26456 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.402660 26884 consensus_queue.cc:1059] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:37.403678 27053 raft_consensus.cc:3055] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:37.404079 27053 raft_consensus.cc:740] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:37.404914 27053 consensus_queue.cc:260] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.406037 26810 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.406625 27053 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:37.408267 26810 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:37.409825 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:37.415073 22472 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:18:37.415537 22472 pending_rounds.cc:85] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 5
I20260709 12:18:37.415779 22472 pending_rounds.cc:107] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:18:37.416013 22472 raft_consensus.cc:2889] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:37.418453 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.419456 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.420632 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:37.421839 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.422396 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.422729 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:37.424747 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:37.331236 27132 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 12:18:37.449820 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.439149 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.449348 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.485138 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.485898 22471 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:37.435425 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:37.452956 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.431422 22542 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:18:37.432158 22548 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:37.433982 22397 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:37.491191 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:37.493798 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:37.498381 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.482566 22367 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:37.502238 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:37.503633 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.504271 22473 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:18:37.507089 22367 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:37.508826 22367 leader_election.cc:400] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12.
I20260709 12:18:37.509193 22367 leader_election.cc:403] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:18:37.512480 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:37.513746 22367 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:37.515537 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 202588us
I20260709 12:18:37.516400 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.515590 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.517043 22474 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:18:37.515834 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:37.520602 23122 raft_consensus.cc:2393] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:37.524730 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:37.538043 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.432394 26890 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 12:18:37.565742 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:37.566529 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:37.566956 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.569204 22543 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:37.570716 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.567823 22516 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:37.572057 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:37.573207 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:37.569218 22548 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:18:37.517190 26922 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:37.425679 27080 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.438500 27107 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.519179 27113 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12.
I20260709 12:18:37.517374 26989 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:37.525696 27082 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:37.630831 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:37.634238 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 61101.6us
I20260709 12:18:37.654860 22545 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:37.507891 26766 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.648514 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:37.649188 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.563450 26798 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.564054 27081 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:37.561905 26728 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:37.521672 27028 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.632427 26991 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:37.617746 26892 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:37.567277 26724 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 12:18:37.648088 27095 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:37.673974 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:37.674362 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:37.686800 22470 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:37.566906 27069 consensus_queue.cc:1048] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 12:18:37.601423 26923 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 12:18:37.751216 26985 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:37.760912 26985 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.762077 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:37.761376 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:37.764659 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:37.779209 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:37.678426 26892 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.785354 22398 raft_consensus.cc:1240] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:37.662724 26798 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.699785 27081 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:37.700649 26989 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:37.750130 26991 raft_consensus.cc:697] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:37.762116 27107 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:37.700361 27113 consensus_queue.cc:1048] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 12:18:37.789813 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:37.763832 26456 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:37.672842 26728 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.813905 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:37.814181 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:37.815506 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:37.780646 27070 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:37.762890 27095 raft_consensus.cc:697] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:37.787863 26892 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:37.821514 22545 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:37.826789 22470 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:37.814656 22396 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:37.835095 22394 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
W20260709 12:18:37.844256 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 339349us
I20260709 12:18:37.863170 22441 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:37.865612 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 300447us
W20260709 12:18:37.859182 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 297644us
I20260709 12:18:37.812988 26985 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:37.873983 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:37.875820 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:37.875973 22400 raft_consensus.cc:2393] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 13: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:37.796361 27081 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.877377 22367 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:37.880340 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:37.890129 22398 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:37.887217 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:37.834493 27082 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:37.895066 22400 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:37.893265 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:18:37.910238 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 162123us
I20260709 12:18:37.858132 27070 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:37.817342 26989 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.911515 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:37.916456 22400 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 15: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:37.913272 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:37.918702 22402 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
W20260709 12:18:37.927095 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 49791.7us
I20260709 12:18:37.928750 22367 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:37.920488 27147 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:37.944867 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:37.945557 22396 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:18:37.893445 27036 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:18:37.951014 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:37.942822 26991 consensus_queue.cc:237] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.943181 27080 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:37.956068 22396 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:37.920308 26706 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:37.909884 26556 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:37.930545 26923 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:37.964617 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:37.940335 27140 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:37.966387 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:37.970609 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:37.920785 27082 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.960985 27028 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:37.958567 27040 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:37.958463 26706 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:37.922397 27070 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:37.963792 26860 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:37.962046 26556 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:37.960175 27110 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:37.914160 27095 consensus_queue.cc:237] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:37.989240 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:37.980634 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:37.967859 27142 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:37.992565 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:38.007501 27137 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:18:38.021732 27081 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:38.022246 27136 log.cc:927] Time spent T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:18:38.028609 27070 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:37.971904 27140 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:38.038190 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:37.987408 26706 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:38.047252 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:37.993119 26556 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:38.014672 27133 log.cc:927] Time spent T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:18:38.012022 26798 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:38.014860 26728 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:38.015237 27142 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:38.039142 27144 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:38.063087 22442 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:37.989419 27040 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:38.085875 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.014935 27028 consensus_queue.cc:1059] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:18:38.090268 22398 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:38.033382 27110 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.104091 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:38.063058 27142 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:38.113221 22400 raft_consensus.cc:1240] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:18:38.104544 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 191343us
I20260709 12:18:38.104982 27082 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:38.109601 27148 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:18:38.116667 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 270837us
I20260709 12:18:38.072165 27147 consensus_queue.cc:1059] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:18:38.110693 26989 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:38.110122 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 247045us
I20260709 12:18:38.122879 22441 leader_election.cc:400] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12.
I20260709 12:18:38.126350 27147 raft_consensus.cc:3055] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:38.114482 26922 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:38.116171 26884 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.133502 26884 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.135166 27145 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:38.135669 26884 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:38.135721 27145 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:38.136423 22396 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:38.127899 27053 consensus_meta.cc:287] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.001s
I20260709 12:18:38.081894 27144 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:38.132984 27147 raft_consensus.cc:740] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:38.119974 27148 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:38.142189 27144 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:38.146032 26884 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:38.146508 27045 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:38.147297 22441 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:38.229516 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 82272.5us
I20260709 12:18:38.230216 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:38.230997 22398 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:38.231186 27040 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:38.160280 27140 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:38.149564 27126 log.cc:927] Time spent T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.960s	user 0.015s	sys 0.003s
I20260709 12:18:38.231730 27151 consensus_queue.cc:1059] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:38.233374 22441 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:38.233912 27151 raft_consensus.cc:3055] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:38.234280 27151 raft_consensus.cc:740] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:18:38.164845 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 185810us
I20260709 12:18:38.172958 22401 raft_consensus.cc:1240] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:38.178551 22476 raft_consensus.cc:1240] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:38.235752 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 2394) took 1246 ms. Trace:
I20260709 12:18:38.181325 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2525) took 1123 ms. Trace:
I20260709 12:18:38.183305 27145 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:38.183480 27132 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:38.185976 27109 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.187213 22393 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:38.187654 26985 consensus_queue.cc:1059] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:38.191958 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:38.245059 23125 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:38.193324 26860 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:38.247515 26860 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:38.249019 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:38.197122 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:38.209936 22399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58054 (request call id 499) took 1775 ms (client timeout 2108 ms). Trace:
W20260709 12:18:38.250805 22399 rpcz_store.cc:269] 0709 12:18:36.397563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.397790 (+   227us) service_pool.cc:224] Handling call
0709 12:18:38.172618 (+1774828us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b5400348354. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:38.172807 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2159289088}
I20260709 12:18:38.179153 27148 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:38.212935 27110 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:38.217954 26750 consensus_meta.cc:287] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.868s	user 0.010s	sys 0.001s
I20260709 12:18:38.255558 27144 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:38.225837 27001 consensus_queue.cc:1059] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:38.226393 27147 consensus_queue.cc:260] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.259331 27147 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:38.154037 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 200117us
I20260709 12:18:38.231716 27036 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:38.264585 27036 raft_consensus.cc:3055] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:38.264997 27036 raft_consensus.cc:740] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:38.265846 27036 consensus_queue.cc:260] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.266932 27036 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:38.268249 27146 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:38.270253 27146 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:38.236088 22476 rpcz_store.cc:276] 0709 12:18:36.989376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.989499 (+   123us) service_pool.cc:224] Handling call
0709 12:18:38.178210 (+1188711us) spinlock_profiling.cc:243] Waited 901 us on lock 0x7b5800084c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2feee 000000000036eb39 00007fb4fdaa31e0 00007fb4fdb6c0c4 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:18:38.178381 (+   171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.235489 (+ 57108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.235698 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2072832}
I20260709 12:18:38.238297 22366 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:38.272140 26962 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:38.272209 22366 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:38.272576 26962 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:38.272969 26962 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:38.273453 22366 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:38.274115 27068 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:38.274487 27068 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:38.274827 27068 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:38.287155 27108 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:38.287884 27108 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:38.291551 26990 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.292218 26990 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:38.302866 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 53895.1us
I20260709 12:18:38.303179 26990 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:38.304909 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:38.306133 27155 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:38.306612 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:38.307478 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:38.308032 23125 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:38.306365 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:38.309991 26798 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:38.311887 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:38.311367 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:38.311457 26990 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:38.313337 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:38.313743 26798 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:38.314230 26798 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:38.314599 26798 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:38.315662 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:38.306774 27155 raft_consensus.cc:697] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:38.316666 26990 raft_consensus.cc:697] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:38.318039 26990 consensus_queue.cc:237] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.323922 26798 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.326311 26798 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:38.330181 27108 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:38.328068 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:38.336786 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:38.340255 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:38.236924 22550 rpcz_store.cc:276] 0709 12:18:37.057737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.148822 (+ 91085us) service_pool.cc:224] Handling call
0709 12:18:37.149246 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:37.149638 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:37.149667 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:37.795790 (+646123us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b2c001328c8. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f744da11 00007fb4f745d372 00007fb4f8b8fa01 00007fb4f8b5443a 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2
0709 12:18:37.806495 (+ 10705us) log.cc:844] Serialized 26 byte log entry
0709 12:18:38.108646 (+302151us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:38.108693 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.108766 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:38.167398 (+ 58632us) raft_consensus.cc:1685] finished
0709 12:18:38.167417 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.181197 (+ 13780us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":63293312,"thread_start_us":240238,"threads_started":1,"wal-append.queue_time_us":324441}
I20260709 12:18:38.352718 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:38.341487 22547 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:38.342471 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:38.343055 27155 consensus_queue.cc:237] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.326884 26750 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:38.345440 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:38.369591 22542 raft_consensus.cc:2393] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 16: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:38.403529 22397 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:38.410116 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:38.402678 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:38.406051 22393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:18:38.372828 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:38.455302 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:38.244426 27040 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:38.502739 22393 raft_consensus.cc:606] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:38.508333 22393 raft_consensus.cc:614] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:38.504858 23129 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:38.375221 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:38.490590 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.400785 27045 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.404477 26750 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:38.405277 26794 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:38.407239 27135 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:38.421202 26798 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:38.410797 26766 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:38.520556 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2213) took 1934 ms. Trace:
I20260709 12:18:38.526877 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:38.520504 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:38.352392 27132 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.517231 23125 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:38.540023 22366 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:38.529606 26798 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:38.547466 26798 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:38.350472 27109 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.551731 27109 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:38.536017 27095 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:38.534489 22395 rpcz_store.cc:276] 0709 12:18:36.585679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.585868 (+   189us) service_pool.cc:224] Handling call
0709 12:18:36.586150 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.586351 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:36.646545 (+ 60194us) log.cc:844] Serialized 14 byte log entry
0709 12:18:37.366891 (+720346us) spinlock_profiling.cc:243] Waited 7.2 ms on lock 0x7b18001cf840. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:18:38.202474 (+835583us) spinlock_profiling.cc:243] Waited 54 ms on lock 0x7b18001cf840. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f59e1c0a 00007fb4ff121219 00007fb4f5a69a40 00007fb4f5a644e4 00007fb4f5a64455 00007fb4fc54c3c7 00007fb4f8b5e9a7 00007fb4f8b6e0bf 00007fb4f8b6e038
0709 12:18:38.202816 (+   342us) log.cc:844] Serialized 14 byte log entry
0709 12:18:38.520116 (+317300us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:38.520171 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:38.520220 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.520363 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.520494 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2251526,"prepare.queue_time_us":1624386,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":83,"raft.queue_time_us":8255,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":831161,"spinlock_wait_cycles":140701312,"thread_start_us":316963,"threads_started":1}
I20260709 12:18:38.235034 27151 consensus_queue.cc:260] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.582527 27151 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:38.585754 27144 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:38.584740 26860 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.590806 22548 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:38.593240 26860 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:38.350196 26884 consensus_queue.cc:1175] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8c3bcfa13ca74a24ab8999a408532932" responder_term: 12 status { last_received { term: 12 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 12 index: 7 } }
I20260709 12:18:38.370021 26706 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.558593 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:38.603525 22550 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 13.
I20260709 12:18:38.604662 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:38.525349 27116 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:38.403237 27118 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.140s
I20260709 12:18:38.613127 22366 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:38.572909 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.569598 23129 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:38.614832 22550 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:38.575664 27113 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:38.577092 22394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:18:38.553336 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:38.619443 22546 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:38.515843 27146 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:18:38.581061 27142 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:38.598352 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 363435us
I20260709 12:18:38.625341 22441 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:38.621285 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:38.545856 27135 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:38.630990 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:38.631682 22468 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:38.632863 22476 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:38.535569 27045 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:38.606777 27109 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:38.647805 22366 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:38.666860 22402 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:38.694177 23125 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:38.695580 27135 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:38.702023 27110 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.702720 27110 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.704979 27110 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:38.710191 26890 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:38.711256 26890 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.711826 26890 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.714803 27132 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:38.716889 26706 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:38.705513 27110 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.717687 27110 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.718485 27148 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.720206 27110 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:38.720757 27148 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:38.722271 26890 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:38.730340 26962 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.731420 26798 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.733434 26798 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:38.734174 22394 raft_consensus.cc:606] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
W20260709 12:18:38.734828 26892 consensus_meta.cc:287] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.877s	user 0.009s	sys 0.000s
I20260709 12:18:38.735278 26892 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.736161 27045 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:38.736366 22549 raft_consensus.cc:1240] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:18:38.737218 26892 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:38.738654 26962 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:38.740351 27142 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:38.740556 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 92850.5us
I20260709 12:18:38.740377 27111 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:38.742681 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:38.742666 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:38.744432 22546 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:38.748173 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:38.749310 22442 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.008s	sys 0.013s
I20260709 12:18:38.750043 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:18:38.750375 22442 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.008s	sys 0.013s
W20260709 12:18:38.751986 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 522839us
I20260709 12:18:38.753573 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:38.753659 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:38.754494 22546 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:38.670109 27113 raft_consensus.cc:697] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:18:38.742679 26556 consensus_meta.cc:287] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.685s	user 0.008s	sys 0.000s
I20260709 12:18:38.799329 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:38.800236 22395 raft_consensus.cc:2410] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:38.801170 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:38.802697 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:38.803515 22397 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 16: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:38.808534 22546 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:18:38.613590 27116 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.842954 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:38.844058 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:18:38.759521 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 386746us
I20260709 12:18:38.847901 22399 raft_consensus.cc:2393] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:38.849845 22366 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:38.676002 27109 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:38.837975 26962 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:38.855948 22442 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:38.867221 27147 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:38.867697 27147 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:38.868065 27147 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:38.871312 27142 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:38.871953 27142 raft_consensus.cc:697] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:38.872946 27142 consensus_queue.cc:237] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:38.838899 26556 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.883581 22547 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:18:38.854434 27122 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.854744 27163 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:38.892372 22366 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:38.897054 22366 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:38.859671 27040 consensus_queue.cc:1059] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 12:18:38.962173 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.932569 22544 raft_consensus.cc:1240] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:38.856163 22516 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:38.988862 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 132808us
I20260709 12:18:38.930300 27111 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:18:38.956470 27036 consensus_meta.cc:287] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.689s	user 0.007s	sys 0.003s
I20260709 12:18:38.906424 27080 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:38.884019 26962 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.996317 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:38.901167 27122 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.905885 27163 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:38.982672 27161 consensus_queue.cc:1059] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:18:39.006017 27111 raft_consensus.cc:697] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:39.012428 26990 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:39.009594 26892 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:39.012126 26860 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:38.966158 27113 consensus_queue.cc:237] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:39.011607 27080 raft_consensus.cc:697] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:18:39.043030 27167 log.cc:927] Time spent T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:18:39.068441 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 467842us
I20260709 12:18:39.053428 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2224) took 1296 ms. Trace:
I20260709 12:18:39.020087 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
W20260709 12:18:39.069823 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 444571us
W20260709 12:18:39.062407 27168 log.cc:927] Time spent T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:18:39.076700 22401 rpcz_store.cc:276] 0709 12:18:37.757030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.757155 (+   125us) service_pool.cc:224] Handling call
0709 12:18:38.172774 (+415619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.238257 (+ 65483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.053152 (+814895us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b5400348350. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:39.053320 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955183360}
I20260709 12:18:39.101322 22515 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:39.103163 22441 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.069280 27109 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:39.107316 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:39.110172 27175 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:18:39.110517 27163 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:39.110987 27170 log.cc:927] Time spent T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:18:39.111533 27104 raft_consensus.cc:3055] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:39.111943 27104 raft_consensus.cc:740] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:39.112772 27104 consensus_queue.cc:260] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:39.114053 27173 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:18:39.080423 26556 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:39.106599 26890 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:39.118359 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:39.118815 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:39.106806 27180 log.cc:927] Time spent T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:18:39.123509 22441 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.117997 27149 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:39.081094 27040 consensus_queue.cc:1059] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 12:18:39.119390 27171 log.cc:927] Time spent T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:18:39.132330 22398 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:39.117558 27163 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:39.135068 27149 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.138417 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:39.107859 27036 consensus_queue.cc:1059] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:18:39.126058 27161 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:39.126437 27104 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:39.156106 27122 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:39.138350 27184 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:39.171162 26922 raft_consensus.cc:3055] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:39.171686 26922 raft_consensus.cc:740] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:39.172629 26922 consensus_queue.cc:260] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.173153 27096 consensus_queue.cc:1059] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:18:39.174222 27096 raft_consensus.cc:3055] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:39.174609 27096 raft_consensus.cc:740] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:39.175531 27096 consensus_queue.cc:260] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:39.176832 27096 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:39.159132 26962 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:39.183498 27036 raft_consensus.cc:3055] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:39.183979 27036 raft_consensus.cc:740] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:39.184891 27036 consensus_queue.cc:260] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:39.189471 27122 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:39.194723 26890 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.195254 26890 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.195875 27116 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:39.196372 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:39.196998 22394 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:39.129969 27111 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:39.198985 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 60640.4us
I20260709 12:18:39.201081 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.202536 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.202785 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:39.203342 22476 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 12: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:39.204627 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.205583 22476 raft_consensus.cc:2410] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:39.208097 22442 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:39.209316 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.130146 27080 consensus_queue.cc:237] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.197738 26890 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:39.212766 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.197840 27163 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:39.213318 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.214789 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.215735 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.215489 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:39.215639 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.221112 22474 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:18:39.216939 22477 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 16: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:39.232247 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.234155 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.235031 22471 raft_consensus.cc:2410] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:18:39.233565 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.229827 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.237095 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.237625 22470 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:39.238592 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.173712 26922 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:39.238683 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.213547 27120 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:39.239754 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:39.225687 27068 consensus_meta.cc:287] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.950s	user 0.012s	sys 0.001s
I20260709 12:18:39.243316 22475 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:18:39.195288 27149 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:39.244287 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.158016 27147 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.240535 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.247385 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.248942 23125 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:39.225854 26890 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:39.234210 27036 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:39.256311 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.259423 27147 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:39.251132 27068 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.262367 27068 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:39.263916 22395 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 16: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:39.260044 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.266829 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.267176 22470 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:18:39.266894 22471 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:39.269706 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.270340 22472 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:39.255601 26890 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.234323 27163 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:39.276842 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.276887 22472 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:18:39.280194 22472 pending_rounds.cc:85] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 6
I20260709 12:18:39.280463 22472 pending_rounds.cc:107] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:18:39.280678 22472 raft_consensus.cc:2889] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:39.284675 23129 raft_consensus.cc:1240] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:39.288159 22367 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:39.290709 22475 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:18:39.276966 26890 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:39.293099 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:39.290831 27113 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:39.315297 22367 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:39.326334 22471 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:18:39.304442 26766 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:39.333740 22401 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:39.339056 27163 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:39.354446 26922 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:39.355083 26922 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:39.356182 22543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2548) took 1010 ms. Trace:
I20260709 12:18:39.357415 26922 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:39.335600 27111 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:18:39.359155 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 257921us
I20260709 12:18:39.360008 27154 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:39.360456 27154 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:39.360805 27154 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:39.362037 27186 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:39.363848 23094 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:39.364811 23094 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.335988 26766 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:39.366201 26766 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:39.368436 26248 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:39.368884 26248 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:39.369271 26248 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:39.359441 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 339433us
I20260709 12:18:39.370645 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:39.366119 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:39.356590 22543 rpcz_store.cc:276] 0709 12:18:38.346193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.346323 (+   130us) service_pool.cc:224] Handling call
0709 12:18:38.346647 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.346864 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:38.756789 (+409925us) log.cc:844] Serialized 14 byte log entry
0709 12:18:39.101153 (+344364us) log.cc:844] Serialized 14 byte log entry
0709 12:18:39.344399 (+243246us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b18003fbe00. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:18:39.355661 (+ 11262us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b18003fbe00. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f59e1c0a 00007fb4ff121219 00007fb4f5a69a40 00007fb4f5a644e4 00007fb4f5a64455 00007fb4f8b4c060 00007fb4f8b5e716 00007fb4f8b6f287 00007fb4f8b6f208
0709 12:18:39.355825 (+   164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:39.355875 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:39.355922 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.355993 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.356121 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25517,"prepare.queue_time_us":500498,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":84,"raft.queue_time_us":24686,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":14077,"spinlock_wait_cycles":11321600,"thread_start_us":724012,"threads_started":2,"wal-append.queue_time_us":367636}
W20260709 12:18:39.375707 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.337568 22367 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:39.379926 22401 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:39.359767 27109 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:39.378424 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:18:39.384976 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 47505.2us
I20260709 12:18:39.384984 22399 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:39.387005 22367 leader_election.cc:336] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.834s (SENT)
I20260709 12:18:39.387533 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.388177 22367 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:39.389667 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:39.390340 22395 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:39.374437 26556 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:39.391937 22546 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:39.392513 22548 raft_consensus.cc:1240] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:18:39.392712 22542 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:39.392985 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.396450 26556 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:39.397303 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.381024 27151 raft_consensus.cc:3055] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:39.398608 27118 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:39.398900 27151 raft_consensus.cc:740] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:39.399241 27118 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.399847 27151 consensus_queue.cc:260] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:39.400415 27120 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:39.384254 27109 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:39.401257 27109 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:39.401434 27118 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:39.402619 27164 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:39.403132 27164 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.398429 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.381371 27117 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:39.391953 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.405433 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.406827 22476 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:39.408267 22367 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:39.411592 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.413174 27164 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:39.393800 27186 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.414292 27186 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.416390 27186 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:39.376159 27045 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:18:39.420743 26890 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.421939 22477 raft_consensus.cc:2368] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17.
I20260709 12:18:39.422554 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.405825 27144 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:39.424952 27144 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.425307 27144 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:39.393688 27149 consensus_queue.cc:1059] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:18:39.381024 27142 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:39.410509 22543 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:39.431257 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.432845 22475 raft_consensus.cc:2368] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16.
I20260709 12:18:39.432699 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.435014 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.435571 27164 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:39.436138 22545 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:18:39.437121 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.393966 26922 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:39.438433 27164 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:39.438916 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.439616 22516 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.440083 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.440392 27164 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:39.441011 27164 raft_consensus.cc:697] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:39.442297 27164 consensus_queue.cc:237] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.446749 22472 raft_consensus.cc:1275] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:39.448849 22472 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:39.449245 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2538) took 1137 ms. Trace:
I20260709 12:18:39.449643 22549 rpcz_store.cc:276] 0709 12:18:38.311816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.312805 (+   989us) service_pool.cc:224] Handling call
0709 12:18:38.313169 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:38.736829 (+423660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.449009 (+712180us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54000654d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:39.449187 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":972626176}
I20260709 12:18:39.398562 26556 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:39.454897 22544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2546) took 1112 ms. Trace:
I20260709 12:18:39.455713 27142 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:39.458269 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 71654.8us
I20260709 12:18:39.455333 22544 rpcz_store.cc:276] 0709 12:18:38.342410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.344283 (+  1873us) service_pool.cc:224] Handling call
0709 12:18:38.344609 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.986850 (+642241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.454646 (+467796us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54001ead54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:39.454836 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1351767424}
W20260709 12:18:39.459940 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 86223.2us
I20260709 12:18:39.428529 27080 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:39.461970 27177 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:39.462929 27169 raft_consensus.cc:3055] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:39.463133 27116 consensus_queue.cc:1059] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:39.469139 22516 leader_election.cc:400] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16.
I20260709 12:18:39.491261 22516 leader_election.cc:403] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:18:39.461311 27104 consensus_queue.cc:1059] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:18:39.470548 27186 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:39.473991 27142 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:39.470428 26991 consensus_queue.cc:1048] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:18:39.550012 22468 raft_consensus.cc:1275] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:39.462858 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:39.551317 22472 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:39.478824 22399 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:39.480800 22473 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
W20260709 12:18:39.427381 27195 log.cc:927] Time spent T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:18:39.493322 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:39.497242 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.557283 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.508847 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.535742 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.538405 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:39.561161 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 98389.4us
I20260709 12:18:39.553205 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.562050 22548 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:18:39.555092 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.555346 27104 consensus_queue.cc:1243] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Peer b8621fa34be04d3fa2d68a300f858cd1 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:18:39.538642 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:39.562867 22477 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:39.567207 22367 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:39.533309 27095 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:39.563293 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.491353 27149 consensus_queue.cc:1243] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer b8621fa34be04d3fa2d68a300f858cd1 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:39.539522 27147 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.539283 27040 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.569003 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:39.572831 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.539134 27080 raft_consensus.cc:697] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:39.553941 27108 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:39.487825 27169 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:39.579521 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:39.489197 26766 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.580646 22441 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.597963 22441 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.504925 27109 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:39.585016 22367 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:39.585549 27146 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:39.555797 27113 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:39.441111 26248 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:39.594679 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.599586 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.568037 27116 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:39.611974 22477 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
I20260709 12:18:39.600944 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.597229 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.601595 22441 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.617462 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.584017 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:39.477713 27154 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.604811 22367 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:39.626083 22441 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.606112 26985 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:39.583077 27104 consensus_queue.cc:1059] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:18:39.606308 26456 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.606168 27001 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:39.634507 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.598788 26556 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 12:18:39.695227 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 51485us
I20260709 12:18:39.700878 22543 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:39.594417 26860 consensus_queue.cc:1059] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:18:39.708037 26860 raft_consensus.cc:3055] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:39.708416 26860 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:18:39.711655 27192 log.cc:927] Time spent T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.480s	user 0.004s	sys 0.000s
I20260709 12:18:39.709236 26860 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.713740 26860 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:39.716473 22299 catalog_manager.cc:5697] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:39.718129 22299 catalog_manager.cc:5697] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:39.720420 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:39.722535 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:39.723125 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:39.634018 27146 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.724895 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:39.726215 26456 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:39.586552 27147 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.728390 26456 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:18:39.728737 27147 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:39.725636 22400 raft_consensus.cc:2368] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16.
I20260709 12:18:39.730593 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.731220 22400 raft_consensus.cc:1275] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:39.731699 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.726090 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:39.732471 22394 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:39.733927 26922 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:39.734442 26922 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.734850 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:39.735659 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.735985 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:39.736442 26922 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:39.739341 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:39.740852 27147 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:39.741390 27147 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.743449 27147 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:39.709108 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.745783 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.746735 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.747558 22470 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 16: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:39.748164 27154 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:39.748924 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:39.749081 27159 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:39.749492 27159 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:39.733961 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.750092 22476 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:39.750603 22473 raft_consensus.cc:2393] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 10: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:39.750260 27159 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.751408 27159 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:39.753711 22475 raft_consensus.cc:2393] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 11: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:39.754627 22402 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:39.756264 22400 raft_consensus.cc:1275] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:18:39.757381 22294 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50176 (request call id 186) took 20607 ms (client timeout 15000 ms). Trace:
I20260709 12:18:39.719590 22299 catalog_manager.cc:5697] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:39.696369 27182 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:39.761394 22470 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:39.746022 26884 raft_consensus.cc:3055] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:39.762084 26884 raft_consensus.cc:740] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:39.763433 26248 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:39.764026 27109 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:39.768235 26766 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:39.768747 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:39.614041 27113 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.769381 22395 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:39.770479 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:39.770809 27113 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:39.771404 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:39.772218 22402 raft_consensus.cc:2393] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 11: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:39.772747 27169 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.773595 22400 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:39.761272 27080 consensus_queue.cc:237] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.607415 26962 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:39.596880 27040 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:39.775588 22548 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:39.776464 27040 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:39.700371 27111 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:18:39.699224 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.586374 27184 consensus_queue.cc:1059] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:18:39.779407 22472 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:18:39.779781 22472 pending_rounds.cc:85] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 5
I20260709 12:18:39.600649 27028 consensus_queue.cc:1059] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:18:39.779896 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.780485 22401 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:39.780601 27028 raft_consensus.cc:3055] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:39.780968 27028 raft_consensus.cc:740] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:39.599357 27143 consensus_queue.cc:1059] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:18:39.781385 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.783031 27143 raft_consensus.cc:3055] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:39.779295 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.779879 27184 raft_consensus.cc:3055] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:39.784077 22550 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 14: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:39.780907 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.703256 26890 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:39.703846 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:39.781394 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:39.785830 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.787015 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:39.787134 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:39.696151 27142 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:39.706542 27151 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:39.784053 27184 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:39.707300 27140 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:39.789659 27184 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.790067 27140 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:39.790464 22551 raft_consensus.cc:1240] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:39.790866 27184 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:39.783180 27169 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:39.724694 27146 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:39.793851 27028 consensus_queue.cc:260] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.794997 27028 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:39.795136 27142 raft_consensus.cc:697] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:39.748164 27108 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:39.796959 27108 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:39.781232 22472 pending_rounds.cc:107] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:18:39.787262 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:39.783450 27143 raft_consensus.cc:740] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:39.798439 22472 raft_consensus.cc:2889] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:39.796066 27142 consensus_queue.cc:237] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:39.801710 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:39.701995 22441 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.806140 22401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:50398
W20260709 12:18:39.823273 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 121361us
I20260709 12:18:39.823554 22401 raft_consensus.cc:606] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:39.622573 27116 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:39.808749 22394 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:39.761284 22299 catalog_manager.cc:5697] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 8 to 11, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 11 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:39.809113 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:39.824013 22441 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.827243 22366 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:39.828368 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.828770 26990 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:39.829581 27201 log.cc:927] Time spent T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
I20260709 12:18:39.830937 22366 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:39.831694 26990 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:39.831557 27143 consensus_queue.cc:260] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.832854 27143 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:39.833990 23095 leader_election.cc:336] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.626s (SENT)
I20260709 12:18:39.828998 27147 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:39.837657 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:39.838124 22548 raft_consensus.cc:2393] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 14: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:39.828428 22441 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.834474 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.628588 27177 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:39.629171 26810 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:39.840178 22441 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.842303 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:39.829185 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.855485 22441 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.854907 22299 catalog_manager.cc:5697] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 8 to 10, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 10 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:39.844236 27177 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:39.826002 27204 log.cc:927] Time spent T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:18:39.864533 22394 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:39.866920 22515 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:39.860390 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:18:39.859426 27177 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:39.635249 27036 consensus_queue.cc:1059] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.226s
I20260709 12:18:39.839578 27116 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:39.874713 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 243739us
I20260709 12:18:39.843855 27040 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:39.870919 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:39.635658 27144 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:39.881551 22367 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:39.884541 22442 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:39.884547 22367 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:39.854303 27117 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:39.881901 22470 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:39.888700 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:39.884956 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.897881 22394 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:39.898856 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.865782 27104 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:39.868274 26962 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:39.897307 22367 leader_election.cc:400] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17.
I20260709 12:18:39.903800 22367 leader_election.cc:403] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:39.843288 26922 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:18:39.905944 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.908069 22516 leader_election.cc:400] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16.
I20260709 12:18:39.915477 22394 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:18:39.876312 27161 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:18:39.881897 27009 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.006s	sys 0.035s
I20260709 12:18:39.919734 22516 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:39.920737 23095 leader_election.cc:336] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.691s (SENT)
I20260709 12:18:39.882773 26892 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:39.925695 22542 raft_consensus.cc:2368] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14.
W20260709 12:18:39.929042 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 44577.9us
I20260709 12:18:39.937861 22442 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:39.938696 23095 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:39.930779 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.941931 22516 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.902441 27113 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:39.948853 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.949414 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.896796 27135 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:39.949023 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.958738 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:18:39.931417 27009 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.006s	sys 0.036s
I20260709 12:18:39.963454 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.951757 22548 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:39.918102 26556 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:39.918892 27118 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:39.923048 27033 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:39.957553 27001 consensus_queue.cc:1059] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:18:39.946946 27146 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:39.962965 22544 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:39.917011 27108 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:39.965013 23095 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:39.966012 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.924422 27155 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:18:39.991722 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:39.992277 22401 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:39.994170 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.995209 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:39.962743 26248 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:39.976980 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:40.001031 22549 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:39.960326 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:39.976625 27114 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:39.948282 27164 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:39.950768 26810 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:39.957472 27113 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:39.968848 26991 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:39.958712 27117 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:39.998615 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.998967 22393 raft_consensus.cc:2410] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:39.983291 27135 raft_consensus.cc:697] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:39.999850 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:39.938673 27154 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:40.002964 22399 raft_consensus.cc:1217] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Deduplicated request from leader. Original: 10.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 12:18:40.000686 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:39.972638 22516 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:40.010044 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 112882us
I20260709 12:18:39.985683 27080 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:18:40.034394 27113 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:40.048368 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.055548 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:40.056739 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:40.037616 27117 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:40.059327 27117 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:40.062667 22542 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:18:39.984460 27036 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:40.033273 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:40.034067 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:40.065938 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 93443.1us
I20260709 12:18:40.067305 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:39.986326 27140 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:40.068835 22399 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:18:40.070114 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:40.000226 27122 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:40.083511 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.034543 27147 raft_consensus.cc:3055] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:40.085935 26798 consensus_queue.cc:1048] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:40.077630 27154 consensus_queue.cc:1059] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:18:40.088024 27154 raft_consensus.cc:3055] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:40.088408 27154 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:40.089133 27154 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.068562 26991 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:40.078166 22548 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:40.007088 27095 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16.
W20260709 12:18:39.757970 22294 rpcz_store.cc:269] 0709 12:18:19.150307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.154590 (+  4283us) service_pool.cc:224] Handling call
0709 12:18:39.757143 (+20602553us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:31.377153 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:31.471528 (+ 94375us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:31.471564 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:18:31.477557 (+  5993us) tablet.cc:662] Decoding operations
0709 12:18:31.656642 (+179085us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:31.656730 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:31.656775 (+    45us) tablet.cc:685] Acquiring locks for 25 operations
0709 12:18:31.842584 (+185809us) tablet.cc:701] Row locks acquired
0709 12:18:31.842605 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:18:31.842748 (+   143us) write_op.cc:270] Start()
0709 12:18:31.842874 (+   126us) write_op.cc:276] Timestamp: P: 1783599511842700 usec, L: 0
0709 12:18:31.842895 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:18:31.867887 (+ 24992us) log.cc:844] Serialized 9771 byte log entry
0709 12:18:32.468211 (+600324us) op_driver.cc:464] REPLICATION: finished
0709 12:18:32.641147 (+172936us) write_op.cc:301] APPLY: starting
0709 12:18:32.641226 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:32.993249 (+352023us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:32.993508 (+   259us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:33.476245 (+482737us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:33.476695 (+   450us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=0,mrs_lookups=0
0709 12:18:33.476757 (+    62us) write_op.cc:312] APPLY: finished
0709 12:18:33.477456 (+   699us) log.cc:844] Serialized 220 byte log entry
0709 12:18:33.674575 (+197119us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:33.695438 (+ 20863us) write_op.cc:454] Released schema lock
0709 12:18:33.695531 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:33.696046 (+   515us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:33.696071 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":559887,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":172691,"apply.run_cpu_time_us":47711,"apply.run_wall_time_us":1054834,"cfile_cache_hit":98,"cfile_cache_hit_bytes":102655,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6222,"cfile_init":1,"lbm_read_time_us":26105,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":7,"num_ops":25,"prepare.queue_time_us":226610,"prepare.run_cpu_time_us":39440,"prepare.run_wall_time_us":610475,"raft.queue_time_us":276460,"raft.run_cpu_time_us":22447,"raft.run_wall_time_us":133594,"replication_time_us":602241,"thread_start_us":679949,"threads_started":5,"wal-append.queue_time_us":422329,"wal-append.run_cpu_time_us":51934,"wal-append.run_wall_time_us":2343544}]]}
I20260709 12:18:39.997722 26869 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:40.081249 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:40.087301 26798 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:40.089555 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:40.089913 27033 consensus_queue.cc:1059] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:40.090286 27144 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:40.131258 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
W20260709 12:18:40.092542 27213 log.cc:927] Time spent T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:18:40.094686 26766 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:40.088156 27186 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:40.101027 22441 leader_election.cc:400] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14.
I20260709 12:18:40.136426 22441 leader_election.cc:403] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:40.101562 27147 raft_consensus.cc:740] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:40.101788 22442 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:40.141104 27154 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:40.072016 22549 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:18:40.032542 26810 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:18:40.102696 27210 log.cc:927] Time spent T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:18:40.102288 27001 consensus_queue.cc:1059] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:18:40.029513 27009 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 12:18:40.142474 26810 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:40.142887 26456 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:40.100812 27036 raft_consensus.cc:697] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:40.144440 27036 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.144923 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:40.145505 22470 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:18:40.147884 27001 raft_consensus.cc:3055] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:40.148238 27001 raft_consensus.cc:740] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:40.148672 27116 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:40.148989 27001 consensus_queue.cc:260] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.074051 22367 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:40.139382 23095 leader_election.cc:336] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.915s (SENT)
I20260709 12:18:40.150039 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:40.140071 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:40.151064 22442 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:40.152241 22442 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:40.153189 23095 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:40.154049 22402 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:40.153268 26810 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.154577 27200 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:40.155062 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:40.155428 27200 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:40.155827 26456 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:40.154644 27149 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:40.157099 26810 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:40.157559 23125 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:40.158967 27120 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:40.159468 27120 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.159461 26810 consensus_queue.cc:1059] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:40.155503 22396 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:40.161855 27120 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:40.161516 26810 raft_consensus.cc:3055] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:40.162799 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:40.162891 26810 raft_consensus.cc:740] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:40.164529 27001 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:40.164299 26810 consensus_queue.cc:260] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:40.165321 22470 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:18:40.166030 26810 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:40.167598 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:40.169351 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:40.155622 22395 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:40.159610 27116 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:40.176354 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:40.196641 22395 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:18:40.196853 26884 consensus_queue.cc:260] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.198076 26884 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:40.136790 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 51866us
I20260709 12:18:40.206210 27040 raft_consensus.cc:3055] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:40.207391 27040 raft_consensus.cc:740] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:40.209494 27040 consensus_queue.cc:260] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:40.232249 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 158260us
I20260709 12:18:40.233148 22367 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:40.234438 22367 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:40.133847 26991 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:40.269193 22549 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:40.136199 27186 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:40.272234 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:40.276057 22545 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:18:40.231447 27122 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14.
I20260709 12:18:40.282438 22468 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
W20260709 12:18:40.271211 27216 log.cc:927] Time spent T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:18:40.265736 26922 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:40.294739 22441 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:40.268081 27108 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:40.137961 26766 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:40.315747 22442 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:40.315917 22441 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:40.287019 27186 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:40.320940 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:40.288851 27104 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:40.284579 27001 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:40.298691 26991 raft_consensus.cc:697] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:40.320432 27149 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:18:40.343029 27159 consensus_meta.cc:287] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.001s
I20260709 12:18:40.329725 27154 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:40.346117 22472 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:40.301738 27219 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:40.263137 27135 consensus_queue.cc:237] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.321942 27053 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:40.330106 27033 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:40.247637 27164 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:40.329020 27122 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:18:40.354382 27151 consensus_meta.cc:287] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.000s
I20260709 12:18:40.364768 22473 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:40.302733 27147 consensus_queue.cc:260] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.437688 23094 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:40.449229 22474 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 10.
I20260709 12:18:40.442723 27053 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:40.452447 23122 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:40.452339 27053 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.399097 27219 raft_consensus.cc:697] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:40.456545 27219 consensus_queue.cc:237] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.394083 27080 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17.
I20260709 12:18:40.336510 27207 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 12:18:40.388139 26456 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:40.468284 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 150122us
I20260709 12:18:40.451628 27009 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:40.478224 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.366752 27154 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:40.488031 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:40.492434 23095 leader_election.cc:336] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.083s (SENT)
I20260709 12:18:40.365800 27001 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.490120 22394 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:18:40.471046 26991 consensus_queue.cc:237] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:40.505369 27177 consensus_meta.cc:287] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.619s	user 0.005s	sys 0.002s
W20260709 12:18:40.506469 27222 log.cc:927] Time spent T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:18:40.450847 27184 consensus_queue.cc:1175] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8c3bcfa13ca74a24ab8999a408532932" responder_term: 14 status { last_received { term: 11 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: [13.7-13.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:40.508071 27117 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:40.511070 27154 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:40.512495 27001 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:40.512950 27207 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:40.536830 27169 consensus_meta.cc:287] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.741s	user 0.008s	sys 0.004s
I20260709 12:18:40.516424 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:40.523798 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 51719.2us
I20260709 12:18:40.534471 22401 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:40.535156 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:40.536417 22547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.009s	sys 0.012s
W20260709 12:18:40.559478 22547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.009s	sys 0.012s
I20260709 12:18:40.547879 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:40.469805 26456 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.480265 27209 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:18:40.563303 23125 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:40.546347 27176 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:40.584199 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 319042us
W20260709 12:18:40.570005 27113 consensus_meta.cc:287] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.000s
I20260709 12:18:40.571460 26766 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:40.571434 27033 raft_consensus.cc:697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:40.569316 27164 raft_consensus.cc:697] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:40.623219 27164 consensus_queue.cc:237] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.541507 27177 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:40.597440 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.623723 26706 raft_consensus.cc:3055] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:18:40.629551 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.654218 27177 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:40.653538 27033 consensus_queue.cc:237] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:40.655647 27233 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:18:40.663640 22474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43060 (request call id 452) took 1126 ms. Trace:
I20260709 12:18:40.664152 22474 rpcz_store.cc:276] 0709 12:18:39.537429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.634260 (+ 96831us) service_pool.cc:224] Handling call
0709 12:18:40.663414 (+1029154us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b5400161054. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:40.663569 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1729568640}
I20260709 12:18:40.628072 27221 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:40.665372 27221 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.667505 27221 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:40.668035 26991 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:40.668625 26991 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.562918 27207 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.720739 22475 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:18:40.663517 26798 consensus_meta.cc:287] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.000s
I20260709 12:18:40.675818 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43060 (request call id 454) took 1135 ms. Trace:
I20260709 12:18:40.677436 22476 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:40.685340 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:40.740763 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:40.724054 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:40.740757 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:40.670289 22477 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:40.746014 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:40.738818 22468 rpcz_store.cc:276] 0709 12:18:39.540157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.731493 (+191336us) service_pool.cc:224] Handling call
0709 12:18:40.675656 (+944163us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b5400395154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:40.675763 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139368704}
I20260709 12:18:40.747464 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:40.676994 27143 consensus_meta.cc:287] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.844s	user 0.004s	sys 0.006s
I20260709 12:18:40.753114 22402 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:40.760848 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:40.576366 27176 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.596060 27223 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.173s
I20260709 12:18:40.593400 27113 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.677395 26706 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:18:40.760262 27243 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:18:40.745610 26798 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:40.721938 26990 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:18:40.760124 27232 log.cc:927] Time spent T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:18:40.720387 27040 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:40.760018 27215 log.cc:927] Time spent T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
W20260709 12:18:40.768766 27231 log.cc:927] Time spent T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:18:40.764603 26991 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:40.824448 22395 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16. Ops: []
W20260709 12:18:40.760521 27237 log.cc:927] Time spent T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 12:18:40.840480 27214 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.736s	user 0.000s	sys 0.004s
I20260709 12:18:40.844390 22402 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:40.814595 27169 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:40.809592 27001 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:40.852329 22472 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:40.674817 27118 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.171s
I20260709 12:18:40.813208 27053 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:40.823688 27236 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:40.862380 22367 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:40.853744 22474 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:40.876113 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:40.887308 22367 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:40.868472 27169 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.892967 26456 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:40.894721 27169 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:40.824275 26990 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:40.895861 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:40.907639 27247 log.cc:927] Time spent T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:18:40.897805 27159 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:40.897574 27028 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:40.878692 27053 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.912348 27053 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:40.914499 27113 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:40.917321 26990 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:40.869189 27209 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:18:40.886211 27236 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:40.865387 26706 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.919638 26706 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:40.920858 27236 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:40.925565 27221 consensus_queue.cc:1059] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:40.926954 27221 raft_consensus.cc:3055] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:18:40.926808 26798 consensus_queue.cc:1175] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "25ebf14868c042dca42f54b3e251e1b2" responder_term: 14 status { last_received { term: 14 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:18:40.928184 27250 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:18:40.928982 27207 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:40.927412 27221 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:40.930603 27176 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:40.930794 27221 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:40.931578 26922 consensus_meta.cc:287] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.000s
W20260709 12:18:40.932313 27246 log.cc:927] Time spent T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:18:40.934214 26922 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:40.902561 26766 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:40.874127 27001 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.938684 27001 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:40.932137 27221 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:40.943236 27186 consensus_meta.cc:287] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.000s
W20260709 12:18:40.956599 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 95600.9us
I20260709 12:18:40.964623 27045 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.965272 27045 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:40.968317 27045 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:40.971551 27147 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:40.973657 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 2462) took 1408 ms. Trace:
I20260709 12:18:40.974233 22477 rpcz_store.cc:276] 0709 12:18:39.565277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.788633 (+223356us) service_pool.cc:224] Handling call
0709 12:18:40.669905 (+881272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:40.746788 (+ 76883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:40.973416 (+226628us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b5400161050. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:40.973588 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2026064128}
I20260709 12:18:40.975415 22545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 2106) took 1488 ms. Trace:
I20260709 12:18:40.975850 22545 rpcz_store.cc:276] 0709 12:18:39.487151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.487264 (+   113us) service_pool.cc:224] Handling call
0709 12:18:40.975218 (+1487954us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b540008c0d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:40.975331 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1262834560}
I20260709 12:18:40.956928 27186 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:40.997916 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:41.002542 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.004953 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.005209 27068 raft_consensus.cc:993] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:18:41.005904 22402 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:41.005895 27068 raft_consensus.cc:1081] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:18:41.019474 27186 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:41.020412 22551 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:41.028499 23129 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:41.031054 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:41.033167 22545 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:41.034157 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:41.035354 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.036056 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:41.038143 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:41.040670 27164 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.041194 27164 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.042819 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 2265) took 1051 ms. Trace:
I20260709 12:18:41.060177 22394 rpcz_store.cc:276] 0709 12:18:39.991369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.991484 (+   115us) service_pool.cc:224] Handling call
0709 12:18:41.042680 (+1051196us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b5400037fd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:41.042766 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1111157120}
W20260709 12:18:41.046859 27240 log.cc:927] Time spent T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.187s	user 0.002s	sys 0.000s
W20260709 12:18:41.046983 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.052446 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:41.042037 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.064126 22441 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:41.064760 22395 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
I20260709 12:18:41.064126 23129 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:18:41.054217 22544 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:41.067596 22472 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:41.069914 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:41.072078 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:41.073700 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:41.075814 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:41.077203 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:41.076280 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:41.062582 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:41.082494 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:41.087111 22550 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:41.088980 22544 raft_consensus.cc:2393] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 19: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:41.078954 26884 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:41.094643 26884 raft_consensus.cc:697] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:41.080343 27116 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:18:41.095539 26884 consensus_queue.cc:237] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.096909 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.110219 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:41.115456 22474 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:41.114743 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.116008 22472 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:41.111495 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43060 (request call id 446) took 1575 ms. Trace:
I20260709 12:18:41.117452 22476 rpcz_store.cc:276] 0709 12:18:39.535961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.750780 (+214819us) service_pool.cc:224] Handling call
0709 12:18:40.677079 (+926299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:40.739555 (+ 62476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:41.111286 (+371731us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b5400395150. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:41.111432 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2129610112}
I20260709 12:18:41.117003 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.110361 22402 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:18:41.079670 27239 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.130518 23094 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:41.121573 22516 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:41.131084 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.131778 27033 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:41.133208 22542 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:18:41.134404 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.140908 22474 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
W20260709 12:18:41.194095 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.193921 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:41.284471 22402 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:41.096230 27095 consensus_queue.cc:1059] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:18:41.259054 27164 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:41.291085 22516 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:41.259765 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.099357 27116 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.110587 27109 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:41.195250 27239 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.299206 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:41.266188 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.141634 27033 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:41.131908 27263 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:41.272174 27209 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:41.277962 27161 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.280494 22546 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:18:41.308887 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.309063 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.309602 22473 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
W20260709 12:18:41.280900 22442 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.1:37927 timed out after 1.605s (SENT) [suppressed 14 similar messages]
I20260709 12:18:41.093271 26962 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:18:41.281250 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 146574us
I20260709 12:18:41.311221 22402 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
W20260709 12:18:41.312247 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 180588us
I20260709 12:18:41.282829 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.314169 22401 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:18:41.288879 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.291531 27147 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:41.290781 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:41.292471 22470 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:41.292850 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:41.302452 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.270973 27253 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:18:41.314378 22548 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:41.297996 27207 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:41.289180 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:41.306176 27033 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:41.296320 27118 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:41.319168 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:41.320863 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:41.315639 22472 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:18:41.325248 22395 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:41.325608 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:41.317487 26884 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.301306 27109 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.300194 27116 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.307384 27009 consensus_queue.cc:1059] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:18:41.357431 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:41.370669 22468 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:18:41.364805 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 75729.2us
I20260709 12:18:41.372773 22367 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:41.375241 22366 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:41.327173 26892 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:41.314966 27161 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.345700 27220 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:41.384083 22542 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:41.361008 26884 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.348155 27207 raft_consensus.cc:697] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:41.385915 26766 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:41.386760 27252 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:41.367682 27164 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:41.387411 27113 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:41.370725 27223 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:41.387751 22544 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:18:41.480033 22544 pending_rounds.cc:85] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 11
I20260709 12:18:41.480342 22544 pending_rounds.cc:107] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:18:41.480579 22544 raft_consensus.cc:2889] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:41.389626 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.366011 27236 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:18:41.321936 27147 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.348572 27217 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.123s
I20260709 12:18:41.384121 26892 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.379372 27209 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:41.380993 27108 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:18:41.486258 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 205377us
I20260709 12:18:41.387200 26922 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:41.330093 27118 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:41.452358 27163 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.457885 27164 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:41.477116 27268 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:18:41.470773 27154 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:41.552433 27149 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:41.504715 26798 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.594282 26798 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.595494 26884 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:41.537745 26892 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:41.612475 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.555091 27164 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:41.616052 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.618428 22395 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:41.539958 27028 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:18:41.552771 26922 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.555486 27163 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:41.626036 27177 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.650765 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:41.651502 22395 raft_consensus.cc:2376] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17. Re-sending same reply.
I20260709 12:18:41.602811 27154 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:41.611042 27149 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.666359 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.664885 27144 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:41.700431 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 306418us
I20260709 12:18:41.706813 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.707543 22395 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:41.665391 27239 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:41.630767 27207 consensus_queue.cc:237] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.666621 27177 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:41.699266 27116 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:41.705085 27109 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:41.731153 22475 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:41.733383 22395 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:41.714483 26766 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:41.744343 26766 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.745873 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.746541 26766 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:41.719841 27108 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:18:41.748152 27109 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.748657 27109 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.750758 27109 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:41.751601 27278 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:41.752168 27278 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.762360 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.717249 27161 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:41.744361 22395 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:41.738730 27280 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.739207 27147 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:41.741135 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.742801 27276 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.773083 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.773976 22475 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:41.775141 27177 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:41.771256 27277 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.773165 27276 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.778506 27276 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:41.775657 27280 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.780218 26922 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:41.781670 27280 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:41.771240 27154 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:41.774195 27118 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:41.781699 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.710394 27144 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.776484 27277 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.784466 27144 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:41.719568 27159 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:18:41.785204 27277 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:41.785831 27278 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:41.786113 27272 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:41.776561 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.786770 22395 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
I20260709 12:18:41.786633 27272 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:41.787271 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.787968 22475 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:18:41.788622 27272 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:41.788841 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.789304 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.789921 22468 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:18:41.790148 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.782052 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.791805 22475 raft_consensus.cc:2410] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:18:41.795962 22399 raft_consensus.cc:2410] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:18:41.797504 27149 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:41.797628 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.798570 22475 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:41.799549 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 2472) took 1071 ms. Trace:
I20260709 12:18:41.799943 22469 rpcz_store.cc:276] 0709 12:18:40.727702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.751347 (+ 23645us) service_pool.cc:224] Handling call
0709 12:18:40.751681 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:40.762486 (+ 10805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:40.762513 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:40.762972 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 12:18:41.389630 (+626658us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b180042f4c0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a49e07 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b 00007fb4f86f3d23 00007fb4f86f40d1 00007fb4f8b0fa0f
0709 12:18:41.648528 (+258898us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:41.672249 (+ 23721us) log.cc:844] Serialized 14 byte log entry
0709 12:18:41.672445 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:41.672515 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:41.792981 (+120466us) raft_consensus.cc:1685] finished
0709 12:18:41.799349 (+  6368us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:41.799491 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10565,"prepare.queue_time_us":19313,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":20548,"raft.queue_time_us":11125,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":66638,"spinlock_wait_cycles":3852160,"thread_start_us":258674,"threads_started":1,"wal-append.queue_time_us":967660}
I20260709 12:18:41.803818 27217 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.804395 27217 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.805420 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.805608 27270 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.806874 27270 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:41.811638 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.812271 22400 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:41.812712 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:41.813090 27270 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:41.813349 22548 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:41.814064 27277 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:41.814741 22542 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:41.814610 27277 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:41.816731 27277 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:41.814085 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:41.817946 22544 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:41.818159 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.814088 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.818889 22400 raft_consensus.cc:2393] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 15: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:41.808248 27220 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:41.819641 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.820268 22469 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:18:41.822881 27033 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.826860 27270 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:41.812160 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:41.820060 27220 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.832777 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:41.830169 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.831491 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:41.834498 22544 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:41.806545 27217 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:41.840099 22548 raft_consensus.cc:2393] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:41.842024 27040 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.842350 27164 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.842784 27033 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:41.843540 22545 raft_consensus.cc:1240] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 12:18:41.848344 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.849975 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:41.790367 26892 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.855690 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:41.856695 22468 raft_consensus.cc:2393] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 16: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:41.859959 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:41.857631 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.864971 22468 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:18:41.868211 22469 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:41.868121 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.874965 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:41.875648 22542 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:18:41.876047 22441 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:41.877007 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:41.879421 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.879513 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:41.883597 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:41.883487 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:41.881557 22516 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:41.885036 22469 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:41.871515 22442 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:41.845021 27149 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.850210 26810 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.893607 26991 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:41.903961 22469 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:41.892465 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:41.906042 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.908208 27276 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:41.908519 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:41.908740 27276 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.909132 27276 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:41.909936 26991 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:41.868508 27040 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.911413 26991 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:41.912405 27040 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:41.914798 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.896831 22543 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:18:41.915416 22470 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:41.915740 27144 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:41.868733 27147 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.916604 27147 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.916983 27276 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.916196 27144 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.917562 27117 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:41.917933 27144 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:41.918856 27147 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:41.888588 27116 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:41.919646 27116 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.917315 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:41.868510 27033 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:41.870085 27272 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:41.923908 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.916334 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:41.947806 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:41.893795 26884 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:41.955392 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:41.915961 27164 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:41.964849 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:41.955955 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 79970.1us
I20260709 12:18:41.958098 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:41.913388 26810 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:41.899413 27184 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:41.966148 22441 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:41.962404 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:41.966339 22544 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:18:41.970118 22469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36286
I20260709 12:18:41.971311 22469 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:41.972195 22469 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:41.976099 27096 raft_consensus.cc:3055] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:41.976567 27096 raft_consensus.cc:740] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:41.986450 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 2128) took 1819 ms. Trace:
I20260709 12:18:41.986900 22551 rpcz_store.cc:276] 0709 12:18:40.166629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.171260 (+  4631us) service_pool.cc:224] Handling call
0709 12:18:40.171552 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:41.020899 (+849347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:41.986235 (+965336us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b54001405d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:41.986388 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1951753984}
I20260709 12:18:41.988945 22477 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:41.990278 22477 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:41.997926 22394 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:41.998565 22441 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:41.953909 26991 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:41.921748 27116 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.005785 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:42.012271 22545 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:41.977511 27096 consensus_queue.cc:260] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:41.922343 27149 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.022434 27276 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:42.023422 27283 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:42.024140 27283 consensus_queue.cc:1243] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer b8621fa34be04d3fa2d68a300f858cd1 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:42.030426 22398 pending_rounds.cc:85] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 5
I20260709 12:18:42.030763 22398 pending_rounds.cc:107] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:18:42.031020 22398 raft_consensus.cc:2889] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:42.031342 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:42.032558 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:42.033095 22475 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:42.038749 26892 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:41.967834 27184 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:42.039693 27184 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:42.010291 26991 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.042080 26991 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:42.042387 22470 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:18:42.045821 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:42.046445 22470 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:42.047343 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:42.043458 27149 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:42.051187 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 52703.7us
I20260709 12:18:42.007300 27182 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:42.056387 22475 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:18:42.057331 27147 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:42.052316 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:42.018738 22469 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.066054 22394 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:42.063602 22441 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:42.064527 27040 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:18:42.070182 22469 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.069631 22476 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 14. Ops: []
W20260709 12:18:42.070884 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 180967us
I20260709 12:18:42.046154 27260 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.076254 22470 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:18:42.075521 22441 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:42.078989 22442 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:42.080430 22475 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:18:42.065689 26810 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.082269 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:42.083956 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:42.088905 22441 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:42.089658 26810 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:42.089888 27120 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:42.090065 26810 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.090312 27120 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:42.090696 27120 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:42.091507 27287 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:42.091931 27287 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:42.092254 27287 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:42.092689 27184 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.062480 27045 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:42.094017 27045 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:42.095825 22442 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:42.096145 27045 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.064680 27239 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:18:42.070225 27149 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:18:42.097119 26884 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:42.098400 27149 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:42.098681 22366 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:42.099530 27068 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:42.099871 27068 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.100209 27068 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:42.101972 26810 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:42.104419 26798 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:42.081894 27040 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:42.106173 27040 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.106649 27040 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:42.109964 22366 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:42.111080 22366 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:42.112669 27236 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:42.113077 27236 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.113400 27236 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:42.116281 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:42.116935 22470 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:18:42.118196 27284 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:42.077093 27096 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:42.129923 22441 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:42.140815 22394 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
W20260709 12:18:42.144665 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 48897us
I20260709 12:18:42.101468 27144 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.121011 27284 raft_consensus.cc:697] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:42.119980 27278 consensus_queue.cc:1059] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:18:42.136631 27113 consensus_queue.cc:1059] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:18:42.083786 27260 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:42.163872 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:42.136420 27217 consensus_queue.cc:1059] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:18:42.155301 27161 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:42.177166 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:42.177913 23129 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:42.165657 26766 raft_consensus.cc:3055] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:42.158643 26884 consensus_queue.cc:1059] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:18:42.188753 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:42.189677 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:42.191468 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:42.172291 27161 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:42.181138 27045 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.197091 22367 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:42.207072 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:42.211575 27182 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:42.211848 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:42.212530 22548 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:42.213395 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:42.208812 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:42.172149 27111 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:18:42.188753 27116 raft_consensus.cc:3055] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:42.183079 27272 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:42.213899 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:42.183369 26766 raft_consensus.cc:740] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:42.214866 22548 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:42.210912 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:42.215942 22367 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:42.181576 27163 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:42.219017 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:42.221971 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:42.194589 27161 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:42.227085 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.257436 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:42.276417 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 60585.7us
I20260709 12:18:42.249297 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:42.277215 22367 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:42.221633 27184 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.219769 26962 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.220201 27116 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:42.306634 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 2473) took 1578 ms. Trace:
I20260709 12:18:42.307116 22471 rpcz_store.cc:276] 0709 12:18:40.728244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.816330 (+ 88086us) service_pool.cc:224] Handling call
0709 12:18:40.834760 (+ 18430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:40.937146 (+102386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:40.937178 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:40.937219 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:40.937248 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.306382 (+1369134us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400309dd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:42.306434 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:42.306568 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235022080}
I20260709 12:18:42.219527 27045 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:42.282348 27147 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:42.299737 27163 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:42.248739 27068 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.246505 27272 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:42.309335 27209 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:42.372310 23122 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:18:42.378924 22395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:18:42.379544 22395 raft_consensus.cc:606] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:42.359392 27144 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:42.375252 27270 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:42.219103 27284 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.351696 27223 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:18:42.417332 27120 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.420717 27120 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.423976 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:42.424777 22543 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:42.333647 26766 consensus_queue.cc:260] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.426811 27253 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:42.428755 26991 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.431424 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:42.433936 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:42.435698 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:42.361295 27147 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:42.369325 27163 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.436738 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:42.437014 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:42.436329 22394 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:42.443420 22396 raft_consensus.cc:3055] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:42.443764 22396 raft_consensus.cc:740] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:42.443936 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:18:42.437979 27289 log.cc:927] Time spent T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 12:18:42.447259 22397 raft_consensus.cc:2393] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 15: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:42.447069 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:42.433281 27236 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.440816 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:42.377281 27287 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.447162 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 2250) took 1338 ms. Trace:
I20260709 12:18:42.441987 27040 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.456897 26892 consensus_queue.cc:1059] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:42.434060 27176 raft_consensus.cc:3055] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:18:42.473595 27299 log.cc:927] Time spent T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:18:42.448217 22442 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:42.471721 22396 consensus_queue.cc:260] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.475965 22472 rpcz_store.cc:276] 0709 12:18:41.108401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.116757 (+  8356us) service_pool.cc:224] Handling call
0709 12:18:42.446992 (+1330235us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400047754. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:18:42.447102 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453325056}
I20260709 12:18:42.459708 27113 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:18:42.446431 27294 log.cc:927] Time spent T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:18:42.489226 27287 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.490819 27040 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.499779 27236 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.501241 26991 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:42.502053 22394 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:18:42.504842 27220 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.512173 27147 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:42.513926 27163 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.515317 27068 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.516569 26810 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.518150 27272 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.483198 27176 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:42.521358 22396 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:18:42.526420 22402 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:42.530639 22441 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:42.533583 26884 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:42.530676 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:42.531822 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 83669.3us
W20260709 12:18:42.533084 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:42.534842 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 229611us
I20260709 12:18:42.562353 22367 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:42.545687 22399 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.012s	sys 0.025s
W20260709 12:18:42.563776 22399 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.012s	sys 0.025s
I20260709 12:18:42.404439 27116 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.565634 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:42.546402 27095 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:42.469002 22515 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:42.545899 27288 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:42.568482 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:42.569787 22548 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
W20260709 12:18:42.567049 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 98501.8us
I20260709 12:18:42.569936 22442 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:42.573992 22515 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:42.577433 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:42.587786 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:42.588557 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:42.589152 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:42.592003 22548 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 14: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:42.595510 22551 raft_consensus.cc:2393] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 14: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:42.597193 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:42.600908 22402 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
I20260709 12:18:42.565572 26884 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:42.613981 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:42.568444 27288 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.568598 26892 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.592156 27163 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:42.622776 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:42.603315 27236 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:42.627323 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:42.578615 26922 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:42.593603 27040 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:42.629323 22548 raft_consensus.cc:2368] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 19. Current term is 20.
I20260709 12:18:42.578892 26991 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:42.594156 27154 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:18:42.635171 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.611833 27272 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:42.626327 27288 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:42.637053 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:42.619354 27116 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:42.627614 27303 log.cc:927] Time spent T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:18:42.636425 22551 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:42.576689 27095 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:42.611410 27305 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:42.627188 27045 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.664047 22543 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:42.643033 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:42.666069 27308 log.cc:927] Time spent T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:18:42.641211 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:42.637542 26922 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.641248 27040 raft_consensus.cc:697] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:42.674439 27095 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:42.674045 27040 consensus_queue.cc:237] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.657631 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:42.630028 27236 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:42.662118 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:42.662664 27305 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:42.663398 27111 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:42.678910 27309 log.cc:927] Time spent T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:18:42.626791 27176 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:42.652307 27154 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.691988 27154 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:42.693485 27111 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.695639 27111 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.698244 27305 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:42.698748 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:42.699424 22401 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:42.684762 27236 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:42.706133 22400 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:42.692510 27161 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.683450 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:42.716945 27045 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:42.718128 27295 log.cc:927] Time spent T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.295s	user 0.003s	sys 0.000s
I20260709 12:18:42.687660 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:42.688984 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:42.714039 27108 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:42.714092 26766 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:42.724560 22401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:50398
W20260709 12:18:42.680943 27297 log.cc:927] Time spent T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.267s	user 0.000s	sys 0.002s
I20260709 12:18:42.724771 22548 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 14.
I20260709 12:18:42.726194 22475 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:42.726083 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:42.727288 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:42.728097 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:42.757673 22474 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:42.728483 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:42.729095 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:42.734721 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:42.767810 22395 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:42.735618 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:42.768707 22468 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:42.740617 27161 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.734615 22398 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:42.742836 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:42.744247 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:42.771031 22393 raft_consensus.cc:2393] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 14: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:42.749167 27149 raft_consensus.cc:3055] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:42.749220 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:42.750749 22442 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:42.751600 23094 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:42.774376 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:42.775166 22402 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 15: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:42.753261 22396 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:42.753705 22401 raft_consensus.cc:606] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:42.777801 22401 raft_consensus.cc:614] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:42.782151 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 53149.5us
I20260709 12:18:42.783547 23094 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:42.790206 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:42.772100 27149 raft_consensus.cc:740] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:42.755151 27108 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:42.790164 27154 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.803006 22395 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 20.
I20260709 12:18:42.781629 27316 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:42.793968 27258 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:42.810125 22468 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
W20260709 12:18:42.803088 27080 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 14 is higher.
I20260709 12:18:42.812852 22474 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 20.
I20260709 12:18:42.799237 22515 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:42.794267 26810 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.823549 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:42.825501 22474 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 14.
I20260709 12:18:42.834682 27209 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:42.835259 27209 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.837334 26922 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.826299 27033 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:42.838009 26794 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:18:42.838620 22399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:18:42.822788 27161 raft_consensus.cc:2764] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 12:18:42.820904 27155 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:18:42.837301 27209 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:42.842613 27313 log.cc:927] Time spent T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.175s	user 0.001s	sys 0.001s
I20260709 12:18:42.827019 26884 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:42.845654 27236 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.846773 27260 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:42.848546 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:42.869953 22543 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:18:42.858753 27033 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.849238 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:42.861701 27001 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:42.871575 27001 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:42.873350 22366 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:42.851784 27288 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.874691 27209 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:42.875126 27209 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:42.875510 27209 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:42.855480 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:42.856936 27108 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:42.863845 27258 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.878165 27258 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:42.878700 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:42.880239 27258 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.881011 27155 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.883136 27236 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.883916 27147 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:42.884148 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:42.884611 27147 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.886703 27147 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:42.887259 27304 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.332s	user 0.004s	sys 0.000s
I20260709 12:18:42.887771 27209 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.888974 26794 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:42.889423 26794 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:42.889848 26794 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:42.891039 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:42.891985 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:42.892573 22549 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:42.892669 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:42.893383 27154 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:42.875506 27288 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.894181 26556 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:42.894562 26556 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.894894 26556 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:42.898223 27288 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:42.873598 27001 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:42.898859 27288 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.900219 22549 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
I20260709 12:18:42.902153 22366 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:42.903205 26962 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:42.900986 27155 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.903846 26962 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:42.871181 27033 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:42.900986 27288 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.908591 22516 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:42.908445 27095 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:42.909555 27154 raft_consensus.cc:2764] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 12:18:42.900795 27209 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.917598 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:42.918092 27155 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.919945 27244 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:42.920377 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:42.920499 27244 raft_consensus.cc:697] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:42.921267 27155 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:42.922139 27244 consensus_queue.cc:237] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.925390 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:42.925571 26556 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.929436 27155 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:42.929894 26556 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:42.929973 27155 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:42.930543 27155 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:42.931912 27310 log.cc:927] Time spent T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:18:42.938395 27155 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.939400 26991 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:18:42.940728 27300 log.cc:927] Time spent T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.521s	user 0.003s	sys 0.007s
I20260709 12:18:42.939631 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:42.926997 27154 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:42.942312 26991 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:42.942555 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 2498) took 1067 ms. Trace:
I20260709 12:18:42.942305 27154 raft_consensus.cc:697] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:42.943300 26991 raft_consensus.cc:697] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:42.942939 22469 rpcz_store.cc:276] 0709 12:18:41.875251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.075927 (+200676us) service_pool.cc:224] Handling call
0709 12:18:42.076237 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:42.079162 (+  2925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:42.079192 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:42.079667 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:18:42.249274 (+169607us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:42.249316 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.249394 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:42.940139 (+690745us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:42.942236 (+  2097us) raft_consensus.cc:1685] finished
0709 12:18:42.942287 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:42.942498 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2539,"raft.queue_time_us":9336,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":3838,"spinlock_wait_cycles":38913792,"thread_start_us":126405,"threads_started":1,"wal-append.queue_time_us":266393}
I20260709 12:18:42.944363 27154 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.946089 27176 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:42.950119 22549 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 17. Current term is 18. Ops: [15.9-17.10]
I20260709 12:18:42.951152 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:42.951754 22548 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:42.952967 23095 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:18:42.954049 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:42.954864 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:42.955238 22543 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:42.958400 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:42.958967 22545 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 15: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:42.905260 26962 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.962177 22399 raft_consensus.cc:606] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:42.962646 22399 raft_consensus.cc:614] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:42.945264 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:42.964211 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:42.964438 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:42.964938 22545 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:42.965467 22441 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:42.967437 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:42.968019 22441 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:42.964190 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:42.937214 27149 consensus_queue.cc:260] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.968869 27161 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.972885 27161 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:42.970667 27288 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:42.975003 27161 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:42.976136 26991 consensus_queue.cc:237] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:42.983022 27315 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.302s	user 0.000s	sys 0.002s
W20260709 12:18:42.987504 27323 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.308s	user 0.001s	sys 0.001s
I20260709 12:18:42.988690 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 2612) took 1081 ms. Trace:
I20260709 12:18:42.990146 22545 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:42.991101 27033 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:42.964772 27104 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:42.985132 26794 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:42.966583 27095 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:42.993672 27033 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:42.961155 27307 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:42.995070 27307 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.995419 27307 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:42.997476 26794 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:42.998451 27095 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:42.999534 27095 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.000000 22399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:18:43.000645 22399 raft_consensus.cc:606] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:42.992269 27104 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.001008 22399 raft_consensus.cc:614] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:43.005579 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:18:43.005837 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:43.005533 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:43.007098 22543 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:43.008736 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:43.010637 22549 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:43.012213 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:43.013855 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:43.014978 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:43.015664 22400 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:18:42.989120 22542 rpcz_store.cc:276] 0709 12:18:41.907581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.921025 (+ 13444us) service_pool.cc:224] Handling call
0709 12:18:41.921411 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:41.922054 (+   643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:41.922084 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:41.922546 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:18:42.594096 (+671550us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b1800111ca0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a49e07 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b 00007fb4f86f3d23 00007fb4f86f40d1 00007fb4f8b0fa0f
0709 12:18:42.623894 (+ 29798us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:42.623934 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.623996 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:42.986959 (+362963us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:42.988483 (+  1524us) raft_consensus.cc:1685] finished
0709 12:18:42.988504 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:42.988631 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":498,"raft.queue_time_us":167,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":35556352,"thread_start_us":29617,"threads_started":1,"wal-append.queue_time_us":754824}
I20260709 12:18:43.017447 22442 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:43.018872 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:43.019951 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:43.011600 22515 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:43.022706 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:43.022749 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:43.023085 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:18:43.027129 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 59182.9us
I20260709 12:18:43.027864 22441 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:43.032440 27040 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:43.019867 27154 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:43.039271 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:43.023597 27288 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:43.040794 23125 raft_consensus.cc:2393] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 12: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:43.041278 22441 leader_election.cc:400] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 19. Current term is 20.
I20260709 12:18:43.042121 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:43.026454 27161 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.035303 27147 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:43.031409 27149 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:43.044292 22441 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:43.037458 26794 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:43.033931 27040 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:43.034061 27001 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:43.055867 22441 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:43.067039 22441 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:43.047055 26962 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.075079 22399 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:43.036260 26884 consensus_queue.cc:1059] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:18:43.047178 27154 raft_consensus.cc:697] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:43.075927 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:18:43.081851 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 50521us
I20260709 12:18:43.060173 27120 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:43.056263 27155 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:43.064921 27147 raft_consensus.cc:697] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:43.077014 27184 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:43.093341 27305 raft_consensus.cc:3055] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:43.103109 27305 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:43.103951 27287 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:43.104526 27287 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:43.104947 27287 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:43.105903 27184 raft_consensus.cc:697] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:43.106148 27154 consensus_queue.cc:237] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.106943 27184 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.104538 27306 consensus_queue.cc:1059] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:18:43.104072 22441 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:43.095046 27104 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:43.093230 26892 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:18:43.115123 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:43.055223 27161 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.047469 27288 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.160190 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:43.160772 22473 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:43.167215 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 63236.6us
I20260709 12:18:43.168359 22441 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:43.175673 22441 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:43.177517 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:43.178213 22471 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:43.104004 27305 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.182898 27305 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:43.082726 26962 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.078053 27322 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:43.147295 26810 raft_consensus.cc:3055] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:43.150976 27176 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:43.190543 26810 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:43.152283 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:43.156235 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:43.144817 27307 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:43.187477 27147 consensus_queue.cc:237] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.189563 27288 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:43.190132 26962 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:43.192700 27040 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:43.223704 23129 raft_consensus.cc:2393] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 15: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:43.172789 27306 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:18:43.193132 27163 consensus_queue.cc:1175] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8c3bcfa13ca74a24ab8999a408532932" responder_term: 14 status { last_received { term: 14 index: 9 } last_committed_idx: 8 last_received_current_leader { term: 14 index: 9 } }
I20260709 12:18:43.215065 27272 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.226049 27306 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:43.223351 27287 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:43.242707 27329 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 12:18:43.240291 27328 log.cc:927] Time spent T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:18:43.244109 27287 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:43.245369 27330 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.198s	user 0.003s	sys 0.000s
I20260709 12:18:43.245570 27307 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:43.239109 27306 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:43.233608 27272 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:43.249547 27272 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:43.044342 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:43.315110 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 139429us
I20260709 12:18:43.317044 22441 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:43.319823 22441 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:43.322793 22441 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:43.158747 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:43.339567 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:43.145749 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 134224us
I20260709 12:18:43.341583 22399 raft_consensus.cc:2410] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:18:43.346567 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:43.366485 22477 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:43.366528 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:43.370568 22394 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 16.
I20260709 12:18:43.213209 26810 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.376261 26810 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:43.377115 26962 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.377986 26962 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:43.350220 22543 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:43.382285 27040 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:43.382884 27001 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:43.352993 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:43.384979 27040 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:43.385550 27040 raft_consensus.cc:697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:43.387036 22542 raft_consensus.cc:2393] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 16: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:43.391134 23095 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:43.394797 22477 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:43.422209 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:43.423220 22399 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:43.423756 27287 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:43.424466 27287 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:43.427322 22396 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:43.427163 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:43.436532 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:43.438544 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:43.387130 27040 consensus_queue.cc:237] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:43.443239 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 52497.1us
I20260709 12:18:43.381462 26962 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:43.421365 27239 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:43.482312 27161 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:43.487183 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:43.487934 22515 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:43.488314 22477 raft_consensus.cc:2393] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 14: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:43.490415 27258 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:43.491063 27258 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:43.491575 27258 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:43.489509 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:43.511442 27239 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.515249 26962 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:43.558182 22471 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
W20260709 12:18:43.558095 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 158850us
I20260709 12:18:43.559628 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:43.560765 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:43.561337 22471 raft_consensus.cc:1275] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:43.562390 22475 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:18:43.563304 22473 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:18:43.563746 22547 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:18:43.565012 22473 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:43.558466 27307 consensus_queue.cc:1059] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:18:43.566424 27219 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:43.567147 27219 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.569867 26556 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:18:43.573706 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 58959.3us
I20260709 12:18:43.553489 22399 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:18:43.555852 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:43.558007 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 59406.2us
I20260709 12:18:43.588855 22477 raft_consensus.cc:2410] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:18:43.576367 27219 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:43.591116 27307 raft_consensus.cc:3055] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:43.611649 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:43.612426 22471 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
I20260709 12:18:43.558063 26962 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.621238 27209 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.602717 27307 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:18:43.637055 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 48040.3us
I20260709 12:18:43.639158 22548 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:43.640810 27307 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:43.642376 27307 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:43.645991 22400 consensus_meta.cc:287] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.571s	user 0.018s	sys 0.007s
I20260709 12:18:43.646489 22400 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
W20260709 12:18:43.638998 27149 consensus_meta.cc:287] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.570s	user 0.006s	sys 0.010s
I20260709 12:18:43.657620 27239 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:43.658319 22516 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:43.649412 27287 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:18:43.672333 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:43.674362 27344 log.cc:927] Time spent T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:18:43.667797 27209 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.682017 27209 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:43.683084 27338 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:18:43.686486 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 62326.9us
I20260709 12:18:43.689939 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:43.694903 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:43.726122 22299 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32988 (request call id 95) took 17214 ms (client timeout 15000 ms). Trace:
I20260709 12:18:43.727666 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:43.728091 26892 consensus_queue.cc:1059] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:43.734668 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:43.736207 27144 raft_consensus.cc:3055] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:43.742420 27144 raft_consensus.cc:740] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:43.740698 26990 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.736871 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:43.743664 26990 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.740383 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:43.744314 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:43.738214 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:43.759544 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:43.726655 22299 rpcz_store.cc:269] 0709 12:18:26.511809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.744954 (+233145us) service_pool.cc:224] Handling call
0709 12:18:43.725825 (+16980871us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:40.464624 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:40.507586 (+ 42962us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:40.507638 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:18:40.507655 (+    17us) tablet.cc:662] Decoding operations
0709 12:18:40.508663 (+  1008us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:40.508860 (+   197us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:40.508886 (+    26us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:18:40.509760 (+   874us) tablet.cc:701] Row locks acquired
0709 12:18:40.546217 (+ 36457us) write_op.cc:260] PREPARE: finished
0709 12:18:40.560420 (+ 14203us) write_op.cc:270] Start()
0709 12:18:40.575850 (+ 15430us) write_op.cc:276] Timestamp: P: 1783599520560350 usec, L: 0
0709 12:18:40.583650 (+  7800us) op_driver.cc:348] REPLICATION: starting
0709 12:18:40.811925 (+228275us) log.cc:844] Serialized 4078 byte log entry
0709 12:18:41.348907 (+536982us) op_driver.cc:464] REPLICATION: finished
0709 12:18:41.695941 (+347034us) write_op.cc:301] APPLY: starting
0709 12:18:41.696057 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:41.826425 (+130368us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:41.826526 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:42.183591 (+357065us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:42.222806 (+ 39215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 12:18:42.246233 (+ 23427us) write_op.cc:312] APPLY: finished
0709 12:18:42.299541 (+ 53308us) log.cc:844] Serialized 97 byte log entry
0709 12:18:42.507543 (+208002us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f5a4a0ac 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b
0709 12:18:42.641148 (+133605us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:42.687427 (+ 46279us) write_op.cc:454] Released schema lock
0709 12:18:42.733383 (+ 45956us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:42.793560 (+ 60177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:42.793605 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5198700,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":335879,"apply.run_cpu_time_us":46820,"apply.run_wall_time_us":1088970,"cfile_cache_hit":42,"cfile_cache_hit_bytes":46027,"num_ops":10,"prepare.queue_time_us":341972,"prepare.run_cpu_time_us":53502,"prepare.run_wall_time_us":495925,"raft.queue_time_us":332706,"raft.run_cpu_time_us":11609,"raft.run_wall_time_us":356353,"replication_time_us":738024,"spinlock_wait_cycles":60500736,"thread_start_us":1034337,"threads_started":5,"wal-append.queue_time_us":553040,"wal-append.run_cpu_time_us":107744,"wal-append.run_wall_time_us":2131106}]]}
I20260709 12:18:43.762478 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:43.765955 22470 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:18:43.761090 22401 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:18:43.747385 26962 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:43.775727 27159 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
W20260709 12:18:43.776659 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 59986.8us
I20260709 12:18:43.777081 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:43.779039 22442 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:43.782702 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:43.749560 27209 consensus_queue.cc:1059] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
W20260709 12:18:43.786043 27306 consensus_meta.cc:287] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.517s	user 0.004s	sys 0.013s
I20260709 12:18:43.787654 27306 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:43.788359 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:43.794948 22542 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
W20260709 12:18:43.796269 27339 log.cc:927] Time spent T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.548s	user 0.000s	sys 0.005s
I20260709 12:18:43.797875 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:43.798036 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:43.799849 27142 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:18:43.789489 22468 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:43.789224 27144 consensus_queue.cc:260] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.789940 27239 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:43.801381 27223 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.801724 27239 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:43.803747 22473 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
W20260709 12:18:43.804524 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 76952.5us
I20260709 12:18:43.791384 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:43.785897 27244 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:43.786331 22474 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:18:43.806262 27239 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:43.807372 27001 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:43.802083 27223 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.810719 27244 raft_consensus.cc:697] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:43.811360 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:43.812405 22545 raft_consensus.cc:2393] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 15: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:43.811939 27244 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.814399 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:43.820793 27223 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:43.802672 27142 raft_consensus.cc:3055] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:43.802089 27144 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:43.837291 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:43.832484 27142 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:43.877087 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:43.874538 27147 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.878336 27147 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.880988 27147 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:43.898203 22397 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:43.874017 27306 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:43.900669 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:43.907351 22400 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:18:43.907752 22400 pending_rounds.cc:85] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 7
W20260709 12:18:43.906834 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.909462 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:43.913156 27142 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:43.914618 27142 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:43.916333 22398 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:18:43.917464 22470 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:43.914562 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:43.914508 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:43.924902 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:43.926132 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.907964 22400 pending_rounds.cc:107] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:18:43.932570 22400 raft_consensus.cc:2889] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:43.940914 22472 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:18:43.941107 22367 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:43.942294 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 67962.8us
I20260709 12:18:43.943533 22367 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:43.944259 22395 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:18:43.944461 22393 raft_consensus.cc:1275] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:43.972126 22395 pending_rounds.cc:85] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 8
I20260709 12:18:43.972510 22395 pending_rounds.cc:107] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:18:43.950232 27280 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:43.958819 22367 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:43.962983 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:43.966553 22295 catalog_manager.cc:5697] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:43.979583 22469 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
I20260709 12:18:43.972873 22395 raft_consensus.cc:2889] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:43.982440 22477 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:18:43.985560 27361 log.cc:927] Time spent T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:18:43.977100 27280 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:43.993961 27147 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:43.994360 22441 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:43.995462 27306 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:43.996271 27147 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:43.997628 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:43.995954 27258 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:43.998637 27362 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:18:44.000128 22469 raft_consensus.cc:1240] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:44.001401 27258 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:44.003173 27363 log.cc:927] Time spent T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.128s	user 0.003s	sys 0.000s
I20260709 12:18:44.003340 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:43.998688 27147 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:44.004103 22469 raft_consensus.cc:2393] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 15: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:44.005570 22469 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:44.008090 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:43.994405 27280 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:44.009370 22441 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:44.012542 26990 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:44.012750 22441 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:44.014072 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:43.998533 22471 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
I20260709 12:18:44.015684 27001 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:44.000200 23129 raft_consensus.cc:2393] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 17: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:18:44.014204 22441 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:43.983304 27209 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:44.016055 27001 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:44.021173 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:43.989043 22295 catalog_manager.cc:5697] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 6 to 11, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 11 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:44.025753 27001 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:44.020309 27149 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:44.035089 22396 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:44.031261 26556 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:44.024564 27306 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:44.043167 27252 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:44.028379 27287 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:44.039068 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:44.051573 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.053386 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:44.054947 27163 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:44.058104 22401 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:18:44.042157 27149 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:44.070602 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 111973us
I20260709 12:18:44.036398 27239 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:44.074584 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:44.066030 27338 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:44.075572 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:44.069875 27149 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:44.083933 27338 raft_consensus.cc:697] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:44.086352 22547 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:18:44.091168 27239 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:44.091967 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:44.092681 22476 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:44.073277 27306 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:18:44.113164 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 78639.1us
I20260709 12:18:44.119923 27338 consensus_queue.cc:237] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:44.125020 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:44.142359 22367 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:44.147090 22516 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:18:44.143872 27239 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.151392 22547 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
W20260709 12:18:44.147883 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 98313.2us
I20260709 12:18:44.156419 22441 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:44.148716 27223 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:44.153640 27209 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:44.169569 27155 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:44.157104 27239 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:44.161197 27144 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:44.173919 27144 raft_consensus.cc:697] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:44.174082 27239 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:44.175421 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 67985.6us
I20260709 12:18:44.176499 22367 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:44.175020 27144 consensus_queue.cc:237] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:44.149279 27163 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:18:44.185995 23094 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:44.190995 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:44.192080 22441 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:44.206175 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:44.210934 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:44.216362 27263 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:44.217005 27263 raft_consensus.cc:697] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 17 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:44.218055 27263 consensus_queue.cc:237] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:44.220271 27104 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:44.210693 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:44.206892 27306 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:44.210547 27186 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:44.227246 22544 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:44.221457 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:44.227692 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:44.234637 22547 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:18:44.237110 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 60731us
I20260709 12:18:44.235450 27307 consensus_queue.cc:1059] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:18:44.240389 22548 raft_consensus.cc:2393] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:44.197788 27155 consensus_queue.cc:1048] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:18:44.241645 23095 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:44.209337 26990 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:44.246237 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:44.246412 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:44.248275 23123 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:44.254374 22545 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:44.255796 22441 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:44.264671 22295 catalog_manager.cc:5697] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:44.266470 27272 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:44.233330 27001 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:44.275024 22441 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:44.272596 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:44.277964 22476 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:18:44.287569 22441 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:44.290475 27001 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:44.294627 23095 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:44.296538 27117 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:44.296959 27117 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.297297 27117 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:44.299471 27096 raft_consensus.cc:3055] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:44.299897 27096 raft_consensus.cc:740] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:44.300823 27096 consensus_queue.cc:260] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:44.278216 27306 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:18:44.311038 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 58453.1us
I20260709 12:18:44.307909 22295 catalog_manager.cc:5697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:44.259267 27186 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:44.315353 27096 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:44.317277 27184 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:44.310669 27040 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:44.287662 27272 consensus_queue.cc:1059] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:18:44.347105 22367 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:44.348666 22367 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:44.349368 27142 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:44.349622 27252 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:44.334656 27155 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:18:44.359086 27154 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:18:44.311664 27280 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:44.361562 27186 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:44.361739 27280 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:44.366676 27223 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:44.366966 27149 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:44.375795 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 88309.2us
I20260709 12:18:44.379793 22441 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:44.371237 27149 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:44.400897 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:44.403285 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:44.411242 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:44.385743 27040 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
W20260709 12:18:44.417915 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 69388.7us
I20260709 12:18:44.419476 22367 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:44.420269 27223 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:44.420665 27223 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:44.420701 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:44.421147 27223 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:44.422078 22546 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:18:44.397292 27287 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:44.429319 27252 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:44.427182 27287 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.432518 27287 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:44.439463 27371 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:18:44.448216 22544 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:44.385537 27239 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:18:44.458657 22400 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:18:44.421241 27117 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:44.465575 22395 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:44.465641 27176 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:18:44.403568 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 65966.6us
I20260709 12:18:44.404717 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:44.484678 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:44.441620 27223 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:44.486676 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:44.487274 23123 raft_consensus.cc:2368] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 12. Current term is 13.
W20260709 12:18:44.492609 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 87977.8us
I20260709 12:18:44.498363 27001 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.505870 27001 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:44.508096 27001 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:44.509392 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.494939 27104 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:44.510555 27104 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:44.510986 27104 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:44.490322 27147 consensus_queue.cc:1059] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:18:44.512131 27147 raft_consensus.cc:3055] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:44.512480 27147 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:44.515232 22367 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:44.516551 22367 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:44.517019 27287 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:44.517323 26990 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:44.517758 27096 raft_consensus.cc:3055] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:44.518045 27142 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:44.486801 27219 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.522619 27096 raft_consensus.cc:740] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:44.523123 27219 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:44.523557 27096 consensus_queue.cc:260] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:44.524765 27096 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:44.525246 27219 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:44.498220 27144 consensus_queue.cc:1059] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:18:44.526314 27144 raft_consensus.cc:3055] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:44.526687 27144 raft_consensus.cc:740] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:44.490808 27176 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:44.527489 27287 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:44.528306 27373 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:18:44.529076 27176 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:44.530800 27219 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.531366 27219 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:44.513294 27147 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:44.544872 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:44.545415 22542 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:44.551625 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:44.521886 27104 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:44.556614 27272 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:44.558233 27272 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:44.558656 27219 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:44.545337 27147 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:44.565724 22544 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:44.564374 22442 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:44.566720 26556 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:44.579874 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:44.578439 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:44.583159 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:44.589922 27375 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:18:44.591349 27287 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:44.527521 27144 consensus_queue.cc:260] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:44.591620 27373 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:44.597610 27373 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:44.598209 27373 raft_consensus.cc:697] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:44.568487 27219 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:44.606751 26556 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:44.609138 27176 consensus_queue.cc:1048] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:44.603297 27373 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:44.606237 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:44.592727 27144 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:44.611063 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:44.627879 22396 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:44.629974 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:44.638091 22400 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:44.646106 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:44.647148 22442 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:44.621556 27209 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:18:44.639312 27280 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:44.652709 27117 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:44.645105 27223 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:44.655309 22441 leader_election.cc:400] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 12. Current term is 13.
I20260709 12:18:44.656425 27219 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:44.658634 27219 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:44.658929 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:44.659512 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:44.660125 22477 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
W20260709 12:18:44.661379 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.663028 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:44.663733 22401 raft_consensus.cc:2393] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 15: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:44.665482 27280 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.665740 27272 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:44.665915 27280 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:44.668340 27159 consensus_queue.cc:1059] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:44.669445 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:44.669754 27159 raft_consensus.cc:3055] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:44.670200 27159 raft_consensus.cc:740] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:44.670300 22546 raft_consensus.cc:2393] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 14: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:44.671918 22396 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:18:44.669379 22367 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:44.621058 27338 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:18:44.685595 22542 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 13.
W20260709 12:18:44.710243 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 64910.1us
I20260709 12:18:44.675557 27149 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:44.704542 27287 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:44.845172 23094 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:44.847407 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:44.849967 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:44.850868 22475 raft_consensus.cc:2393] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 11: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:44.675312 27223 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.163s
I20260709 12:18:44.853657 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:44.842983 27287 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.896495 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:44.899421 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:44.897679 22550 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:44.904690 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:44.912194 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:44.916342 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:44.917037 22546 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:44.942958 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.945132 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:44.893208 27176 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:44.897153 27287 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:44.946969 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:44.948954 22545 raft_consensus.cc:2393] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 13: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:44.852064 27149 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:44.897989 27104 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:18:44.989862 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 47779.9us
I20260709 12:18:44.994525 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:45.000310 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:45.018745 22475 raft_consensus.cc:2368] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15.
I20260709 12:18:45.033455 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:44.895310 27159 consensus_queue.cc:260] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.032377 27380 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:45.017022 27176 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:45.096978 27391 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 12:18:45.098476 27382 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.451s	user 0.000s	sys 0.001s
I20260709 12:18:45.098819 27149 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:45.063624 27397 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:45.105960 27369 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:18:45.106952 23128 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:18:45.111418 22474 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:18:45.114140 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:45.120400 27147 consensus_meta.cc:287] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.002s
I20260709 12:18:45.109539 22367 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:45.054455 27209 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:45.144249 22396 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:45.145169 23122 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
W20260709 12:18:45.204965 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 306726us
W20260709 12:18:45.206954 22476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.000s	sys 0.011s
W20260709 12:18:45.211815 22476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.000s	sys 0.012s
I20260709 12:18:45.114012 27401 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:45.217476 22468 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:18:45.218910 22468 pending_rounds.cc:85] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 9
I20260709 12:18:45.219164 22468 pending_rounds.cc:107] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:18:45.219395 22468 raft_consensus.cc:2889] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:45.222482 27176 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:45.142379 27280 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.225759 27280 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:45.236308 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 126862us
I20260709 12:18:45.237139 22367 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:45.238161 22367 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:45.217895 27380 raft_consensus.cc:697] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:18:45.246376 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.246966 22367 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:45.253237 27104 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:45.254017 27104 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.255440 27209 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:45.255908 27209 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:45.256146 27104 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:45.264292 22442 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.017s	sys 0.037s
W20260709 12:18:45.264676 22442 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.017s	sys 0.037s
W20260709 12:18:45.265154 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 618057us
I20260709 12:18:45.267956 27209 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.218027 27397 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.242354 27223 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:45.276151 22367 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:45.281159 27142 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:45.247592 27280 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:45.232414 27401 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.318135 22367 leader_election.cc:400] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15.
I20260709 12:18:45.281165 27184 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:45.317579 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:45.319682 22367 leader_election.cc:403] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:45.284883 27239 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:45.312867 27142 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:45.311900 27209 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:45.366518 22474 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:18:45.320223 27395 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:45.321175 27176 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:18:45.387262 27395 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:45.390421 27405 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:18:45.390859 27403 log.cc:927] Time spent T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:18:45.392431 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:45.338173 27239 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.366189 26962 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15.
I20260709 12:18:45.403725 22395 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
I20260709 12:18:45.395428 22471 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:18:45.355877 27184 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:45.398559 22546 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:45.389904 27410 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:45.378444 27404 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:18:45.415374 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 101554us
I20260709 12:18:45.422748 22394 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:45.421074 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:45.406680 27244 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:45.404943 27287 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.430197 27408 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:45.374886 27380 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:45.444639 27280 consensus_queue.cc:1059] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:45.446424 22396 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:18:45.446978 27184 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:45.447995 27398 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:45.445597 22401 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:18:45.426683 27307 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:45.424664 27244 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:45.448506 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:45.448555 27398 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:45.445544 27280 raft_consensus.cc:3055] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:45.457858 22442 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:45.460834 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:45.459120 27184 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:45.458783 27244 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:45.472046 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:45.469808 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:45.473658 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:18:45.475747 22397 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 16: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:45.460618 27280 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:45.476042 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:45.469913 27416 log.cc:927] Time spent T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:18:45.483251 27401 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:45.483912 27401 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:45.484366 27401 raft_consensus.cc:697] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:45.466178 27149 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:45.475248 27163 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:45.477000 27104 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:45.470265 27184 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.475311 27147 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:45.514294 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:45.517989 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:45.522490 27239 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:45.525305 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:45.526397 27417 log.cc:927] Time spent T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:18:45.530280 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:45.499179 27149 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.542347 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:45.455060 27408 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.512792 27104 raft_consensus.cc:697] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:45.544390 22401 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:45.526546 27287 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:45.490837 27401 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:45.512683 27163 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.555367 27408 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:45.559176 27398 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:45.561178 27149 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:45.562304 27184 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:45.513881 27280 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.563616 27280 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:45.539382 27400 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:45.566193 27400 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } }
I20260709 12:18:45.568361 27400 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:45.521749 27147 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.576516 27147 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:45.577571 27104 consensus_queue.cc:237] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.579694 27397 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:45.591780 26556 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:18:45.593961 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 119362us
I20260709 12:18:45.592471 26556 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:45.601926 27244 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.605458 27154 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:45.606114 27154 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.607831 27395 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:45.608121 27154 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:45.609208 27244 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:45.610646 27424 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:45.612372 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:45.616731 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 2322) took 1054 ms. Trace:
I20260709 12:18:45.617158 22468 rpcz_store.cc:276] 0709 12:18:44.562359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.562745 (+   386us) service_pool.cc:224] Handling call
0709 12:18:44.563038 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:45.219897 (+656859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:45.616475 (+396578us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b5400328f54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:45.616648 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504234368}
I20260709 12:18:45.618471 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:45.597507 26556 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:45.620383 27155 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:45.621312 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:45.624867 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:45.635601 27411 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.382s	user 0.001s	sys 0.001s
I20260709 12:18:45.638211 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 2313) took 1103 ms. Trace:
I20260709 12:18:45.638612 22476 rpcz_store.cc:276] 0709 12:18:44.535005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.535113 (+   108us) service_pool.cc:224] Handling call
0709 12:18:44.546129 (+ 11016us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:44.546478 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:44.546506 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:44.566181 (+ 19675us) log.cc:844] Serialized 26 byte log entry
0709 12:18:45.214156 (+647975us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:45.214224 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:45.214287 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:45.634942 (+420655us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:45.637869 (+  2927us) raft_consensus.cc:1685] finished
0709 12:18:45.637891 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:45.638147 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":66406656,"thread_start_us":590958,"threads_started":1,"wal-append.queue_time_us":635398}
I20260709 12:18:45.609522 27154 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:45.647131 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 105157us
I20260709 12:18:45.648217 22401 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:18:45.650103 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:45.652238 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:45.659397 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:45.660218 22397 raft_consensus.cc:2368] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16.
I20260709 12:18:45.647847 27334 consensus_queue.cc:1059] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:18:45.660883 22366 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:45.661573 27334 raft_consensus.cc:3055] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:45.661947 27334 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:45.662340 22366 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:45.662807 27334 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.664064 27334 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:45.664880 27280 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:45.666074 27420 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:45.670837 22516 leader_election.cc:400] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16.
I20260709 12:18:45.671231 22516 leader_election.cc:403] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:18:45.671756 26556 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:45.673738 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:45.678550 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:45.681308 22400 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:45.675693 22442 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:45.690312 27380 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:45.690980 27380 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:45.694952 27380 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:45.700939 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:45.705654 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:45.702152 27306 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:45.672969 27154 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.708915 27306 raft_consensus.cc:697] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:45.708860 27176 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.703768 27155 consensus_queue.cc:1059] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:18:45.711150 27176 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:45.715358 27176 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:45.722141 27163 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:45.710835 27154 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:45.710810 27306 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.725515 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:45.727128 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:45.729231 22441 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:45.730656 22367 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:45.730863 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:45.731374 26556 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16.
I20260709 12:18:45.732237 22367 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:45.733088 26990 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:45.745277 27410 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:18:45.756008 26556 raft_consensus.cc:3055] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:45.756619 26556 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:45.732160 27142 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:45.759796 27429 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:18:45.757697 26556 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:45.761956 26556 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:45.744040 27154 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:18:45.768308 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:45.769054 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:45.769088 23123 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:18:45.770783 27239 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:45.774824 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:45.773432 22441 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:45.769691 23125 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:18:45.796700 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:45.797385 22515 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:45.796868 23122 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:45.798621 22477 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 14: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:45.777346 27104 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.812460 26556 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.812657 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:45.815483 26556 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:45.818559 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.818722 22515 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:45.819689 26556 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:45.820827 26556 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:45.821302 26556 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.805730 27397 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:45.821831 26556 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:45.808884 27154 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:45.823818 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:18:45.825490 27373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.011s	sys 0.018s
W20260709 12:18:45.825914 27373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.011s	sys 0.018s
I20260709 12:18:45.827389 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:45.828074 22473 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:18:45.834453 26556 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:45.805823 27244 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:18:45.808535 27040 consensus_queue.cc:1059] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:18:45.839329 27040 consensus_queue.cc:1243] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer 65951063312d4a1e9123f92354101c71 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:18:45.868322 27435 log.cc:927] Time spent T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:18:45.877226 27437 log.cc:927] Time spent T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:18:45.817354 27104 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:45.882138 27104 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:45.883292 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:45.884011 23122 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:45.889467 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:18:45.892892 27104 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:45.893376 27104 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.893733 27104 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:45.902010 26556 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:45.911666 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:45.925082 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:45.934535 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:45.936420 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.934535 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:18:45.950358 27386 log.cc:927] Time spent T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 1.047s	user 0.012s	sys 0.000s
I20260709 12:18:45.951723 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 2319) took 1399 ms. Trace:
I20260709 12:18:45.952086 22472 rpcz_store.cc:276] 0709 12:18:44.552474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.552626 (+   152us) service_pool.cc:224] Handling call
0709 12:18:44.552936 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:44.558749 (+  5813us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:44.558784 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:44.559268 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:18:44.671645 (+112377us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:44.671683 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.671743 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:45.935578 (+1263835us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:18:45.951436 (+ 15858us) raft_consensus.cc:1685] finished
0709 12:18:45.951462 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:45.951668 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6233,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3407,"spinlock_wait_cycles":65216384,"thread_start_us":73718,"threads_started":1,"wal-append.queue_time_us":271537}
I20260709 12:18:45.963197 27104 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:45.964586 22474 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:18:45.974857 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:45.975548 22472 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:45.988104 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:45.988787 22397 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
W20260709 12:18:45.993204 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 174517us
I20260709 12:18:45.997321 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:45.997953 22396 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:18:46.001391 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:46.008476 22545 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:46.011322 27421 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:46.011961 27421 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:46.007418 27104 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:46.014569 27421 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:46.002708 27432 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:46.016489 27432 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:46.021497 27432 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:45.849224 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:46.023077 27444 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:46.023522 27444 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:46.023834 27444 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:46.023224 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:46.025024 27155 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:46.025386 27155 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:46.025724 27155 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:46.029517 27159 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:46.034803 27155 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:46.035617 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:46.038120 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:46.038929 22393 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 14: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:46.037653 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:46.041004 27396 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:46.044961 22393 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:46.050958 27444 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:46.052241 27306 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:46.052821 27306 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:46.053128 27444 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:46.065984 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.050824 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:46.057442 22516 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:46.068622 23128 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:46.074898 27095 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:46.075213 27413 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:46.075632 27095 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:46.077783 27095 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:46.080171 27306 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:46.080925 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.081310 27438 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:46.082690 22402 raft_consensus.cc:2410] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:18:46.085052 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.085976 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.086148 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:46.086930 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.069661 27104 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:18:46.089852 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.085115 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.092756 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.093649 22549 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:18:46.094542 27432 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:46.097595 27404 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:46.075706 27413 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:46.082692 27448 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:46.100033 27448 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:46.101125 27413 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:46.099341 27404 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:46.102077 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.103957 27404 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:46.105068 27448 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:46.099272 27432 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:46.108204 27432 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:46.101218 27040 raft_consensus.cc:3055] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:46.111145 27040 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:46.111920 27040 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:46.113173 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:46.094446 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.116837 23095 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:46.123409 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 49351.2us
I20260709 12:18:46.113090 27040 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:46.120365 27117 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:46.128777 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:18:46.130825 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 62243.3us
I20260709 12:18:46.134639 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:46.135402 22397 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:46.135977 22542 raft_consensus.cc:2410] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:18:46.137216 23128 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:18:46.132592 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:46.141542 22393 raft_consensus.cc:2393] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 15: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:46.142141 22546 raft_consensus.cc:2368] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 16. Current term is 17.
I20260709 12:18:46.150152 22442 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:46.171010 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:46.173357 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:46.148203 27373 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:46.165486 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:18:46.177316 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:46.182981 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:46.159929 27117 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.201582 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:46.201862 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:46.202054 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:46.203428 22469 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:46.161504 27104 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:46.204882 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.206434 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:46.214215 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:46.216187 22394 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:46.175238 27396 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:46.220067 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:46.222550 22401 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:46.157335 22293 catalog_manager.cc:5697] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 14 to 17, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 17 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:46.174733 27448 consensus_queue.cc:1059] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:18:46.230043 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.231225 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.232383 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:46.232569 22549 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:46.200397 27397 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:46.212167 27117 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:46.234783 27380 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:46.235062 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.236131 27117 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:46.236472 22550 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:46.236728 27117 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:46.193099 27373 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:46.239284 27373 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:46.233748 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.240619 22551 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:46.243197 27155 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:46.243508 27154 consensus_queue.cc:1059] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:46.244498 27154 raft_consensus.cc:3055] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:46.244820 27154 raft_consensus.cc:740] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:46.246009 27244 raft_consensus.cc:3055] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:46.246402 27244 raft_consensus.cc:740] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:46.247189 27244 consensus_queue.cc:260] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:46.248417 27244 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:46.212659 27338 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.253873 27338 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:46.256616 22546 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:46.257269 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:46.259135 22401 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:46.275971 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:46.284235 27338 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:46.285181 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:46.285065 27380 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:46.290297 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.300712 22469 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
W20260709 12:18:46.301998 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 65639.8us
I20260709 12:18:46.215790 27104 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:46.299243 22468 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:18:46.306738 22441 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:46.309252 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:46.309986 22475 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:18:46.311725 23122 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:18:46.314260 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:46.314828 23122 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:46.314832 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:46.315758 22472 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:18:46.316186 22472 pending_rounds.cc:85] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 10
I20260709 12:18:46.316402 22472 pending_rounds.cc:107] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:18:46.318308 22472 raft_consensus.cc:2889] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:46.322798 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:46.329957 22441 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:46.331329 27373 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:46.332531 27373 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:46.287025 27397 raft_consensus.cc:697] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:46.335417 22516 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:46.336602 22394 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
W20260709 12:18:46.338456 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 99792.2us
I20260709 12:18:46.338567 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:46.339178 22367 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:46.314473 27104 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:46.347379 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:46.357270 22401 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:18:46.358276 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:46.350207 26962 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.361016 26962 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:46.363430 26962 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:46.363880 27380 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:46.367291 22401 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:46.245585 27154 consensus_queue.cc:260] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:46.345149 27410 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:46.350387 27252 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:46.346421 27394 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:46.377434 23122 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:18:46.365089 27438 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:46.387853 23128 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: []
W20260709 12:18:46.389326 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 59458.1us
I20260709 12:18:46.390592 22441 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:46.391584 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.392225 22548 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
I20260709 12:18:46.392341 22515 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:46.392668 22547 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:18:46.393643 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.394266 22542 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:18:46.372831 22394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "444001888258449e8c4f5fd4ad540389"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:18:46.399037 22394 raft_consensus.cc:606] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:46.399410 22394 raft_consensus.cc:614] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:46.400198 27397 consensus_queue.cc:237] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:46.411132 22366 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:46.412063 22441 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:46.413378 27395 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:46.416808 22475 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:18:46.417305 22515 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:46.416198 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:46.418269 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:46.418761 26556 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:46.426617 22515 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:46.431814 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.432196 23094 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:46.433410 22515 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:46.414148 27252 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:46.438079 27252 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:46.438382 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.435871 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:46.413334 27394 raft_consensus.cc:697] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:46.445355 22441 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:46.420284 27395 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:46.428057 27444 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:46.439029 27338 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:18:46.510272 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 62366.4us
I20260709 12:18:46.510560 27463 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:18:46.514384 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 57557.3us
W20260709 12:18:46.514532 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 69289.5us
I20260709 12:18:46.515420 22441 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:46.443296 27154 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:46.442210 27252 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:46.446713 27396 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:46.526486 22441 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:46.502562 27380 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:46.538682 27380 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:46.539086 27380 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:46.529247 27338 raft_consensus.cc:697] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:46.543977 27338 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:46.548306 27396 raft_consensus.cc:697] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:46.518777 27306 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:46.529644 27459 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:46.536572 27394 consensus_queue.cc:237] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:46.439275 27040 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 12:18:46.455104 27373 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:46.567413 22441 leader_election.cc:400] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 16. Current term is 17.
I20260709 12:18:46.576785 22441 leader_election.cc:403] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:46.549240 27396 consensus_queue.cc:237] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:46.574424 27452 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.338s	user 0.005s	sys 0.001s
I20260709 12:18:46.582652 22441 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:46.589999 22441 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:46.597313 22441 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:46.584353 27456 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:18:46.572237 27095 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:46.575788 27401 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.580691 27395 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:46.591789 27406 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 16. Current term is 17.
I20260709 12:18:46.591006 27432 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:46.619946 22542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b42c69680a57493c942307ff09185b72"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:18:46.603214 27287 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:46.595242 27459 consensus_queue.cc:1059] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:18:46.650615 27459 raft_consensus.cc:3055] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:46.650986 27459 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:46.628392 27401 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:46.603581 26962 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:18:46.655349 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 73958.7us
I20260709 12:18:46.616742 27373 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:46.659330 27373 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:46.653715 26962 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:46.659757 27373 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:46.654309 27401 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:46.641556 27104 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:46.669425 22477 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:46.624275 22542 raft_consensus.cc:606] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:46.670306 22293 catalog_manager.cc:5697] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 8 to 10, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 10 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:46.672627 27459 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:46.692013 22441 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:46.674597 26962 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:46.672559 22293 catalog_manager.cc:5697] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:46.690151 27459 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:46.688087 27401 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:18:46.701449 27040 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:46.707535 27457 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:46.719796 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:46.720430 23128 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:46.717906 27413 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.712978 27380 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:46.746944 27287 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:46.758183 27144 consensus_queue.cc:1059] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:46.763535 22547 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:46.763829 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.764529 22542 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:46.766716 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:46.767336 23128 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:18:46.767746 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:46.768293 22547 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:18:46.744879 27413 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:46.775411 27413 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:46.761976 27104 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:46.788780 27252 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:46.793110 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:46.793838 22472 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:46.810560 22547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:18:46.811293 22547 raft_consensus.cc:606] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:46.826844 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:46.827622 22473 raft_consensus.cc:2393] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 14: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:46.828840 27380 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:46.830075 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:46.835829 23095 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:46.836423 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:46.837057 22476 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:46.837586 27252 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:46.838512 27380 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:46.841922 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:46.842579 22468 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:46.848994 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 75333us
I20260709 12:18:46.849459 22400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:18:46.850832 22400 raft_consensus.cc:606] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:46.851191 22400 raft_consensus.cc:614] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:46.861459 22468 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:18:46.863178 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:18:46.867491 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:46.869481 22550 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:18:46.869941 22550 pending_rounds.cc:85] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 12
I20260709 12:18:46.870167 22550 pending_rounds.cc:107] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:18:46.870421 22550 raft_consensus.cc:2889] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:46.875118 22441 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:46.877811 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:46.878566 22547 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:18:46.877409 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:18:46.825306 27373 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:46.964349 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 81809.2us
I20260709 12:18:46.878949 27401 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:46.980144 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:46.980994 22400 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:46.990048 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:18:46.991794 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 138019us
I20260709 12:18:46.876845 27287 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 12:18:46.994572 22476 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 13.
I20260709 12:18:46.993294 22367 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:46.998572 23095 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:18:46.985627 27401 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.022256 22547 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 13.
I20260709 12:18:46.975186 27397 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:18:47.005342 27408 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:47.013027 27401 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:47.083374 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 103670us
W20260709 12:18:47.123303 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 124801us
I20260709 12:18:47.081585 27408 raft_consensus.cc:697] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:47.140476 27467 raft_consensus.cc:3055] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:47.140965 27467 raft_consensus.cc:740] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:47.151284 27373 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:47.161476 27475 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.162374 27475 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:47.167208 27475 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:47.189312 27473 log.cc:927] Time spent T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:18:47.197427 27252 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:47.198047 27252 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:47.200166 27252 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:47.203001 22366 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:47.169266 27467 consensus_queue.cc:260] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:47.185446 27478 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:47.218941 22442 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:47.196511 27408 consensus_queue.cc:237] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:47.234938 27280 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:47.235397 27280 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:18:47.235785 27280 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:47.237807 27104 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:47.239831 27478 raft_consensus.cc:697] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:47.240767 27478 consensus_queue.cc:237] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:47.247964 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:47.251905 22396 raft_consensus.cc:2410] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:18:47.257788 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:47.233196 27401 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:47.261744 22398 raft_consensus.cc:2393] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 15: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:47.254657 27239 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:47.312834 27239 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:47.327606 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:47.329016 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:47.332221 22550 raft_consensus.cc:2410] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:18:47.338411 23128 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:18:47.323872 27468 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:47.343802 27482 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:47.365177 27468 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:47.366616 27482 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:47.370074 27482 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:47.372785 27468 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:47.390880 22542 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:47.416330 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:47.417017 22542 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:18:47.426290 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:47.426579 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:47.423941 27252 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.427778 27252 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:47.438362 27474 log.cc:927] Time spent T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:18:47.453346 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:47.464646 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:47.464867 27465 log.cc:927] Time spent T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.665s	user 0.001s	sys 0.006s
I20260709 12:18:47.471678 22396 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 16: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:47.486047 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:47.489686 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:47.494316 27397 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:47.508678 22542 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:18:47.467054 27471 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.461922 27421 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:47.535408 22366 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:47.539386 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:47.544255 26556 raft_consensus.cc:993] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:18:47.544721 26556 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.545130 26556 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:47.541249 27443 log.cc:927] Time spent T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:18:47.558728 26556 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:47.559872 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 72390.4us
I20260709 12:18:47.541379 27458 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:47.556139 27394 raft_consensus.cc:1081] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:18:47.540249 27471 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:47.542867 27421 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:47.563745 27408 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.585268 27421 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:47.587289 22441 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:47.599274 22441 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:47.589407 27408 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:47.592437 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:47.605054 22549 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:18:47.605937 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:47.592913 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:47.593819 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:47.593999 27239 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:47.609279 22551 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:47.613485 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:47.611514 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:18:47.607163 27482 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:47.564042 27280 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:47.610729 27104 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:47.634900 22398 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:47.619879 27401 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:47.641045 27471 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:47.642675 27438 raft_consensus.cc:993] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:18:47.643141 27438 raft_consensus.cc:1081] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:18:47.645788 27252 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:47.631831 27244 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:47.648586 27408 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:47.652072 27280 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:47.635079 27104 raft_consensus.cc:697] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:47.658609 22551 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:47.660018 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:47.660566 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:47.660812 22551 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:18:47.662220 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:47.663412 22551 raft_consensus.cc:2368] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15.
I20260709 12:18:47.661226 22545 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:18:47.666533 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:47.668748 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:47.669450 22547 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:18:47.681561 23125 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
W20260709 12:18:47.682329 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 43633.8us
I20260709 12:18:47.689266 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:47.689479 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:47.689992 22475 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:18:47.690343 22400 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:18:47.690006 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:47.691623 22473 raft_consensus.cc:2393] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 17: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:47.692123 22398 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:47.695851 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:47.696777 22469 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:18:47.699040 22474 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:47.699756 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:47.698945 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:47.701792 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:47.701836 22473 raft_consensus.cc:2368] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15.
W20260709 12:18:47.703112 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 46141.4us
I20260709 12:18:47.703015 22472 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:18:47.703153 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:47.701061 22401 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:18:47.708015 22477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36296
I20260709 12:18:47.700157 22471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b42c69680a57493c942307ff09185b72"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36296
I20260709 12:18:47.708715 22477 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:47.709092 22477 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:47.712050 22471 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:47.712497 22471 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:47.716660 27497 log.cc:927] Time spent T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.069s	user 0.003s	sys 0.000s
I20260709 12:18:47.654358 27104 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:47.727443 22471 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:47.732190 27413 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:47.733201 27413 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:47.733636 27413 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:47.742435 27413 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:47.748580 22293 catalog_manager.cc:5697] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:47.752148 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:18:47.754125 22295 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50166 (request call id 209) took 32878 ms (client timeout 15000 ms). Trace:
W20260709 12:18:47.755865 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 51906.8us
W20260709 12:18:47.763849 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.759761 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:47.769351 22546 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:47.771353 22366 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:47.772377 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:47.773051 22401 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:47.774485 27494 log.cc:927] Time spent T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
I20260709 12:18:47.775775 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:47.789934 22366 leader_election.cc:400] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15.
I20260709 12:18:47.795809 22366 leader_election.cc:403] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:18:47.788228 22471 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:47.794291 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:47.796478 23128 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:47.791461 27144 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:18:47.798273 27144 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:47.798305 27502 log.cc:927] Time spent T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.158s	user 0.002s	sys 0.000s
I20260709 12:18:47.799935 22293 catalog_manager.cc:5697] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 7 to 10, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 10 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:47.803386 22458 tablet_service.cc:1558] Processing DeleteTablet for tablet 0723691b01e2413baf71cbc73a551fdc with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:51846
I20260709 12:18:47.790575 27458 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:47.801749 27144 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:47.804349 27458 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.804760 27458 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:47.808140 22367 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:47.809593 27408 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:47.810103 27408 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.810492 27408 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:47.801682 22293 catalog_manager.cc:5697] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:47.816071 22293 catalog_manager.cc:5697] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:47.819007 27408 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:47.821441 27458 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:47.825184 22441 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:47.794567 22477 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:47.837311 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:47.838937 22367 leader_election.cc:400] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15.
I20260709 12:18:47.845381 22401 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:47.845527 22441 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:47.851136 22441 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:47.856573 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:18:47.858762 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 68973.6us
I20260709 12:18:47.858911 27252 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15.
I20260709 12:18:47.861461 27373 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:47.863662 27475 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:47.890995 22477 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:47.895221 22441 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:47.843575 27458 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:47.877508 27413 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:47.765367 22295 rpcz_store.cc:269] 0709 12:18:14.875845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.876021 (+   176us) service_pool.cc:224] Handling call
0709 12:18:15.104583 (+228562us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b5400030890. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a300b2 00007fb4fe9a9759 00007fb4fe941a76 00007fb4fe912d58 00007fb4fea1104e 00007fb4fced22a4 00007fb4fced2232 00007fb4fced2161 00007fb4fced20dc
0709 12:18:47.754053 (+32649470us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:44.469537 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:44.530689 (+ 61152us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:44.530737 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:18:44.530756 (+    19us) tablet.cc:662] Decoding operations
0709 12:18:44.531413 (+   657us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:44.531527 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:44.531553 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:18:44.531997 (+   444us) tablet.cc:701] Row locks acquired
0709 12:18:44.532041 (+    44us) write_op.cc:260] PREPARE: finished
0709 12:18:44.532215 (+   174us) write_op.cc:270] Start()
0709 12:18:44.532356 (+   141us) write_op.cc:276] Timestamp: P: 1783599524532155 usec, L: 0
0709 12:18:44.532399 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:18:44.533091 (+   692us) log.cc:844] Serialized 1694 byte log entry
0709 12:18:45.477421 (+944330us) op_driver.cc:464] REPLICATION: finished
0709 12:18:45.666448 (+189027us) write_op.cc:301] APPLY: starting
0709 12:18:45.666555 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:45.669569 (+  3014us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:45.669693 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:45.713934 (+ 44241us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:45.714269 (+   335us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:18:45.714332 (+    63us) write_op.cc:312] APPLY: finished
0709 12:18:45.714683 (+   351us) log.cc:844] Serialized 49 byte log entry
0709 12:18:45.763574 (+ 48891us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:45.787633 (+ 24059us) write_op.cc:454] Released schema lock
0709 12:18:45.804837 (+ 17204us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:45.833760 (+ 28923us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:45.834996 (+  1236us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39912,"reported_tablets":54,"spinlock_wait_cycles":88370560,"child_traces":[["op",{"apply.queue_time_us":179892,"apply.run_cpu_time_us":8128,"apply.run_wall_time_us":152733,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20887,"num_ops":4,"prepare.queue_time_us":42299,"prepare.run_cpu_time_us":18998,"prepare.run_wall_time_us":409197,"raft.queue_time_us":202652,"raft.run_cpu_time_us":10129,"raft.run_wall_time_us":94590,"replication_time_us":927994,"spinlock_wait_cycles":12032,"thread_start_us":369851,"threads_started":4,"wal-append.queue_time_us":482757,"wal-append.run_cpu_time_us":17642,"wal-append.run_wall_time_us":1699534}]]}
I20260709 12:18:47.850309 27421 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:47.904466 23128 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:47.906049 22366 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:47.890285 27397 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:47.890062 27373 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:47.919675 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:47.922904 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:47.926079 22477 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:47.929966 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:47.905969 27287 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:47.906935 27421 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.935839 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:47.936492 22547 raft_consensus.cc:3055] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:47.936787 22547 raft_consensus.cc:740] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:47.916538 27252 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:47.942678 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:47.941852 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 118847us
I20260709 12:18:47.943287 22546 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:47.930202 27373 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:47.925793 27408 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:47.941133 27142 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.953490 27142 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:47.954203 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:47.954799 23122 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:47.955621 27142 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:47.961802 22477 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
I20260709 12:18:47.947243 26556 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:47.965404 23122 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:18:47.920413 27458 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:18:47.936116 27421 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:47.977586 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:47.942005 27252 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.980602 22543 raft_consensus.cc:2410] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:18:47.817718 22293 catalog_manager.cc:5697] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:47.968729 22547 consensus_queue.cc:260] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:47.988139 22546 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
I20260709 12:18:47.988808 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:47.989280 22366 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:47.989418 23125 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:48.003966 27408 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:48.004597 27408 raft_consensus.cc:697] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:48.005635 22547 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:47.984880 27252 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:48.048575 23125 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:48.055706 22551 raft_consensus.cc:3055] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:48.056115 22551 raft_consensus.cc:740] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:48.056417 22544 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:18:48.059213 22284 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress
I20260709 12:18:48.061800 22468 raft_consensus.cc:1240] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:48.067579 27117 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:48.068387 22401 raft_consensus.cc:1240] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:48.070073 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:48.056806 22551 consensus_queue.cc:260] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:48.072679 22551 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:48.072825 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:48.073741 22469 raft_consensus.cc:2368] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 17. Current term is 18.
I20260709 12:18:48.075516 22469 raft_consensus.cc:1240] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:48.081439 22551 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:18:48.010304 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:48.015089 22293 catalog_manager.cc:5697] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 11 to 14, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 14 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:48.017604 27467 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:48.018159 27408 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:48.027547 22547 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
W20260709 12:18:48.091985 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 81749us
I20260709 12:18:48.097259 22285 catalog_manager.cc:5028] TS 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): tablet 0723691b01e2413baf71cbc73a551fdc (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:18:48.098235 27338 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:48.066061 27373 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:48.086246 27504 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.098s	user 0.001s	sys 0.003s
W20260709 12:18:48.132797 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 205282us
I20260709 12:18:48.139886 22441 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:48.152948 22441 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:48.160853 22477 pending_rounds.cc:85] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 10
I20260709 12:18:48.161222 22477 pending_rounds.cc:107] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:18:48.161468 22477 raft_consensus.cc:2889] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:48.129174 27287 raft_consensus.cc:697] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:18:48.143752 22284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 88884.6us
I20260709 12:18:48.180435 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:48.181278 22397 raft_consensus.cc:2368] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 16. Current term is 17.
I20260709 12:18:48.171614 27373 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:48.186152 22442 leader_election.cc:400] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 16. Current term is 17.
I20260709 12:18:48.186480 22442 leader_election.cc:403] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:18:48.188783 22516 leader_election.cc:400] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 17. Current term is 18.
I20260709 12:18:48.189105 22516 leader_election.cc:403] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:18:48.176729 27513 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:48.219790 27397 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:48.226377 27513 raft_consensus.cc:697] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:48.227450 27513 consensus_queue.cc:237] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:48.230177 27287 consensus_queue.cc:237] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:48.188588 27040 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:48.236291 22398 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:48.195096 27447 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 17. Current term is 18.
I20260709 12:18:48.285493 27040 raft_consensus.cc:697] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:48.291864 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:48.297044 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:48.286675 27040 consensus_queue.cc:237] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:48.301699 22475 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:18:48.229598 27421 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:48.313871 22284 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b42c69680a57493c942307ff09185b72 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8c3bcfa13ca74a24ab8999a408532932 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:48.319114 22472 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:48.337183 22548 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 17: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:18:48.288542 27459 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 12:18:48.340356 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 173992us
W20260709 12:18:48.403680 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 76609.1us
W20260709 12:18:48.460022 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 53174.8us
I20260709 12:18:48.460933 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:48.404697 27519 log.cc:927] Time spent T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:18:48.489041 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:18:48.483757 27496 log.cc:927] Time spent T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:18:48.510965 22547 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:48.483316 27280 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:48.484274 27468 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.269004 22293 catalog_manager.cc:5697] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 8 to 10, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 10 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:48.538978 27421 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:48.544054 27252 consensus_meta.cc:287] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.506s	user 0.007s	sys 0.001s
I20260709 12:18:48.544543 27252 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:48.608211 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 121148us
I20260709 12:18:48.619212 27500 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:18:48.622313 27526 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.162s	user 0.002s	sys 0.000s
I20260709 12:18:48.627671 27252 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:48.556589 27468 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:48.629109 27397 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 16. Current term is 17.
I20260709 12:18:48.597457 27527 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 12:18:48.727276 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:48.728015 22549 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:48.735101 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 68748.2us
W20260709 12:18:48.735991 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 253774us
I20260709 12:18:48.741688 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:48.742633 22398 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 17: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:48.662762 27104 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.077s
W20260709 12:18:48.738875 27531 log.cc:927] Time spent T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:18:48.756382 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:48.774677 22549 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
W20260709 12:18:48.779673 27520 log.cc:927] Time spent T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 12:18:48.784464 27468 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:48.788513 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 150034us
I20260709 12:18:48.791332 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:18:48.812386 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 363494us
W20260709 12:18:48.812085 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 201753us
I20260709 12:18:48.843869 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:48.844668 22399 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 15: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:48.848982 27401 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.849511 27401 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:48.812064 27540 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:48.868199 22474 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:18:48.869030 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:48.870352 23122 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:48.875813 22366 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:48.884174 27475 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:48.914213 22393 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:18:48.913220 27467 consensus_meta.cc:287] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.767s	user 0.009s	sys 0.002s
I20260709 12:18:48.933095 23122 raft_consensus.cc:1275] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:48.915289 27471 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:48.917377 27525 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:48.934278 27471 raft_consensus.cc:697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:48.930629 27401 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:48.931000 27468 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:48.935293 27471 consensus_queue.cc:237] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:48.933142 27447 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.964007 22367 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:48.939317 27406 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:18:48.949347 27447 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:48.978230 27406 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:48.980382 27406 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:48.991515 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:49.000488 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:49.001252 22543 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 15: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:18:48.955127 27482 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:18:49.010756 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:49.012248 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:49.012912 22548 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:48.934370 27525 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:49.008801 27219 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:49.052086 22548 raft_consensus.cc:1275] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:49.052807 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:49.054818 22469 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:49.060765 22472 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:49.061981 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:49.047006 27219 raft_consensus.cc:697] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:49.081313 22547 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:49.085659 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:49.088413 22397 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:49.094796 22469 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:18:49.086814 27525 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:49.117036 27219 consensus_queue.cc:237] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:49.118738 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:49.119516 22548 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:49.123479 22441 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:49.131984 22441 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:49.097811 27458 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:18:49.100488 27287 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:18:49.133872 27525 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:49.150245 27373 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:49.175846 27482 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:49.177377 22441 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:49.168668 27535 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:18:49.184141 22441 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:49.178903 27373 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.187686 27373 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:49.186414 27040 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:49.187906 27525 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:49.195712 27287 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:18:49.234408 27447 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:18:49.239028 27558 log.cc:927] Time spent T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:18:49.251869 22549 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:49.254719 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:49.265643 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:18:49.265926 27546 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:49.237238 27373 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:49.310988 22476 raft_consensus.cc:2393] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 16: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:18:49.311998 27373 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:49.313896 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:49.314498 22543 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:49.334764 27219 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:18:49.335465 27219 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:49.343152 27219 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:49.344233 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:18:49.344880 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:18:49.345635 22476 raft_consensus.cc:2368] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 15. Current term is 16.
I20260709 12:18:49.347473 22367 leader_election.cc:400] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 15. Current term is 16.
I20260709 12:18:49.347791 22367 leader_election.cc:403] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:49.348738 27219 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:18:49.351586 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:49.355206 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:49.345566 22543 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:18:49.379114 22441 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:49.379091 27533 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:49.383991 27525 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:49.384753 27525 raft_consensus.cc:697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:49.386013 27525 consensus_queue.cc:237] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:49.414662 23122 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:49.420209 27287 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 12:18:49.475025 22284 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b42c69680a57493c942307ff09185b72 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8c3bcfa13ca74a24ab8999a408532932 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:49.498558 27219 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 15. Current term is 16.
I20260709 12:18:49.494434 22398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:18:49.530565 22398 raft_consensus.cc:606] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:49.530920 22398 raft_consensus.cc:614] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:49.533187 22469 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:49.533636 22397 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:18:49.545495 22393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:18:49.546111 22393 raft_consensus.cc:606] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:49.546439 22393 raft_consensus.cc:614] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:49.549489 22543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:18:49.550092 22543 raft_consensus.cc:606] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:49.550415 22543 raft_consensus.cc:614] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:49.551118 27471 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:49.558141 22543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b42c69680a57493c942307ff09185b72"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:18:49.558732 22543 raft_consensus.cc:606] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:49.559068 22543 raft_consensus.cc:614] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:49.561007 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:18:49.581300 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:49.585361 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:49.592949 22543 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:49.595000 27535 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:49.610087 22469 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:18:49.620656 27535 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:49.661705 22298 catalog_manager.cc:5697] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 9 to 11, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 11 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:49.677817 22298 catalog_manager.cc:5697] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 10 to 11, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 11 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:49.682775 22298 catalog_manager.cc:5697] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 3 to 8, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 8 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:49.686002 22298 catalog_manager.cc:5697] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:49.736016 22543 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:18:49.739267 27535 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
W20260709 12:18:49.768967 27572 log.cc:927] Time spent T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:18:49.814011 22293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32988 (request call id 96) took 6156 ms. Trace:
W20260709 12:18:49.858767 27573 log.cc:927] Time spent T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:18:49.903970 22298 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50158 (request call id 190) took 44386 ms (client timeout 15000 ms). Trace:
I20260709 12:18:49.906908 22297 catalog_manager.cc:5697] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:49.908527 22297 catalog_manager.cc:5697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 10 to 11, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 11 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:49.904471 22298 rpcz_store.cc:269] 0709 12:18:05.517351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.517600 (+   249us) service_pool.cc:224] Handling call
0709 12:18:05.901602 (+384002us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b540038b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abe090 00007fb4f8b5cf3a 00007fb4fe912e9c 00007fb4fea1104e 00007fb4fced22a4 00007fb4fced2232 00007fb4fced2161 00007fb4fced20dc 00007fb4fced1392 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:18:49.903852 (+44002250us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:49.696479 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:49.697018 (+   539us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:49.697058 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:18:49.697076 (+    18us) tablet.cc:662] Decoding operations
0709 12:18:49.697699 (+   623us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:49.697756 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:49.697810 (+    54us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:18:49.698248 (+   438us) tablet.cc:701] Row locks acquired
0709 12:18:49.698266 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:18:49.698461 (+   195us) write_op.cc:270] Start()
0709 12:18:49.698625 (+   164us) write_op.cc:276] Timestamp: P: 1783599529698408 usec, L: 0
0709 12:18:49.698650 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:18:49.699354 (+   704us) log.cc:844] Serialized 1694 byte log entry
0709 12:18:49.701656 (+  2302us) op_driver.cc:464] REPLICATION: finished
0709 12:18:49.702184 (+   528us) write_op.cc:301] APPLY: starting
0709 12:18:49.702275 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:49.715576 (+ 13301us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:49.716872 (+  1296us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:49.741272 (+ 24400us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:49.741437 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:18:49.741481 (+    44us) write_op.cc:312] APPLY: finished
0709 12:18:49.741693 (+   212us) log.cc:844] Serialized 49 byte log entry
0709 12:18:49.741885 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:49.742001 (+   116us) write_op.cc:454] Released schema lock
0709 12:18:49.742041 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:49.747362 (+  5321us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:49.747396 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":52596,"reported_tablets":52,"spinlock_wait_cycles":149538432,"child_traces":[["op",{"apply.queue_time_us":299,"apply.run_cpu_time_us":7441,"apply.run_wall_time_us":45102,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16760,"num_ops":4,"prepare.queue_time_us":123,"prepare.run_cpu_time_us":3202,"prepare.run_wall_time_us":3202,"replication_time_us":2838,"spinlock_wait_cycles":2432}]]}
I20260709 12:18:49.913643 22297 catalog_manager.cc:5697] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 11 to 13, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:49.814549 22293 rpcz_store.cc:276] 0709 12:18:43.658141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.658498 (+   357us) service_pool.cc:224] Handling call
0709 12:18:49.813924 (+6155426us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:49.023042 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:49.023648 (+   606us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:49.023703 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:18:49.023729 (+    26us) tablet.cc:662] Decoding operations
0709 12:18:49.024789 (+  1060us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:49.024855 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:49.024886 (+    31us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:18:49.026862 (+  1976us) tablet.cc:701] Row locks acquired
0709 12:18:49.026883 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:18:49.027016 (+   133us) write_op.cc:270] Start()
0709 12:18:49.027126 (+   110us) write_op.cc:276] Timestamp: P: 1783599529026974 usec, L: 0
0709 12:18:49.027145 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:18:49.088102 (+ 60957us) log.cc:844] Serialized 4016 byte log entry
0709 12:18:49.289407 (+201305us) op_driver.cc:464] REPLICATION: finished
0709 12:18:49.415847 (+126440us) write_op.cc:301] APPLY: starting
0709 12:18:49.417636 (+  1789us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:49.543580 (+125944us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:49.544832 (+  1252us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:49.560087 (+ 15255us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:49.560322 (+   235us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 12:18:49.560368 (+    46us) write_op.cc:312] APPLY: finished
0709 12:18:49.560643 (+   275us) log.cc:844] Serialized 97 byte log entry
0709 12:18:49.560809 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:49.560951 (+   142us) write_op.cc:454] Released schema lock
0709 12:18:49.561000 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:49.564009 (+  3009us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:49.564042 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1471022,"reported_tablets":18,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":113028,"apply.run_cpu_time_us":14384,"apply.run_wall_time_us":153530,"cfile_cache_hit":42,"cfile_cache_hit_bytes":46027,"num_ops":10,"prepare.queue_time_us":209821,"prepare.run_cpu_time_us":21239,"prepare.run_wall_time_us":166405,"raft.queue_time_us":6893,"raft.run_cpu_time_us":27978,"raft.run_wall_time_us":99292,"replication_time_us":262104,"spinlock_wait_cycles":253824,"thread_start_us":292261,"threads_started":4,"wal-append.queue_time_us":126676}]]}
W20260709 12:18:49.953934 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 69079.3us
I20260709 12:18:50.016439 22297 catalog_manager.cc:5697] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 13 to 14, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 14 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:50.018611 22297 catalog_manager.cc:5697] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.020447 22297 catalog_manager.cc:5697] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 8 to 11, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 11 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.025875 22393 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:50.049453 27373 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:50.058832 22297 catalog_manager.cc:5697] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.071331 22297 catalog_manager.cc:5697] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.072865 22297 catalog_manager.cc:5697] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
W20260709 12:18:50.087997 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 103716us
I20260709 12:18:50.110435 22545 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:50.113592 27401 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
W20260709 12:18:50.311173 22297 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50158 (request call id 191) took 21922 ms (client timeout 15000 ms). Trace:
W20260709 12:18:50.311615 22297 rpcz_store.cc:269] 0709 12:18:28.388552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.388746 (+   194us) service_pool.cc:224] Handling call
0709 12:18:50.311083 (+21922337us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:50.128769 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:50.129270 (+   501us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:50.129304 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:18:50.129321 (+    17us) tablet.cc:662] Decoding operations
0709 12:18:50.130198 (+   877us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:50.130251 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:50.130277 (+    26us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:18:50.130929 (+   652us) tablet.cc:701] Row locks acquired
0709 12:18:50.130949 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:18:50.131086 (+   137us) write_op.cc:270] Start()
0709 12:18:50.131199 (+   113us) write_op.cc:276] Timestamp: P: 1783599530131039 usec, L: 0
0709 12:18:50.131215 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:18:50.131804 (+   589us) log.cc:844] Serialized 3619 byte log entry
0709 12:18:50.134163 (+  2359us) op_driver.cc:464] REPLICATION: finished
0709 12:18:50.134472 (+   309us) write_op.cc:301] APPLY: starting
0709 12:18:50.134554 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:50.138568 (+  4014us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:50.138636 (+    68us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:50.178588 (+ 39952us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:50.178788 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0709 12:18:50.178843 (+    55us) write_op.cc:312] APPLY: finished
0709 12:18:50.179128 (+   285us) log.cc:844] Serialized 89 byte log entry
0709 12:18:50.198512 (+ 19384us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:50.200222 (+  1710us) write_op.cc:454] Released schema lock
0709 12:18:50.200544 (+   322us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:50.210978 (+ 10434us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:50.211012 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32608,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":113,"apply.run_cpu_time_us":9994,"apply.run_wall_time_us":76429,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37710,"num_ops":9,"prepare.queue_time_us":1550,"prepare.run_cpu_time_us":3325,"prepare.run_wall_time_us":5821,"replication_time_us":2817}]]}
I20260709 12:18:50.314127 22296 catalog_manager.cc:5697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:50.316035 22296 catalog_manager.cc:5697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:50.318209 22296 catalog_manager.cc:5697] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 4 to 8, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 8 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:50.319770 22296 catalog_manager.cc:5697] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 11 to 14, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 14 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:50.321321 22296 catalog_manager.cc:5697] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 11 to 13, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.338716 22296 catalog_manager.cc:5697] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:50.340077 22296 catalog_manager.cc:5697] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 5 to 8, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 8 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.341746 22296 catalog_manager.cc:5697] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 11 to 15, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 15 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:50.356727 22296 catalog_manager.cc:5697] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 9 to 10, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 10 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.358893 22296 catalog_manager.cc:5697] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 8 to 13, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 13 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:50.361829 22296 catalog_manager.cc:5697] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 11 to 16, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 16 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:50.363142 22296 catalog_manager.cc:5697] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 14 to 15, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 15 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.373194 22296 catalog_manager.cc:5697] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 11 to 13, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.374867 22296 catalog_manager.cc:5697] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:50.376173 22296 catalog_manager.cc:5697] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.377683 22296 catalog_manager.cc:5697] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.379258 22296 catalog_manager.cc:5697] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 15 to 17, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 17 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.380797 22296 catalog_manager.cc:5697] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 9 to 10, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 10 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.390481 22296 catalog_manager.cc:5697] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.392033 22296 catalog_manager.cc:5697] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 7 to 11, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 11 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.393680 22296 catalog_manager.cc:5697] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 11 to 12, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 12 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.395788 22296 catalog_manager.cc:5697] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 9 to 13, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.397336 22296 catalog_manager.cc:5697] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 10 to 11, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 11 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.409895 22296 catalog_manager.cc:5697] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 11 to 14, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 14 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.412315 22296 catalog_manager.cc:5697] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 10 to 13, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.413914 22296 catalog_manager.cc:5697] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 13 to 14, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 14 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.415794 22296 catalog_manager.cc:5697] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 9 to 12, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 12 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.633810 22293 catalog_manager.cc:5697] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.635603 22293 catalog_manager.cc:5697] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.637476 22293 catalog_manager.cc:5697] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 13 to 15, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 15 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:50.643445 22293 catalog_manager.cc:5697] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 12 to 14, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 14 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:18:50.675038 22296 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50166 (request call id 210) took 14375 ms (client timeout 15000 ms). Trace:
I20260709 12:18:50.675747 22293 catalog_manager.cc:5697] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.677946 22293 catalog_manager.cc:5697] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:50.679575 22293 catalog_manager.cc:5697] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 11 to 12, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 12 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:50.681193 22293 catalog_manager.cc:5697] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 10 to 11, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 11 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:18:50.675472 22296 rpcz_store.cc:269] 0709 12:18:36.299378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.299686 (+   308us) service_pool.cc:224] Handling call
0709 12:18:50.674953 (+14375267us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:50.492095 (+     0us) spinlock_profiling.cc:243] Waited 9.46 ms on lock 0x7b540038afa8. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fef109e1 00007fb4fef0f64c 00007fb4fc59eadc 00007fb4fc58a0a6 00007fb4fc589d58 00007fb4fc58e9f1 00007fb4fc58e9a9 00007fb4fc58e939 00007fb4fc58e901 00007fb4fc58db2d 0000000000388634
0709 12:18:50.492194 (+    99us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:50.492733 (+   539us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:50.492772 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:18:50.492791 (+    19us) tablet.cc:662] Decoding operations
0709 12:18:50.494802 (+  2011us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:50.494862 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:50.494891 (+    29us) tablet.cc:685] Acquiring locks for 27 operations
0709 12:18:50.497150 (+  2259us) tablet.cc:701] Row locks acquired
0709 12:18:50.497171 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:18:50.497315 (+   144us) write_op.cc:270] Start()
0709 12:18:50.497517 (+   202us) write_op.cc:276] Timestamp: P: 1783599530497270 usec, L: 0
0709 12:18:50.497541 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:18:50.512787 (+ 15246us) log.cc:844] Serialized 10540 byte log entry
0709 12:18:50.520079 (+  7292us) op_driver.cc:464] REPLICATION: finished
0709 12:18:50.520856 (+   777us) write_op.cc:301] APPLY: starting
0709 12:18:50.520941 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:50.559432 (+ 38491us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:50.559447 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:50.603870 (+ 44423us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:50.604242 (+   372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=0,mrs_lookups=0
0709 12:18:50.604292 (+    50us) write_op.cc:312] APPLY: finished
0709 12:18:50.604725 (+   433us) log.cc:844] Serialized 236 byte log entry
0709 12:18:50.613943 (+  9218us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:50.614147 (+   204us) write_op.cc:454] Released schema lock
0709 12:18:50.614206 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:50.650004 (+ 35798us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:50.650034 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19681,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":398,"apply.run_cpu_time_us":28582,"apply.run_wall_time_us":129117,"cfile_cache_hit":108,"cfile_cache_hit_bytes":113130,"num_ops":27,"prepare.queue_time_us":138,"prepare.run_cpu_time_us":9235,"prepare.run_wall_time_us":37366,"replication_time_us":21944,"spinlock_wait_cycles":21751040}]]}
I20260709 12:18:50.756916 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:50.820406 22299 catalog_manager.cc:5697] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 17 to 20, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 20 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:50.844591 22299 catalog_manager.cc:5697] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 10 to 11, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 11 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:50.847919 22299 catalog_manager.cc:5697] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 13 to 15, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 15 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.850129 22299 catalog_manager.cc:5697] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.851936 22299 catalog_manager.cc:5697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:50.858038 22299 catalog_manager.cc:5697] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 8 to 9, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 9 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.859951 22299 catalog_manager.cc:5697] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 12 to 14, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 14 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:50.862170 22299 catalog_manager.cc:5697] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 15 to 16, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 16 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.863885 22299 catalog_manager.cc:5697] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 9 to 12, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 12 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } }
I20260709 12:18:50.865252 22299 catalog_manager.cc:5697] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 14 to 16, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 16 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.866832 22299 catalog_manager.cc:5697] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 10 to 13, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:50.868391 22299 catalog_manager.cc:5697] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 15 to 18, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 18 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.882232 22299 catalog_manager.cc:5697] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 8 to 11, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 11 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:50.886153 22299 catalog_manager.cc:5697] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 6 to 12, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 12 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.887843 22299 catalog_manager.cc:5697] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.889637 22299 catalog_manager.cc:5697] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 10 to 11, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 11 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.892247 22299 catalog_manager.cc:5697] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 10 to 12, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 12 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:50.893700 22299 catalog_manager.cc:5697] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 11 to 12, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 12 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.895360 22299 catalog_manager.cc:5697] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:50.896955 22299 catalog_manager.cc:5697] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 10 to 12, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 12 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:51.008452 22471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:51.009060 22471 raft_consensus.cc:606] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:51.014050 22471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:51.014611 22471 raft_consensus.cc:606] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:51.014928 22471 raft_consensus.cc:614] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:51.019595 22471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:51.020174 22471 raft_consensus.cc:606] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:51.020493 22471 raft_consensus.cc:614] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:51.031399 22476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:51.032023 22476 raft_consensus.cc:606] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:51.032359 22476 raft_consensus.cc:614] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:51.041311 22471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:51.042024 22471 raft_consensus.cc:606] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:51.043550 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:51.045310 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:51.054489 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:51.070319 22285 catalog_manager.cc:4755] TS 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): ChangeConfig:REMOVE_PEER RPC failed for tablet 2974af5009474d6590a8e35ea1dc6b83: Remote error: Service unavailable: leader transfer in progress
I20260709 12:18:51.135525 22293 catalog_manager.cc:5697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 13 to 15, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 15 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:51.137563 22293 catalog_manager.cc:5697] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 8 to 17, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 17 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:51.139566 22293 catalog_manager.cc:5697] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.156337 22299 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50158 (request call id 192) took 4712 ms. Trace:
I20260709 12:18:51.162604 22293 catalog_manager.cc:5697] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 10 to 13, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 13 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:51.157967 22299 rpcz_store.cc:276] 0709 12:18:46.444153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:46.454632 (+ 10479us) service_pool.cc:224] Handling call
0709 12:18:51.156269 (+4701637us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:50.916916 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:50.917439 (+   523us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:50.917474 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:18:50.917491 (+    17us) tablet.cc:662] Decoding operations
0709 12:18:50.918983 (+  1492us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:50.919045 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:50.919072 (+    27us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:18:50.920430 (+  1358us) tablet.cc:701] Row locks acquired
0709 12:18:50.920448 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:18:50.920604 (+   156us) write_op.cc:270] Start()
0709 12:18:50.920719 (+   115us) write_op.cc:276] Timestamp: P: 1783599530920553 usec, L: 0
0709 12:18:50.920739 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:18:50.935784 (+ 15045us) log.cc:844] Serialized 7846 byte log entry
0709 12:18:50.941241 (+  5457us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b540038b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b4fe28 00007fb4fc58a581 00007fb4fc589d58 00007fb4fc58e9f1 00007fb4fc58e9a9 00007fb4fc58e939 00007fb4fc58e901 00007fb4fc58db2d 0000000000388634 0000000000388479
0709 12:18:50.970610 (+ 29369us) op_driver.cc:464] REPLICATION: finished
0709 12:18:50.971001 (+   391us) write_op.cc:301] APPLY: starting
0709 12:18:50.971086 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:50.981091 (+ 10005us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:50.981112 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:51.049382 (+ 68270us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:51.049672 (+   290us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=0,mrs_lookups=0
0709 12:18:51.049716 (+    44us) write_op.cc:312] APPLY: finished
0709 12:18:51.064099 (+ 14383us) log.cc:844] Serialized 180 byte log entry
0709 12:18:51.071383 (+  7284us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:51.071563 (+   180us) write_op.cc:454] Released schema lock
0709 12:18:51.071625 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:51.072034 (+   409us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:51.072064 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1057271,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":172,"apply.run_cpu_time_us":23115,"apply.run_wall_time_us":100992,"cfile_cache_hit":80,"cfile_cache_hit_bytes":83800,"num_ops":20,"prepare.queue_time_us":1278,"prepare.run_cpu_time_us":6055,"prepare.run_wall_time_us":24481,"replication_time_us":49726,"spinlock_wait_cycles":33107712}]]}
I20260709 12:18:51.166505 22293 catalog_manager.cc:5697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 14 to 16, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 16 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.168808 22293 catalog_manager.cc:5697] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 6 to 12, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 12 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:51.170500 22293 catalog_manager.cc:5697] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:51.172556 22293 catalog_manager.cc:5697] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 13 to 16, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 16 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.174407 22293 catalog_manager.cc:5697] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:51.176441 22293 catalog_manager.cc:5697] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 13 to 17, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 17 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:51.178671 22293 catalog_manager.cc:5697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 7 to 15, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 15 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.180896 22293 catalog_manager.cc:5697] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 12 to 14, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 14 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:51.183475 22293 catalog_manager.cc:5697] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.185886 22293 catalog_manager.cc:5697] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 7 to 14, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 14 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:51.187299 22293 catalog_manager.cc:5697] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 14 to 17, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 17 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:18:51.264178 27546 raft_consensus.cc:993] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:51.264669 27546 raft_consensus.cc:1081] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:51.266646 22547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54498
I20260709 12:18:51.267210 22547 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:51.267560 22547 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:51.317889 22547 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:51.327327 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:51.327912 23122 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:51.335783 23122 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:18:51.340034 22547 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:51.358345 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:51.362596 22398 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:51.359023 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:51.370106 22476 raft_consensus.cc:3055] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:51.370467 22476 raft_consensus.cc:740] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:51.371385 22476 consensus_queue.cc:260] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:51.360374 27546 raft_consensus.cc:993] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:51.373391 22476 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:51.397277 22471 consensus_queue.cc:237] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:51.374788 27581 raft_consensus.cc:1081] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:51.402772 22545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54498
I20260709 12:18:51.403375 22545 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:51.403733 22545 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:51.404807 22398 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:18:51.416921 22516 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:51.425495 27580 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:51.426774 27580 raft_consensus.cc:697] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:51.420581 22545 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:51.428190 27580 consensus_queue.cc:237] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:51.429247 22545 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:51.453377 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:51.454059 22398 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:51.454052 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:51.458645 22469 raft_consensus.cc:3055] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:51.459022 22469 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:51.462528 22294 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50176 (request call id 187) took 9723 ms. Trace:
I20260709 12:18:51.462704 22469 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:51.464310 22469 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:51.466898 22398 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:18:51.462927 22294 rpcz_store.cc:276] 0709 12:18:41.739155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.739343 (+   188us) service_pool.cc:224] Handling call
0709 12:18:51.462328 (+9722985us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":54}
I20260709 12:18:51.469875 22476 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
W20260709 12:18:51.490042 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 54165.7us
I20260709 12:18:51.499622 23122 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:51.501276 27546 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:51.490159 22469 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:18:51.533226 22547 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:51.536446 27592 raft_consensus.cc:2955] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 6 to 10, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:51.537985 27581 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:18:51.538661 23122 raft_consensus.cc:2955] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 6 to 10, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:51.534014 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:51.574956 27467 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:51.575501 27467 raft_consensus.cc:697] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:51.613516 27467 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:51.619072 22547 raft_consensus.cc:2955] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 6 to 10, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:51.622406 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b42c69680a57493c942307ff09185b72 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
I20260709 12:18:51.656064 22294 catalog_manager.cc:5697] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 6 to 10, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New cstate: current_term: 11 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:51.690855 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 99943.4us
I20260709 12:18:51.812216 22387 tablet_service.cc:1558] Processing DeleteTablet for tablet b42c69680a57493c942307ff09185b72 with delete_type TABLET_DATA_TOMBSTONED (TS b8621fa34be04d3fa2d68a300f858cd1 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:52914
I20260709 12:18:51.823967 22299 catalog_manager.cc:5697] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 15 to 16, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 16 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.832631 27608 tablet_replica.cc:333] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:18:51.833938 27608 raft_consensus.cc:2243] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:51.837397 22299 catalog_manager.cc:5697] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 15 to 16, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 16 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:51.844522 27608 raft_consensus.cc:2272] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.857532 27608 ts_tablet_manager.cc:1916] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:51.870405 22545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54490
I20260709 12:18:51.871068 22545 raft_consensus.cc:606] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Received request to transfer leadership
I20260709 12:18:51.876255 22545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54490
I20260709 12:18:51.876819 22545 raft_consensus.cc:606] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Received request to transfer leadership
I20260709 12:18:51.889464 22472 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:18:51.891546 27602 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:51.921880 27608 ts_tablet_manager.cc:1929] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 12:18:51.931471 22545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54490
I20260709 12:18:51.932163 22545 raft_consensus.cc:606] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Received request to transfer leadership
I20260709 12:18:51.941321 27591 raft_consensus.cc:993] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:18:51.922621 27608 log.cc:1199] T b42c69680a57493c942307ff09185b72 P b8621fa34be04d3fa2d68a300f858cd1: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-0-root/wals/b42c69680a57493c942307ff09185b72
I20260709 12:18:51.953862 27467 raft_consensus.cc:1081] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:18:51.998203 22469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36296
I20260709 12:18:51.999037 22469 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:51.999490 22469 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:52.005062 22396 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:18:52.019068 27580 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:52.028776 22469 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:52.035852 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:52.036592 22545 raft_consensus.cc:3055] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:52.037014 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:52.037578 22545 raft_consensus.cc:740] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:52.038774 22545 consensus_queue.cc:260] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:52.040150 22545 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:52.047335 22469 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:52.049151 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:52.049759 23122 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:52.053855 22285 catalog_manager.cc:5028] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): tablet b42c69680a57493c942307ff09185b72 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:18:52.054085 22545 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:18:52.071646 23122 raft_consensus.cc:2468] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:18:52.074162 22441 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:52.077399 27603 raft_consensus.cc:2804] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:52.087790 27603 raft_consensus.cc:697] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:52.088788 27603 consensus_queue.cc:237] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:52.108740 22284 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2974af5009474d6590a8e35ea1dc6b83 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8c3bcfa13ca74a24ab8999a408532932 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:52.115463 22396 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:18:52.124106 22299 catalog_manager.cc:5697] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 16 to 17, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 17 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.131214 27605 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
W20260709 12:18:52.180827 22347 auto_rebalancer.cc:893] Removing replace marker failed: Replica 8c3bcfa13ca74a24ab8999a408532932 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:18:52.181279 22347 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 2974af5009474d6590a8e35ea1dc6b83 already in progress
W20260709 12:18:52.181602 22347 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 2974af5009474d6590a8e35ea1dc6b83 already in progress
I20260709 12:18:52.229542 22472 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:18:52.242012 27602 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:52.293008 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:52.383344 22545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:18:52.383972 22545 raft_consensus.cc:606] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:52.389278 22393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:18:52.390018 22393 raft_consensus.cc:606] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:52.406585 22393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:18:52.407410 22393 raft_consensus.cc:606] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:52.410313 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:18:52.412420 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:52.413268 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:52.435674 27590 raft_consensus.cc:993] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:52.436172 27590 raft_consensus.cc:1081] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:52.438151 22543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54496
I20260709 12:18:52.438689 22543 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:52.439054 22543 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:52.446013 22543 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:52.456189 22543 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:52.457139 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:52.457633 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:52.457906 22393 raft_consensus.cc:3055] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:52.458415 22393 raft_consensus.cc:740] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:52.458305 22472 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:52.461398 22393 consensus_queue.cc:260] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:52.462956 22393 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:52.469215 22472 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:52.474992 22516 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:52.475893 27467 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:52.476429 27467 raft_consensus.cc:697] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:52.477313 27467 consensus_queue.cc:237] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:52.487783 22393 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:18:52.495306 22398 raft_consensus.cc:3060] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:52.507176 22398 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:18:52.508746 27617 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:52.545171 22299 catalog_manager.cc:5697] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 10 to 11, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 11 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.582173 27499 raft_consensus.cc:993] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:18:52.582711 27499 raft_consensus.cc:1081] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:18:52.584542 22472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36286
I20260709 12:18:52.585150 22472 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:52.585476 22472 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:52.599476 22472 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:52.602407 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:52.603017 22397 raft_consensus.cc:3055] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:52.603313 22397 raft_consensus.cc:740] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:52.603559 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:52.604126 22543 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:52.604020 22397 consensus_queue.cc:260] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:52.605363 22397 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:52.612080 22547 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:18:52.612201 22397 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:52.614728 22472 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:52.614753 22442 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:52.615414 27617 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:18:52.618645 27373 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:52.631426 27373 raft_consensus.cc:697] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:52.618332 22543 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:18:52.632934 27373 consensus_queue.cc:237] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:52.662665 23125 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:18:52.691274 27592 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:52.696722 22294 catalog_manager.cc:5697] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 13 to 14, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 14 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.815537 27621 raft_consensus.cc:993] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:18:52.816020 27621 raft_consensus.cc:1081] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:18:52.823747 22471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36296
I20260709 12:18:52.824374 22471 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:52.824734 22471 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:52.859606 22472 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:52.861241 27621 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:52.866163 22471 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:52.868211 22471 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:52.869692 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:52.872037 22396 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:52.869740 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:52.873986 22543 raft_consensus.cc:3055] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:52.874303 22543 raft_consensus.cc:740] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:52.875038 22543 consensus_queue.cc:260] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:52.876313 22543 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:52.879068 22396 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:52.880666 22442 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:52.881557 27603 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:52.882053 27603 raft_consensus.cc:697] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:52.882943 27603 consensus_queue.cc:237] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:52.886795 22543 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 9.
I20260709 12:18:52.898995 22398 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:52.903473 27621 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:18:52.989962 22299 catalog_manager.cc:5697] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 8 to 9, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 9 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:53.014269 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 53981us
I20260709 12:18:53.132520 22543 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:18:53.138541 27617 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:53.156476 22396 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:18:53.158080 27603 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:53.514218 22396 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:53.530536 27645 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:18:53.561244 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 72166.4us
I20260709 12:18:53.586796 22543 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:53.616125 27642 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:18:53.682673 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 46775.1us
I20260709 12:18:53.716578 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:53.982702 22469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:53.983695 22469 raft_consensus.cc:606] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:53.988672 22547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:18:53.989305 22547 raft_consensus.cc:606] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:54.008212 22396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:18:54.008999 22396 raft_consensus.cc:606] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:54.012763 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:18:54.014513 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:54.015565 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:54.063392 22347 auto_rebalancer.cc:629] Failed to schedule move for tablet ff6628c2d6a44791975f2350758cb3db: Remote error: Service unavailable: leader transfer in progress
I20260709 12:18:54.065629 27634 raft_consensus.cc:993] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:18:54.066249 27634 raft_consensus.cc:1081] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:18:54.083849 22399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48924
I20260709 12:18:54.084508 22399 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:54.084923 22399 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:54.097824 22399 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:54.158061 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:54.158859 22545 raft_consensus.cc:3055] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:54.159157 22545 raft_consensus.cc:740] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:54.159561 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:54.160117 23122 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:54.160018 22545 consensus_queue.cc:260] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:54.165563 22545 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:54.177127 23122 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:54.177860 22399 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:54.179979 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:54.181303 27640 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:54.181806 27640 raft_consensus.cc:697] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:54.182806 27640 consensus_queue.cc:237] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:54.188182 22472 consensus_queue.cc:237] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:54.191874 22545 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
I20260709 12:18:54.192631 22469 consensus_queue.cc:237] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:18:54.207522 23128 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:18:54.209187 27627 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:54.210587 22398 raft_consensus.cc:1275] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:18:54.212340 27645 consensus_queue.cc:1048] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:54.224887 22396 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:54.229234 22545 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:18:54.230027 22441 consensus_peers.cc:597] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c837f3ed639d47cc8258ce902cca0154. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:54.231076 27627 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:54.233556 27645 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:54.235700 27642 raft_consensus.cc:2955] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 4 to 13, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:54.243480 22398 raft_consensus.cc:2955] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 4 to 13, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:18:54.263003 22330 debug-util.cc:398] Leaking SignalData structure 0x7b080032c6e0 after lost signal to thread 21247
W20260709 12:18:54.264379 22330 debug-util.cc:398] Leaking SignalData structure 0x7b0800260fa0 after lost signal to thread 22333
I20260709 12:18:54.263520 22293 catalog_manager.cc:5697] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 8 to 9, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 9 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:54.266991 22330 debug-util.cc:398] Leaking SignalData structure 0x7b08000398c0 after lost signal to thread 22501
W20260709 12:18:54.272228 22330 debug-util.cc:398] Leaking SignalData structure 0x7b0800337900 after lost signal to thread 22575
W20260709 12:18:54.276302 22330 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5e20 after lost signal to thread 23155
I20260709 12:18:54.247588 23128 raft_consensus.cc:2955] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 4 to 13, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:54.278795 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2974af5009474d6590a8e35ea1dc6b83 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 12:18:54.288581 27373 raft_consensus.cc:2955] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:18:54.289623 22545 raft_consensus.cc:2955] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:18:54.290031 22294 catalog_manager.cc:5697] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 4 to 13, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New cstate: current_term: 17 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.309988 27499 raft_consensus.cc:993] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:54.310554 27499 raft_consensus.cc:1081] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:54.312819 22543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54496
I20260709 12:18:54.313377 22543 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:54.313812 22543 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:54.304756 22396 raft_consensus.cc:2955] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:18:54.335417 22543 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:54.338112 22543 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:54.338973 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:54.339604 22399 raft_consensus.cc:3055] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:54.339912 22399 raft_consensus.cc:740] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:54.340737 22399 consensus_queue.cc:260] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:54.344420 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:54.345050 22472 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:54.364571 22399 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:54.367759 22398 consensus_queue.cc:237] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:18:54.353057 22299 catalog_manager.cc:5697] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index -1 to 9, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:18:54.385224 22472 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:54.387073 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:18:54.388648 27605 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:54.389178 27605 raft_consensus.cc:697] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:54.390266 27605 consensus_queue.cc:237] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:54.443776 22399 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:54.469026 22472 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:54.472987 27640 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:54.500027 27471 raft_consensus.cc:2955] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:18:54.512544 27627 raft_consensus.cc:993] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:18:54.513211 27627 raft_consensus.cc:1081] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:18:54.516095 22398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:18:54.516671 22398 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:54.517037 22398 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:54.526593 22398 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:54.526212 22472 raft_consensus.cc:2955] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:18:54.535496 22398 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:54.551748 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:54.552347 22471 raft_consensus.cc:3055] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:54.552665 22471 raft_consensus.cc:740] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:54.555028 22538 tablet_service.cc:1558] Processing DeleteTablet for tablet 2974af5009474d6590a8e35ea1dc6b83 with delete_type TABLET_DATA_TOMBSTONED (TS 8c3bcfa13ca74a24ab8999a408532932 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:54490
I20260709 12:18:54.553467 22471 consensus_queue.cc:260] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:54.566648 22543 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:54.578646 22471 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:54.659508 22366 consensus_peers.cc:597] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: beb931ddd9ec4606a06a5fd9dbc6322e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:54.661657 22471 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:54.662962 22543 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:54.664532 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:54.665110 23125 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:54.667361 22367 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:54.668259 27640 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:54.668697 27640 raft_consensus.cc:697] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:54.669603 27640 consensus_queue.cc:237] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:54.682807 23125 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:18:54.693513 22293 catalog_manager.cc:5697] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index -1 to 8, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 12 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:54.699612 22299 catalog_manager.cc:5697] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 11 to 12, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 12 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.702689 27672 tablet_replica.cc:333] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:18:54.703027 22543 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:18:54.722096 27672 raft_consensus.cc:2243] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:54.723459 27672 raft_consensus.cc:2272] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:54.732985 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 70180.9us
I20260709 12:18:54.734311 27471 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:18:54.740247 22515 consensus_peers.cc:597] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a60334567abd4be7b4e9f6f2e754d015. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:54.743194 27672 ts_tablet_manager.cc:1916] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:54.748615 22393 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:54.753118 22471 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:54.753644 27605 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:54.757838 27648 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:54.771667 27471 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:54.778995 22293 catalog_manager.cc:5697] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 9 to 10, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 10 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:54.792686 22545 raft_consensus.cc:2955] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:18:54.815692 27676 ts_tablet_manager.cc:933] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:54.840950 22399 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:54.847892 27605 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:54.856078 27648 raft_consensus.cc:2955] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:18:54.859555 22393 raft_consensus.cc:2955] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:18:54.874709 22471 raft_consensus.cc:2955] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:18:54.891287 27672 ts_tablet_manager.cc:1929] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 12:18:54.892076 27672 log.cc:1199] T 2974af5009474d6590a8e35ea1dc6b83 P 8c3bcfa13ca74a24ab8999a408532932: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-2-root/wals/2974af5009474d6590a8e35ea1dc6b83
I20260709 12:18:54.917484 22284 catalog_manager.cc:5028] TS 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): tablet 2974af5009474d6590a8e35ea1dc6b83 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:18:54.918390 23125 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:54.926608 27471 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:54.928007 22296 catalog_manager.cc:5697] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index -1 to 10, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 12 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:18:54.968052 22472 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:54.938141 27676 tablet_copy_client.cc:323] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.2:46187
I20260709 12:18:55.010367 22487 tablet_copy_service.cc:140] P 25ebf14868c042dca42f54b3e251e1b2: Received BeginTabletCopySession request for tablet c837f3ed639d47cc8258ce902cca0154 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:43060)
I20260709 12:18:55.010982 22487 tablet_copy_service.cc:161] P 25ebf14868c042dca42f54b3e251e1b2: Beginning new tablet copy session on tablet c837f3ed639d47cc8258ce902cca0154 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:43060: session id = 65951063312d4a1e9123f92354101c71-c837f3ed639d47cc8258ce902cca0154
I20260709 12:18:55.036044 22487 tablet_copy_source_session.cc:215] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:55.074101 27676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c837f3ed639d47cc8258ce902cca0154. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:55.083998 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 101784us
I20260709 12:18:55.106755 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:55.183590 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 102589us
I20260709 12:18:55.179270 27634 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:18:55.214198 23122 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:18:55.250880 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 133677us
I20260709 12:18:55.263906 22471 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:55.393796 27699 ts_tablet_manager.cc:933] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:55.398406 27702 ts_tablet_manager.cc:933] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
W20260709 12:18:55.412600 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 93105.6us
I20260709 12:18:55.378055 27673 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.139s
W20260709 12:18:55.418567 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 78732.2us
I20260709 12:18:55.424855 27699 tablet_copy_client.cc:323] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.3:38645
I20260709 12:18:55.446038 27669 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 12:18:55.534008 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 74499.3us
W20260709 12:18:55.560075 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 86577.6us
I20260709 12:18:55.580113 22560 tablet_copy_service.cc:140] P 8c3bcfa13ca74a24ab8999a408532932: Received BeginTabletCopySession request for tablet a60334567abd4be7b4e9f6f2e754d015 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:49290)
I20260709 12:18:55.580761 22560 tablet_copy_service.cc:161] P 8c3bcfa13ca74a24ab8999a408532932: Beginning new tablet copy session on tablet a60334567abd4be7b4e9f6f2e754d015 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:49290: session id = 65951063312d4a1e9123f92354101c71-a60334567abd4be7b4e9f6f2e754d015
I20260709 12:18:55.588331 27676 tablet_copy_client.cc:806] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:55.589011 27676 tablet_copy_client.cc:670] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:55.592351 22543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:18:55.593029 22543 raft_consensus.cc:606] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:55.618644 22393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:18:55.619287 22393 raft_consensus.cc:606] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:55.621026 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:55.623227 27702 tablet_copy_client.cc:323] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.1:37927
I20260709 12:18:55.631633 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:55.640456 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:55.611202 27676 tablet_copy_client.cc:538] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:55.632748 27711 raft_consensus.cc:993] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:18:55.679924 22560 tablet_copy_source_session.cc:215] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:55.680938 27701 raft_consensus.cc:1081] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
W20260709 12:18:55.690035 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 87795.2us
I20260709 12:18:55.692821 22411 tablet_copy_service.cc:140] P b8621fa34be04d3fa2d68a300f858cd1: Received BeginTabletCopySession request for tablet beb931ddd9ec4606a06a5fd9dbc6322e from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:58054)
I20260709 12:18:55.693524 22411 tablet_copy_service.cc:161] P b8621fa34be04d3fa2d68a300f858cd1: Beginning new tablet copy session on tablet beb931ddd9ec4606a06a5fd9dbc6322e from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:58054: session id = 65951063312d4a1e9123f92354101c71-beb931ddd9ec4606a06a5fd9dbc6322e
I20260709 12:18:55.706173 27704 raft_consensus.cc:993] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:55.706732 27704 raft_consensus.cc:1081] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:55.711225 22551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54496
I20260709 12:18:55.711787 22551 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:55.712112 22551 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:55.712162 27699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a60334567abd4be7b4e9f6f2e754d015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:55.726950 22411 tablet_copy_source_session.cc:215] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:55.741575 22471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36296
I20260709 12:18:55.759516 22471 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:55.759922 22471 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:55.763538 27702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beb931ddd9ec4606a06a5fd9dbc6322e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:55.733259 22551 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:55.773630 22551 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:55.786512 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:55.787168 22397 raft_consensus.cc:3055] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:55.787470 22397 raft_consensus.cc:740] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:55.788192 22397 consensus_queue.cc:260] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:55.789671 22397 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:55.792809 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:55.793475 22474 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:55.800980 22397 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:55.807574 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:55.809145 27705 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:55.809787 27705 raft_consensus.cc:697] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:55.811293 22471 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:55.813371 22471 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:18:55.816779 27676 tablet_bootstrap.cc:492] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:18:55.817175 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:18:55.817731 23128 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:55.828011 23128 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:55.801478 22474 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:18:55.829663 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:55.830516 22551 raft_consensus.cc:3055] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:55.832024 22551 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:55.810699 27705 consensus_queue.cc:237] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:55.831087 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:18:55.834722 27716 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:55.835425 27716 raft_consensus.cc:697] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:55.836475 27716 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:55.843214 22551 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:55.853291 22551 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:56.007246 22551 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:18:56.033640 27699 tablet_copy_client.cc:806] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:56.034423 27699 tablet_copy_client.cc:670] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:56.053118 22296 catalog_manager.cc:5697] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 11 to 12, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 12 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:56.068938 27702 tablet_copy_client.cc:806] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:56.069595 27702 tablet_copy_client.cc:670] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:56.082031 27702 tablet_copy_client.cc:538] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:56.097306 27702 tablet_bootstrap.cc:492] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:18:56.140483 22293 catalog_manager.cc:5697] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 14 to 15, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 15 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:56.151484 27699 tablet_copy_client.cc:538] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:56.247712 22469 raft_consensus.cc:1275] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:56.249372 27634 consensus_queue.cc:1048] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:56.269129 22543 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:18:56.271029 27733 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:56.272986 27699 tablet_bootstrap.cc:492] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:18:56.283751 22393 raft_consensus.cc:1275] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:56.288822 27688 consensus_queue.cc:1048] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:18:56.303743 23125 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:18:56.319432 27676 tablet_bootstrap.cc:492] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:56.308593 27733 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:18:56.341535 27676 tablet_bootstrap.cc:492] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:18:56.365942 27676 ts_tablet_manager.cc:1403] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.549s	user 0.051s	sys 0.034s
I20260709 12:18:56.378468 27676 raft_consensus.cc:359] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:18:56.392031 27676 raft_consensus.cc:740] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:18:56.392828 27676 consensus_queue.cc:260] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:18:56.430370 27702 tablet_bootstrap.cc:492] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:56.431651 27702 tablet_bootstrap.cc:492] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:18:56.432446 27702 ts_tablet_manager.cc:1403] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.335s	user 0.037s	sys 0.020s
I20260709 12:18:56.485919 27676 ts_tablet_manager.cc:1434] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.116s	user 0.013s	sys 0.001s
I20260709 12:18:56.504823 27702 raft_consensus.cc:359] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:18:56.509377 27702 raft_consensus.cc:740] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:18:56.511123 27702 consensus_queue.cc:260] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:18:56.513469 22487 tablet_copy_service.cc:342] P 25ebf14868c042dca42f54b3e251e1b2: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-c837f3ed639d47cc8258ce902cca0154 received from {username='slave'} at 127.0.0.1:43060
I20260709 12:18:56.521778 22487 tablet_copy_service.cc:434] P 25ebf14868c042dca42f54b3e251e1b2: ending tablet copy session 65951063312d4a1e9123f92354101c71-c837f3ed639d47cc8258ce902cca0154 on tablet c837f3ed639d47cc8258ce902cca0154 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:18:56.533586 27702 ts_tablet_manager.cc:1434] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.000s
I20260709 12:18:56.536813 22411 tablet_copy_service.cc:342] P b8621fa34be04d3fa2d68a300f858cd1: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-beb931ddd9ec4606a06a5fd9dbc6322e received from {username='slave'} at 127.0.0.1:58054
I20260709 12:18:56.537279 22411 tablet_copy_service.cc:434] P b8621fa34be04d3fa2d68a300f858cd1: ending tablet copy session 65951063312d4a1e9123f92354101c71-beb931ddd9ec4606a06a5fd9dbc6322e on tablet beb931ddd9ec4606a06a5fd9dbc6322e with peer 65951063312d4a1e9123f92354101c71
I20260709 12:18:56.647784 27699 tablet_bootstrap.cc:492] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:56.648862 27699 tablet_bootstrap.cc:492] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:18:56.649652 27699 ts_tablet_manager.cc:1403] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.378s	user 0.037s	sys 0.010s
I20260709 12:18:56.706166 27699 raft_consensus.cc:359] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:18:56.707123 27699 raft_consensus.cc:740] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:18:56.707875 27699 consensus_queue.cc:260] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:18:56.726403 23122 raft_consensus.cc:1217] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 12:18:56.787483 27699 ts_tablet_manager.cc:1434] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.137s	user 0.006s	sys 0.001s
I20260709 12:18:56.807224 23122 raft_consensus.cc:1217] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 12:18:56.835464 22560 tablet_copy_service.cc:342] P 8c3bcfa13ca74a24ab8999a408532932: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-a60334567abd4be7b4e9f6f2e754d015 received from {username='slave'} at 127.0.0.1:49290
I20260709 12:18:56.835991 22560 tablet_copy_service.cc:434] P 8c3bcfa13ca74a24ab8999a408532932: ending tablet copy session 65951063312d4a1e9123f92354101c71-a60334567abd4be7b4e9f6f2e754d015 on tablet a60334567abd4be7b4e9f6f2e754d015 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:18:57.021584 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:57.163964 22545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:18:57.164575 22545 raft_consensus.cc:606] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:57.170487 27642 raft_consensus.cc:1064] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:18:57.175239 22393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:18:57.173194 27642 consensus_queue.cc:237] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:57.175873 22393 raft_consensus.cc:606] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:18:57.182832 22469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:57.183463 22469 raft_consensus.cc:606] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:57.185020 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:18:57.188406 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:57.196171 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:57.200049 23122 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 13 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:18:57.207671 22393 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:18:57.209357 27373 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:57.210319 22543 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:18:57.212520 27373 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:57.214013 27642 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:57.224383 27704 raft_consensus.cc:993] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:57.225378 27709 raft_consensus.cc:1081] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:57.240305 27720 raft_consensus.cc:1064] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:18:57.240685 23125 raft_consensus.cc:1217] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 12:18:57.249501 27720 consensus_queue.cc:237] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:57.268477 22543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54496
I20260709 12:18:57.269688 22543 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:57.270699 22543 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:57.304334 22543 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:57.306236 22543 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:57.307449 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:57.308096 22401 raft_consensus.cc:3055] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:57.308379 22401 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:57.309294 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:57.309119 22401 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:57.309867 22469 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:57.310410 22401 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:57.317286 22401 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:18:57.317497 23125 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 12 LEARNER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:57.322806 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:57.322741 27709 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:57.328758 22543 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:57.331521 22474 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:57.336503 27693 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:57.338027 27709 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:57.341724 22469 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:18:57.356134 27704 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:57.357599 27733 raft_consensus.cc:2955] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:57.363312 23122 raft_consensus.cc:2955] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:18:57.433300 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 100877us
I20260709 12:18:57.422065 27693 raft_consensus.cc:697] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:57.435570 22297 catalog_manager.cc:5697] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 9 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:57.481194 27693 consensus_queue.cc:237] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:57.542505 27756 log.cc:927] Time spent T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.053s	user 0.000s	sys 0.007s
I20260709 12:18:57.543239 27730 raft_consensus.cc:993] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
W20260709 12:18:57.547658 27747 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.145s	user 0.007s	sys 0.000s
I20260709 12:18:57.546324 27730 raft_consensus.cc:1081] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
W20260709 12:18:57.555137 27753 log.cc:927] Time spent T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.129s	user 0.005s	sys 0.000s
W20260709 12:18:57.558959 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 84732.2us
W20260709 12:18:57.569219 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 122941us
I20260709 12:18:57.579557 22543 raft_consensus.cc:2955] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:57.617480 22469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36296
I20260709 12:18:57.618175 22469 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:57.618541 22469 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:57.610484 22393 raft_consensus.cc:2955] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:57.636482 22469 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:57.655476 22293 catalog_manager.cc:5697] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 17 to 18, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 18 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:57.674088 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:57.674748 22397 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:57.710279 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 58556.5us
I20260709 12:18:57.733551 22397 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 21.
I20260709 12:18:57.732775 27768 raft_consensus.cc:2955] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:57.752202 23122 raft_consensus.cc:2955] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:57.757745 22442 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:57.760109 22469 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:18:57.770988 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 94827.1us
I20260709 12:18:57.777246 27733 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:57.816743 22543 raft_consensus.cc:2955] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:57.828214 27733 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:57.829613 27642 raft_consensus.cc:993] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:18:57.830184 27642 raft_consensus.cc:1081] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:18:57.835215 22393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:18:57.835884 22393 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:57.836283 22393 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:57.829344 27733 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:57.845170 22393 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:18:57.850575 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 44386.3us
W20260709 12:18:57.851441 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 135896us
I20260709 12:18:57.878980 22393 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:57.890108 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:57.890781 22546 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:57.900971 22546 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:57.912153 22366 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:57.917598 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:57.918398 22545 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:57.918741 22545 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:57.919566 22545 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:57.914146 27768 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:57.925639 27768 raft_consensus.cc:697] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:57.926594 27768 consensus_queue.cc:237] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:57.920825 22545 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:57.952484 22545 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 21.
I20260709 12:18:57.955214 22474 raft_consensus.cc:2955] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:57.961820 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:57.962477 22471 raft_consensus.cc:3055] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:57.962778 22471 raft_consensus.cc:740] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:57.963512 22471 consensus_queue.cc:260] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:57.964552 22471 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:57.975629 22469 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:57.988121 22471 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:18:57.988720 22545 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:58.008971 27782 raft_consensus.cc:1064] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:18:58.011729 27782 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:58.027981 22296 catalog_manager.cc:5697] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 8 to 9, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:58.032657 22299 catalog_manager.cc:5697] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 20 to 21, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 21 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.041244 22393 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:18:58.050805 23122 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 12 LEARNER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:58.051432 27761 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:58.055313 27761 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:58.063544 22474 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:58.066140 22393 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:58.080963 27782 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:58.084936 22469 consensus_queue.cc:237] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:58.092764 27761 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:58.109944 23128 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:18:58.099293 22297 catalog_manager.cc:5697] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 11 to 12, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 12 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.119225 27779 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:18:58.161026 22400 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:18:58.170053 22469 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:18:58.185105 27730 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:18:58.188915 27761 raft_consensus.cc:2955] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:58.182689 27698 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:18:58.302560 22393 consensus_queue.cc:237] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:58.306121 27779 raft_consensus.cc:2955] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:58.306265 23122 raft_consensus.cc:2955] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:58.316399 22551 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:58.317879 27767 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:58.318440 23128 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:58.331964 27720 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:18:58.336143 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 57219.2us
I20260709 12:18:58.346104 22393 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:18:58.349323 22393 raft_consensus.cc:2955] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:58.353045 27768 raft_consensus.cc:2955] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:58.361646 27642 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:58.361044 22551 raft_consensus.cc:2955] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:58.367957 22297 catalog_manager.cc:5697] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 10 to 11, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:58.396203 22400 raft_consensus.cc:2955] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:18:58.403442 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 68824.5us
I20260709 12:18:58.407711 23122 raft_consensus.cc:2955] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:58.425180 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet beb931ddd9ec4606a06a5fd9dbc6322e with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:58.446684 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:58.447553 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c837f3ed639d47cc8258ce902cca0154 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:58.449169 22472 raft_consensus.cc:2955] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:58.461560 22293 catalog_manager.cc:5697] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index 9 to 10, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New cstate: current_term: 12 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:58.466836 23125 raft_consensus.cc:2955] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:58.481990 22476 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:58.482578 22551 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:18:58.487275 22299 catalog_manager.cc:5697] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 10 to 11, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:18:58.490402 27795 log.cc:927] Time spent T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:18:58.532246 22551 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:58.563251 22538 tablet_service.cc:1558] Processing DeleteTablet for tablet c837f3ed639d47cc8258ce902cca0154 with delete_type TABLET_DATA_TOMBSTONED (TS 8c3bcfa13ca74a24ab8999a408532932 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:54490
I20260709 12:18:58.567008 27797 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:18:58.571918 22458 tablet_service.cc:1558] Processing DeleteTablet for tablet beb931ddd9ec4606a06a5fd9dbc6322e with delete_type TABLET_DATA_TOMBSTONED (TS 25ebf14868c042dca42f54b3e251e1b2 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:51846
I20260709 12:18:58.580302 22549 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:58.580073 27778 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:58.625154 27800 tablet_replica.cc:333] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:18:58.623438 27751 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:18:58.637352 22399 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:18:58.647656 23125 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:18:58.669188 27801 tablet_replica.cc:333] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:18:58.671525 27717 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:18:58.709059 27801 raft_consensus.cc:2243] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:58.709990 27801 raft_consensus.cc:2272] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:58.721364 27780 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:18:58.722894 27801 ts_tablet_manager.cc:1916] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:58.757452 27800 raft_consensus.cc:2243] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:58.758571 27800 raft_consensus.cc:2272] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:58.761709 27800 ts_tablet_manager.cc:1916] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:58.796646 22400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:18:58.797405 22400 raft_consensus.cc:606] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:18:58.807655 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 93878.4us
I20260709 12:18:58.851092 27759 raft_consensus.cc:2955] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:58.857136 23125 raft_consensus.cc:2955] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:58.862636 22400 raft_consensus.cc:2955] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:18:58.879072 22546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "444001888258449e8c4f5fd4ad540389"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:18:58.879796 22546 raft_consensus.cc:606] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:18:58.892774 22284 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a60334567abd4be7b4e9f6f2e754d015 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:58.897938 27693 raft_consensus.cc:993] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:18:58.900149 27693 raft_consensus.cc:1081] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:18:58.931128 22472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "444001888258449e8c4f5fd4ad540389"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36296
I20260709 12:18:58.931757 22472 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:58.932148 22472 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:58.933555 27787 log.cc:927] Time spent T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.058s	user 0.010s	sys 0.000s
I20260709 12:18:58.989095 22296 catalog_manager.cc:5697] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index 11 to 12, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New cstate: current_term: 12 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.005054 22458 tablet_service.cc:1558] Processing DeleteTablet for tablet a60334567abd4be7b4e9f6f2e754d015 with delete_type TABLET_DATA_TOMBSTONED (TS 25ebf14868c042dca42f54b3e251e1b2 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:51846
I20260709 12:18:59.010419 22468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:59.011080 22468 raft_consensus.cc:606] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:18:59.030400 22476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "65951063312d4a1e9123f92354101c71"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:18:59.031031 22476 raft_consensus.cc:606] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Received request to transfer leadership to TS 65951063312d4a1e9123f92354101c71
I20260709 12:18:59.031183 27777 raft_consensus.cc:993] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:18:59.033181 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:18:59.033134 27765 raft_consensus.cc:1081] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:18:59.035066 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:59.035861 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:59.043717 27801 ts_tablet_manager.cc:1929] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 12:18:59.044243 27801 log.cc:1199] T beb931ddd9ec4606a06a5fd9dbc6322e P 25ebf14868c042dca42f54b3e251e1b2: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-1-root/wals/beb931ddd9ec4606a06a5fd9dbc6322e
I20260709 12:18:59.045989 22285 catalog_manager.cc:5028] TS 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): tablet beb931ddd9ec4606a06a5fd9dbc6322e (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:18:59.048748 27800 ts_tablet_manager.cc:1929] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 12:18:59.050328 27800 log.cc:1199] T c837f3ed639d47cc8258ce902cca0154 P 8c3bcfa13ca74a24ab8999a408532932: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-2-root/wals/c837f3ed639d47cc8258ce902cca0154
I20260709 12:18:59.052299 22284 catalog_manager.cc:5028] TS 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): tablet c837f3ed639d47cc8258ce902cca0154 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:18:59.057538 22397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:18:59.058177 22397 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.058557 22397 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:59.065286 22472 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:59.067448 22472 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:59.072363 27752 raft_consensus.cc:993] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:59.073096 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:59.074782 22397 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:59.086933 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:59.098297 27752 raft_consensus.cc:1081] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:18:59.098732 22551 raft_consensus.cc:3055] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:59.099061 22551 raft_consensus.cc:740] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:59.099828 22551 consensus_queue.cc:260] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:59.100158 22546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54496
I20260709 12:18:59.100732 22546 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.100930 22551 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:59.101097 22546 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:59.103308 22397 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:18:59.098237 22393 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:59.104008 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:59.104614 22468 raft_consensus.cc:3055] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:59.104935 22468 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:59.105674 22468 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:59.106951 22468 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:59.114694 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:18:59.115353 22544 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:59.127056 22393 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:59.130405 22544 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:18:59.131556 22442 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:59.131696 22366 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:59.132484 27752 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:59.132966 27752 raft_consensus.cc:697] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:59.133528 27803 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:59.134219 27803 raft_consensus.cc:697] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:59.133878 27752 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:59.135110 27803 consensus_queue.cc:237] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:59.133884 22551 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:18:59.141945 22546 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:59.156365 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:59.156980 22397 raft_consensus.cc:3055] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:59.157271 22397 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:18:59.158069 22397 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:59.159111 22397 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:59.162475 27801 tablet_replica.cc:333] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:18:59.162760 22293 catalog_manager.cc:5697] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 12 to 13, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.169121 22546 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:59.170179 22468 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:18:59.171097 22397 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:18:59.170748 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:59.174485 27801 raft_consensus.cc:2243] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:59.191942 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:18:59.193807 27801 raft_consensus.cc:2272] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:59.194103 27810 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:59.194670 27810 raft_consensus.cc:697] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:18:59.195593 27810 consensus_queue.cc:237] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:18:59.225164 22472 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:59.235165 27801 ts_tablet_manager.cc:1916] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:59.288026 22293 catalog_manager.cc:5697] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 16 to 17, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 17 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:59.410676 22472 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:18:59.459483 27733 raft_consensus.cc:993] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 65951063312d4a1e9123f92354101c71 to start an election
I20260709 12:18:59.460031 27733 raft_consensus.cc:1081] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Signalling peer 65951063312d4a1e9123f92354101c71 to start an election
I20260709 12:18:59.464686 23125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154"
dest_uuid: "65951063312d4a1e9123f92354101c71"
 from {username='slave'} at 127.0.0.1:41012
I20260709 12:18:59.465339 23125 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.465703 23125 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:59.507899 23125 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:18:59.513052 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 85700.8us
I20260709 12:18:59.524228 23125 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:18:59.526598 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:18:59.527539 22468 raft_consensus.cc:3055] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:59.527894 22468 raft_consensus.cc:740] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:18:59.528788 22468 consensus_queue.cc:260] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:59.529974 22468 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:59.531255 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:18:59.531948 22400 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:59.538868 22468 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 14.
I20260709 12:18:59.550616 22400 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 14.
I20260709 12:18:59.556053 23095 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:18:59.557235 27794 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:59.557824 27794 raft_consensus.cc:697] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 14 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:18:59.558708 27794 consensus_queue.cc:237] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:18:59.576419 22293 catalog_manager.cc:5697] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 16 to 17, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 17 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.608369 22397 raft_consensus.cc:1240] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:59.616725 22397 raft_consensus.cc:1275] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:59.618100 27801 ts_tablet_manager.cc:1929] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.11
I20260709 12:18:59.618641 27801 log.cc:1199] T a60334567abd4be7b4e9f6f2e754d015 P 25ebf14868c042dca42f54b3e251e1b2: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-1-root/wals/a60334567abd4be7b4e9f6f2e754d015
I20260709 12:18:59.624593 22285 catalog_manager.cc:5028] TS 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): tablet a60334567abd4be7b4e9f6f2e754d015 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:18:59.632084 27733 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:18:59.646178 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 64401.2us
W20260709 12:18:59.651556 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 70673.8us
I20260709 12:18:59.685395 22546 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:59.694967 22293 catalog_manager.cc:5697] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 13 to 14, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 14 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:59.714586 22398 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:18:59.719002 27823 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:59.740760 27709 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:59.746891 22546 raft_consensus.cc:1275] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:59.757681 22468 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:59.765461 27817 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:59.760257 27777 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:59.877449 22468 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:18:59.879135 27822 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:00.091292 22397 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:00.093212 27773 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:00.128656 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:00.153504 22476 consensus_queue.cc:237] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:00.178781 22468 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:00.180668 27794 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:00.196193 22398 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:00.197743 27698 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:00.204054 22551 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:00.209901 27733 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:19:00.223937 22472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "444001888258449e8c4f5fd4ad540389"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:00.224563 22472 raft_consensus.cc:606] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:00.227367 22441 consensus_peers.cc:597] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 453901cb626f4358bcfa980bf0d03ea4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:00.242125 22544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:19:00.241443 27777 raft_consensus.cc:2955] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:00.243623 22544 raft_consensus.cc:606] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:00.248108 22401 raft_consensus.cc:2955] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:00.252655 22544 raft_consensus.cc:2955] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:00.267243 22543 consensus_queue.cc:237] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:00.270004 22546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:19:00.271914 22546 raft_consensus.cc:606] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:00.282007 22398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
W20260709 12:19:00.282241 22515 consensus_peers.cc:597] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b2850432f3942ddadf16c096755b5b5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:00.282785 22398 raft_consensus.cc:606] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:00.282677 27803 raft_consensus.cc:993] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:00.283550 27803 raft_consensus.cc:1081] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:00.285351 22401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "444001888258449e8c4f5fd4ad540389"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:19:00.285990 22401 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:00.286352 22401 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:00.286290 22293 catalog_manager.cc:5697] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index -1 to 7, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 9 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:00.295920 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:19:00.297863 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:00.298452 22401 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:00.299903 22476 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:00.300782 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:00.302460 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:00.303081 22476 raft_consensus.cc:3055] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:00.303378 22476 raft_consensus.cc:740] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:00.304085 22476 consensus_queue.cc:260] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:00.304431 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:00.303498 22401 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:00.305002 22544 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:00.309448 22398 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:00.313067 27822 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:00.305154 22476 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:00.322950 22544 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:00.324796 22476 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:00.324630 22366 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:00.333391 27797 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:00.333942 27797 raft_consensus.cc:697] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:00.334776 27797 consensus_queue.cc:237] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:00.342453 27780 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:00.367038 27823 raft_consensus.cc:2955] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:00.369356 22469 raft_consensus.cc:2955] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:00.402913 22398 raft_consensus.cc:2955] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:00.422902 22401 consensus_queue.cc:237] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:00.435117 22544 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:19:00.436870 22366 consensus_peers.cc:597] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8462358d27c41a9a8e75c2021a10a4a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:00.439395 27775 raft_consensus.cc:993] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:00.439925 27775 raft_consensus.cc:1081] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:00.441937 22469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36296
I20260709 12:19:00.442516 22469 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:00.442843 22469 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:00.443017 22472 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:00.444536 27797 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:00.448027 27819 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:00.451004 22469 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:00.454046 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:00.454653 22398 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:00.462265 22398 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:00.464031 22442 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:00.465035 27820 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:00.465576 27820 raft_consensus.cc:697] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:00.466320 22469 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:00.467845 27822 raft_consensus.cc:993] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:00.468341 27823 raft_consensus.cc:1081] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:00.468616 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:00.469183 22546 raft_consensus.cc:3055] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:00.469470 22546 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:00.470408 22546 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:00.471467 22546 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:00.466491 27820 consensus_queue.cc:237] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:00.484791 22398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48924
I20260709 12:19:00.485479 22398 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:00.485873 22398 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:00.498934 22398 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:00.500795 22398 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:00.502424 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:00.502987 23122 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:00.503952 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:00.504540 22549 raft_consensus.cc:3055] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:00.504805 22549 raft_consensus.cc:740] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:00.505545 22549 consensus_queue.cc:260] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:00.506589 22549 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:00.500917 22299 catalog_manager.cc:5697] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 13 to 14, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 14 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:00.516295 22299 catalog_manager.cc:5697] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index -1 to 8, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 11 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:00.527118 23122 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:19:00.549089 22546 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:00.558426 22366 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:19:00.586025 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 52310.8us
I20260709 12:19:00.586308 27818 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:00.586992 27818 raft_consensus.cc:697] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:00.587935 27818 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:00.596800 27819 raft_consensus.cc:993] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:00.597368 27709 raft_consensus.cc:1081] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:00.604604 22551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54496
I20260709 12:19:00.605201 22551 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:00.605576 22551 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:00.617012 22551 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:00.625207 22549 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:19:00.622105 22551 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:00.644765 22299 catalog_manager.cc:5697] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 17 to 18, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 18 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:00.650266 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:00.650903 22469 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:00.655673 22297 catalog_manager.cc:5697] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 12 to 13, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 13 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:00.670554 22469 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:19:00.679136 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:00.679721 22397 raft_consensus.cc:3055] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:00.679955 22397 raft_consensus.cc:740] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:00.685489 22397 consensus_queue.cc:260] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:00.686774 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:00.687677 27823 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:00.688191 27823 raft_consensus.cc:697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:00.689069 27823 consensus_queue.cc:237] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:00.698163 22397 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:00.703604 27819 raft_consensus.cc:2955] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:00.713014 22544 raft_consensus.cc:2955] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:00.714722 22397 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:19:00.722244 22469 raft_consensus.cc:2955] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:00.744570 22297 catalog_manager.cc:5697] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index -1 to 11, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 15 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:00.766727 22472 consensus_queue.cc:237] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:00.783923 22299 catalog_manager.cc:5697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 11 to 12, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 12 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:00.818554 27856 ts_tablet_manager.cc:933] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:00.818126 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 71336.2us
I20260709 12:19:00.825717 27857 ts_tablet_manager.cc:933] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:00.829293 22549 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:19:00.829497 22441 consensus_peers.cc:597] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7c8d517a42b486fab919998ad1e7e07. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:00.831458 22397 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:19:00.830430 27777 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:19:00.833716 27820 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:00.858443 27856 tablet_copy_client.cc:323] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.3:38645
I20260709 12:19:00.880040 27820 raft_consensus.cc:2955] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:00.883548 22544 raft_consensus.cc:1275] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:00.883854 22399 raft_consensus.cc:2955] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:00.885970 27818 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:00.922534 22560 tablet_copy_service.cc:140] P 8c3bcfa13ca74a24ab8999a408532932: Received BeginTabletCopySession request for tablet 5b2850432f3942ddadf16c096755b5b5 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:49290)
I20260709 12:19:00.923272 22560 tablet_copy_service.cc:161] P 8c3bcfa13ca74a24ab8999a408532932: Beginning new tablet copy session on tablet 5b2850432f3942ddadf16c096755b5b5 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:49290: session id = 65951063312d4a1e9123f92354101c71-5b2850432f3942ddadf16c096755b5b5
I20260709 12:19:00.927330 27857 tablet_copy_client.cc:323] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.2:46187
I20260709 12:19:00.932758 22487 tablet_copy_service.cc:140] P 25ebf14868c042dca42f54b3e251e1b2: Received BeginTabletCopySession request for tablet 453901cb626f4358bcfa980bf0d03ea4 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:43060)
I20260709 12:19:00.933540 22487 tablet_copy_service.cc:161] P 25ebf14868c042dca42f54b3e251e1b2: Beginning new tablet copy session on tablet 453901cb626f4358bcfa980bf0d03ea4 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:43060: session id = 65951063312d4a1e9123f92354101c71-453901cb626f4358bcfa980bf0d03ea4
I20260709 12:19:00.949427 22549 raft_consensus.cc:2955] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:00.974483 22487 tablet_copy_source_session.cc:215] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:00.975258 22560 tablet_copy_source_session.cc:215] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:00.978703 22468 raft_consensus.cc:1275] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:00.982167 27857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 453901cb626f4358bcfa980bf0d03ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:00.977348 22293 catalog_manager.cc:5697] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index -1 to 10, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 16 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:01.014132 22544 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:19:01.032852 27819 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:01.034935 27803 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:19:01.039937 27856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2850432f3942ddadf16c096755b5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:01.047806 22398 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:19:01.060788 27698 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 12:19:01.139504 27857 tablet_copy_client.cc:806] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:01.140678 27857 tablet_copy_client.cc:670] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:01.145296 27857 tablet_copy_client.cc:538] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:01.155174 23125 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:19:01.157299 27819 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:01.163563 27857 tablet_bootstrap.cc:492] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:19:01.167580 27866 ts_tablet_manager.cc:933] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:19:01.174583 22549 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 12:19:01.203236 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 98196.2us
I20260709 12:19:01.223798 27797 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:01.267938 22469 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:01.261571 27856 tablet_copy_client.cc:806] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
W20260709 12:19:01.318943 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 47173.9us
I20260709 12:19:01.291720 27856 tablet_copy_client.cc:670] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
W20260709 12:19:01.343825 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 63802.5us
W20260709 12:19:01.391551 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 46883.5us
I20260709 12:19:01.359614 27866 tablet_copy_client.cc:323] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.1:37927
I20260709 12:19:01.408349 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:01.416637 27885 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:01.399194 27856 tablet_copy_client.cc:538] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:01.461663 22399 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:19:01.564939 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 79677.7us
I20260709 12:19:01.542016 22411 tablet_copy_service.cc:140] P b8621fa34be04d3fa2d68a300f858cd1: Received BeginTabletCopySession request for tablet f8462358d27c41a9a8e75c2021a10a4a from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:58054)
W20260709 12:19:01.577291 27872 log.cc:927] Time spent T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.148s	user 0.004s	sys 0.000s
I20260709 12:19:01.585796 22411 tablet_copy_service.cc:161] P b8621fa34be04d3fa2d68a300f858cd1: Beginning new tablet copy session on tablet f8462358d27c41a9a8e75c2021a10a4a from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:58054: session id = 65951063312d4a1e9123f92354101c71-f8462358d27c41a9a8e75c2021a10a4a
I20260709 12:19:01.592893 22411 tablet_copy_source_session.cc:215] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:01.630684 27883 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:01.634035 27866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8462358d27c41a9a8e75c2021a10a4a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:01.642800 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 46874.7us
I20260709 12:19:01.663393 27856 tablet_bootstrap.cc:492] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
W20260709 12:19:01.735944 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 58596.4us
W20260709 12:19:01.745251 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 59811.9us
I20260709 12:19:01.746788 27898 ts_tablet_manager.cc:933] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:01.791917 27898 tablet_copy_client.cc:323] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.2:46187
W20260709 12:19:01.809330 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 353031us
W20260709 12:19:01.837471 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 82437.4us
W20260709 12:19:01.905691 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 145083us
I20260709 12:19:01.932358 22396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:19:01.933054 22396 raft_consensus.cc:606] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:01.934161 22487 tablet_copy_service.cc:140] P 25ebf14868c042dca42f54b3e251e1b2: Received BeginTabletCopySession request for tablet c7c8d517a42b486fab919998ad1e7e07 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:43060)
I20260709 12:19:01.934712 22487 tablet_copy_service.cc:161] P 25ebf14868c042dca42f54b3e251e1b2: Beginning new tablet copy session on tablet c7c8d517a42b486fab919998ad1e7e07 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:43060: session id = 65951063312d4a1e9123f92354101c71-c7c8d517a42b486fab919998ad1e7e07
I20260709 12:19:01.950197 22549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:19:01.950925 22549 raft_consensus.cc:606] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:01.971212 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:01.971820 22477 raft_consensus.cc:606] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:02.012892 22401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:19:02.013511 22401 raft_consensus.cc:606] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:02.018885 22544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:19:02.019596 22544 raft_consensus.cc:606] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:02.020727 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:02.022555 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:02.023411 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:02.032997 27866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41028 (request call id 718) took 1034 ms. Trace:
I20260709 12:19:02.033756 27866 rpcz_store.cc:276] 0709 12:19:00.998664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.998855 (+   191us) service_pool.cc:224] Handling call
0709 12:19:01.201697 (+202842us) ts_tablet_manager.cc:934] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
0709 12:19:01.632684 (+430987us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:19:01.835976 (+203292us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:01.855363 (+ 19387us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:19:02.028081 (+172718us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:19:02.028429 (+   348us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:02.032838 (+  4409us) ts_tablet_manager.cc:989] Replica registered.
0709 12:19:02.032926 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":67992,"tablet-copy.queue_time_us":168180,"thread_start_us":153017,"threads_started":2}
I20260709 12:19:02.043607 22487 tablet_copy_source_session.cc:215] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:19:02.060334 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 176431us
I20260709 12:19:02.083904 27797 raft_consensus.cc:993] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:02.084462 27797 raft_consensus.cc:1081] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:02.077579 27866 tablet_copy_client.cc:806] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:02.104848 27898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c8d517a42b486fab919998ad1e7e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:02.109700 27823 raft_consensus.cc:993] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:02.110282 27823 raft_consensus.cc:1081] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:02.113102 27866 tablet_copy_client.cc:670] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
W20260709 12:19:02.121156 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 45671.8us
I20260709 12:19:02.121570 22393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48924
I20260709 12:19:02.122197 22393 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:02.122581 22393 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:02.127909 22551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54496
I20260709 12:19:02.128566 22551 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:02.128957 22551 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:02.131906 22393 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:02.146333 27866 tablet_copy_client.cc:538] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:02.154201 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:02.155031 22477 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:02.167311 22393 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:02.172559 22551 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:02.180095 22477 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:19:02.207563 22551 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:02.212406 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:02.212971 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:02.213181 23122 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:02.213528 22544 raft_consensus.cc:3055] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:02.213886 22544 raft_consensus.cc:740] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:02.214596 22544 consensus_queue.cc:260] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:02.229086 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:02.229892 22396 raft_consensus.cc:3055] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:02.231353 22396 raft_consensus.cc:740] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:02.232187 23122 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:02.234148 22515 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:02.235908 22367 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:02.236917 22544 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:02.232187 22396 consensus_queue.cc:260] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:02.291149 22396 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:02.300546 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 64686.9us
I20260709 12:19:02.326104 22396 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:02.318271 27841 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:02.336664 27841 raft_consensus.cc:697] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:02.337638 27841 consensus_queue.cc:237] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:02.329255 27878 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:02.344846 27878 raft_consensus.cc:697] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:02.345723 27878 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:02.359125 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 52776.3us
I20260709 12:19:02.333557 22544 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:19:02.345599 27866 tablet_bootstrap.cc:492] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
W20260709 12:19:02.387714 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 153646us
W20260709 12:19:02.388302 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 133006us
I20260709 12:19:02.467696 22299 catalog_manager.cc:5697] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 13 to 14, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 14 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:02.485042 27881 raft_consensus.cc:993] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:02.485846 27898 tablet_copy_client.cc:806] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:02.486564 27898 tablet_copy_client.cc:670] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:02.485603 27881 raft_consensus.cc:1081] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:02.501046 27857 tablet_bootstrap.cc:492] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:02.505964 27857 tablet_bootstrap.cc:492] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:19:02.506953 27857 ts_tablet_manager.cc:1403] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 1.344s	user 0.036s	sys 0.018s
I20260709 12:19:02.522615 27920 raft_consensus.cc:993] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:02.523370 27890 raft_consensus.cc:1081] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:02.528183 27886 raft_consensus.cc:993] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:02.528831 27886 raft_consensus.cc:1081] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:02.542275 22468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36286
I20260709 12:19:02.542876 22468 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:02.543251 22468 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:02.551731 22551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54498
I20260709 12:19:02.552340 22551 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:02.552668 22551 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:02.547650 22293 catalog_manager.cc:5697] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 14 to 15, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 15 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:02.575397 27898 tablet_copy_client.cc:538] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:02.583382 27856 tablet_bootstrap.cc:492] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:02.563292 27857 raft_consensus.cc:359] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:02.584663 22469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36296
I20260709 12:19:02.603009 27857 raft_consensus.cc:740] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:19:02.603163 22469 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:02.603672 22469 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:02.603930 27857 consensus_queue.cc:260] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:02.617300 22469 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:02.620951 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:02.622108 22396 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:02.624432 22551 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:02.631203 27857 ts_tablet_manager.cc:1434] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.123s	user 0.004s	sys 0.005s
I20260709 12:19:02.634068 27856 tablet_bootstrap.cc:492] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:19:02.647470 22487 tablet_copy_service.cc:342] P 25ebf14868c042dca42f54b3e251e1b2: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-453901cb626f4358bcfa980bf0d03ea4 received from {username='slave'} at 127.0.0.1:43060
I20260709 12:19:02.647981 22487 tablet_copy_service.cc:434] P 25ebf14868c042dca42f54b3e251e1b2: ending tablet copy session 65951063312d4a1e9123f92354101c71-453901cb626f4358bcfa980bf0d03ea4 on tablet 453901cb626f4358bcfa980bf0d03ea4 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:19:02.637575 22469 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:02.638895 22468 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:02.640130 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:02.648084 27856 ts_tablet_manager.cc:1403] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.985s	user 0.042s	sys 0.046s
I20260709 12:19:02.650615 22545 raft_consensus.cc:3055] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:02.643122 22396 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:19:02.651120 22545 raft_consensus.cc:740] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:02.651908 22545 consensus_queue.cc:260] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:02.652832 22545 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:02.653466 22551 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:02.652263 22442 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:02.654520 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:02.655082 23125 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:02.659292 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:02.659973 23128 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:02.663944 27856 raft_consensus.cc:359] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:02.665599 27856 raft_consensus.cc:740] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:19:02.666396 27856 consensus_queue.cc:260] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:02.667634 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:02.668536 22396 raft_consensus.cc:3055] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:02.668989 22396 raft_consensus.cc:740] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:02.669941 22396 consensus_queue.cc:260] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:02.671357 22396 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:02.675066 22468 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:02.676156 23128 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:19:02.679296 22441 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:19:02.680209 22401 raft_consensus.cc:1240] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:02.680570 27879 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:02.680588 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:02.667816 27894 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:02.681947 22469 raft_consensus.cc:3055] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:02.685932 22469 raft_consensus.cc:740] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:02.686386 23125 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:02.686802 22469 consensus_queue.cc:260] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:02.688038 22469 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:02.692322 27894 raft_consensus.cc:697] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:02.693502 27894 consensus_queue.cc:237] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:02.698513 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.706202 27879 raft_consensus.cc:697] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:02.708632 27898 tablet_bootstrap.cc:492] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:19:02.707450 27879 consensus_queue.cc:237] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:02.726610 22469 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:02.712010 22396 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:19:02.731547 22545 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
W20260709 12:19:02.730672 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 47043.1us
I20260709 12:19:02.743283 22515 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:02.745467 27915 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:02.746131 27915 raft_consensus.cc:697] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:02.747141 27915 consensus_queue.cc:237] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:02.670178 27856 ts_tablet_manager.cc:1434] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
W20260709 12:19:02.779176 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 45870.3us
I20260709 12:19:02.783135 22560 tablet_copy_service.cc:342] P 8c3bcfa13ca74a24ab8999a408532932: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-5b2850432f3942ddadf16c096755b5b5 received from {username='slave'} at 127.0.0.1:49290
I20260709 12:19:02.783669 22560 tablet_copy_service.cc:434] P 8c3bcfa13ca74a24ab8999a408532932: ending tablet copy session 65951063312d4a1e9123f92354101c71-5b2850432f3942ddadf16c096755b5b5 on tablet 5b2850432f3942ddadf16c096755b5b5 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:19:02.786566 22297 catalog_manager.cc:5697] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 10 to 11, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 11 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:02.929589 23128 raft_consensus.cc:1217] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 12:19:02.922384 22468 raft_consensus.cc:1275] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:02.934749 23125 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:19:02.937673 27906 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:19:02.936630 27915 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 12:19:02.965561 22396 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:19:02.970779 22545 raft_consensus.cc:1275] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:02.976562 27906 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:19:03.001204 27775 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:03.036216 23123 raft_consensus.cc:1217] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
W20260709 12:19:03.115242 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 43703.9us
I20260709 12:19:03.149580 22293 catalog_manager.cc:5697] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 16 to 17, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 17 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:03.203766 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:03.204972 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 135153us
I20260709 12:19:03.234573 22401 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:03.249055 27916 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:03.259167 22472 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:19:03.260679 27878 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:19:03.347733 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 73256.3us
I20260709 12:19:03.376958 22400 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:03.388212 27884 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:03.398394 22297 catalog_manager.cc:5697] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 12 to 13, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:03.402556 27866 tablet_bootstrap.cc:492] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:03.403962 27866 tablet_bootstrap.cc:492] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:19:03.404800 27866 ts_tablet_manager.cc:1403] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 1.060s	user 0.056s	sys 0.015s
I20260709 12:19:03.489951 23128 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:03.508306 23125 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:19:03.517818 27823 raft_consensus.cc:1064] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:19:03.517342 27866 raft_consensus.cc:359] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:03.524024 27866 raft_consensus.cc:740] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:19:03.595641 27866 consensus_queue.cc:260] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:03.598557 27866 ts_tablet_manager.cc:1434] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.192s	user 0.007s	sys 0.002s
I20260709 12:19:03.600780 27898 tablet_bootstrap.cc:492] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:03.614089 27898 tablet_bootstrap.cc:492] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:19:03.615105 27898 ts_tablet_manager.cc:1403] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.907s	user 0.047s	sys 0.033s
W20260709 12:19:03.619853 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 122367us
I20260709 12:19:03.635453 22411 tablet_copy_service.cc:342] P b8621fa34be04d3fa2d68a300f858cd1: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-f8462358d27c41a9a8e75c2021a10a4a received from {username='slave'} at 127.0.0.1:58054
I20260709 12:19:03.652259 22411 tablet_copy_service.cc:434] P b8621fa34be04d3fa2d68a300f858cd1: ending tablet copy session 65951063312d4a1e9123f92354101c71-f8462358d27c41a9a8e75c2021a10a4a on tablet f8462358d27c41a9a8e75c2021a10a4a with peer 65951063312d4a1e9123f92354101c71
I20260709 12:19:03.675968 27959 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:03.676376 22546 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:03.697309 27897 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:03.707489 23125 raft_consensus.cc:1217] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
W20260709 12:19:03.746222 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 79948.3us
I20260709 12:19:03.753711 22546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:19:03.754449 22546 raft_consensus.cc:606] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:03.770430 27898 raft_consensus.cc:359] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:03.771502 27898 raft_consensus.cc:740] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:19:03.772261 27898 consensus_queue.cc:260] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:03.778072 27898 ts_tablet_manager.cc:1434] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.162s	user 0.008s	sys 0.001s
W20260709 12:19:03.775135 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 123519us
I20260709 12:19:03.796399 27823 consensus_queue.cc:237] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:03.817943 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 60858.5us
I20260709 12:19:03.835079 23125 raft_consensus.cc:1217] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
W20260709 12:19:03.840298 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 92033.6us
W20260709 12:19:03.852504 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 94458.7us
I20260709 12:19:03.879755 27896 raft_consensus.cc:993] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:03.880357 27896 raft_consensus.cc:1081] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:03.882074 22469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:03.882823 22469 raft_consensus.cc:606] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:03.892488 27884 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:03.920650 22472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36296
I20260709 12:19:03.921262 22472 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:03.921627 22472 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:03.924947 22468 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:03.927488 27896 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:03.937525 22472 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:04.029016 22472 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:04.031893 22546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:19:03.957197 23125 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 11 LEARNER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:04.015702 22398 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:04.048270 22546 raft_consensus.cc:606] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:04.109319 22487 tablet_copy_service.cc:342] P 25ebf14868c042dca42f54b3e251e1b2: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-c7c8d517a42b486fab919998ad1e7e07 received from {username='slave'} at 127.0.0.1:43060
I20260709 12:19:04.110180 22487 tablet_copy_service.cc:434] P 25ebf14868c042dca42f54b3e251e1b2: ending tablet copy session 65951063312d4a1e9123f92354101c71-c7c8d517a42b486fab919998ad1e7e07 on tablet c7c8d517a42b486fab919998ad1e7e07 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:19:04.118377 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:04.120079 27823 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:04.122008 22400 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:04.134227 22399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:19:04.135100 22399 raft_consensus.cc:606] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:04.173671 22400 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:19:04.195832 22398 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:04.192101 22472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:04.206660 22472 raft_consensus.cc:606] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:04.212320 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:04.218134 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:04.219485 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:04.219841 27822 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:04.221588 27896 consensus_queue.cc:1059] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:04.222661 27822 raft_consensus.cc:3055] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:04.223158 27822 raft_consensus.cc:740] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:04.224436 27822 consensus_queue.cc:260] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:04.226461 27822 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:04.231891 27906 raft_consensus.cc:1064] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:19:04.245965 22442 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:04.247627 27886 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:04.248189 27886 raft_consensus.cc:697] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:04.249436 27886 consensus_queue.cc:237] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:04.311537 27906 consensus_queue.cc:237] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:04.338888 27822 raft_consensus.cc:2955] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:04.347681 27960 raft_consensus.cc:1064] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
W20260709 12:19:04.348297 27960 raft_consensus.cc:1068] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2: Unable to promote non-voter 65951063312d4a1e9123f92354101c71: Service unavailable: leader transfer in progress
I20260709 12:19:04.351931 23123 raft_consensus.cc:2955] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:04.420642 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:04.434566 22472 raft_consensus.cc:2955] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:04.441179 22547 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:04.449879 27957 raft_consensus.cc:993] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:04.450450 27957 raft_consensus.cc:1081] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:04.455596 22398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48924
I20260709 12:19:04.456223 22398 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:04.456591 22398 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:04.463146 27881 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:04.463927 27961 raft_consensus.cc:993] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:04.466080 22546 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:19:04.467948 22396 raft_consensus.cc:2955] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:04.465503 27797 raft_consensus.cc:1081] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:04.488344 22398 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:04.504758 22296 catalog_manager.cc:5697] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 12 to 13, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:04.516033 23123 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 LEARNER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:04.500878 22297 catalog_manager.cc:5697] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 8 to 9, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:04.518157 27941 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:04.535734 22468 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:04.537038 22468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36286
I20260709 12:19:04.537564 22468 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:04.537945 22468 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:04.549793 22468 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:04.551396 27897 raft_consensus.cc:993] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:04.555701 27897 raft_consensus.cc:1081] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:04.554663 27941 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:04.558768 22472 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:04.565145 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:04.565826 22400 raft_consensus.cc:3055] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:04.566123 22400 raft_consensus.cc:740] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:04.568385 22546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54498
I20260709 12:19:04.569339 22398 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:04.570369 22468 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:04.571775 22546 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:04.572292 22546 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:04.578545 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:04.568897 22400 consensus_queue.cc:260] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:04.582456 23128 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:04.582957 22400 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:04.587241 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:04.587891 23125 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:04.589915 27906 consensus_queue.cc:1175] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "25ebf14868c042dca42f54b3e251e1b2" responder_term: 11 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:04.579358 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:04.593084 22547 raft_consensus.cc:3055] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:04.593413 22547 raft_consensus.cc:740] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:04.594586 22547 consensus_queue.cc:260] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:04.596326 22547 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:04.597826 22400 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:19:04.600076 22442 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:04.601168 27955 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:04.601677 27955 raft_consensus.cc:697] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:04.602650 27955 consensus_queue.cc:237] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:04.609921 23125 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:19:04.606341 27956 raft_consensus.cc:1064] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
W20260709 12:19:04.613160 27956 raft_consensus.cc:1068] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2: Unable to promote non-voter 65951063312d4a1e9123f92354101c71: Service unavailable: leader transfer in progress
I20260709 12:19:04.630391 22547 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:19:04.655861 23128 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:19:04.665923 22366 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:04.673501 22546 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:04.679566 27886 raft_consensus.cc:993] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:04.682121 27886 raft_consensus.cc:1081] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:04.684242 22398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:19:04.684804 22398 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:04.685189 22398 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:04.685755 27960 raft_consensus.cc:1064] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:19:04.688485 27960 consensus_queue.cc:237] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:04.692145 22546 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:04.692962 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:04.694012 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:04.695756 22400 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:04.695860 22472 raft_consensus.cc:3055] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:04.696343 22472 raft_consensus.cc:740] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:04.697218 22472 consensus_queue.cc:260] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:04.698560 27941 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:04.699128 27941 raft_consensus.cc:697] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:04.699162 22472 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:04.700309 27941 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:04.705150 22544 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:04.707886 27879 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:04.694829 22398 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:04.714880 22400 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:19:04.716241 22516 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:04.723167 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:04.723932 22468 raft_consensus.cc:3055] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:04.724238 22468 raft_consensus.cc:740] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:04.724802 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:04.725528 23125 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:04.725859 22468 consensus_queue.cc:260] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:04.726972 27822 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:04.727510 27822 raft_consensus.cc:697] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:04.726992 22468 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:04.758261 22398 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:04.757791 22474 raft_consensus.cc:2955] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:04.728873 27906 raft_consensus.cc:2955] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:04.721465 22472 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:19:04.773623 22468 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:19:04.728430 27822 consensus_queue.cc:237] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:04.788369 23125 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:19:04.801446 22398 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:19:04.803690 22547 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:19:04.810289 23123 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 16 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:19:04.816880 27955 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:04.818174 27884 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:04.820209 27884 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:04.831022 22367 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:04.832500 27881 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:04.833061 27881 raft_consensus.cc:697] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:04.834074 27881 consensus_queue.cc:237] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:04.877038 22398 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:04.878613 27884 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:04.937243 23125 raft_consensus.cc:2955] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:04.961643 22549 raft_consensus.cc:2955] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:05.035750 27986 log.cc:927] Time spent T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:19:05.047186 22545 consensus_queue.cc:237] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:05.069303 27956 raft_consensus.cc:2955] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:05.083316 22546 raft_consensus.cc:2955] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:05.121318 22293 catalog_manager.cc:5697] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 9 to 10, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 10 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:05.123354 22293 catalog_manager.cc:5697] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index 11 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:05.128345 23125 raft_consensus.cc:2955] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:05.167394 22474 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:05.162389 22299 catalog_manager.cc:5697] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 14 to 15, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 15 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:05.202137 22400 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:05.199108 22299 catalog_manager.cc:5697] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 11 to 12, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 12 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:05.208004 22546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54490
I20260709 12:19:05.208703 22546 raft_consensus.cc:606] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Received request to transfer leadership
I20260709 12:19:05.241731 23125 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:05.215034 27822 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:19:05.259079 22546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54490
I20260709 12:19:05.259708 22546 raft_consensus.cc:606] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Received request to transfer leadership
W20260709 12:19:05.277585 22284 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 453901cb626f4358bcfa980bf0d03ea4 already in progress [suppressed 2 similar messages]
I20260709 12:19:05.283741 22546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54490
I20260709 12:19:05.284380 22546 raft_consensus.cc:606] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Received request to transfer leadership
I20260709 12:19:05.295683 22398 consensus_queue.cc:237] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:05.298522 22347 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:19:05.301514 22347 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 453901cb626f4358bcfa980bf0d03ea4 already in progress
W20260709 12:19:05.301883 22347 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 453901cb626f4358bcfa980bf0d03ea4 already in progress
I20260709 12:19:05.306434 27957 raft_consensus.cc:2955] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:05.314217 22468 raft_consensus.cc:2955] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:05.330096 27896 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:05.333279 23125 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:19:05.336397 23125 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:05.338266 22299 catalog_manager.cc:5697] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 10 to 11, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:05.345434 27990 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:19:05.349318 27990 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:05.351140 22474 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:19:05.353878 27952 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:05.355970 23125 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [term 9 LEARNER]: Advancing to term 10
W20260709 12:19:05.360188 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 156813us
I20260709 12:19:05.362205 22296 catalog_manager.cc:5697] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 10 to 11, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 11 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:05.368268 23123 raft_consensus.cc:2955] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:05.378726 22546 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:19:05.381868 22546 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:05.385792 23129 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:05.388206 23125 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [term 10 LEARNER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:19:05.354784 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 142009us
I20260709 12:19:05.394987 27892 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:05.395716 27960 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:05.392478 22472 consensus_queue.cc:237] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:05.405516 27943 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:05.410560 22400 raft_consensus.cc:2955] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:05.412914 28009 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:05.394228 27990 raft_consensus.cc:2955] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:05.429494 23122 raft_consensus.cc:2955] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:05.468305 22396 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:19:05.473619 22547 raft_consensus.cc:2955] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:05.535566 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 99496.2us
I20260709 12:19:05.546351 23122 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:19:05.556178 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 45808.7us
I20260709 12:19:05.559793 23128 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:05.571063 22397 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:05.578871 27989 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:05.584906 27956 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:05.586614 22469 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:05.616467 27881 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:05.586515 27956 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:19:05.628634 28008 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:05.632369 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f8462358d27c41a9a8e75c2021a10a4a with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:05.652123 28007 raft_consensus.cc:2955] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:05.654992 22398 raft_consensus.cc:2955] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:05.674680 22299 catalog_manager.cc:5697] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index 9 to 10, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New cstate: current_term: 11 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:05.680927 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c7c8d517a42b486fab919998ad1e7e07 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:19:05.685519 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 212695us
I20260709 12:19:05.686390 22284 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5b2850432f3942ddadf16c096755b5b5 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:05.690858 28009 raft_consensus.cc:1064] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
W20260709 12:19:05.691380 28009 raft_consensus.cc:1068] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932: Unable to promote non-voter 65951063312d4a1e9123f92354101c71: Service unavailable: leader transfer in progress
I20260709 12:19:05.714569 22296 catalog_manager.cc:5697] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index 12 to 13, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New cstate: current_term: 15 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:05.743141 28009 raft_consensus.cc:993] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:05.743654 28009 raft_consensus.cc:1081] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:05.758589 22387 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b2850432f3942ddadf16c096755b5b5 with delete_type TABLET_DATA_TOMBSTONED (TS b8621fa34be04d3fa2d68a300f858cd1 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:52914
I20260709 12:19:05.770915 22468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36296
I20260709 12:19:05.771552 22468 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:05.771934 22468 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:05.762768 27822 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:19:05.785498 28025 tablet_replica.cc:333] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:05.786720 28025 raft_consensus.cc:2243] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:05.787567 28025 raft_consensus.cc:2272] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:05.788028 22468 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:05.798590 22469 raft_consensus.cc:1240] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:05.801878 28025 ts_tablet_manager.cc:1916] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:05.807693 22458 tablet_service.cc:1558] Processing DeleteTablet for tablet f8462358d27c41a9a8e75c2021a10a4a with delete_type TABLET_DATA_TOMBSTONED (TS 25ebf14868c042dca42f54b3e251e1b2 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:51846
I20260709 12:19:05.822907 22468 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:05.818708 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:05.830780 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:05.831435 22547 raft_consensus.cc:3055] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:05.832093 22547 raft_consensus.cc:740] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:05.825210 27822 raft_consensus.cc:1064] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:19:05.832845 22547 consensus_queue.cc:260] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:05.836580 22547 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:05.838382 27966 consensus_queue.cc:1175] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "25ebf14868c042dca42f54b3e251e1b2" responder_term: 11 status { last_received { term: 10 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:05.847957 22547 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
W20260709 12:19:05.861263 27822 raft_consensus.cc:1068] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932: Unable to promote non-voter 65951063312d4a1e9123f92354101c71: Illegal state: Replica 8c3bcfa13ca74a24ab8999a408532932 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:05.867811 22296 catalog_manager.cc:5697] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 11 to 12, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New cstate: current_term: 16 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:05.895607 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 59892.9us
I20260709 12:19:05.897732 22441 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:05.902585 27884 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:05.903131 27884 raft_consensus.cc:697] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:05.903977 27884 consensus_queue.cc:237] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:05.907181 23122 raft_consensus.cc:2955] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:05.970247 28027 tablet_replica.cc:333] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:19:05.971463 28027 raft_consensus.cc:2243] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:05.998482 22538 tablet_service.cc:1558] Processing DeleteTablet for tablet c7c8d517a42b486fab919998ad1e7e07 with delete_type TABLET_DATA_TOMBSTONED (TS 8c3bcfa13ca74a24ab8999a408532932 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:54490
I20260709 12:19:05.976759 28027 raft_consensus.cc:2272] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:06.003379 28027 ts_tablet_manager.cc:1916] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:06.028689 22299 catalog_manager.cc:5697] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 10 to 11, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 11 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:06.036274 28028 tablet_replica.cc:333] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:19:06.041168 28028 raft_consensus.cc:2243] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:06.042383 28028 raft_consensus.cc:2272] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:06.053890 28025 ts_tablet_manager.cc:1929] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 12:19:06.069525 28025 log.cc:1199] T 5b2850432f3942ddadf16c096755b5b5 P b8621fa34be04d3fa2d68a300f858cd1: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-0-root/wals/5b2850432f3942ddadf16c096755b5b5
I20260709 12:19:06.073447 22285 catalog_manager.cc:5028] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): tablet 5b2850432f3942ddadf16c096755b5b5 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:19:06.059975 28028 ts_tablet_manager.cc:1916] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:06.073524 28027 ts_tablet_manager.cc:1929] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 12:19:06.090118 28027 log.cc:1199] T f8462358d27c41a9a8e75c2021a10a4a P 25ebf14868c042dca42f54b3e251e1b2: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-1-root/wals/f8462358d27c41a9a8e75c2021a10a4a
I20260709 12:19:06.092403 22285 catalog_manager.cc:5028] TS 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): tablet f8462358d27c41a9a8e75c2021a10a4a (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:19:06.107398 28028 ts_tablet_manager.cc:1929] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 12:19:06.107973 28028 log.cc:1199] T c7c8d517a42b486fab919998ad1e7e07 P 8c3bcfa13ca74a24ab8999a408532932: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-2-root/wals/c7c8d517a42b486fab919998ad1e7e07
I20260709 12:19:06.109825 22284 catalog_manager.cc:5028] TS 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): tablet c7c8d517a42b486fab919998ad1e7e07 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:19:06.254024 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:06.339975 22546 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:06.342273 27886 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:06.352028 22396 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:06.357367 23122 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [term 10 LEARNER]: Advancing to term 11
I20260709 12:19:06.381129 22397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "277d262725804effb16ede64e81d19c8"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:19:06.388279 22396 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:06.389223 23122 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [term 11 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:06.381696 22397 raft_consensus.cc:606] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:06.393085 27884 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:06.402583 28004 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:06.404887 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:06.406124 22477 raft_consensus.cc:606] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:06.430346 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:06.430949 22477 raft_consensus.cc:606] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:06.436728 22470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "65951063312d4a1e9123f92354101c71"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:06.437407 22470 raft_consensus.cc:606] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Received request to transfer leadership to TS 65951063312d4a1e9123f92354101c71
I20260709 12:19:06.449523 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:19:06.451529 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:06.448248 27884 raft_consensus.cc:1064] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:19:06.452414 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:06.455037 27884 consensus_queue.cc:237] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:06.494868 23122 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [term 11 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:06.497611 28004 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:06.509299 22547 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:06.517287 27956 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:06.531164 22398 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:06.556493 27886 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:06.574281 27955 raft_consensus.cc:2955] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 7 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:06.605335 22549 raft_consensus.cc:2955] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 7 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:06.627245 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 106035us
I20260709 12:19:06.633046 22397 raft_consensus.cc:2955] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 7 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:06.636615 23122 raft_consensus.cc:2955] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 7 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:06.644132 22297 catalog_manager.cc:5697] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 7 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:06.690883 27956 raft_consensus.cc:993] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:06.691464 27956 raft_consensus.cc:1081] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:06.693917 27960 raft_consensus.cc:993] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:06.694404 27960 raft_consensus.cc:1081] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:06.695142 22549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54498
I20260709 12:19:06.695724 22549 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:06.696074 22549 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:06.699627 22546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54498
I20260709 12:19:06.700296 22546 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:06.700646 22546 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:06.707996 22546 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:06.716120 22549 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:06.721329 27955 raft_consensus.cc:993] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 65951063312d4a1e9123f92354101c71 to start an election
I20260709 12:19:06.730752 27955 raft_consensus.cc:1081] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Signalling peer 65951063312d4a1e9123f92354101c71 to start an election
I20260709 12:19:06.723881 22546 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:06.724891 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:06.732268 22470 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:19:06.732645 22470 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:06.733258 23122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec"
dest_uuid: "65951063312d4a1e9123f92354101c71"
 from {username='slave'} at 127.0.0.1:41012
I20260709 12:19:06.733418 22470 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:06.734706 22470 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:06.733934 23122 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:06.725675 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:06.735564 22549 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:06.737550 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:06.736581 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:06.742229 22470 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 22.
I20260709 12:19:06.800798 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:06.801714 28016 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:19:06.799985 22396 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:06.802249 28016 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:06.803485 28016 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:06.804833 23122 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:06.805747 22470 consensus_queue.cc:237] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:06.815369 22396 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:06.813402 22397 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:06.817266 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:06.817641 23123 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:06.820771 27960 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:06.821565 27822 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:06.821985 22477 raft_consensus.cc:3055] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:06.824694 22477 raft_consensus.cc:740] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:06.822064 27822 raft_consensus.cc:697] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:06.825470 22477 consensus_queue.cc:260] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:06.825920 27822 consensus_queue.cc:237] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:06.826782 22477 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:06.829439 27943 raft_consensus.cc:993] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:06.830005 27943 raft_consensus.cc:1081] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:06.832192 27955 raft_consensus.cc:2955] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:06.839851 23122 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:06.842604 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:06.842947 23123 raft_consensus.cc:2955] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:06.843247 22398 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:06.845088 22397 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 22.
I20260709 12:19:06.845329 22470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "277d262725804effb16ede64e81d19c8"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36286
I20260709 12:19:06.854543 22396 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:06.877044 22470 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:06.877523 22470 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:06.854139 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:06.879462 22468 raft_consensus.cc:3055] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:06.879761 22468 raft_consensus.cc:740] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:06.879088 22293 catalog_manager.cc:5697] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 10 to 11, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New cstate: current_term: 11 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:06.880586 27884 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:06.870085 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 453901cb626f4358bcfa980bf0d03ea4 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:06.884975 22468 consensus_queue.cc:260] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:06.886103 22468 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:06.887341 22400 raft_consensus.cc:2955] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:06.903282 22477 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:06.913040 22468 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:19:06.901503 22398 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:19:06.914865 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:06.915778 27962 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:06.916286 27962 raft_consensus.cc:697] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 12 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:06.917131 27962 consensus_queue.cc:237] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:06.917900 22538 tablet_service.cc:1558] Processing DeleteTablet for tablet 453901cb626f4358bcfa980bf0d03ea4 with delete_type TABLET_DATA_TOMBSTONED (TS 8c3bcfa13ca74a24ab8999a408532932 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:54490
I20260709 12:19:06.863379 22297 catalog_manager.cc:5697] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 21 to 22, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 22 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:06.853912 23122 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:06.948800 22470 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:06.950906 22470 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:06.953461 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:06.954159 22400 raft_consensus.cc:3055] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:06.954445 22400 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:06.957051 22400 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:06.958124 22400 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:06.962904 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:06.963553 22549 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:06.968627 22400 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
I20260709 12:19:06.970288 22442 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:06.973527 27955 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:06.974093 27955 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:06.974974 27955 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:06.989200 22549 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
I20260709 12:19:07.016891 22297 catalog_manager.cc:5697] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 11 to 12, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 12 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:07.063891 28038 tablet_replica.cc:333] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:19:07.066393 28038 raft_consensus.cc:2243] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:07.068086 22293 catalog_manager.cc:5697] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 14 to 15, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 15 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:07.081794 28038 raft_consensus.cc:2272] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:07.100684 22296 catalog_manager.cc:5697] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 18 to 19, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 19 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:07.107544 28038 ts_tablet_manager.cc:1916] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:07.213577 22470 consensus_queue.cc:237] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:07.236137 22546 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:07.240157 27960 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:07.242767 22400 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:07.244562 27955 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:19:07.256321 22441 consensus_peers.cc:597] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f65bed92f9e64bb9955b9ba82a1645c8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:07.262663 28038 ts_tablet_manager.cc:1929] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 12:19:07.264957 28038 log.cc:1199] T 453901cb626f4358bcfa980bf0d03ea4 P 8c3bcfa13ca74a24ab8999a408532932: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-2-root/wals/453901cb626f4358bcfa980bf0d03ea4
I20260709 12:19:07.267552 22284 catalog_manager.cc:5028] TS 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): tablet 453901cb626f4358bcfa980bf0d03ea4 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:19:07.301817 22470 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:19:07.309461 27822 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:07.330637 22396 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:07.331982 22468 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:07.338066 28044 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:07.338765 27960 raft_consensus.cc:2955] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:07.340555 27962 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:07.341084 22396 raft_consensus.cc:2955] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:07.360055 22397 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:19:07.367929 27822 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:07.393849 22396 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:07.410424 28009 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:19:07.461218 22397 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:19:07.463662 27956 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:07.476486 22297 catalog_manager.cc:5697] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index -1 to 11, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 14 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:07.506738 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:07.526857 22546 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:19:07.529794 22546 raft_consensus.cc:2955] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:07.536492 27956 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:19:07.613230 22472 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:07.614184 22546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:19:07.615024 22546 raft_consensus.cc:606] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:07.669916 28017 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 12:19:07.709153 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 106149us
I20260709 12:19:07.756313 22546 consensus_queue.cc:237] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:07.771719 22472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:07.772403 22472 raft_consensus.cc:606] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:07.780020 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 264762us
W20260709 12:19:07.782099 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 94855.4us
W20260709 12:19:07.808693 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 139732us
I20260709 12:19:07.829985 22400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:19:07.830623 22400 raft_consensus.cc:606] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:07.833966 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:19:07.835749 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:07.836539 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:07.884366 28068 raft_consensus.cc:993] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:07.884964 28068 raft_consensus.cc:1081] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:07.887226 22551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54496
I20260709 12:19:07.907172 22551 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:07.907603 22551 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:07.924813 28075 raft_consensus.cc:993] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:07.926265 22474 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:07.929461 22400 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:19:07.927826 22515 consensus_peers.cc:597] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d5abbd8a2264ab6ac3b4face1caa842. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:07.928586 28077 raft_consensus.cc:1081] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:07.942433 28075 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:07.944608 22551 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:07.946542 22551 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:07.950453 28057 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:07.957693 28078 ts_tablet_manager.cc:933] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:07.959949 22468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36296
I20260709 12:19:07.960561 22468 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:07.960901 22468 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:07.969082 22468 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:07.972364 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:07.973086 22472 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:07.974714 22468 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:07.978920 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:07.979333 22472 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:19:07.979626 22551 raft_consensus.cc:3055] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:07.980013 22551 raft_consensus.cc:740] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:07.980846 22551 consensus_queue.cc:260] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:07.981968 22551 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:07.991428 22551 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:08.000020 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:08.000769 22399 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:08.003736 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:08.004356 22394 raft_consensus.cc:3055] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:08.004637 22394 raft_consensus.cc:740] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:08.005345 22394 consensus_queue.cc:260] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:08.006577 22394 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:08.012295 22441 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:08.013235 28073 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:08.013732 28073 raft_consensus.cc:697] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:08.014601 28073 consensus_queue.cc:237] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:08.019357 22399 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:08.020313 22394 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:19:08.028991 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:08.029793 28075 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:08.030277 28075 raft_consensus.cc:697] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:08.031459 28075 consensus_queue.cc:237] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:08.078419 28078 tablet_copy_client.cc:323] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.2:46187
I20260709 12:19:08.091261 22487 tablet_copy_service.cc:140] P 25ebf14868c042dca42f54b3e251e1b2: Received BeginTabletCopySession request for tablet f65bed92f9e64bb9955b9ba82a1645c8 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:43060)
I20260709 12:19:08.090515 28077 raft_consensus.cc:2955] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:08.091881 22487 tablet_copy_service.cc:161] P 25ebf14868c042dca42f54b3e251e1b2: Beginning new tablet copy session on tablet f65bed92f9e64bb9955b9ba82a1645c8 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:43060: session id = 65951063312d4a1e9123f92354101c71-f65bed92f9e64bb9955b9ba82a1645c8
I20260709 12:19:08.096781 22474 raft_consensus.cc:2955] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:08.106582 22487 tablet_copy_source_session.cc:215] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:08.106025 22296 catalog_manager.cc:5697] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 14 to 15, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 15 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:08.109753 28078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f65bed92f9e64bb9955b9ba82a1645c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:08.117170 22394 raft_consensus.cc:2955] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:08.128419 22474 consensus_queue.cc:237] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:08.140398 28078 tablet_copy_client.cc:806] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:08.141983 28078 tablet_copy_client.cc:670] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:08.149293 22293 catalog_manager.cc:5697] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index -1 to 8, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 11 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:08.157559 28078 tablet_copy_client.cc:538] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:08.159139 28073 raft_consensus.cc:993] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:08.159809 28073 raft_consensus.cc:1081] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:08.165838 22397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:19:08.166443 22397 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:08.166818 22397 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:08.172729 28078 tablet_bootstrap.cc:492] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
W20260709 12:19:08.181582 22441 consensus_peers.cc:597] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 272f66365eb84231bc71d7c51137bbfb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:08.186755 22397 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:08.190423 22394 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:08.192066 27955 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:08.196359 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:08.198288 22474 raft_consensus.cc:3055] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:08.198771 22474 raft_consensus.cc:740] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:08.208333 22547 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:08.211714 22474 consensus_queue.cc:260] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:08.212868 22474 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:08.212915 28073 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:08.231890 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:08.232472 22547 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:08.233366 22474 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:08.234699 22367 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:08.235991 28068 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:08.236482 28068 raft_consensus.cc:697] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:08.237023 27955 raft_consensus.cc:2955] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index -1 to 11, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:08.237347 28068 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:08.242049 22397 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:08.245460 22546 raft_consensus.cc:2955] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index -1 to 11, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:08.247774 22547 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:08.266355 22297 catalog_manager.cc:5697] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 9 to 10, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 10 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:08.324218 22297 catalog_manager.cc:5697] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index -1 to 11, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:08.339931 22399 raft_consensus.cc:2955] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index -1 to 11, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:08.358717 22296 catalog_manager.cc:5697] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 13 to 14, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 14 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:08.365298 22474 consensus_queue.cc:237] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:08.427877 28099 ts_tablet_manager.cc:933] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:08.438199 22441 consensus_peers.cc:597] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 621dbb467a3b47c7b0f2d1e85c7eba84. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:08.456986 22547 raft_consensus.cc:1275] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:08.462499 28069 consensus_queue.cc:1048] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:19:08.477258 22551 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:08.478787 28069 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:08.487270 22399 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:08.494843 28069 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:19:08.512244 22474 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:08.516106 28100 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:08.522646 28099 tablet_copy_client.cc:323] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.3:38645
I20260709 12:19:08.526953 22560 tablet_copy_service.cc:140] P 8c3bcfa13ca74a24ab8999a408532932: Received BeginTabletCopySession request for tablet 2d5abbd8a2264ab6ac3b4face1caa842 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:49290)
I20260709 12:19:08.527570 22560 tablet_copy_service.cc:161] P 8c3bcfa13ca74a24ab8999a408532932: Beginning new tablet copy session on tablet 2d5abbd8a2264ab6ac3b4face1caa842 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:49290: session id = 65951063312d4a1e9123f92354101c71-2d5abbd8a2264ab6ac3b4face1caa842
I20260709 12:19:08.537511 22560 tablet_copy_source_session.cc:215] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:08.555845 28099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d5abbd8a2264ab6ac3b4face1caa842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:08.554993 28101 raft_consensus.cc:2955] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:08.562382 22550 raft_consensus.cc:2955] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:08.588011 22394 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:08.598491 28060 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:08.626092 22394 raft_consensus.cc:1275] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:08.618626 22297 catalog_manager.cc:5697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index -1 to 9, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 15 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:08.620327 22397 raft_consensus.cc:2955] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:08.630048 28101 consensus_queue.cc:1048] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:08.667762 28078 tablet_bootstrap.cc:492] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:08.668808 28078 tablet_bootstrap.cc:492] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:19:08.669595 28078 ts_tablet_manager.cc:1403] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.497s	user 0.049s	sys 0.025s
I20260709 12:19:08.682548 28099 tablet_copy_client.cc:806] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:08.683163 28099 tablet_copy_client.cc:670] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:08.702373 28099 tablet_copy_client.cc:538] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:08.693703 28078 raft_consensus.cc:359] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:08.713104 28078 raft_consensus.cc:740] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:19:08.716974 28108 ts_tablet_manager.cc:933] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:08.727998 28099 tablet_bootstrap.cc:492] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:19:08.728497 28078 consensus_queue.cc:260] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:08.746640 28078 ts_tablet_manager.cc:1434] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.077s	user 0.005s	sys 0.002s
I20260709 12:19:08.750514 28108 tablet_copy_client.cc:323] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.2:46187
I20260709 12:19:08.752461 22487 tablet_copy_service.cc:140] P 25ebf14868c042dca42f54b3e251e1b2: Received BeginTabletCopySession request for tablet 272f66365eb84231bc71d7c51137bbfb from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:43060)
I20260709 12:19:08.753091 22487 tablet_copy_service.cc:161] P 25ebf14868c042dca42f54b3e251e1b2: Beginning new tablet copy session on tablet 272f66365eb84231bc71d7c51137bbfb from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:43060: session id = 65951063312d4a1e9123f92354101c71-272f66365eb84231bc71d7c51137bbfb
W20260709 12:19:08.755884 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 93965.4us
I20260709 12:19:08.761916 22487 tablet_copy_source_session.cc:215] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:08.766273 28108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272f66365eb84231bc71d7c51137bbfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:08.774561 22487 tablet_copy_service.cc:342] P 25ebf14868c042dca42f54b3e251e1b2: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-f65bed92f9e64bb9955b9ba82a1645c8 received from {username='slave'} at 127.0.0.1:43060
I20260709 12:19:08.776793 22487 tablet_copy_service.cc:434] P 25ebf14868c042dca42f54b3e251e1b2: ending tablet copy session 65951063312d4a1e9123f92354101c71-f65bed92f9e64bb9955b9ba82a1645c8 on tablet f65bed92f9e64bb9955b9ba82a1645c8 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:19:08.788883 23128 raft_consensus.cc:1217] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 12:19:08.831146 22550 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:08.833554 28065 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:08.838907 22474 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:08.840827 28068 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:08.902258 28108 tablet_copy_client.cc:806] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:08.902915 28108 tablet_copy_client.cc:670] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:08.926755 28108 tablet_copy_client.cc:538] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:08.936892 28108 tablet_bootstrap.cc:492] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:19:08.958951 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:08.994324 28099 tablet_bootstrap.cc:492] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:08.995360 28099 tablet_bootstrap.cc:492] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:19:08.996198 28099 ts_tablet_manager.cc:1403] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.268s	user 0.023s	sys 0.013s
I20260709 12:19:09.023357 28099 raft_consensus.cc:359] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:09.024238 28099 raft_consensus.cc:740] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:19:09.024922 28099 consensus_queue.cc:260] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:09.057613 28078 ts_tablet_manager.cc:933] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:09.068447 28099 ts_tablet_manager.cc:1434] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.003s
I20260709 12:19:09.089669 22560 tablet_copy_service.cc:342] P 8c3bcfa13ca74a24ab8999a408532932: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-2d5abbd8a2264ab6ac3b4face1caa842 received from {username='slave'} at 127.0.0.1:49290
I20260709 12:19:09.090163 22560 tablet_copy_service.cc:434] P 8c3bcfa13ca74a24ab8999a408532932: ending tablet copy session 65951063312d4a1e9123f92354101c71-2d5abbd8a2264ab6ac3b4face1caa842 on tablet 2d5abbd8a2264ab6ac3b4face1caa842 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:19:09.118464 28078 tablet_copy_client.cc:323] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.2:46187
I20260709 12:19:09.128221 28108 tablet_bootstrap.cc:492] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:09.129750 22487 tablet_copy_service.cc:140] P 25ebf14868c042dca42f54b3e251e1b2: Received BeginTabletCopySession request for tablet 621dbb467a3b47c7b0f2d1e85c7eba84 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:43060)
I20260709 12:19:09.130429 22487 tablet_copy_service.cc:161] P 25ebf14868c042dca42f54b3e251e1b2: Beginning new tablet copy session on tablet 621dbb467a3b47c7b0f2d1e85c7eba84 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:43060: session id = 65951063312d4a1e9123f92354101c71-621dbb467a3b47c7b0f2d1e85c7eba84
I20260709 12:19:09.129829 28108 tablet_bootstrap.cc:492] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:19:09.134840 28108 ts_tablet_manager.cc:1403] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.198s	user 0.046s	sys 0.007s
I20260709 12:19:09.155846 22550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "367745908a334997957e47f869d9fb14"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:19:09.156548 22550 raft_consensus.cc:606] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:09.160089 28108 raft_consensus.cc:359] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:09.161067 28108 raft_consensus.cc:740] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:19:09.161758 28108 consensus_queue.cc:260] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:09.164150 28108 ts_tablet_manager.cc:1434] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:19:09.169824 22394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:19:09.170442 22394 raft_consensus.cc:606] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:09.178565 22474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:09.179136 22474 raft_consensus.cc:606] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:09.185443 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:19:09.187148 22486 tablet_copy_service.cc:342] P 25ebf14868c042dca42f54b3e251e1b2: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-272f66365eb84231bc71d7c51137bbfb received from {username='slave'} at 127.0.0.1:43060
I20260709 12:19:09.187701 22486 tablet_copy_service.cc:434] P 25ebf14868c042dca42f54b3e251e1b2: ending tablet copy session 65951063312d4a1e9123f92354101c71-272f66365eb84231bc71d7c51137bbfb on tablet 272f66365eb84231bc71d7c51137bbfb with peer 65951063312d4a1e9123f92354101c71
I20260709 12:19:09.187879 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:09.214973 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:09.233486 22487 tablet_copy_source_session.cc:215] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:09.241717 28078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 621dbb467a3b47c7b0f2d1e85c7eba84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:09.259145 28078 tablet_copy_client.cc:806] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:09.259816 28078 tablet_copy_client.cc:670] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:09.266599 28078 tablet_copy_client.cc:538] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:09.267632 28071 raft_consensus.cc:993] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:09.268163 28071 raft_consensus.cc:1081] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:09.269826 22397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:19:09.270346 22397 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:09.270668 22397 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:09.279002 22397 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:09.282938 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:09.283527 22474 raft_consensus.cc:3055] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:09.283825 22474 raft_consensus.cc:740] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:09.284513 22474 consensus_queue.cc:260] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:09.285506 22474 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:09.295269 28078 tablet_bootstrap.cc:492] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:19:09.301836 22397 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:09.304032 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:09.317674 23128 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:09.325887 28101 raft_consensus.cc:1064] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:19:09.327090 23128 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:19:09.328562 22366 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:09.307451 22474 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:19:09.329944 28065 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:09.335788 28065 raft_consensus.cc:697] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:09.338937 28065 consensus_queue.cc:237] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:09.368952 27892 raft_consensus.cc:993] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:09.369472 27892 raft_consensus.cc:1081] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:09.375109 22550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54496
I20260709 12:19:09.375799 22550 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:09.376228 22550 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:09.377938 28101 consensus_queue.cc:237] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:09.379442 28078 tablet_bootstrap.cc:492] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:09.385309 28078 tablet_bootstrap.cc:492] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:19:09.386058 28078 ts_tablet_manager.cc:1403] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.091s	user 0.041s	sys 0.011s
I20260709 12:19:09.389322 28078 raft_consensus.cc:359] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:09.390242 28078 raft_consensus.cc:740] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:19:09.390929 28078 consensus_queue.cc:260] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:09.396898 28078 ts_tablet_manager.cc:1434] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:19:09.403074 22550 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:09.407083 22487 tablet_copy_service.cc:342] P 25ebf14868c042dca42f54b3e251e1b2: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-621dbb467a3b47c7b0f2d1e85c7eba84 received from {username='slave'} at 127.0.0.1:43060
I20260709 12:19:09.407308 22550 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:09.407965 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:09.425972 22394 raft_consensus.cc:3055] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:09.418859 22487 tablet_copy_service.cc:434] P 25ebf14868c042dca42f54b3e251e1b2: ending tablet copy session 65951063312d4a1e9123f92354101c71-621dbb467a3b47c7b0f2d1e85c7eba84 on tablet 621dbb467a3b47c7b0f2d1e85c7eba84 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:19:09.422830 23122 raft_consensus.cc:1217] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 12:19:09.409106 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:09.426793 22394 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:09.427244 22470 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:09.428639 22394 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:09.430126 22394 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:09.435128 22470 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:09.438031 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:09.439114 28113 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:09.439652 28113 raft_consensus.cc:697] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:09.440006 22394 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:09.441196 28113 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:09.468741 23122 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 14 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:09.469487 22394 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:09.470551 27955 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:09.474243 27955 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:09.490865 28017 raft_consensus.cc:993] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:09.491403 28017 raft_consensus.cc:1081] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:09.491408 22550 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:09.496340 22470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "367745908a334997957e47f869d9fb14"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36296
I20260709 12:19:09.496927 22470 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:09.497579 22470 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:09.504426 27955 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:09.516427 23122 raft_consensus.cc:1217] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.8->[15.9-15.9]   Dedup: 15.9->[]
I20260709 12:19:09.523648 28071 raft_consensus.cc:2955] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:09.539943 22470 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:09.545732 23122 raft_consensus.cc:1217] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.10->[13.11-13.11]   Dedup: 13.11->[]
I20260709 12:19:09.546737 22394 raft_consensus.cc:2955] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:09.554131 22470 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:09.554816 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:09.555424 22399 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:09.558492 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:09.559113 22546 raft_consensus.cc:3055] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:09.559392 22546 raft_consensus.cc:740] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:09.560109 22546 consensus_queue.cc:260] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:09.561265 22546 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:09.586882 22297 catalog_manager.cc:5697] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 17 to 18, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 18 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:09.593339 22546 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:09.599465 22399 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:09.613183 22293 catalog_manager.cc:5697] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 11 to 12, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 12 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:09.624434 22299 catalog_manager.cc:5697] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 11 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:09.650698 23128 raft_consensus.cc:2955] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:09.653676 22441 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:09.656348 28101 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:09.656873 28101 raft_consensus.cc:697] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:09.662792 22546 raft_consensus.cc:2955] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:09.657732 28101 consensus_queue.cc:237] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:09.807494 22474 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:09.810003 28065 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:09.832336 22470 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:19:09.834630 28017 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:09.875689 28100 raft_consensus.cc:1064] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:19:09.888432 28100 consensus_queue.cc:237] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:09.907070 23128 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:09.908864 28068 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:09.921016 22470 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:09.930653 23123 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 11 LEARNER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:09.931730 28113 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:19:09.960407 28075 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:10.012991 22296 catalog_manager.cc:5697] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 17 to 18, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 18 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:10.034507 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 90912.6us
I20260709 12:19:10.064263 22401 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:10.082543 22470 consensus_queue.cc:237] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:10.090452 22401 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:19:10.103523 23122 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:19:10.110307 28135 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:19:10.203995 28148 log.cc:927] Time spent T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.094s	user 0.004s	sys 0.005s
W20260709 12:19:10.218739 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 48175.6us
W20260709 12:19:10.219856 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 113923us
W20260709 12:19:10.248322 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 316322us
W20260709 12:19:10.334034 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 83625us
I20260709 12:19:10.237587 28153 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 12:19:10.267544 28154 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.113s
I20260709 12:19:10.477865 28131 raft_consensus.cc:1064] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
W20260709 12:19:10.552909 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:10.557742 22544 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:19:10.573642 27955 raft_consensus.cc:2955] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:10.579475 28138 raft_consensus.cc:1064] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:19:10.590497 23128 raft_consensus.cc:2955] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:10.626364 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:10.563871 28131 consensus_queue.cc:237] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 7, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:10.638531 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 188146us
I20260709 12:19:10.642361 22394 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:19:10.657310 22547 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:19:10.661757 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:10.664052 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 208793us
I20260709 12:19:10.686457 28157 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:19:10.716693 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:10.722924 22297 catalog_manager.cc:5697] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 12 to 13, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New cstate: current_term: 14 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:10.688059 28176 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:19:10.727672 28160 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:10.731258 28138 consensus_queue.cc:237] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:10.740615 23128 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 15 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:19:10.747430 28154 raft_consensus.cc:2955] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:10.760139 22545 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:19:10.758517 22401 raft_consensus.cc:2955] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:10.791388 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 124063us
I20260709 12:19:10.803692 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f65bed92f9e64bb9955b9ba82a1645c8 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:10.809623 22549 raft_consensus.cc:2955] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:10.765103 28135 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:19:10.847764 28159 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:19:10.868268 22471 raft_consensus.cc:2955] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:10.881146 22397 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:19:10.927346 28191 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:19:10.969301 23123 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 13 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:10.993149 22471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:10.993743 22471 raft_consensus.cc:606] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:11.011196 22401 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:19:10.995025 28195 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.170s	user 0.002s	sys 0.003s
W20260709 12:19:11.044237 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 51501.1us
I20260709 12:19:11.054586 22549 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:11.057415 22545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:19:11.058118 22545 raft_consensus.cc:606] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:11.063365 22401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:19:11.063952 22401 raft_consensus.cc:606] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:11.044092 28135 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:19:11.076537 28101 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:11.078735 28129 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:11.093210 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:19:11.095023 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:11.095922 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:11.110632 23128 raft_consensus.cc:2955] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:11.200301 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 68130.6us
I20260709 12:19:11.218242 23125 raft_consensus.cc:2955] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.331157 28159 raft_consensus.cc:2955] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.339103 22400 raft_consensus.cc:2955] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.346772 28191 raft_consensus.cc:993] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:11.347325 28191 raft_consensus.cc:1081] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:11.353088 22393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:19:11.353667 22393 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:11.354041 22393 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:11.361275 22393 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:11.365520 22393 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:11.404597 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:11.405236 22547 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:11.426714 22547 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:11.429932 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:11.430572 22471 raft_consensus.cc:3055] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:11.430898 22471 raft_consensus.cc:740] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:11.432853 22546 raft_consensus.cc:2955] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.428030 22366 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:11.443599 22471 consensus_queue.cc:260] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:11.447142 27943 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:11.451817 22471 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:11.463442 22471 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:11.458338 27943 raft_consensus.cc:697] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:11.469170 27943 consensus_queue.cc:237] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:11.462311 28168 raft_consensus.cc:993] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:11.472469 28168 raft_consensus.cc:1081] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:11.495363 28101 raft_consensus.cc:2955] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.498242 22299 catalog_manager.cc:5697] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index 8 to 9, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:11.502256 22394 raft_consensus.cc:2955] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.510440 22474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36296
I20260709 12:19:11.511490 22474 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:11.511929 22474 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:11.511042 28180 raft_consensus.cc:993] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:11.513820 22387 tablet_service.cc:1558] Processing DeleteTablet for tablet f65bed92f9e64bb9955b9ba82a1645c8 with delete_type TABLET_DATA_TOMBSTONED (TS b8621fa34be04d3fa2d68a300f858cd1 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:52914
I20260709 12:19:11.513425 28180 raft_consensus.cc:1081] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:11.523128 22546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54496
I20260709 12:19:11.523720 22546 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:11.524067 22546 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:11.532537 22296 catalog_manager.cc:5697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 9 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.543506 28136 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:11.544118 28136 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:11.547060 28136 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:11.549127 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:11.556409 28212 tablet_replica.cc:333] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:11.556898 22474 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:11.561024 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:11.560195 22545 raft_consensus.cc:2955] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.563095 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:11.565286 22394 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:11.565359 23122 raft_consensus.cc:2955] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.567548 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:11.567840 22474 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:11.558076 28212 raft_consensus.cc:2243] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.569954 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:11.570618 22547 raft_consensus.cc:3055] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:11.570889 22547 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:11.571642 22547 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:11.572805 22547 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:11.580549 22547 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:11.587299 22441 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:11.589322 28101 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:11.587438 28212 raft_consensus.cc:2272] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.587635 22367 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:11.590335 28101 raft_consensus.cc:697] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:19:11.590767 22367 raft_consensus.cc:2686] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:19:11.594451 22546 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:11.596879 22394 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
W20260709 12:19:11.614151 28209 log.cc:927] Time spent T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.092s	user 0.000s	sys 0.010s
I20260709 12:19:11.618579 22546 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:11.620025 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:11.620618 22394 raft_consensus.cc:3055] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:11.620903 22394 raft_consensus.cc:740] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:19:11.621814 28140 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.078s	user 0.007s	sys 0.006s
I20260709 12:19:11.621683 22394 consensus_queue.cc:260] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:11.629004 22394 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:11.638640 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:11.639317 22469 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:11.646778 28212 ts_tablet_manager.cc:1916] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:11.640064 22293 catalog_manager.cc:5697] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 11 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:11.657999 22394 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:19:11.661194 22545 consensus_queue.cc:237] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:11.663748 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:11.665670 28113 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:11.666254 28113 raft_consensus.cc:697] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:11.674338 28113 consensus_queue.cc:237] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:11.673945 28194 log.cc:927] Time spent T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.070s	user 0.002s	sys 0.008s
I20260709 12:19:11.690054 22469 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:19:11.700474 22471 consensus_queue.cc:237] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:11.707685 23122 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:11.710443 22394 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:11.591658 28101 consensus_queue.cc:237] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:11.721730 23122 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:19:11.713011 28168 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:19:11.737170 22469 consensus_queue.cc:237] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:11.742693 22394 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:19:11.743283 28179 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:11.731467 28131 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:19:11.759841 28153 raft_consensus.cc:2955] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.762837 23122 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:11.765429 22545 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:11.766477 28135 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:11.772287 23128 raft_consensus.cc:2955] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.764997 22293 catalog_manager.cc:5697] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 13 to 14, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 14 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:11.786811 22297 catalog_manager.cc:5697] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 12 to 13, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 13 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:11.786921 22393 raft_consensus.cc:2955] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.797143 28073 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:11.806928 28073 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:11.809383 28131 raft_consensus.cc:2955] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Committing config change with OpId 13.13: config changed from index 12 to 13, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.813923 23122 raft_consensus.cc:2955] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Committing config change with OpId 13.13: config changed from index 12 to 13, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.817700 22294 catalog_manager.cc:5697] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 9 to 10, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New cstate: current_term: 11 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.820636 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 272f66365eb84231bc71d7c51137bbfb with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:11.832130 22545 raft_consensus.cc:2955] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.825570 28073 raft_consensus.cc:2955] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.857333 22545 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:11.882565 28212 ts_tablet_manager.cc:1929] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.12
I20260709 12:19:11.883085 28212 log.cc:1199] T f65bed92f9e64bb9955b9ba82a1645c8 P b8621fa34be04d3fa2d68a300f858cd1: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-0-root/wals/f65bed92f9e64bb9955b9ba82a1645c8
I20260709 12:19:11.884824 22285 catalog_manager.cc:5028] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): tablet f65bed92f9e64bb9955b9ba82a1645c8 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:19:11.907603 22284 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2d5abbd8a2264ab6ac3b4face1caa842 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:19:11.912633 28213 log.cc:927] Time spent T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:19:11.887472 28165 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:19:11.920643 23128 raft_consensus.cc:2955] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.940050 22469 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:11.945291 22393 raft_consensus.cc:2955] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Committing config change with OpId 13.13: config changed from index 12 to 13, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:11.945364 28136 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:19:11.966991 22299 catalog_manager.cc:5697] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 12 to 13, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:11.969076 22299 catalog_manager.cc:5697] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 17 to 18, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 18 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:11.980266 22458 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d5abbd8a2264ab6ac3b4face1caa842 with delete_type TABLET_DATA_TOMBSTONED (TS 25ebf14868c042dca42f54b3e251e1b2 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:51846
I20260709 12:19:12.018445 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 621dbb467a3b47c7b0f2d1e85c7eba84 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:12.026216 22297 catalog_manager.cc:5697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index 10 to 11, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New cstate: current_term: 15 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:12.044759 22538 tablet_service.cc:1558] Processing DeleteTablet for tablet 272f66365eb84231bc71d7c51137bbfb with delete_type TABLET_DATA_TOMBSTONED (TS 8c3bcfa13ca74a24ab8999a408532932 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:54490
I20260709 12:19:12.055945 22400 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:12.044703 28220 tablet_replica.cc:333] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:19:12.057793 28153 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:12.058879 28220 raft_consensus.cc:2243] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:12.059770 28220 raft_consensus.cc:2272] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:12.086548 28220 ts_tablet_manager.cc:1916] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:12.095073 28223 tablet_replica.cc:333] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:19:12.096149 28223 raft_consensus.cc:2243] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:12.097056 28223 raft_consensus.cc:2272] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:12.112973 28223 ts_tablet_manager.cc:1916] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:12.129325 22387 tablet_service.cc:1558] Processing DeleteTablet for tablet 621dbb467a3b47c7b0f2d1e85c7eba84 with delete_type TABLET_DATA_TOMBSTONED (TS b8621fa34be04d3fa2d68a300f858cd1 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:52914
I20260709 12:19:12.130313 28212 tablet_replica.cc:333] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:12.131268 28212 raft_consensus.cc:2243] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:12.132138 28212 raft_consensus.cc:2272] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:12.133044 28223 ts_tablet_manager.cc:1929] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.12
I20260709 12:19:12.133505 28223 log.cc:1199] T 272f66365eb84231bc71d7c51137bbfb P 8c3bcfa13ca74a24ab8999a408532932: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-2-root/wals/272f66365eb84231bc71d7c51137bbfb
I20260709 12:19:12.135293 22284 catalog_manager.cc:5028] TS 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): tablet 272f66365eb84231bc71d7c51137bbfb (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:19:12.136947 28212 ts_tablet_manager.cc:1916] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:12.146062 28220 ts_tablet_manager.cc:1929] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 12:19:12.146559 28220 log.cc:1199] T 2d5abbd8a2264ab6ac3b4face1caa842 P 25ebf14868c042dca42f54b3e251e1b2: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-1-root/wals/2d5abbd8a2264ab6ac3b4face1caa842
I20260709 12:19:12.148270 22285 catalog_manager.cc:5028] TS 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): tablet 2d5abbd8a2264ab6ac3b4face1caa842 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:19:12.164994 28212 ts_tablet_manager.cc:1929] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 12:19:12.165560 28212 log.cc:1199] T 621dbb467a3b47c7b0f2d1e85c7eba84 P b8621fa34be04d3fa2d68a300f858cd1: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-0-root/wals/621dbb467a3b47c7b0f2d1e85c7eba84
I20260709 12:19:12.168426 22285 catalog_manager.cc:5028] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): tablet 621dbb467a3b47c7b0f2d1e85c7eba84 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:19:12.171708 22469 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:12.173159 28168 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:12.197901 22393 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:19:12.199621 28073 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:12.248148 22551 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:19:12.250546 28073 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:12.697427 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:12.843967 22546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:19:12.844578 22546 raft_consensus.cc:606] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:12.847966 22546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:19:12.848603 22546 raft_consensus.cc:606] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:12.859777 22400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:19:12.860354 22400 raft_consensus.cc:606] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:12.866297 22474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "65951063312d4a1e9123f92354101c71"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:12.866912 22474 raft_consensus.cc:606] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Received request to transfer leadership to TS 65951063312d4a1e9123f92354101c71
I20260709 12:19:12.873392 22474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:12.874158 22474 raft_consensus.cc:606] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:12.875638 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:12.877337 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:12.878141 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:12.973591 28168 raft_consensus.cc:993] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:12.976397 28153 raft_consensus.cc:1081] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:13.010301 22474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36296
I20260709 12:19:13.010903 22474 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:13.011245 22474 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:19:13.030534 22474 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:13.041558 28230 raft_consensus.cc:993] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:13.042174 28230 raft_consensus.cc:1081] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:13.042588 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:13.043205 22393 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:19:13.050577 22393 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 23.
I20260709 12:19:13.051971 22471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36296
I20260709 12:19:13.052038 22442 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:13.052786 22471 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:13.053148 22471 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:13.053198 28073 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:19:13.053740 28073 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:13.054538 28073 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:13.060619 22471 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:13.067715 22471 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:13.067902 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:13.068562 22546 raft_consensus.cc:3055] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:13.068931 22546 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:13.069936 22546 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:13.071200 22546 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:13.076303 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:13.076984 22393 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:13.087872 22474 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:13.088862 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:13.090119 22545 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:19:13.090409 22545 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:13.091112 22545 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:13.092180 22545 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:19:13.103989 22545 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 23.
I20260709 12:19:13.086475 22393 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:19:13.108767 22546 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:19:13.122009 22442 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:13.138075 28073 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:13.123912 22294 catalog_manager.cc:5697] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 22 to 23, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 23 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.133533 28215 raft_consensus.cc:993] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 65951063312d4a1e9123f92354101c71 to start an election
I20260709 12:19:13.142164 28215 raft_consensus.cc:1081] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Signalling peer 65951063312d4a1e9123f92354101c71 to start an election
I20260709 12:19:13.143929 28073 raft_consensus.cc:697] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:13.143997 23128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138"
dest_uuid: "65951063312d4a1e9123f92354101c71"
 from {username='slave'} at 127.0.0.1:41012
I20260709 12:19:13.144685 23128 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:13.145059 23128 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:13.144874 28073 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:13.161912 23128 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:13.171373 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:13.172099 22474 raft_consensus.cc:3055] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:13.172320 23128 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:13.172487 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:13.173126 22546 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:13.172487 22474 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:13.178994 22474 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:13.180256 22474 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:13.181908 28136 raft_consensus.cc:993] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:13.182377 28136 raft_consensus.cc:1081] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:13.184146 22551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54496
I20260709 12:19:13.184684 22551 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:13.185034 22551 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:13.191896 22551 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:13.194211 22551 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:13.195199 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:13.196575 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:13.197137 22471 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:13.197032 22393 raft_consensus.cc:3055] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:13.199623 22393 raft_consensus.cc:740] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:13.200273 22393 consensus_queue.cc:260] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:13.201076 22393 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:13.202236 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 61936.7us
I20260709 12:19:13.204608 22471 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:13.207767 22393 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:13.184621 22546 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 16.
I20260709 12:19:13.208607 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:13.210700 28183 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:13.209688 23094 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:13.211205 28183 raft_consensus.cc:697] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:13.212132 28183 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:13.216071 28062 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:13.216745 28062 raft_consensus.cc:697] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 16 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:13.217679 28062 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:13.240664 22474 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 16.
I20260709 12:19:13.343626 22297 catalog_manager.cc:5697] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 15 to 16, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 16 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:13.343637 22293 catalog_manager.cc:5697] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 14 to 15, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 15 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:13.349815 28131 raft_consensus.cc:993] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:13.350775 28131 raft_consensus.cc:1081] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:13.353832 22396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:19:13.354524 22396 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:13.354884 22396 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:13.363173 22396 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:13.374373 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 57893.8us
I20260709 12:19:13.381757 22396 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:13.383383 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:13.384135 22474 raft_consensus.cc:3055] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:13.384469 22474 raft_consensus.cc:740] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:13.388479 22474 consensus_queue.cc:260] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:13.388867 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:13.389669 22551 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:13.414906 22474 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:19:13.435969 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 90041.7us
I20260709 12:19:13.436012 22551 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:13.456648 22474 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
W20260709 12:19:13.742337 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 283450us
I20260709 12:19:13.774636 22551 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:19:13.777091 28173 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:13.803639 22474 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:19:13.810297 28250 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:13.820868 22551 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:19:13.823561 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 438995us
I20260709 12:19:13.823834 28251 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:14.036074 22367 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:19:14.122223 28257 log.cc:927] Time spent T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
W20260709 12:19:14.362171 22442 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.000s	sys 0.005s
W20260709 12:19:14.362779 22442 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.000s	sys 0.006s
I20260709 12:19:14.474936 28215 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:14.475749 28215 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:14.478312 28215 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:14.524158 22443 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.006s	sys 0.004s
W20260709 12:19:14.524766 22443 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.006s	sys 0.004s
I20260709 12:19:14.529640 28252 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:14.530331 28252 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:14.533136 28252 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:14.569515 28256 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:14.693400 28256 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:14.696071 28256 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:14.592655 28261 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:14.697018 28261 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:14.699455 28261 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:14.688159 28263 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:14.707576 28263 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:14.710309 28263 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:14.599843 28215 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:14.770749 28215 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:14.788069 28256 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:14.789207 28256 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:14.793236 28261 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:14.794312 28261 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:14.855736 28261 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:14.858786 28215 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:14.862602 28261 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:14.864831 28252 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:14.869916 28256 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:14.870878 28261 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:14.873647 28215 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:14.876331 28261 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:14.877092 28215 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:14.879787 28215 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:14.884251 28267 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:14.884356 28215 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:14.865974 28252 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:14.885669 28267 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:14.888319 28252 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:14.885970 28215 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:14.893740 28215 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:14.894598 28269 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:14.895804 28269 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:14.894044 28264 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:14.898594 28264 raft_consensus.cc:697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:14.900588 28249 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:14.900223 28264 consensus_queue.cc:237] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:14.907902 28215 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:14.914271 28267 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:14.914921 28267 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:14.915621 28267 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:14.901531 28249 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:14.908883 28215 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:14.920761 28249 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:14.930466 28215 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:14.930645 28267 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:14.981227 28272 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:14.982220 28272 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:14.985114 28272 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:14.988955 28272 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:14.990319 28249 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:14.991307 28252 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:14.991861 28256 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:14.992539 28270 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:15.002302 28229 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.002641 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.003307 28229 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.006204 28268 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:15.007099 28268 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:14.942793 28267 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:15.002550 28249 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.010425 28265 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:15.011330 28265 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:14.999251 28215 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:15.013067 28215 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.002342 28252 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.028687 28266 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:15.029562 28266 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.032183 28266 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:15.010067 22498 debug-util.cc:398] Leaking SignalData structure 0x7b080028f300 after lost signal to thread 21247
I20260709 12:19:15.041270 28256 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.044605 28270 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.047528 28270 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.009909 28267 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.063091 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.064917 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.067862 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.115136 28256 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.110978 28252 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.111593 28267 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.101652 28229 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:15.123159 28265 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.103615 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.111972 28275 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:15.092315 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.242084 28275 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.111447 28268 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:15.246397 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.247097 22543 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:15.248500 22543 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:19:15.249485 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.250765 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.251329 22543 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:15.252334 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.253561 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.251246 28267 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:15.261588 28268 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:15.262312 28265 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.263206 28265 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.264122 28267 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.266444 28267 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.266763 28269 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:15.262375 28268 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.266364 28265 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.267978 28269 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:15.269294 28268 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.269816 28269 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.270291 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.268586 28274 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.271579 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.276404 28275 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:15.279884 22441 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:15.280725 28165 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.281508 28165 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.281952 28268 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:15.282459 28268 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:19:15.282820 22551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.455s	user 0.003s	sys 0.019s
I20260709 12:19:15.282886 28268 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:15.284912 28165 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.285605 28165 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.286229 28275 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:15.286458 28165 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.282125 28264 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:15.288201 28264 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.289418 28165 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:15.286145 28247 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:15.290107 28165 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.290838 28165 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.291270 28264 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.291895 28264 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:15.292706 28264 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.293365 28165 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:15.293922 28165 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.290763 28247 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.287376 28275 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.294050 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:15.297199 22551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.469s	user 0.003s	sys 0.019s
I20260709 12:19:15.297915 28263 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.298673 28263 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.294615 28165 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.298785 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 3027) took 1472 ms. Trace:
I20260709 12:19:15.294116 28274 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.303062 28263 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.286135 28232 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:19:15.296968 22441 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:15.308725 28153 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.322956 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.335170 28256 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:15.334970 28265 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:15.338581 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.310984 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.348861 28269 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:15.357422 28256 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.357426 28238 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.358904 28136 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.359407 28238 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.359617 28136 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.360054 28256 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:15.354028 28239 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.361541 28239 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:15.363358 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 81635.5us
I20260709 12:19:15.364494 28232 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:15.365046 28232 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:15.365520 28232 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:15.365926 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:15.271710 28272 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.352291 28279 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:15.387321 28283 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:15.370464 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:15.353559 28278 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:15.415642 22476 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:15.416630 28280 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.417289 28280 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.417567 22393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 807) took 1573 ms. Trace:
I20260709 12:19:15.300504 22551 rpcz_store.cc:276] 0709 12:19:13.826193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:13.826330 (+   137us) service_pool.cc:224] Handling call
0709 12:19:13.826718 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:13.827066 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:13.827096 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:13.827557 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 12:19:15.298224 (+1470667us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:15.298309 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:15.298401 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:15.298471 (+    70us) raft_consensus.cc:1685] finished
0709 12:19:15.298481 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:15.298704 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"thread_start_us":1469820,"threads_started":1,"wal-append.queue_time_us":355958,"wal-append.run_cpu_time_us":1896,"wal-append.run_wall_time_us":1069127}
I20260709 12:19:15.353638 28275 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.421756 22393 rpcz_store.cc:276] 0709 12:19:13.843896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:15.416378 (+1572482us) service_pool.cc:224] Handling call
0709 12:19:15.416792 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:15.417115 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:15.417142 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:15.417178 (+    36us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:15.417236 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:15.417294 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:15.417399 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:15.426280 22549 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:19:15.427609 28281 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:15.402271 28269 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.435930 28265 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.436200 28281 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.438724 28265 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:15.439061 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.419236 28279 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.440079 28017 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:15.440805 28017 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.441978 28269 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.444705 28269 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.445075 28280 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.436314 28276 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:15.446420 28276 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.447058 28272 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.391034 28256 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:15.448081 28256 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.448720 28276 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.420163 28153 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.450105 28283 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.435990 28278 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.456641 28281 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.442157 28279 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:15.459290 28283 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:15.459928 28283 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.460440 28283 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.462492 28256 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:15.463277 28278 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:15.463932 28278 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:19:15.464416 22546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.636s	user 0.011s	sys 0.010s
I20260709 12:19:15.464628 28278 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:15.471046 22546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.643s	user 0.012s	sys 0.011s
I20260709 12:19:15.472950 28272 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:15.474275 28017 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:15.476176 28264 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.479704 28215 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.453472 28243 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.481117 28243 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.481756 28232 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.483812 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49290 (request call id 1048) took 1703 ms. Trace:
I20260709 12:19:15.479771 28153 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:15.484766 28243 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.484300 22546 rpcz_store.cc:276] 0709 12:19:13.780607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:13.780743 (+   136us) service_pool.cc:224] Handling call
0709 12:19:13.781095 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:13.827717 (+ 46622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:13.827757 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:13.828199 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 12:19:15.480378 (+1652179us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:19:15.480463 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:15.480545 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:15.480584 (+    39us) raft_consensus.cc:1685] finished
0709 12:19:15.480594 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:15.483745 (+  3151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2126,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":123,"thread_start_us":1689085,"threads_started":2,"wal-append.queue_time_us":768958}
I20260709 12:19:15.471488 28269 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.491544 28269 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.615130 22401 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:19:15.611239 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.626942 28275 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.509744 28282 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:15.487123 28283 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:15.628585 28283 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:15.629099 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.629383 28283 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.630832 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.631649 22401 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:19:15.512496 28165 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.573786 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:15.606886 22498 debug-util.cc:398] Leaking SignalData structure 0x7b0800276940 after lost signal to thread 22333
I20260709 12:19:15.627170 22402 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:15.632897 28282 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.655061 28282 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.483844 28272 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.618927 28284 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.658026 28284 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.658712 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.614421 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.614357 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.474455 28239 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.518841 22441 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:15.525679 22393 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:19:15.659705 22397 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:19:15.660192 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.660607 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.660848 22395 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:19:15.661348 28261 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:15.509757 28279 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:15.491847 28274 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:15.510488 28247 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.592077 28136 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.511852 28268 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:15.662293 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 143559us
I20260709 12:19:15.492383 28230 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:15.662846 28279 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.663636 28230 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.665295 22469 raft_consensus.cc:2393] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 19: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:15.660693 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.614969 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.656976 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.661310 22397 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:19:15.660336 28284 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.661916 28261 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:15.513955 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 128646us
I20260709 12:19:15.477454 28280 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.608716 28232 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.627756 28275 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.666854 22399 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:19:15.667291 22401 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:15.668041 22545 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:19:15.668398 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.676276 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.701589 22393 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:19:15.507941 28017 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:15.700098 28284 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.732966 22397 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:19:15.736801 28284 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.736210 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.735862 28017 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.737380 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.739152 22397 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:19:15.735801 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.642599 28278 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:15.515120 28153 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:15.676391 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.740003 22401 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:19:15.743448 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 808) took 1899 ms. Trace:
I20260709 12:19:15.743945 22400 rpcz_store.cc:276] 0709 12:19:13.844167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:15.742311 (+1898144us) service_pool.cc:224] Handling call
0709 12:19:15.742691 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:15.742885 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:15.742912 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:15.742955 (+    43us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:19:15.742994 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:15.743044 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:15.743262 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:15.746248 22498 debug-util.cc:398] Leaking SignalData structure 0x7b080016aea0 after lost signal to thread 22426
I20260709 12:19:15.675770 28261 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:15.746089 28249 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:15.733376 28251 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:19:15.749212 22498 debug-util.cc:398] Leaking SignalData structure 0x7b08001af420 after lost signal to thread 22501
I20260709 12:19:15.749650 28249 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:15.749697 28173 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:15.726629 28230 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:15.750587 28173 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.709627 28252 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:15.752202 28252 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.752676 28246 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:15.753279 28173 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:15.753321 28246 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.754482 28252 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:15.755030 28153 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.727211 28268 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.750583 28249 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.780783 28289 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:15.749846 28251 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.781572 28289 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.765331 28278 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:15.777817 28230 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:15.770156 28265 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:15.787743 28230 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.788321 28278 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.788741 28173 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.787808 28265 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:15.786156 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 48143.2us
I20260709 12:19:15.762672 28280 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.789294 28173 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.794297 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:15.795912 28265 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.797052 28284 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:15.797632 28284 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:15.798209 28284 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.800540 28284 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:15.801086 28284 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.802644 28251 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.801622 28284 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.786425 28268 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:15.819393 28275 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.820317 28275 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:15.822332 22469 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:15.822017 28268 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:15.825109 28268 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.828563 28173 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.821313 22293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50176 (request call id 289) took 2500 ms. Trace:
I20260709 12:19:15.829339 28244 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:15.837584 22299 catalog_manager.cc:5697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 16 to 17, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 17 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:15.830682 28286 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:19:15.831741 22498 debug-util.cc:398] Leaking SignalData structure 0x7b080038f520 after lost signal to thread 22575
I20260709 12:19:15.792187 28289 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.838304 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:15.841969 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:15.842950 22476 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:19:15.842998 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:15.821272 28275 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.846115 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.846758 22402 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:15.847383 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:15.848846 28238 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:15.849043 28283 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:15.849954 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:15.850632 22468 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:15.851617 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:15.853070 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.854333 28286 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.858528 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:15.838973 28244 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:15.861969 28244 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:15.863356 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:15.864102 23125 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
W20260709 12:19:15.843881 22498 debug-util.cc:398] Leaking SignalData structure 0x7b08003c35c0 after lost signal to thread 22576
I20260709 12:19:15.835129 22293 rpcz_store.cc:276] 0709 12:19:13.320926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:13.321086 (+   160us) service_pool.cc:224] Handling call
0709 12:19:15.821111 (+2500025us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:13.352308 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:13.352841 (+   533us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:13.352874 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:19:13.352886 (+    12us) tablet.cc:662] Decoding operations
0709 12:19:13.353214 (+   328us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:13.353257 (+    43us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:13.353284 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:13.353450 (+   166us) tablet.cc:701] Row locks acquired
0709 12:19:13.353463 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:19:13.353612 (+   149us) write_op.cc:270] Start()
0709 12:19:13.364131 (+ 10519us) write_op.cc:276] Timestamp: P: 1783599553353549 usec, L: 0
0709 12:19:13.364155 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:19:13.389633 (+ 25478us) log.cc:844] Serialized 538 byte log entry
0709 12:19:13.412410 (+ 22777us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b540038b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b4fe28 00007fb4fc58a581 00007fb4fc589d58 00007fb4fc58e9f1 00007fb4fc58e9a9 00007fb4fc58e939 00007fb4fc58e901 00007fb4fc58db2d 0000000000388634 0000000000388479
0709 12:19:15.305447 (+1893037us) op_driver.cc:464] REPLICATION: finished
0709 12:19:15.691658 (+386211us) write_op.cc:301] APPLY: starting
0709 12:19:15.696824 (+  5166us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:15.698330 (+  1506us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:15.698370 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:15.699153 (+   783us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:15.699354 (+   201us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:19:15.699420 (+    66us) write_op.cc:312] APPLY: finished
0709 12:19:15.699732 (+   312us) log.cc:844] Serialized 25 byte log entry
0709 12:19:15.699915 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:15.700015 (+   100us) write_op.cc:454] Released schema lock
0709 12:19:15.700088 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:15.725477 (+ 25389us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:15.725511 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":370919,"apply.run_cpu_time_us":3989,"apply.run_wall_time_us":48706,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4190,"num_ops":1,"prepare.queue_time_us":746,"prepare.run_cpu_time_us":4708,"prepare.run_wall_time_us":60286,"replication_time_us":1940837,"spinlock_wait_cycles":49174784}]]}
I20260709 12:19:15.865202 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:15.865916 28275 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:15.866277 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:15.865908 22477 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:19:15.869872 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:15.870561 23122 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:19:15.809885 28265 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:15.875036 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:15.875605 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.875037 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:15.877516 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:15.858592 22297 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32988 (request call id 174) took 2588 ms. Trace:
I20260709 12:19:15.890503 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:15.890897 22477 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:15.882954 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:15.891861 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 55971.3us
I20260709 12:19:15.891427 23129 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:19:15.892768 28289 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:15.911180 22470 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 16: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:15.892670 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:15.930179 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.912757 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:15.895440 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:15.936203 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.935949 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.930620 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.069733 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.069554 28261 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:16.064909 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.063383 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.070858 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.063045 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.930974 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.913465 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.077061 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.077875 22547 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 23.
I20260709 12:19:16.075188 22546 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:16.079843 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.939898 28265 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:16.081172 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.079241 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:16.082486 22498 debug-util.cc:398] Leaking SignalData structure 0x7b0800084740 after lost signal to thread 23155
I20260709 12:19:15.893918 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.082566 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.076098 28294 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:16.083181 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.085026 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:15.893285 28272 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:16.086521 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.084170 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.088012 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.088768 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.089157 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:15.894440 28269 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:16.090528 22498 debug-util.cc:398] Leaking SignalData structure 0x7b0800145a20 after lost signal to thread 23156
I20260709 12:19:16.094103 22542 raft_consensus.cc:2410] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:19:15.955721 28287 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:16.096810 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.088069 23130 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:19:16.094847 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.099296 22546 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:19:16.100782 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.081504 28296 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:16.100060 28253 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:15.884801 22297 rpcz_store.cc:276] 0709 12:19:13.270180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:13.272315 (+  2135us) service_pool.cc:224] Handling call
0709 12:19:13.326013 (+ 53698us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b540038b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abe090 00007fb4f8b5cf3a 00007fb4fe912e9c 00007fb4fea1104e 00007fb4fced22a4 00007fb4fced2232 00007fb4fced2161 00007fb4fced20dc 00007fb4fced1392 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:15.858394 (+2532381us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:13.412778 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:13.413295 (+   517us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:13.413320 (+    25us) write_op.cc:435] Acquired schema lock
0709 12:19:13.413336 (+    16us) tablet.cc:662] Decoding operations
0709 12:19:13.413649 (+   313us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:13.413689 (+    40us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:13.413716 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:13.413934 (+   218us) tablet.cc:701] Row locks acquired
0709 12:19:13.413952 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:19:13.414077 (+   125us) write_op.cc:270] Start()
0709 12:19:13.414177 (+   100us) write_op.cc:276] Timestamp: P: 1783599553414027 usec, L: 0
0709 12:19:13.414201 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:19:15.013190 (+1598989us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b540038b6a0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8ad1520 00007fb4f8b5ab42 00007fb4f8b4ff67 00007fb4f8b4fda4 00007fb4fc58a581 00007fb4fc589d58 00007fb4fc58e9f1 00007fb4fc58e9a9 00007fb4fc58e939 00007fb4fc58e901
0709 12:19:15.026186 (+ 12996us) log.cc:844] Serialized 533 byte log entry
0709 12:19:15.661718 (+635532us) op_driver.cc:464] REPLICATION: finished
0709 12:19:15.733491 (+ 71773us) write_op.cc:301] APPLY: starting
0709 12:19:15.741650 (+  8159us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:15.827346 (+ 85696us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:15.827375 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:15.828225 (+   850us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:15.828385 (+   160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:19:15.828436 (+    51us) write_op.cc:312] APPLY: finished
0709 12:19:15.828652 (+   216us) log.cc:844] Serialized 25 byte log entry
0709 12:19:15.828843 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:15.828949 (+   106us) write_op.cc:454] Released schema lock
0709 12:19:15.828989 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:15.829367 (+   378us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:15.829395 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":103698304,"child_traces":[["op",{"apply.queue_time_us":71500,"apply.run_cpu_time_us":3493,"apply.run_wall_time_us":95825,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4190,"num_ops":1,"prepare.queue_time_us":47451,"prepare.run_cpu_time_us":30615,"prepare.run_wall_time_us":1613812,"replication_time_us":2247372,"spinlock_wait_cycles":45031296,"thread_start_us":72966,"threads_started":1}]]}
I20260709 12:19:16.102329 28296 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:16.102773 28253 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:16.103607 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.104204 22551 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:19:16.101277 22471 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:19:16.102280 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.084777 28294 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:16.105754 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.105916 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:16.110277 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.110553 22468 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:15.893460 28289 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:16.113047 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.076610 28275 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:16.115644 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.119477 22543 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:19:16.049106 28290 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:19:16.121188 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.096673 28271 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:16.122403 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.104750 28253 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:16.126775 22396 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:16.132079 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.132118 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.136556 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.142405 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.135329 28287 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:16.143851 28271 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:16.145967 28287 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:19:16.118341 28284 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:16.231173 28294 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:16.260043 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.265333 28246 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:16.274262 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 65228.8us
I20260709 12:19:16.301030 28289 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:16.317413 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 97243.8us
I20260709 12:19:16.319649 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.162950 28275 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:16.321447 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.339043 28230 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:16.338029 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.322118 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.337997 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.367812 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:16.371567 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.373997 28261 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:16.375458 28275 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:16.375849 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.377056 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.378894 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.380021 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.372363 23125 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:19:16.383217 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.385135 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.384922 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.388109 22476 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:16.385040 28265 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:16.389369 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:16.389653 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 231285us
I20260709 12:19:16.391183 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.390316 22468 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:19:16.393656 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.394290 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.395619 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.394971 23125 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:16.390480 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:16.396802 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.382467 28271 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:16.397876 22442 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.1:37927 timed out after 1.801s (SENT)
I20260709 12:19:16.399132 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.400525 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.402092 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:16.402462 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.402716 28230 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:16.402122 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.406396 28230 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:16.408268 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.408291 28230 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:16.409068 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.411329 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.411909 22400 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:16.412675 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.414803 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.416518 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.417546 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.413743 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.417872 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.434537 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.416975 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.437173 22472 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
I20260709 12:19:16.470633 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.472837 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.461835 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.465685 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.499676 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.462339 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.467212 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.468050 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.463145 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.470955 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.478433 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.482723 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.480085 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.479326 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.509367 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:16.461248 22347 auto_rebalancer.cc:629] Failed to schedule move for tablet fcf4dc17810b42c6bf0fc46fd69d0fd9: Illegal state: Replica 25ebf14868c042dca42f54b3e251e1b2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:16.510793 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.511510 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.511956 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.512518 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.512086 22402 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:16.470646 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.419057 28271 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:16.517503 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.418795 28278 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:16.518918 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.528159 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.528530 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.529525 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.519024 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.512488 22469 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
I20260709 12:19:16.520195 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.528779 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.522292 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.522446 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.531324 22399 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:19:16.482545 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.525090 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.520746 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.532513 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.531247 22402 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:16.437902 28017 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:16.534785 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 142422us
I20260709 12:19:16.537365 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:16.543730 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.526641 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:16.547091 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.558531 28286 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:16.559846 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.560317 22442 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:16.560541 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.561026 28230 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:16.524436 28271 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:16.563155 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.569257 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.571556 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.572551 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.573186 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.576053 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.580642 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:16.581918 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.585558 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.583169 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:16.575690 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:16.587441 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.561726 28249 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:16.588439 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.588337 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:16.601786 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.602787 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:16.590564 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.604667 22397 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
W20260709 12:19:16.605496 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 45363us
I20260709 12:19:16.607308 22548 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:16.608433 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:16.609298 22442 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:16.546415 28298 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:16.611912 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:16.574144 28271 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:16.612818 28265 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:16.615600 22397 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:16.617883 28230 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:16.622392 28280 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:16.605829 28153 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:16.622932 28168 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:16.625021 28240 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:16.581558 28260 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:19:16.567365 28296 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:16.636606 22442 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:16.638984 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.639992 23094 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:16.659739 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.585736 28255 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:19:16.660292 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 48448.1us
I20260709 12:19:16.613909 28252 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:16.636708 28278 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:16.670199 22442 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:16.670436 22516 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
W20260709 12:19:16.670976 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 87900.6us
I20260709 12:19:16.636173 28265 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:16.673936 23094 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:16.674230 28261 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:16.657629 28277 consensus_queue.cc:1059] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:19:16.666057 28279 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:16.687371 22442 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:19:16.688298 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 105884us
I20260709 12:19:16.688675 28312 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:16.689078 28312 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:16.689430 28312 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:16.670238 28268 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:19:16.688407 22442 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:16.694756 28232 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:16.695154 28232 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:16.674957 28289 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:16.695963 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.679674 23094 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:16.686278 22515 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:16.695540 28232 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:16.678978 28253 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:16.701094 28253 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:16.701488 28253 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:16.703975 28275 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:16.705976 28290 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:16.681685 28298 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:16.679972 28265 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:16.704320 28312 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:16.672465 28255 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:16.708577 28255 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:16.709025 28312 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:16.709707 28277 raft_consensus.cc:3055] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:16.710147 28277 raft_consensus.cc:740] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:16.710418 28271 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:16.711550 22547 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:16.687426 28263 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:16.712332 28263 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:16.712708 28263 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:16.683094 22468 consensus_queue.cc:237] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:16.674422 22294 catalog_manager.cc:5697] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 16 to 17, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 17 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:16.678798 28261 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:16.718014 28290 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:16.718346 28261 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:16.718642 28290 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:16.711012 28277 consensus_queue.cc:260] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:16.696275 22442 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:16.726346 22515 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:16.726393 23094 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:16.731760 22442 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:19:16.734629 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:16.738086 28310 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:16.739048 28296 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:16.740155 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 57039.7us
I20260709 12:19:16.740787 28260 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:16.740862 22441 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:19:16.741312 28260 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:16.741714 28260 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:16.743906 28268 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:16.744314 28268 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:16.744694 28268 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:16.750679 22442 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:16.726052 28277 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:16.753232 22515 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
W20260709 12:19:16.755432 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 57520.3us
I20260709 12:19:16.757084 28252 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:16.757601 28252 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:16.758019 28252 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:16.738636 28310 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:16.757906 28283 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:16.766113 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:16.772467 22545 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:16.775838 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.776959 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.777132 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:16.744716 28263 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:16.749733 28232 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:16.762020 28310 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:16.805524 28240 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:16.808669 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 129249us
I20260709 12:19:16.809957 22366 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:16.788107 28268 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:16.780262 23094 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:16.811731 22545 raft_consensus.cc:2468] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:16.813267 22516 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:16.815866 22516 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:16.815868 22366 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:16.822057 22515 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:16.789472 28278 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:16.783797 28271 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:16.824244 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.827956 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:16.809450 28260 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:16.821733 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:16.778959 28318 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:16.811424 28232 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:16.827661 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:16.827881 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:19:16.872315 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 50656.3us
W20260709 12:19:16.874804 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 134043us
I20260709 12:19:16.872653 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:16.818048 28296 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:16.875661 22441 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:16.789898 28252 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:16.824517 28017 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:16.877290 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:16.784916 28255 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:16.782861 28265 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:16.878351 22515 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:16.878753 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:16.827870 28240 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:16.792431 28261 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:16.818181 28272 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:16.808737 28253 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:16.878983 28237 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:19:16.885516 22516 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:16.887092 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 112181us
I20260709 12:19:16.873373 28318 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:16.823158 28283 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:16.825227 28280 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:19:16.890722 22516 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:16.881062 28278 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:16.876291 28314 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:16.823323 28298 consensus_queue.cc:1059] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:19:16.892143 28288 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:16.891798 28286 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:16.896382 28249 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:16.911903 22545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:19:16.912770 22545 raft_consensus.cc:606] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:16.913127 22545 raft_consensus.cc:614] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:16.887899 28271 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:16.910983 28252 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:16.889982 28318 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:16.914598 28268 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:16.914861 28261 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:16.916304 28253 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:16.917274 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:16.917655 28317 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:16.918073 28317 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:16.918448 28317 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:16.886356 28279 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:19:16.880906 28290 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:16.926295 28290 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:16.927423 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:16.928453 28255 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:16.892534 28280 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:16.930419 28280 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:19:16.932104 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 143404us
I20260709 12:19:16.912262 28249 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:16.935468 22367 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:16.890313 28283 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:16.825170 28275 consensus_queue.cc:1059] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 12:19:16.939066 28309 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:16.940001 22367 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:16.897931 28314 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:16.944504 22367 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:16.942616 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:16.945138 22299 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50158 (request call id 290) took 1428 ms. Trace:
W20260709 12:19:16.945228 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 56295.3us
I20260709 12:19:16.941509 22441 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:16.934880 28249 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:16.947736 28271 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:16.948768 28271 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:16.949128 28271 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:16.947715 28269 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:16.950353 28269 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:16.950752 28269 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:16.955389 28260 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:16.956982 22294 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50166 (request call id 323) took 1951 ms. Trace:
I20260709 12:19:16.945802 28314 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:16.945849 22299 rpcz_store.cc:276] 0709 12:19:15.514571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:15.514824 (+   253us) service_pool.cc:224] Handling call
0709 12:19:16.942630 (+1427806us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:16.351101 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:16.351819 (+   718us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:16.351877 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:19:16.351897 (+    20us) tablet.cc:662] Decoding operations
0709 12:19:16.352308 (+   411us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:16.352399 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:16.352433 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:16.352694 (+   261us) tablet.cc:701] Row locks acquired
0709 12:19:16.352763 (+    69us) write_op.cc:260] PREPARE: finished
0709 12:19:16.352939 (+   176us) write_op.cc:270] Start()
0709 12:19:16.353088 (+   149us) write_op.cc:276] Timestamp: P: 1783599556352861 usec, L: 0
0709 12:19:16.353108 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:19:16.372719 (+ 19611us) log.cc:844] Serialized 538 byte log entry
0709 12:19:16.721895 (+349176us) op_driver.cc:464] REPLICATION: finished
0709 12:19:16.806120 (+ 84225us) write_op.cc:301] APPLY: starting
0709 12:19:16.806218 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:16.807439 (+  1221us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:16.807546 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:16.808256 (+   710us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:16.808451 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:19:16.808498 (+    47us) write_op.cc:312] APPLY: finished
0709 12:19:16.808698 (+   200us) log.cc:844] Serialized 25 byte log entry
0709 12:19:16.808872 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:16.809000 (+   128us) write_op.cc:454] Released schema lock
0709 12:19:16.809090 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:16.809488 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:16.809512 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":83940,"apply.run_cpu_time_us":3356,"apply.run_wall_time_us":3356,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8317,"num_ops":1,"prepare.queue_time_us":467944,"prepare.run_cpu_time_us":3502,"prepare.run_wall_time_us":34529,"replication_time_us":328941,"thread_start_us":278693,"threads_started":2}]]}
I20260709 12:19:16.962248 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:16.962852 22367 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:16.942088 28283 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:16.979275 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:16.979736 22367 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:16.983502 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:16.945874 28277 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:16.946429 28298 raft_consensus.cc:3055] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:16.987713 28318 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:16.980589 28309 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:16.990404 28309 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:16.990749 28309 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:16.991117 28309 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:16.993863 28279 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:16.957368 22294 rpcz_store.cc:276] 0709 12:19:15.005678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:15.006053 (+   375us) service_pool.cc:224] Handling call
0709 12:19:15.654933 (+648880us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b540038b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abe090 00007fb4f8b5cf3a 00007fb4fe912e9c 00007fb4fea1104e 00007fb4fced22a4 00007fb4fced2232 00007fb4fced2161 00007fb4fced20dc 00007fb4fced1392 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:16.956923 (+1301990us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:16.720168 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:16.720681 (+   513us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:16.720721 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:19:16.720737 (+    16us) tablet.cc:662] Decoding operations
0709 12:19:16.721061 (+   324us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:16.721105 (+    44us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:16.721131 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:16.721309 (+   178us) tablet.cc:701] Row locks acquired
0709 12:19:16.721326 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:19:16.721458 (+   132us) write_op.cc:270] Start()
0709 12:19:16.721570 (+   112us) write_op.cc:276] Timestamp: P: 1783599556721412 usec, L: 0
0709 12:19:16.721589 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:19:16.792271 (+ 70682us) log.cc:844] Serialized 538 byte log entry
0709 12:19:16.794129 (+  1858us) op_driver.cc:464] REPLICATION: finished
0709 12:19:16.800643 (+  6514us) spinlock_profiling.cc:243] Waited 50.4 ms on lock 0x7b540038b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b4fe28 00007fb4fc58a581 00007fb4fc589d58 00007fb4fc58e9f1 00007fb4fc58e9a9 00007fb4fc58e939 00007fb4fc58e901 00007fb4fc58db2d 0000000000388634 0000000000388479
0709 12:19:16.811330 (+ 10687us) write_op.cc:301] APPLY: starting
0709 12:19:16.815018 (+  3688us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:16.938766 (+123748us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:16.938793 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:16.939582 (+   789us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:16.939744 (+   162us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:19:16.939783 (+    39us) write_op.cc:312] APPLY: finished
0709 12:19:16.939966 (+   183us) log.cc:844] Serialized 25 byte log entry
0709 12:19:16.940153 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:16.940232 (+    79us) write_op.cc:454] Released schema lock
0709 12:19:16.940269 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:16.940604 (+   335us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:16.940638 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1927,"reported_tablets":2,"spinlock_wait_cycles":57458048,"child_traces":[["op",{"apply.queue_time_us":15485,"apply.run_cpu_time_us":3472,"apply.run_wall_time_us":129255,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4190,"num_ops":1,"prepare.queue_time_us":122,"prepare.run_cpu_time_us":5355,"prepare.run_wall_time_us":80640,"replication_time_us":72404,"spinlock_wait_cycles":115881344,"thread_start_us":85834,"threads_started":1}]]}
I20260709 12:19:16.997610 28310 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.001231 28310 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:16.967865 28268 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:17.001426 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:17.001991 28268 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:17.002430 28268 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:17.010186 28318 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:16.985751 28272 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:17.010933 28272 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:17.011324 28272 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:17.011531 22545 raft_consensus.cc:1240] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:17.013157 28289 consensus_queue.cc:1059] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:17.014201 28289 raft_consensus.cc:3055] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:17.014513 28289 raft_consensus.cc:740] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:17.015442 28289 consensus_queue.cc:260] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.016510 28289 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:17.017876 22441 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:19:17.019230 28260 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:17.019757 22441 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.020483 28260 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:19:17.020692 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 58551.5us
I20260709 12:19:17.020955 28260 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:17.021364 28260 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:16.964785 28265 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:16.968174 28263 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:17.021737 28319 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:17.022886 28319 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:17.023279 28319 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:16.967618 28296 raft_consensus.cc:3055] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:17.029081 28296 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:17.023313 22442 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.030804 28318 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:17.031164 28318 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:17.015600 28317 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.031505 28318 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:17.034660 28317 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:17.038046 28290 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:17.038326 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:17.034551 22442 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.041648 28312 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:17.042066 28312 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:17.042445 28312 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:17.042865 28324 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:17.048846 28269 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.040035 22441 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.051149 28269 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:17.062875 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 78252us
I20260709 12:19:17.051828 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:17.052368 28317 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:17.042177 22442 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:17.029961 28296 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.069223 22516 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:17.070451 22442 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.039949 28260 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.076638 22545 raft_consensus.cc:1240] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:19:17.071784 28309 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.079521 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:17.080790 28309 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:17.083238 28271 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.084352 28272 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.087333 28314 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.089434 28314 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:17.073004 28253 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:17.096007 28272 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:17.073623 28324 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:17.071660 28265 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:17.062700 28249 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.099987 28296 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:17.085508 28271 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:17.102291 22442 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:17.101696 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 115213us
I20260709 12:19:17.061273 28298 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:17.103106 28324 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:17.104008 28265 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:17.107695 22477 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:17.108060 28265 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:17.108759 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:17.103947 28263 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:17.110980 22442 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.106812 22367 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:17.112386 22477 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:17.112499 22545 raft_consensus.cc:1240] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:17.001639 28283 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.111769 28263 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:17.118023 28263 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:17.118279 22473 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:17.118556 28280 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.118839 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:17.112016 28324 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:17.120587 28317 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:19:17.123237 28283 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:17.113906 28268 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.071055 28319 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.126878 22477 raft_consensus.cc:1240] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:17.127624 28260 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:17.119045 28249 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:17.128648 28280 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 24 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:17.129356 28268 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:17.131032 28319 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:17.132705 28298 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.134493 22468 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:17.125487 28322 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.137022 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:17.138304 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.138576 28312 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.136591 22477 raft_consensus.cc:1240] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:17.140424 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:17.140800 28289 consensus_queue.cc:1059] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:17.141618 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:17.141794 28289 raft_consensus.cc:3055] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:17.142148 28289 raft_consensus.cc:740] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:17.143591 28289 consensus_queue.cc:260] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.144793 28289 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:17.146062 28280 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:17.146551 22367 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.157748 22367 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:17.148337 28263 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.148284 28318 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.112375 28314 consensus_queue.cc:1059] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:19:17.148734 28324 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.149904 22545 raft_consensus.cc:1240] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:17.150132 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:17.154932 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:17.155306 22397 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 24 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:19:17.155443 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.161974 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:17.158080 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:17.159744 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.158752 22516 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.161348 28269 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:17.170722 22441 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.172712 22441 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.173094 22473 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:17.174156 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.172559 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.175588 22468 raft_consensus.cc:1240] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:17.165434 28263 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:17.175098 22441 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.176600 22367 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.164932 28296 consensus_queue.cc:1059] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:17.177973 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.179589 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:17.179674 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:17.178035 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.160519 28326 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:17.183073 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.186182 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.182972 22441 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.186728 22401 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:17.166396 28298 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:17.179939 28255 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:17.190548 22367 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.191874 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:17.192109 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.193125 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.193852 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:17.196173 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.196555 22402 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:17.179736 28290 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:17.197710 28278 consensus_queue.cc:1059] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:17.198036 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.198808 28275 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:17.199227 23095 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.200331 23095 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.201094 28275 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:17.189420 28253 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:17.201745 28275 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:17.178424 28322 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:17.203207 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.204450 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.211457 28280 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.212464 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.213239 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.214596 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.214855 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.215379 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.205437 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:17.216276 28253 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:17.217118 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.217249 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.208350 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:17.218122 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.219449 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.220803 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.200424 28293 raft_consensus.cc:3055] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:17.221920 28293 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:17.222391 28327 raft_consensus.cc:3055] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:17.222779 28327 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:17.202585 28323 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:17.222954 22367 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:17.223649 28323 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:17.182358 28320 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:17.224545 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.189301 28310 consensus_queue.cc:1059] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:19:17.205732 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:17.222863 28293 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.225313 22367 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.228711 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.224896 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.231218 22367 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.232483 22401 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
W20260709 12:19:17.234783 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 47841us
I20260709 12:19:17.235082 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.231819 22545 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:17.237089 22551 raft_consensus.cc:2393] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 17: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:17.182379 28312 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:17.237409 22367 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.238184 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:17.239493 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:17.187642 28265 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.241955 28325 raft_consensus.cc:3055] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:17.242343 28325 raft_consensus.cc:740] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:17.243180 28325 consensus_queue.cc:260] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.202612 28263 raft_consensus.cc:2804] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:17.244307 28325 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:17.244586 28265 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:17.245680 28249 consensus_queue.cc:1059] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:17.246690 28249 raft_consensus.cc:3055] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:17.247035 28249 raft_consensus.cc:740] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:17.248338 22472 raft_consensus.cc:1240] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:17.248514 28272 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.213260 28324 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:17.248333 28314 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:17.247912 28249 consensus_queue.cc:260] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.250772 28249 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:17.254074 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.240720 28277 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:17.249050 28293 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:17.256525 28286 consensus_queue.cc:1059] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:17.256805 28290 consensus_queue.cc:1059] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:17.257558 28286 consensus_queue.cc:1059] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:17.244518 28263 raft_consensus.cc:697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:17.258366 28290 raft_consensus.cc:3055] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:17.258560 28286 raft_consensus.cc:3055] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:17.255260 28283 raft_consensus.cc:3055] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:17.258774 28263 consensus_queue.cc:237] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.259572 28283 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:17.259114 28271 raft_consensus.cc:3055] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:17.260387 28271 raft_consensus.cc:740] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:17.260609 28283 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.259595 28286 raft_consensus.cc:740] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:17.261286 28271 consensus_queue.cc:260] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.258611 28327 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.262012 28286 consensus_queue.cc:260] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.262603 28327 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:17.262740 28271 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:17.263226 28286 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:17.227555 28279 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:17.238507 22367 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.259049 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:17.259199 28290 raft_consensus.cc:740] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:17.270967 28253 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:17.271590 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:17.271010 28290 consensus_queue.cc:260] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.272938 28290 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:17.269057 28277 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:17.274477 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.282866 28318 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:17.295904 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.296593 22400 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:17.297080 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 58646.1us
I20260709 12:19:17.297951 22367 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.300427 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:17.303905 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:19:17.305612 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 105358us
I20260709 12:19:17.307853 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.311479 22367 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.309170 23095 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.314523 22367 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.314849 22516 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.315367 23095 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.304020 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.318423 22551 raft_consensus.cc:2393] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 14: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:17.319563 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.321889 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.324406 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.326077 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.327098 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.330585 22547 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:17.305559 28283 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:17.338035 22551 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:17.339782 22442 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.325682 28326 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:17.341732 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.314051 28296 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.347856 22442 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.348484 28317 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:17.313372 28272 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.310772 28279 consensus_queue.cc:1059] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:19:17.354132 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.319877 28269 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:17.329591 28280 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:17.329941 28240 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:17.359339 23122 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:19:17.313527 28318 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:19:17.364118 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.364630 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.323283 28278 consensus_queue.cc:1059] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:19:17.366212 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.366544 22442 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.313292 28253 consensus_queue.cc:1059] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 12:19:17.373195 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.373348 22442 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.375811 22395 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14. Ops: []
W20260709 12:19:17.427606 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 101595us
I20260709 12:19:17.371644 28296 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:17.414505 28331 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.357993 28255 consensus_queue.cc:1059] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:19:17.390134 28310 raft_consensus.cc:3055] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:17.362759 28268 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:17.454476 28322 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:19:17.457448 28240 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:19:17.454947 22367 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.454293 22516 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.455310 22399 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:17.456346 22477 raft_consensus.cc:606] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:17.457631 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 84366.9us
I20260709 12:19:17.476970 22442 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.454178 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.461678 28263 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:19:17.476071 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 96512.7us
I20260709 12:19:17.480000 22516 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.481088 22516 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.478506 22400 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:19:17.464793 28310 raft_consensus.cc:740] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:17.458626 28312 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:19:17.483595 22398 raft_consensus.cc:1240] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 12:19:17.483671 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 168359us
I20260709 12:19:17.507545 23095 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.508481 23127 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:19:17.482453 22442 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.484169 28017 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:17.484508 28232 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:17.486681 28280 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:17.487685 28278 raft_consensus.cc:3055] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:17.488458 28336 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:17.489524 28310 consensus_queue.cc:260] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:17.490953 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.491601 28240 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:17.478395 28253 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:19:17.479802 28255 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 12:19:17.485194 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 93974.2us
I20260709 12:19:17.485437 22367 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.524796 22367 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.510391 22442 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.525602 22468 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:17.519989 23095 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.511044 28252 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:17.518353 28278 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:19:17.529943 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.526432 28336 raft_consensus.cc:2764] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:19:17.530368 28290 consensus_queue.cc:1059] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:17.518234 28298 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:17.532369 22442 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.534463 22367 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.530401 28310 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:17.537241 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.535249 28260 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:17.522459 28255 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:17.538004 22477 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:17.538477 28323 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:17.543040 22442 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:17.545493 28290 raft_consensus.cc:3055] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:17.545895 28290 raft_consensus.cc:740] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:17.546176 28260 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:17.546691 28260 raft_consensus.cc:697] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:17.546748 28290 consensus_queue.cc:260] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.547943 28290 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:17.547845 28260 consensus_queue.cc:237] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.549623 28255 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:17.542425 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.543890 28338 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:17.550846 28338 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:17.551230 28338 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:17.544243 22367 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:17.537160 28275 consensus_queue.cc:1059] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:19:17.553133 22442 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.554328 28275 raft_consensus.cc:3055] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:17.554690 28275 raft_consensus.cc:740] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:17.555491 28275 consensus_queue.cc:260] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.556528 28232 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:17.556650 28275 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:17.557574 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.544795 28332 consensus_queue.cc:1059] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:19:17.558333 22442 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.558631 28278 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.559501 22442 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:17.560238 22441 consensus_peers.cc:597] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff6628c2d6a44791975f2350758cb3db. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:17.560920 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 219808us
I20260709 12:19:17.560138 28312 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.562563 22441 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.563859 28312 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:17.565351 22441 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.542263 28252 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:17.567005 28339 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:17.569365 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:19:17.538002 28337 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:17.570112 28252 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:17.566540 28317 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:17.571342 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.572115 28317 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:17.572579 28317 raft_consensus.cc:697] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:17.573892 28272 raft_consensus.cc:3055] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:17.574276 28272 raft_consensus.cc:740] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:17.573414 28317 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.575069 28272 consensus_queue.cc:260] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.576334 28272 raft_consensus.cc:3060] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:17.570617 28252 raft_consensus.cc:697] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:17.580056 28252 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.559808 28278 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:17.588133 28255 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:19:17.588865 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:17.590044 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:17.590914 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:17.591634 22472 raft_consensus.cc:2393] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 14: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:17.592397 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:17.593103 22468 raft_consensus.cc:2393] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 17: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:17.590955 22469 raft_consensus.cc:1240] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:17.594046 22470 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:17.594303 22396 raft_consensus.cc:1240] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:17.590226 22476 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:17.597389 23095 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:17.597699 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.598984 28017 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:17.599575 28017 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.601366 22477 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:17.601749 28017 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:17.606515 22367 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:17.607545 28279 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:19:17.608311 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 48887.7us
I20260709 12:19:17.609082 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.608917 28341 consensus_queue.cc:1059] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:17.610502 28318 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.610852 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:17.611446 28317 raft_consensus.cc:3055] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:17.589419 28338 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.612282 28017 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:17.612507 28325 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:17.540020 28298 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:17.613170 28017 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.615631 28017 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:17.611987 28317 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:17.616983 22396 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:17.617481 28298 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:17.616947 28317 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.618561 28317 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:17.613967 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.623420 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:17.623943 23095 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.624082 22402 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:19:17.629637 22367 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.633186 22294 catalog_manager.cc:5697] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 17 to 18, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 18 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:17.628042 22442 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.641942 22476 raft_consensus.cc:1240] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:17.631177 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:17.642839 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:17.646085 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.647428 28326 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:17.648442 22473 raft_consensus.cc:2410] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 12:19:17.648526 28326 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:17.649238 28326 consensus_queue.cc:1059] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:17.650599 28314 raft_consensus.cc:3055] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:17.650957 28314 raft_consensus.cc:740] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:17.651801 28314 consensus_queue.cc:260] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.653023 28314 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:17.656554 22442 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.662698 22442 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.668078 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:17.672135 28255 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.672644 28342 consensus_queue.cc:1059] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:17.674209 28342 raft_consensus.cc:3055] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:17.674306 22473 raft_consensus.cc:1240] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:17.675364 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:17.676071 22476 raft_consensus.cc:2393] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 19: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:17.677383 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.666829 28265 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.669384 28318 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:19:17.683291 22476 raft_consensus.cc:1240] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:17.680680 22367 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.656677 28275 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.681811 22442 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.663388 28325 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:17.686404 28286 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:17.686453 28339 consensus_queue.cc:1059] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:17.683314 28017 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:17.668035 28327 consensus_queue.cc:1059] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:19:17.684427 28326 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:19:17.669541 28336 consensus_queue.cc:1059] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:19:17.706450 28339 raft_consensus.cc:3055] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:17.706845 28339 raft_consensus.cc:740] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:17.706955 28327 raft_consensus.cc:3055] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:17.707440 28327 raft_consensus.cc:740] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:17.708330 28327 consensus_queue.cc:260] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.709220 28309 raft_consensus.cc:3055] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:17.685911 28342 raft_consensus.cc:740] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:17.694218 28338 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:17.735329 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.697980 28319 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:17.738835 28249 consensus_queue.cc:1059] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:17.739992 28249 raft_consensus.cc:3055] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:17.740386 28249 raft_consensus.cc:740] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:17.709658 28327 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:17.709622 28309 raft_consensus.cc:740] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:17.747591 22476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "65951063312d4a1e9123f92354101c71"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:17.755507 22476 raft_consensus.cc:606] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Received request to transfer leadership to TS 65951063312d4a1e9123f92354101c71
I20260709 12:19:17.710721 28286 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:17.749171 22366 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:19:17.710846 28279 consensus_queue.cc:1175] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "65951063312d4a1e9123f92354101c71" responder_term: 17 status { last_received { term: 17 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 17 index: 12 } }
I20260709 12:19:17.696887 28278 consensus_queue.cc:1059] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:19:17.752242 28319 raft_consensus.cc:697] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:17.757858 22547 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
I20260709 12:19:17.759156 28286 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:17.772610 28319 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.768715 28298 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.774118 23122 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:17.776321 28298 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:17.768846 22548 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:19:17.777661 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.776961 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:17.770371 28314 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:19:17.771898 28168 raft_consensus.cc:3055] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:17.780601 28168 raft_consensus.cc:740] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:17.781708 28168 consensus_queue.cc:260] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.783722 22476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "65951063312d4a1e9123f92354101c71"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:17.741271 28249 consensus_queue.cc:260] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.794366 23095 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:17.788987 22476 raft_consensus.cc:606] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Received request to transfer leadership to TS 65951063312d4a1e9123f92354101c71
I20260709 12:19:17.806492 22396 raft_consensus.cc:1240] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:17.791465 28339 consensus_queue.cc:260] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.788875 28342 consensus_queue.cc:260] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.794540 28310 consensus_queue.cc:1059] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 12:19:17.810609 28310 raft_consensus.cc:3055] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:17.791328 28309 consensus_queue.cc:260] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.791160 28317 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:19:17.811995 22551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
mode: GRACEFUL
new_leader_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:47064
I20260709 12:19:17.812125 28309 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:17.812569 22551 raft_consensus.cc:606] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Received request to transfer leadership to TS 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:17.798465 28168 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:17.811127 28310 raft_consensus.cc:740] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:17.813980 28337 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:19:17.814088 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:17.814508 28310 consensus_queue.cc:260] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.810586 28342 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:17.816355 28337 consensus_queue.cc:1059] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:17.817330 28337 raft_consensus.cc:3055] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:17.817623 28337 raft_consensus.cc:740] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:17.818470 28337 consensus_queue.cc:260] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.802053 28286 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:17.793788 28249 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:17.802253 28345 log.cc:927] Time spent T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:19:17.815917 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:17.822830 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:17.819096 28339 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:17.815914 28310 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:17.831585 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.819832 28337 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:17.835309 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:17.836817 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.802624 22441 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:17.837653 28253 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:17.838519 28286 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:17.839017 28324 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:17.839569 28324 raft_consensus.cc:697] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:17.844260 28324 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.846500 28260 raft_consensus.cc:2955] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:17.887331 22544 raft_consensus.cc:1240] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:17.890621 22396 raft_consensus.cc:2955] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:17.898012 28344 consensus_queue.cc:1059] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:17.900490 28265 raft_consensus.cc:993] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 65951063312d4a1e9123f92354101c71 to start an election
I20260709 12:19:17.900961 28317 raft_consensus.cc:1081] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Signalling peer 65951063312d4a1e9123f92354101c71 to start an election
I20260709 12:19:17.901866 22402 raft_consensus.cc:1275] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 12:19:17.902271 22402 pending_rounds.cc:85] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 9
I20260709 12:19:17.902469 22402 pending_rounds.cc:107] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:19:17.902726 22402 raft_consensus.cc:2889] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:17.904327 28265 consensus_queue.cc:1048] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:17.907503 23127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4"
dest_uuid: "65951063312d4a1e9123f92354101c71"
 from {username='slave'} at 127.0.0.1:41012
I20260709 12:19:17.908129 23127 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:17.908478 23127 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:17.920176 28354 ts_tablet_manager.cc:933] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:17.929692 23127 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.938477 28249 raft_consensus.cc:993] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932: : Instructing follower 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:17.939301 28310 raft_consensus.cc:1081] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Signalling peer 25ebf14868c042dca42f54b3e251e1b2 to start an election
I20260709 12:19:17.941220 22476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
 from {username='slave'} at 127.0.0.1:36296
I20260709 12:19:17.941836 22476 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:17.942216 22476 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:17.954133 22551 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:17.957494 23127 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:17.958458 28327 consensus_queue.cc:1059] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:17.959569 28327 raft_consensus.cc:3055] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:17.959937 28327 raft_consensus.cc:740] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:17.956488 22548 raft_consensus.cc:1240] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:17.963423 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:17.964114 22469 raft_consensus.cc:3055] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:17.964443 22469 raft_consensus.cc:740] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:17.964787 28332 consensus_queue.cc:1059] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:17.965821 28332 raft_consensus.cc:3055] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:17.966152 28332 raft_consensus.cc:740] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:17.966528 22469 consensus_queue.cc:260] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.966936 28332 consensus_queue.cc:260] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:17.967890 22469 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:17.971750 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.972501 22396 raft_consensus.cc:3060] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:17.977016 22476 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.968323 28332 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:17.982504 22476 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:17.983614 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:17.984328 22548 raft_consensus.cc:3055] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:17.984671 22548 raft_consensus.cc:740] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:17.985756 22548 consensus_queue.cc:260] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:17.987041 22548 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:17.982507 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:17.994910 22402 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:17.956652 28260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:38684 (request call id 7) took 1362 ms. Trace:
I20260709 12:19:18.005795 22548 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:19:18.008750 22396 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:19:18.007015 22441 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:18.010061 23095 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:17.960835 28327 consensus_queue.cc:260] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:18.006633 28309 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.014881 28252 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:18.018327 28331 raft_consensus.cc:2804] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:18.029498 28327 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:18.025513 28354 tablet_copy_client.cc:323] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.2:46187
I20260709 12:19:18.060253 22548 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:18.065125 22402 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:19:18.064473 22547 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:19:18.066134 22469 raft_consensus.cc:2468] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:19:18.067790 22398 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:18.028484 28252 raft_consensus.cc:697] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:18.059952 28331 raft_consensus.cc:697] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [term 12 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:18.068573 22487 tablet_copy_service.cc:140] P 25ebf14868c042dca42f54b3e251e1b2: Received BeginTabletCopySession request for tablet ff6628c2d6a44791975f2350758cb3db from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:43060)
I20260709 12:19:18.072135 22487 tablet_copy_service.cc:161] P 25ebf14868c042dca42f54b3e251e1b2: Beginning new tablet copy session on tablet ff6628c2d6a44791975f2350758cb3db from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:43060: session id = 65951063312d4a1e9123f92354101c71-ff6628c2d6a44791975f2350758cb3db
I20260709 12:19:18.072152 28331 consensus_queue.cc:237] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:18.076141 28319 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:17.996321 28260 rpcz_store.cc:276] 0709 12:19:16.579748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:16.579878 (+   130us) service_pool.cc:224] Handling call
0709 12:19:16.717400 (+137522us) log.cc:844] Serialized 499 byte log entry
0709 12:19:16.955081 (+237681us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b18002fd940. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:19:17.942487 (+987406us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45230,"raft.queue_time_us":133167,"raft.run_cpu_time_us":2231,"raft.run_wall_time_us":82727,"spinlock_wait_cycles":4341504,"thread_start_us":97540,"threads_started":2,"wal-append.queue_time_us":52884,"wal-append.run_cpu_time_us":1890,"wal-append.run_wall_time_us":1011642}
I20260709 12:19:18.070407 28255 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:18.070490 28252 consensus_queue.cc:237] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.023630 28309 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.086968 28260 raft_consensus.cc:3055] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:18.087414 28260 raft_consensus.cc:740] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:18.088471 28260 consensus_queue.cc:260] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:18.091228 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:18.091926 22544 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:19:18.093338 22366 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:18.094182 28332 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:18.094672 28332 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.095134 28332 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:18.100661 23127 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:18.102998 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:18.103615 22469 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:19:18.103461 28317 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:18.087189 28309 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:18.105994 23125 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:19:18.108057 23127 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:18.114429 28265 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:19:18.122107 28309 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:18.122783 28309 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:18.125970 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:18.126713 22551 raft_consensus.cc:2393] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 15: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:18.128961 28309 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:18.141279 28319 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:19:18.149979 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 49330.1us
I20260709 12:19:18.152910 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:18.153673 23125 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:19:18.154968 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:18.156320 28327 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:18.156781 28327 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:18.157169 28327 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:18.160733 28260 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:18.152915 22547 consensus_queue.cc:237] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:18.184454 28319 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:18.189983 28332 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.196544 28332 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:18.198062 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:18.198671 22548 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:18.091274 22297 catalog_manager.cc:5697] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 16 to 17, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 17 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:18.212605 22297 catalog_manager.cc:5697] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 13 to 14, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 14 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:18.218061 22297 catalog_manager.cc:5697] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 12 to 13, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:18.219882 22297 catalog_manager.cc:5697] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 18 to 19, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 19 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:18.230477 22299 catalog_manager.cc:5697] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 11 to 12, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 12 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:18.238986 22548 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:18.242875 22366 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:18.242750 22297 catalog_manager.cc:5697] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 15 to 16, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 16 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:18.245491 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:18.246459 22473 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:18.248974 22297 catalog_manager.cc:5697] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index -1 to 9, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:18.252676 28332 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:18.259933 22398 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:19:18.261505 28332 raft_consensus.cc:697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:18.266187 28332 consensus_queue.cc:237] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.271620 28261 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:18.295275 28341 raft_consensus.cc:993] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 65951063312d4a1e9123f92354101c71 to start an election
I20260709 12:19:18.295776 28341 raft_consensus.cc:1081] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Signalling peer 65951063312d4a1e9123f92354101c71 to start an election
I20260709 12:19:18.297052 22469 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:19:18.300652 22515 consensus_peers.cc:597] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cbdd827fb2d34627bbd307872debd3d3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:18.301302 23123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84"
dest_uuid: "65951063312d4a1e9123f92354101c71"
 from {username='slave'} at 127.0.0.1:41012
I20260709 12:19:18.302244 23123 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:18.302591 23123 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:18.312799 22487 tablet_copy_source_session.cc:215] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:18.319777 22548 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:18.321512 28255 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:18.324378 22398 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:18.306354 28286 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:19:18.334776 28342 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:19:18.343016 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:18.346088 22398 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:18.347745 28344 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:18.358989 22473 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:18.361747 23123 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:18.372463 28327 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:18.376157 28354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff6628c2d6a44791975f2350758cb3db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.383975 28327 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:18.385474 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:18.386345 22547 raft_consensus.cc:2393] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 15: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:18.391489 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:18.392165 22547 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:18.401526 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:18.402362 22473 raft_consensus.cc:3055] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:18.402637 22473 raft_consensus.cc:740] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:18.403332 22473 consensus_queue.cc:260] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:18.404410 22473 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:18.405870 23123 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:18.401572 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:18.419040 22473 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 16.
I20260709 12:19:18.426301 23095 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:19:18.409739 22547 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 16.
I20260709 12:19:18.430147 28342 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.431051 28298 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:18.445262 28342 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.449936 28342 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:18.450548 28298 raft_consensus.cc:697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 16 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:18.450304 22293 catalog_manager.cc:5697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:18.451327 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:18.451493 28298 consensus_queue.cc:237] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:18.451977 22396 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:18.453254 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:18.455741 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:18.457211 28286 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:18.457647 28286 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.458009 28286 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:18.460614 22476 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:18.462687 28331 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:18.462587 22473 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:18.462597 28310 raft_consensus.cc:2955] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:18.475430 22544 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:18.481510 22469 raft_consensus.cc:2955] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:18.487056 23125 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:19:18.477530 22400 raft_consensus.cc:2955] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:18.493165 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:18.493842 28255 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:18.511111 22547 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:19:18.511430 28327 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:18.511950 28327 raft_consensus.cc:697] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:18.512807 28327 consensus_queue.cc:237] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:18.521929 28344 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:18.527235 22396 raft_consensus.cc:1275] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:18.535014 22397 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:18.537590 28255 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:18.549026 22299 catalog_manager.cc:5697] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 11 to 12, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 12 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:18.546947 28249 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.548607 28337 consensus_queue.cc:1048] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:19:18.572484 28249 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.574674 28249 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:18.575426 28342 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.588694 28354 tablet_copy_client.cc:806] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:18.589309 28354 tablet_copy_client.cc:670] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
W20260709 12:19:18.592350 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 51831.7us
I20260709 12:19:18.582307 28342 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.603220 28342 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:18.597445 22297 catalog_manager.cc:5697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 15 to 16, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 16 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:18.625034 28387 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.625576 28387 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.627740 28387 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:18.630303 28286 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.644424 22293 catalog_manager.cc:5697] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 14 to 15, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 15 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:18.646167 28320 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.652874 28286 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:18.652693 28320 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.655471 28320 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:18.657394 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:18.658047 22398 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
I20260709 12:19:18.658946 22442 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:18.659991 28320 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:18.660367 28320 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.660688 28320 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:18.658776 22296 catalog_manager.cc:5697] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index -1 to 9, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 14 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:18.651948 28354 tablet_copy_client.cc:538] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:18.666838 22469 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:18.676194 22398 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:19:18.679874 28344 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:18.688728 28260 raft_consensus.cc:2955] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
W20260709 12:19:18.694337 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 111289us
I20260709 12:19:18.696530 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:18.697118 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:18.697837 22476 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:19:18.698726 22400 raft_consensus.cc:2955] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:18.700460 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:18.701156 22476 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:18.703387 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:18.704282 22476 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:18.706538 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:18.707273 22402 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
I20260709 12:19:18.708858 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:18.709492 22399 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:18.710578 28249 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:18.710852 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:18.711282 22476 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:18.711125 28249 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.712059 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:18.711467 22399 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:18.713187 28249 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:18.720460 28286 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.721017 28286 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.723930 28286 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:18.724080 28249 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.724575 28249 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:18.725841 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 79136.9us
I20260709 12:19:18.724828 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:18.729895 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:18.730129 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:18.730711 22402 raft_consensus.cc:2393] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 24: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:18.730656 22548 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
I20260709 12:19:18.731527 28389 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:18.731961 28389 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.732306 28389 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:18.733702 28249 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:18.735033 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:18.735852 23127 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:18.736264 22399 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:18.737066 22515 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:18.737896 28249 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:18.738255 28249 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.738579 28249 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:18.740824 28389 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.743266 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:18.748849 28310 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:18.749302 28310 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.749661 28310 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:18.757498 28310 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.757623 28249 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:18.759686 28310 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:18.760548 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:18.761258 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:18.761945 23127 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:18.762212 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:18.762907 22476 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 24.
I20260709 12:19:18.769651 23127 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:18.770035 28389 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:18.770848 22515 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:18.771708 28286 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:18.773232 22544 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:19:18.776311 22468 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:19:18.780812 28286 raft_consensus.cc:697] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:18.770931 28389 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:18.782050 28389 raft_consensus.cc:697] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:18.782927 28389 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.783285 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:18.784049 22468 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:19:18.787569 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:18.788239 22468 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:18.789217 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:18.790803 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:18.782027 28286 consensus_queue.cc:237] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:18.796839 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:18.808467 28310 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:18.809005 28310 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.809415 28310 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:18.809623 22548 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:19:18.810101 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:18.811084 28337 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.812013 28337 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:18.817384 28337 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:18.798136 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:18.798933 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:18.800794 28249 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:18.818321 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:18.818922 22398 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:18.819061 22548 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 18.
I20260709 12:19:18.820572 23094 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:18.821820 28337 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:18.822250 28337 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.822602 28337 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:18.826102 22468 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:18.828853 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:18.829901 22399 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
I20260709 12:19:18.836715 28354 tablet_bootstrap.cc:492] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:19:18.837061 22296 catalog_manager.cc:5697] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 15 to 16, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 16 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:18.838169 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:18.839406 22441 consensus_peers.cc:597] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f7fcc060e2443ad87cf29161f3ea079. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:18.839869 28286 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:19:18.840305 28286 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:18.840770 28286 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:19:18.842846 28343 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:18.810946 22476 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:18.844659 28343 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:18.858513 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:18.741425 28320 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.862601 22469 raft_consensus.cc:2393] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 20: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:18.869979 22297 catalog_manager.cc:5697] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index -1 to 14, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 19 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:18.869501 28320 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:18.839318 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:18.874429 28389 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:18.874567 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:18.874869 28389 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.875432 28249 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:18.875910 28249 raft_consensus.cc:697] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:18.876685 28249 consensus_queue.cc:237] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.879437 28385 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:18.879873 28389 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:18.879954 28385 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.880664 22476 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:18.849397 28337 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:18.882557 28310 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.883994 28385 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:18.883805 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:18.884944 22548 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:19:18.884853 28286 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.886204 22366 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:18.886967 28385 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:18.887347 28385 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:18.887683 28385 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:18.890822 28344 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:18.892026 28343 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:18.892534 28343 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.896684 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:18.897758 22548 raft_consensus.cc:2393] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 18: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:18.897856 28343 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:18.887750 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:18.899236 22400 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:18.900861 22296 catalog_manager.cc:5697] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:18.909245 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:18.912737 22402 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:19:18.914659 28389 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.897740 28385 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.916074 22398 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:18.974083 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:18.920665 23127 raft_consensus.cc:1240] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:18.974813 22397 raft_consensus.cc:2393] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 24: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:18.920665 22468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51846
I20260709 12:19:18.975421 22468 raft_consensus.cc:606] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 LEADER]: Received request to transfer leadership
I20260709 12:19:18.975581 28385 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:18.927572 28286 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 24 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:18.885246 28310 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:18.939875 28337 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:18.977185 28332 consensus_queue.cc:1059] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:18.978299 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:18.978554 28332 raft_consensus.cc:3055] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:18.979115 28332 raft_consensus.cc:740] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:18.980005 28332 consensus_queue.cc:260] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:18.982450 28332 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:18.985396 22551 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:19:18.944535 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:18.951208 22402 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 19.
I20260709 12:19:18.990429 22548 raft_consensus.cc:2393] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 20: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:18.990890 23095 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:18.991679 28337 raft_consensus.cc:2804] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:18.953809 22400 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 20.
I20260709 12:19:18.993261 22442 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:18.955802 22544 raft_consensus.cc:2955] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:18.966120 28388 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:18.997082 28388 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:18.998616 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:18.999321 22473 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
I20260709 12:19:18.999511 28388 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:18.971444 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:19.000360 22476 raft_consensus.cc:2393] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 20: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:18.972550 28309 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:19.002401 28309 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.004386 28344 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:19:19.004865 28309 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.004930 28344 raft_consensus.cc:697] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:19.005939 28337 raft_consensus.cc:697] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 19 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:19.007313 28344 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.007932 28337 consensus_queue.cc:237] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.010628 22551 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:19.012379 28298 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:19.018163 28309 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.018779 28309 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.021395 28309 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:18.973222 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:19.025911 22399 raft_consensus.cc:2393] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 20: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:19.024328 22297 catalog_manager.cc:5697] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 18 to 20, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 20 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:18.942224 22296 catalog_manager.cc:5697] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:18.980362 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.032148 22468 raft_consensus.cc:2393] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 16: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:18.940192 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:19.032984 22547 raft_consensus.cc:3060] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:18.976325 28389 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:18.988940 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51846
I20260709 12:19:18.990902 22366 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.033990 22477 raft_consensus.cc:606] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 LEADER]: Received request to transfer leadership
I20260709 12:19:19.035662 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:19.036420 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:18.954994 28343 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:19.037189 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:19.037850 23123 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:19:19.037603 28343 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.036463 22548 raft_consensus.cc:2368] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14.
I20260709 12:19:18.987358 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:19.040395 22366 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.051177 22366 leader_election.cc:400] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14.
I20260709 12:19:19.051577 22366 leader_election.cc:403] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:19.055083 28343 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.037163 22550 raft_consensus.cc:2368] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14.
I20260709 12:19:19.058571 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:19.067849 22297 catalog_manager.cc:5697] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:19.069949 28309 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:19.070572 28309 raft_consensus.cc:697] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:19.070892 28385 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:19:19.071476 22366 leader_election.cc:400] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14.
I20260709 12:19:19.071834 22366 leader_election.cc:403] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:19.072101 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:19.072732 22550 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 19.
I20260709 12:19:19.072865 28332 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:19:19.076714 22366 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.077597 28388 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:19.078012 28388 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:19.078361 28385 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14.
I20260709 12:19:19.078394 28388 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:19.085178 28298 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.085759 28298 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.087841 28298 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.071491 28309 consensus_queue.cc:237] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.088315 22547 raft_consensus.cc:2468] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 19.
I20260709 12:19:19.091989 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.092834 22399 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:19:19.094024 23095 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.071070 28343 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:19.096419 28343 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.096827 28343 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:19.098385 28317 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:19.098184 28388 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.101320 22469 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 24.
I20260709 12:19:19.110106 28385 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:19.110719 28385 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.114075 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.114779 22477 raft_consensus.cc:2368] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14.
I20260709 12:19:19.115365 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.116082 22468 raft_consensus.cc:2393] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:19.114856 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:19.117180 22469 raft_consensus.cc:2393] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 16: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:19.099632 28337 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:19.117683 28339 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:19.098933 28317 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.125126 28339 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.112623 28298 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:19.127342 28385 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.127550 28298 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.133823 28337 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.135754 28337 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:19.138792 28331 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:19.135174 28388 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.139444 28331 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.144256 28339 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.144994 28341 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:19.145567 28341 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.151181 28343 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.153757 28343 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:19.154819 28337 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.156049 28298 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.147702 28341 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:19.158802 28337 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.160816 28317 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:19.167158 28332 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14.
I20260709 12:19:19.141692 28331 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:19.168460 28337 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:19.169154 28337 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.172120 28337 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.173308 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:19.182184 23123 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:19:19.186261 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.187037 22399 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:19:19.192209 23095 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.193059 28337 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:19.193440 28337 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:19.193792 28337 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:19.197649 28332 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:19.198299 28332 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.175221 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.203956 22402 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 18.
I20260709 12:19:19.205685 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.206770 28331 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:19.207257 28331 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:19.207695 28331 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:19.176327 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:19.217000 28332 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.217733 22400 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:19.221627 28337 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.225844 28298 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:19.226058 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:19.226480 28298 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.230931 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.231592 22398 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 13.
I20260709 12:19:19.231720 28298 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:19.233047 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.235002 22397 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:19:19.237435 23095 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.238302 28402 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:19.238767 28402 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:19.239117 28402 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:19.240309 28298 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:19.233377 23123 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:19:19.242606 22366 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.243944 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:19.244728 22477 raft_consensus.cc:606] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:19.243989 28332 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:19.246487 28332 raft_consensus.cc:697] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:19.247400 28332 consensus_queue.cc:237] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.248023 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "277d262725804effb16ede64e81d19c8"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:19.248689 22477 raft_consensus.cc:606] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:19.251475 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:19.252027 22477 raft_consensus.cc:606] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:19.252343 22477 raft_consensus.cc:614] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:19.254945 28402 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.255611 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3367203e404b4201ac57986dc36a032e"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "65951063312d4a1e9123f92354101c71"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:19.256217 22477 raft_consensus.cc:606] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Received request to transfer leadership to TS 65951063312d4a1e9123f92354101c71
I20260709 12:19:19.259181 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:19.259763 22477 raft_consensus.cc:606] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:19.260380 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:19.261075 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:19.263967 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:19.264955 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:19.268764 28402 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:19.272827 28332 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.273653 28332 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.275782 28332 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:19.277729 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:19.278471 23123 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:19:19.279654 22366 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.280983 28343 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:19.281416 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.282171 22473 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:19:19.281386 28343 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.283046 28343 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:19.288992 28317 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.289589 28317 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.290190 22399 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 13.
I20260709 12:19:19.292030 28339 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.291785 28317 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.291743 28343 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.292584 28339 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.295007 28339 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.295300 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.296094 22473 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 19: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:19.297197 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.297247 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.298260 22473 raft_consensus.cc:2393] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:19.298987 28402 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:19.299419 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:19.299577 28402 raft_consensus.cc:697] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:19.300166 22473 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 19: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:19.300704 28402 consensus_queue.cc:237] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.301692 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:19.301951 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.302279 22477 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:19.302717 22469 raft_consensus.cc:2393] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 11: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:19.303120 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.303843 22473 raft_consensus.cc:2393] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 17: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:19.304535 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.305161 22468 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:19.306016 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.306690 22397 raft_consensus.cc:2368] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16.
I20260709 12:19:19.312774 28317 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.310117 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:19.316032 28317 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.312716 28298 raft_consensus.cc:697] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:19.318326 28317 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:19.318776 28298 consensus_queue.cc:237] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.309686 22477 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:19:19.316486 22470 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 16
W20260709 12:19:19.326704 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 336671us
I20260709 12:19:19.313916 28396 ts_tablet_manager.cc:933] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.329922 28310 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.331218 28310 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.332258 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:19.332463 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:19.332942 22547 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:19:19.333241 28310 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:19.333930 28286 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.334376 28286 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.335009 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:19.335642 22543 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:19:19.336354 28286 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:19.338195 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:19.338799 22545 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:19.345428 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:19.345863 28310 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:19.346565 28310 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.347519 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:19.348235 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:19.348635 22545 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:19:19.349339 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:19.341485 22470 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:19:19.350131 22547 raft_consensus.cc:2393] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 15: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:19.351013 22543 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:19.351944 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.352335 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:19.352535 22398 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:19:19.352927 22545 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:19:19.345489 22550 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 19.
I20260709 12:19:19.357848 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:19.360425 23123 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:19:19.361239 22442 leader_election.cc:400] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16.
I20260709 12:19:19.361567 22442 leader_election.cc:403] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:19.356175 23094 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:19.363894 22400 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 16.
I20260709 12:19:19.327611 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:19.363323 22366 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:19:19.372685 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 45154.6us
I20260709 12:19:19.311869 28337 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.383103 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:19.377815 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:19.380151 22367 leader_election.cc:400] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14.
I20260709 12:19:19.380595 22366 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.409492 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.411303 22472 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:19:19.369558 22296 catalog_manager.cc:5697] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 15 to 16, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 16 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.380666 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:19.410523 22442 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.413636 22296 catalog_manager.cc:5697] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.418170 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.418848 22397 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:19.416046 22398 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:19:19.414429 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:19.422542 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:19.423355 22544 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:19.425050 23122 raft_consensus.cc:2393] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 18: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:19.426167 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:19.377321 28389 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.429363 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.427420 23127 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:19.470417 22398 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 10.
I20260709 12:19:19.463102 22400 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:19.419549 28385 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:19.413641 28402 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:19.365724 28309 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:19.462625 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:19.382728 28249 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:19.480322 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:19.472956 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 116859us
I20260709 12:19:19.377858 28341 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16.
W20260709 12:19:19.474012 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 57083.1us
I20260709 12:19:19.383374 28339 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:19.430977 28387 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:19:19.491314 28407 ts_tablet_manager.cc:933] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:19.477210 28402 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:19.481606 22545 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:19:19.461125 28342 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.538702 22470 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:19:19.431236 28286 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:19.498466 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 117960us
I20260709 12:19:19.492717 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:19.473704 28343 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:19.539971 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.540402 22547 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:19:19.540011 22366 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.541208 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.539544 28286 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.541513 22477 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
W20260709 12:19:19.541893 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 184362us
I20260709 12:19:19.543298 28286 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:19.547526 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 50170.8us
I20260709 12:19:19.482034 28388 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:19.480201 28309 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:19.540452 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:19.552557 22472 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:19.555644 28413 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:19.556190 28413 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:19.556579 28413 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:19:19.562258 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 151801us
I20260709 12:19:19.563588 22366 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.483002 28320 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.567459 22472 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:19.498363 28339 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:19.529353 28341 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:19.474473 28385 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:19.581535 22543 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 16.
I20260709 12:19:19.566470 28388 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:19.573992 28249 raft_consensus.cc:697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:19.550199 28409 raft_consensus.cc:993] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
W20260709 12:19:19.582851 22285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 321236us
I20260709 12:19:19.571782 28408 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.570001 28344 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.591805 28324 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.594106 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:19:19.595212 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 45227.5us
I20260709 12:19:19.595687 28422 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.477342 28389 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.537606 28402 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:19.582397 28310 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:19.551906 28403 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:19.610342 28401 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:19:19.612561 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 48142.4us
I20260709 12:19:19.566804 28309 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:19.615150 22472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51846
I20260709 12:19:19.598515 28339 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:19.606873 28341 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.625667 28332 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.607425 28388 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:19.550422 28331 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:19.610790 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 145565us
I20260709 12:19:19.636552 22472 raft_consensus.cc:606] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 LEADER]: Received request to transfer leadership
I20260709 12:19:19.567374 28342 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.575520 28320 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.641005 22366 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:19.642508 22546 raft_consensus.cc:2393] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 15: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:19.634644 28401 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:19.649293 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 156909us
I20260709 12:19:19.615549 28344 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.642933 28341 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:19.651856 22367 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.614351 28408 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.620653 28324 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.655156 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:19.655783 23124 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:19.656802 28408 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.656968 28260 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.652218 28418 raft_consensus.cc:1081] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:19.651849 28414 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.651482 28401 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:19.624222 28422 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.695513 28389 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:19.666296 28425 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:19.640336 28310 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:19:19.698550 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:19.645800 28413 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.701984 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.635040 28403 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.703138 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.645054 28332 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.708950 28332 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:19.709523 28424 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:19.710090 28424 raft_consensus.cc:697] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:19.711126 28422 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.710940 28424 consensus_queue.cc:237] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.666326 28414 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:19.713948 28331 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:19.714740 28414 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:19.715507 28403 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.716954 28407 tablet_copy_client.cc:323] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.2:46187
I20260709 12:19:19.715425 23127 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 9.
I20260709 12:19:19.706976 28413 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.707203 28324 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.657533 28260 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:19.717847 28342 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:19.720134 28320 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.721596 28344 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.722011 28389 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:19:19.722843 28417 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:19.712395 28401 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.733304 23124 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:19:19.649190 28249 consensus_queue.cc:237] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:19.755851 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 104323us
I20260709 12:19:19.759546 28413 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.760258 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:19.760848 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:19.760923 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:19.822324 22543 raft_consensus.cc:2393] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 14: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:19.822474 22547 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 10.
I20260709 12:19:19.763175 28385 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.766590 22546 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:19.767794 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:19:19.768608 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 154657us
I20260709 12:19:19.824833 23124 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 9.
W20260709 12:19:19.825660 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 122602us
I20260709 12:19:19.826973 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.769140 28344 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:19.826092 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 180381us
I20260709 12:19:19.829478 23094 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:19.780035 28339 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.781213 28260 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.741110 28310 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:19.748149 28417 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:19.781276 22347 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
I20260709 12:19:19.792117 28401 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.797984 28396 tablet_copy_client.cc:323] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.3:38645
I20260709 12:19:19.740486 28414 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:19:19.809719 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:19.823978 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.827826 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:19.779014 23123 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:19.831035 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:19.833432 22547 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:19:19.843529 22545 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 14
W20260709 12:19:19.837182 22347 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 7f7fcc060e2443ad87cf29161f3ea079 already in progress
I20260709 12:19:19.837847 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:19.837158 22515 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:19.845510 22543 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 18.
I20260709 12:19:19.823897 28309 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.830487 28413 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.836520 28344 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.844506 22550 raft_consensus.cc:2393] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 10: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:19:19.844807 22347 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 7f7fcc060e2443ad87cf29161f3ea079 already in progress
W20260709 12:19:19.838836 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 187052us
I20260709 12:19:19.862309 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.864094 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.864907 22398 raft_consensus.cc:2368] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14.
I20260709 12:19:19.824630 28387 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 24 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:19.866336 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.867199 22472 raft_consensus.cc:2393] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:19.870223 22472 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:19:19.836634 28310 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.907581 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.908366 22477 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:19.881623 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.910216 22472 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:19.883335 28434 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:19.887128 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.911463 22397 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:19.887799 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.888820 28428 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:19:19.889045 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 44086.6us
I20260709 12:19:19.891312 22396 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:19:19.891914 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.914196 22398 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:19:19.891749 28341 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.893002 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:19.896512 28344 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:19.891228 22399 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:19:19.898520 22297 catalog_manager.cc:5697] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 14 to 15, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 15 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:19.838809 28420 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:19.904047 28387 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:19.898540 22545 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:19.838339 28417 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:19.912439 22402 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:19.914690 22396 pending_rounds.cc:85] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 10
I20260709 12:19:19.930112 22396 pending_rounds.cc:107] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 12:19:19.930454 22396 raft_consensus.cc:2889] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:19.915339 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 63731.1us
I20260709 12:19:19.919071 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.878609 28401 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:19.927205 22399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:19:19.937265 22399 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:19.937641 22399 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:19.938118 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.924417 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:19.879987 28416 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:19.914914 28310 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:19.933403 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.935250 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.947356 22398 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:19:19.940797 22468 raft_consensus.cc:2393] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 12: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:19.940812 22402 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:19:19.935910 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.928051 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:19.949311 22397 raft_consensus.cc:2393] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 14: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:19.932288 23094 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:19.938796 22395 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:19:19.943976 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:19.940865 28431 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:19:19.940975 28420 raft_consensus.cc:697] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 16 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:19.949133 22394 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:19:19.954506 28420 consensus_queue.cc:237] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:19.956000 28309 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.919874 28337 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:19:19.957892 28389 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:19.958060 28249 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:19.958582 28249 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.958956 28249 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:19.958133 28260 raft_consensus.cc:993] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:19.960086 28260 raft_consensus.cc:1081] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:19.961649 22441 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:19.962618 28415 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:19.962988 28415 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.963341 28415 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:19.965658 22516 leader_election.cc:400] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14.
I20260709 12:19:19.966025 22516 leader_election.cc:403] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:19.966166 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.966944 22469 raft_consensus.cc:2393] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:19.959096 22442 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.970113 28418 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:19.970573 28418 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.970981 28418 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:19.973343 28413 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.970041 22442 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:19.973968 28342 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14.
I20260709 12:19:19.970458 28317 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:19:19.976055 28421 raft_consensus.cc:993] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:19.917064 28439 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:19.977423 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:19.977346 22442 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:19:19.982787 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 51066.9us
I20260709 12:19:19.983114 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:19.983774 22543 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
I20260709 12:19:19.985466 22471 raft_consensus.cc:2393] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:19.986210 22476 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:19:19.945886 22399 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:19.986233 22547 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:19.986354 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:19.988180 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.976692 28439 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.988090 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.989748 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:19.990399 22473 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:19.992475 22472 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:19.993217 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:19.993548 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:19.995623 22550 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:19:19.996929 22471 raft_consensus.cc:2393] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 17: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:19.949662 28410 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.995529 28260 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:19.932188 28425 raft_consensus.cc:697] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:20.000547 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:20.001618 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:20.010022 22399 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:19.936750 28438 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:19.940860 28401 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.958376 28389 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.008015 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:20.012323 22545 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:19:20.011049 22468 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
I20260709 12:19:19.960325 28339 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:20.006381 28260 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.016006 28389 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:19.996419 22487 tablet_copy_service.cc:140] P 25ebf14868c042dca42f54b3e251e1b2: Received BeginTabletCopySession request for tablet 7f7fcc060e2443ad87cf29161f3ea079 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:43060)
I20260709 12:19:20.009969 28317 raft_consensus.cc:1081] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:20.018610 22473 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:19.996762 28409 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:20.021458 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:20.014599 28401 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:20.008800 28249 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.016142 28260 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:19.940254 28432 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 12:19:20.028867 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:20.031656 22474 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:20.032793 22397 raft_consensus.cc:1275] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:19:20.003499 28439 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:20.051132 22395 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:19:20.043804 22401 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 18.
I20260709 12:19:19.997236 28406 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:20.045598 28339 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:20.046450 22399 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:20.035970 28320 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.014467 28438 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:20.053050 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:20.018675 22487 tablet_copy_service.cc:161] P 25ebf14868c042dca42f54b3e251e1b2: Beginning new tablet copy session on tablet 7f7fcc060e2443ad87cf29161f3ea079 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:43060: session id = 65951063312d4a1e9123f92354101c71-7f7fcc060e2443ad87cf29161f3ea079
I20260709 12:19:20.060385 23095 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:20.046748 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 69880.2us
I20260709 12:19:20.011137 28410 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.062114 22516 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:20.028028 28388 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.131469 28420 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:20.061425 28438 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:20.032038 28402 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.142104 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:20.054113 28406 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.147316 22547 raft_consensus.cc:2368] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 18. Current term is 19.
I20260709 12:19:20.148711 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:20.146504 22366 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:20.153685 22470 raft_consensus.cc:2393] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 18: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:20.062273 28423 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:20.154951 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:20.056062 28331 consensus_queue.cc:1048] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 12:19:20.154870 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:19:20.155640 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 121648us
I20260709 12:19:20.164374 22542 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:20.062510 28286 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 12:19:20.163946 22366 leader_election.cc:400] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 18. Current term is 19.
I20260709 12:19:20.166213 22366 leader_election.cc:403] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:19:20.162664 23122 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:19:20.168497 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:20.169255 22543 raft_consensus.cc:2393] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 14: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:20.062209 28416 raft_consensus.cc:697] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:20.171233 22548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54498
I20260709 12:19:20.061131 28339 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.171808 22548 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:19:20.171222 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 113656us
I20260709 12:19:20.178686 22548 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:20.129971 28422 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:19:20.160811 28434 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:20.101553 28337 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 12:19:20.153160 28406 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:20.183223 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:20.062976 28320 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.184271 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:20.170437 28343 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:20.205096 22548 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.181525 28456 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:20.218592 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:20.220237 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:20.223333 22395 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:20.230477 22548 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:20.216665 28416 consensus_queue.cc:237] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.135743 28425 consensus_queue.cc:237] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.221295 28434 raft_consensus.cc:697] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:19:20.261229 28447 log.cc:927] Time spent T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:19:20.271363 28434 consensus_queue.cc:237] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.283185 22542 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 20.
W20260709 12:19:20.266357 28442 log.cc:927] Time spent T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:19:20.287664 22366 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:20.256019 22560 tablet_copy_service.cc:140] P 8c3bcfa13ca74a24ab8999a408532932: Received BeginTabletCopySession request for tablet cbdd827fb2d34627bbd307872debd3d3 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:49290)
I20260709 12:19:20.228427 28456 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.277489 28310 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:20.324088 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 145082us
I20260709 12:19:20.296183 28423 raft_consensus.cc:697] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 18 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:20.208940 28453 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.125s
I20260709 12:19:20.308060 28249 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:20.277401 28389 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:20.283557 28298 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:19:20.321787 28456 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:20.240723 28417 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.347046 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:20.355486 22549 raft_consensus.cc:2368] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12.
I20260709 12:19:20.327696 22560 tablet_copy_service.cc:161] P 8c3bcfa13ca74a24ab8999a408532932: Beginning new tablet copy session on tablet cbdd827fb2d34627bbd307872debd3d3 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:49290: session id = 65951063312d4a1e9123f92354101c71-cbdd827fb2d34627bbd307872debd3d3
I20260709 12:19:20.358428 22547 raft_consensus.cc:2393] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 15: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:20.367480 22546 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:19:20.368615 22551 raft_consensus.cc:2368] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 17. Current term is 18.
I20260709 12:19:20.355201 28388 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:20.390959 28402 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:20.391371 28417 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:20.391876 28446 log.cc:927] Time spent T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.242s	user 0.002s	sys 0.000s
I20260709 12:19:20.382356 28435 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:19:20.365727 28410 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:20.458065 28435 raft_consensus.cc:697] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:20.462424 22560 tablet_copy_source_session.cc:215] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:20.466331 28339 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:20.503041 28415 consensus_meta.cc:287] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.539s	user 0.001s	sys 0.009s
I20260709 12:19:20.503548 28415 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.506105 22477 raft_consensus.cc:2368] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 12. Current term is 13.
I20260709 12:19:20.481600 28423 consensus_queue.cc:237] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.380810 28438 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.468094 28389 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:20.518155 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 190027us
I20260709 12:19:20.472801 28343 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 18. Current term is 19.
I20260709 12:19:20.475916 28260 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:20.480696 28439 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.482383 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:20.505712 28415 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:20.484067 22395 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
I20260709 12:19:20.486636 28320 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:20.488461 22474 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:20.490396 28310 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:20.490981 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:20.492223 28435 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:20.513315 28317 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:20.514555 28409 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:20.501971 28418 consensus_meta.cc:287] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.000s
I20260709 12:19:20.535424 22476 raft_consensus.cc:3055] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:20.559052 22472 raft_consensus.cc:2368] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15.
I20260709 12:19:20.559084 22476 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:20.539654 28418 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.562659 22476 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.540488 28409 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:20.536353 28414 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:20.586153 28414 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.588379 28414 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:20.560611 28317 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.567664 28418 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:20.568107 22487 tablet_copy_source_session.cc:215] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:20.571925 28260 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:20.574226 28401 consensus_meta.cc:287] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.000s
I20260709 12:19:20.592286 28411 raft_consensus.cc:993] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:20.591248 28401 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.592828 28411 raft_consensus.cc:1081] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:20.579517 28420 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:20.590757 28317 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:20.594112 22476 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:20.594496 22400 raft_consensus.cc:2393] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 11: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
W20260709 12:19:20.595571 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.596220 28401 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:20.618733 28411 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:20.619342 28411 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.622648 28317 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.623214 28317 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.625357 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:20.626168 22549 raft_consensus.cc:2393] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 11: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:20.626863 28385 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.627403 28385 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.629280 28385 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:20.633831 23125 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:19:20.633993 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:20.634035 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:20.635169 22399 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:20.634137 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:20.640849 23126 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:20.642331 22397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "277d262725804effb16ede64e81d19c8"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:19:20.642908 22397 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:20.643272 22397 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:20.651479 22366 leader_election.cc:400] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12.
I20260709 12:19:20.651906 22366 leader_election.cc:403] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:19:20.652657 22366 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:20.653699 28343 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:20.654294 28343 raft_consensus.cc:697] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:20.667346 22366 leader_election.cc:400] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 17. Current term is 18.
I20260709 12:19:20.667735 22366 leader_election.cc:403] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:19:20.679560 23126 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 11.
I20260709 12:19:20.699625 22394 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
W20260709 12:19:20.700204 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 46483.2us
I20260709 12:19:20.681502 22397 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.709901 22402 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 19. Current term is 20. Ops: []
W20260709 12:19:20.711330 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 180190us
I20260709 12:19:20.723985 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:20.727761 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:20.727999 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:20.730479 22397 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:20.730917 22398 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:20.735200 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:20.648605 28433 raft_consensus.cc:993] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 65951063312d4a1e9123f92354101c71 to start an election
I20260709 12:19:20.625451 28317 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:20.737951 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 62259.8us
I20260709 12:19:20.739445 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:20.739634 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:20.518175 28406 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.717293 22476 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
I20260709 12:19:20.749037 22399 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:19:20.655252 28343 consensus_queue.cc:237] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.752735 22396 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 19. Current term is 20. Ops: []
I20260709 12:19:20.714105 28425 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:20.774380 22442 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:20.778970 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:20.781724 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:20.784420 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:20.785931 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:20.786536 22393 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:20.787324 28445 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:19:20.787858 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:20.788488 22473 raft_consensus.cc:2368] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14.
I20260709 12:19:20.789547 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:20.777271 28409 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.790351 22473 raft_consensus.cc:2410] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 25 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 12:19:20.750478 28401 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12.
I20260709 12:19:20.791489 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:20.791637 28409 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:20.792008 22473 raft_consensus.cc:3055] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:19:20.792348 22473 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:20.792456 28411 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:20.793147 22473 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:20.797027 22469 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:19:20.798465 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:20.799183 22469 raft_consensus.cc:2368] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12.
I20260709 12:19:20.799505 22442 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:20.787336 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:20.810277 22441 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:20.819922 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:20.821856 22474 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:20.822391 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:20.822994 22401 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:20.824143 22442 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:20.811487 22476 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
W20260709 12:19:20.830673 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 174147us
I20260709 12:19:20.831921 22441 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:20.835361 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:20.835692 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:20.836241 22398 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:19:20.837420 22441 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:20.838452 28472 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:20.841905 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:20.805238 28411 raft_consensus.cc:1081] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Signalling peer 65951063312d4a1e9123f92354101c71 to start an election
I20260709 12:19:20.789580 28406 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:20.852087 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 125849us
I20260709 12:19:20.822130 28433 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:20.854353 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:20.835366 28265 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:20.835723 28317 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:20.840420 28490 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.844803 28421 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:20.855036 28479 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:20.867832 22398 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:20.858615 28317 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.871318 28317 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:20.872203 28407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7fcc060e2443ad87cf29161f3ea079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:20.842249 28415 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:19:20.855875 28433 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.858469 28265 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.822003 28456 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.864243 28320 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.866714 28421 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.863692 28432 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:20.860730 28406 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:19:20.885663 28265 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:20.881561 28433 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:20.885962 28402 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:20.885914 28414 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:20.903093 28451 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:20.903203 28414 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.903672 28451 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.905414 28414 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:20.877465 28490 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.891831 28421 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:20.892755 28468 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:20.888707 28479 raft_consensus.cc:697] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:20.900377 28432 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.906747 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41012 (request call id 992) took 1444 ms. Trace:
I20260709 12:19:20.914374 23122 rpcz_store.cc:276] 0709 12:19:19.462221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.462353 (+   132us) service_pool.cc:224] Handling call
0709 12:19:20.906048 (+1443695us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b54007201d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:20.906157 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568208256}
I20260709 12:19:20.912354 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 3143) took 1050 ms. Trace:
I20260709 12:19:20.915940 22400 rpcz_store.cc:276] 0709 12:19:19.861934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.862056 (+   122us) service_pool.cc:224] Handling call
0709 12:19:20.912142 (+1050086us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b5400225954. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:20.912266 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1682053504}
I20260709 12:19:20.891089 28417 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:20.905722 28451 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:20.913210 28439 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:20.911084 28490 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:20.914525 28403 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:20.892196 28320 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.914083 28431 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:20.922367 28410 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.952310 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:20.902827 28459 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 12:19:20.972011 28425 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 17. Current term is 18.
I20260709 12:19:20.972642 28431 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.973337 28317 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.975435 28317 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:20.971952 28464 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:20.980993 28464 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.972301 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:20.982620 22469 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:20.983174 28464 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:20.975063 28403 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.977404 23129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3367203e404b4201ac57986dc36a032e"
dest_uuid: "65951063312d4a1e9123f92354101c71"
 from {username='slave'} at 127.0.0.1:41012
I20260709 12:19:20.986266 23129 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:20.986668 23129 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:20.940948 28414 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:20.990113 28414 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:20.990852 28431 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:20.962761 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:20.991647 22476 raft_consensus.cc:3055] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:19:20.991967 22476 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:20.992383 28414 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:20.992738 22476 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.993963 22476 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:20.996215 28403 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:21.000828 28354 tablet_bootstrap.cc:492] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:20.902908 28402 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.003571 28439 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:21.004205 28439 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.008936 22469 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 19.
I20260709 12:19:21.060882 28439 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:20.911868 28479 consensus_queue.cc:237] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.013710 23129 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.059099 28320 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:21.059515 28402 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:21.062747 28482 log.cc:927] Time spent T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 12:19:21.063746 23129 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:20.911372 28471 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:19:20.911320 28468 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.066956 28468 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:21.069759 22476 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 20.
I20260709 12:19:21.073647 28432 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:21.100522 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 243642us
I20260709 12:19:21.101809 22367 leader_election.cc:400] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14.
I20260709 12:19:21.102792 22367 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:21.109516 22367 leader_election.cc:400] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12.
I20260709 12:19:21.002934 28421 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:20.944415 28417 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.103416 28354 tablet_bootstrap.cc:492] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
W20260709 12:19:21.114066 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 254034us
I20260709 12:19:21.115335 22366 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:21.118474 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:21.114842 22367 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:19:21.120373 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:21.120908 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:21.121244 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.121896 22442 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:21.108955 28425 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:19:21.074851 28410 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:21.127444 22470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43060 (request call id 747) took 1154 ms (client timeout 1514 ms). Trace:
I20260709 12:19:21.150190 22441 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:21.129329 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.130448 28434 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:19:21.112351 28437 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:19:21.154726 28434 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:21.155640 28434 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.130848 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:21.158494 22400 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:21.133196 28497 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:21.134260 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:21.161962 28410 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:21.163712 28440 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 1.117s	user 0.003s	sys 0.007s
I20260709 12:19:21.138983 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 3370) took 1158 ms. Trace:
I20260709 12:19:21.144510 28265 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.164247 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:21.164551 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:21.164182 22546 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:19:21.167016 28265 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:21.145462 28433 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.169219 28433 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:21.146984 28456 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:21.115188 28401 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:19:21.170564 22441 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:21.171980 28408 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:21.135762 28427 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:21.163514 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:19:21.150530 22470 rpcz_store.cc:269] 0709 12:19:19.963586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.987939 (+ 24353us) service_pool.cc:224] Handling call
0709 12:19:21.118279 (+1130340us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54002b3754. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:21.118403 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378167168}
I20260709 12:19:21.151356 22476 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:21.164878 22547 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:21.164145 22472 rpcz_store.cc:276] 0709 12:19:19.980546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.993309 (+ 12763us) service_pool.cc:224] Handling call
0709 12:19:21.138730 (+1145421us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b5400394c54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:21.138904 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1264273280}
I20260709 12:19:21.164832 28425 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:21.185051 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:21.184481 22367 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:21.197698 22367 leader_election.cc:400] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15.
I20260709 12:19:21.198051 22367 leader_election.cc:403] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:19:21.198686 22366 consensus_peers.cc:597] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f7fcc060e2443ad87cf29161f3ea079. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:21.180408 28354 ts_tablet_manager.cc:1403] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 2.344s	user 0.052s	sys 0.012s
I20260709 12:19:21.174315 28433 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:21.204587 22547 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 20.
W20260709 12:19:21.208276 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 80880.8us
I20260709 12:19:21.187533 28427 raft_consensus.cc:697] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:21.214035 22442 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:21.202261 28425 raft_consensus.cc:697] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:21.205653 28497 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:21.219724 22546 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:21.225244 22297 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32988 (request call id 185) took 1413 ms. Trace:
I20260709 12:19:21.213243 28421 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:21.230927 28425 consensus_queue.cc:237] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.228734 22297 rpcz_store.cc:276] 0709 12:19:19.811812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.811989 (+   177us) service_pool.cc:224] Handling call
0709 12:19:21.225171 (+1413182us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:19.947569 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:20.101679 (+154110us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:20.104543 (+  2864us) write_op.cc:435] Acquired schema lock
0709 12:19:20.106903 (+  2360us) tablet.cc:662] Decoding operations
0709 12:19:20.174724 (+ 67821us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:20.177489 (+  2765us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:20.183317 (+  5828us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:20.207112 (+ 23795us) tablet.cc:701] Row locks acquired
0709 12:19:20.210640 (+  3528us) write_op.cc:260] PREPARE: finished
0709 12:19:20.231282 (+ 20642us) write_op.cc:270] Start()
0709 12:19:20.270379 (+ 39097us) write_op.cc:276] Timestamp: P: 1783599560231199 usec, L: 0
0709 12:19:20.283306 (+ 12927us) op_driver.cc:348] REPLICATION: starting
0709 12:19:20.344956 (+ 61650us) log.cc:844] Serialized 533 byte log entry
0709 12:19:20.837755 (+492799us) op_driver.cc:464] REPLICATION: finished
0709 12:19:20.902823 (+ 65068us) write_op.cc:301] APPLY: starting
0709 12:19:20.902915 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:20.904071 (+  1156us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:20.904167 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:20.905013 (+   846us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:20.905205 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:19:20.905246 (+    41us) write_op.cc:312] APPLY: finished
0709 12:19:20.905426 (+   180us) log.cc:844] Serialized 25 byte log entry
0709 12:19:20.905589 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:20.905692 (+   103us) write_op.cc:454] Released schema lock
0709 12:19:20.905730 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:20.906133 (+   403us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:20.906161 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":44414,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":64726,"apply.run_cpu_time_us":3183,"apply.run_wall_time_us":3307,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8317,"num_ops":1,"prepare.queue_time_us":140,"prepare.run_cpu_time_us":4180,"prepare.run_wall_time_us":427220,"replication_time_us":554259,"thread_start_us":20464,"threads_started":1}]]}
I20260709 12:19:21.238364 28407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41012 (request call id 984) took 1878 ms. Trace:
I20260709 12:19:21.238804 28407 rpcz_store.cc:276] 0709 12:19:19.360234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.360416 (+   182us) service_pool.cc:224] Handling call
0709 12:19:19.535254 (+174838us) ts_tablet_manager.cc:934] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
0709 12:19:20.863588 (+1328334us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:19:21.058595 (+195007us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:21.058726 (+   131us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:19:21.234784 (+176058us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:19:21.235066 (+   282us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:21.238201 (+  3135us) ts_tablet_manager.cc:989] Replica registered.
0709 12:19:21.238272 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":64104,"tablet-copy.queue_time_us":111756,"thread_start_us":161624,"threads_started":2}
I20260709 12:19:21.240881 28407 tablet_copy_client.cc:806] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:21.241453 28407 tablet_copy_client.cc:670] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:21.211251 28343 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:19:21.211300 28339 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:21.242497 28427 consensus_queue.cc:237] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:19:21.261724 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.262370 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:21.263223 23122 raft_consensus.cc:2368] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 18. Current term is 19.
I20260709 12:19:21.264351 22441 leader_election.cc:400] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 18. Current term is 19.
I20260709 12:19:21.264674 22441 leader_election.cc:403] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:19:21.233036 28354 raft_consensus.cc:359] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:21.270848 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:21.238708 28438 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:21.274422 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:21.275535 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:21.262689 28428 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15.
I20260709 12:19:21.280050 22473 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:21.273937 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:21.282203 22394 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:21.275467 22393 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 24.
W20260709 12:19:21.287809 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 90263.8us
I20260709 12:19:21.292927 22470 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:21.293133 22472 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:19:21.257488 28339 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.301594 22394 raft_consensus.cc:2468] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
I20260709 12:19:21.298550 22473 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 20.
I20260709 12:19:21.262343 28410 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:21.272339 28417 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:21.306183 22474 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:19:21.302264 22442 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:21.274559 28354 raft_consensus.cc:740] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:19:21.302364 28339 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:21.303599 28428 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:19:21.303498 28410 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.302510 28500 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 18. Current term is 19.
I20260709 12:19:21.315502 28408 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:19:21.318275 28497 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:21.341393 22473 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 19. Current term is 20. Ops: []
I20260709 12:19:21.318554 28410 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:19:21.348263 28508 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:19:21.348752 22551 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:19:21.335561 28354 consensus_queue.cc:260] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:21.353250 28354 ts_tablet_manager.cc:1434] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.142s	user 0.003s	sys 0.005s
I20260709 12:19:21.339238 28408 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.373006 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:21.375226 22473 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:21.373889 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:21.396900 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:21.397629 22473 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
I20260709 12:19:21.397572 22472 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:21.400537 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:21.401898 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:21.404716 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:21.406626 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:21.414031 22398 raft_consensus.cc:2393] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 15: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:21.413822 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.392592 28408 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:19:21.419220 28342 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:21.419598 28432 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:21.419797 28342 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.420197 28432 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.422092 28342 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:21.422511 28432 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:21.423579 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:21.391243 28309 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:19:21.426703 22472 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:21.428037 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.430353 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:21.431536 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:21.432461 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:21.406483 28401 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:19:21.439245 28505 log.cc:927] Time spent T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:19:21.407459 28450 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:21.441377 28450 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.443748 28450 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:21.406823 28456 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:21.446028 22296 catalog_manager.cc:5697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:21.362242 28343 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:19:21.398656 28417 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:21.415477 22400 raft_consensus.cc:2393] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 12: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:21.416985 22476 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 12:19:21.415354 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 113185us
I20260709 12:19:21.359871 28425 consensus_queue.cc:1059] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:19:21.454846 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.347148 28497 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.457621 22296 catalog_manager.cc:5697] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 23 to 24, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 24 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:21.471024 22442 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:21.471858 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:21.474455 22400 raft_consensus.cc:1275] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:19:21.474669 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.475597 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.479864 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.437430 28401 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.484516 22398 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:21.489801 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.493999 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:21.494383 28432 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.495009 28432 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.495743 28439 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:21.496387 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:21.497099 28432 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:21.497298 28414 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:21.497469 28439 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:21.497960 28414 raft_consensus.cc:697] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:21.493901 28450 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.498867 28414 consensus_queue.cc:237] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.499302 28450 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.498080 28431 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:21.502542 28431 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.504755 28431 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:21.501899 28433 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:21.505611 28479 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:21.505743 28433 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.506188 28479 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.507953 28433 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:21.508126 28479 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:21.501636 28450 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:21.446165 28456 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.513499 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.478581 28342 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:21.483110 28255 raft_consensus.cc:2804] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:21.460325 28417 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.558070 22393 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:21.558665 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:21.522212 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.522516 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.521373 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:21.517275 28512 log.cc:927] Time spent T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:19:21.519408 28339 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.522816 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.565729 22399 raft_consensus.cc:1240] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:21.564810 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.566480 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.567327 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.567808 28448 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.547225 28396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbdd827fb2d34627bbd307872debd3d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.562511 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.570008 22472 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:21.534427 23129 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:21.530097 22474 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:21.563727 22471 raft_consensus.cc:2393] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:21.525090 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.562556 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:21.580132 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:21.580796 22548 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:21.577641 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:21.582301 22476 raft_consensus.cc:2393] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 20: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:21.580175 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:21.583624 22545 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:21.584456 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:21.584518 22549 raft_consensus.cc:2410] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:19:21.551718 22297 catalog_manager.cc:5697] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 12 to 13, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 13 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:21.586519 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:21.586789 22550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54498
I20260709 12:19:21.527487 28456 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:21.587404 22550 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:21.587807 22550 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:21.515316 28516 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:19:21.517970 28510 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:19:21.560478 28418 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.590175 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:21.592481 22297 catalog_manager.cc:5697] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 17 to 18, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 18 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:21.519448 28417 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:21.516350 28509 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:21.596369 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:19:21.534461 28503 log.cc:927] Time spent T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:19:21.603804 22297 catalog_manager.cc:5697] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:21.605239 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:21.610594 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:21.611749 22545 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:19:21.525509 28341 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:21.516846 28255 raft_consensus.cc:697] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:21.613517 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:21.581264 28432 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:21.613663 22297 catalog_manager.cc:5697] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 14 to 16, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 16 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:21.634696 22548 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:19:21.542191 28425 consensus_queue.cc:1059] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
W20260709 12:19:21.628103 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:21.639425 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.637645 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:21.616753 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:21.521068 28410 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.648169 28410 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:21.542409 28490 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 12:19:21.603543 28516 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.651329 28432 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.637814 28417 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:21.625635 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:21.652361 22470 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:19:21.665977 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:21.627951 22550 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.568396 28448 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.669965 22548 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 19. Current term is 20. Ops: []
I20260709 12:19:21.670454 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:21.669145 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:21.671574 22475 raft_consensus.cc:606] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:21.671965 22475 raft_consensus.cc:614] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:21.569053 28342 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.666747 23125 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:19:21.606916 28456 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:21.674739 22550 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:21.671787 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 46234us
I20260709 12:19:21.637558 28414 consensus_queue.cc:1059] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
W20260709 12:19:21.683147 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.684804 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:21.664317 28516 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:21.679885 28417 raft_consensus.cc:697] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:21.623904 28504 consensus_queue.cc:1059] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:19:21.692341 28448 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:21.692996 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:21.636376 28509 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.698166 22395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 856) took 1081 ms. Trace:
I20260709 12:19:21.615016 28418 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.701619 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "367745908a334997957e47f869d9fb14"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:21.701939 22543 raft_consensus.cc:2393] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 15: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:21.696838 28432 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:21.718662 22475 raft_consensus.cc:606] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:21.696990 28408 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.720597 22468 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 25 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 24. Current term is 25. Ops: []
I20260709 12:19:21.721695 28408 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 25 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:21.669873 28439 raft_consensus.cc:697] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:21.714133 22395 rpcz_store.cc:276] 0709 12:19:20.616478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.659412 (+ 42934us) service_pool.cc:224] Handling call
0709 12:19:20.659734 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:20.660088 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:20.660116 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:20.660569 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 12:19:21.438461 (+777892us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b180042a7e0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a49e07 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b 00007fb4f86f3d23 00007fb4f86f40d1 00007fb4f8b0fa0f
0709 12:19:21.611006 (+172545us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:19:21.611047 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:21.611111 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:21.697840 (+ 86729us) raft_consensus.cc:1685] finished
0709 12:19:21.697861 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:21.698099 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8600,"raft.queue_time_us":40076,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":25563,"spinlock_wait_cycles":3443456,"thread_start_us":172369,"threads_started":1,"wal-append.queue_time_us":961484}
I20260709 12:19:21.715574 28342 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:21.716027 28255 consensus_queue.cc:237] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.708909 28516 consensus_queue.cc:1059] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:19:21.684015 28450 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:21.729463 28450 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:21.729753 28504 raft_consensus.cc:3055] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:21.725059 28432 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:21.730247 28504 raft_consensus.cc:740] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:21.722839 28521 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:21.731024 28450 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:21.731812 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:21.732501 28509 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:21.732163 28504 consensus_queue.cc:260] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.723138 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:21.733136 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:21.706254 28339 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:21.733285 22475 raft_consensus.cc:606] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 25 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:21.733903 22475 raft_consensus.cc:614] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:21.734323 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:21.730384 28516 raft_consensus.cc:3055] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:21.735033 28516 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:21.735221 28417 consensus_queue.cc:237] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.740860 28401 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:21.741849 28516 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.743080 28516 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:21.743750 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:21.747905 28418 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:21.749979 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.749151 28439 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.752182 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.754375 22474 raft_consensus.cc:2368] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 12. Current term is 13.
I20260709 12:19:21.753026 22471 raft_consensus.cc:1240] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 12:19:21.754554 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.759232 22473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:21.759887 22473 raft_consensus.cc:606] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:21.754629 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:21.765014 22550 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 19. Current term is 20. Ops: []
I20260709 12:19:21.764851 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:21.768952 22486 tablet_copy_service.cc:342] P 25ebf14868c042dca42f54b3e251e1b2: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-ff6628c2d6a44791975f2350758cb3db received from {username='slave'} at 127.0.0.1:43060
I20260709 12:19:21.769508 22486 tablet_copy_service.cc:434] P 25ebf14868c042dca42f54b3e251e1b2: ending tablet copy session 65951063312d4a1e9123f92354101c71-ff6628c2d6a44791975f2350758cb3db on tablet ff6628c2d6a44791975f2350758cb3db with peer 65951063312d4a1e9123f92354101c71
I20260709 12:19:21.770138 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:21.767402 23095 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:19:21.781361 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:21.781646 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:21.782610 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:21.782778 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:21.784668 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:21.784971 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:21.807022 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:21.807695 22545 raft_consensus.cc:2393] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 12: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:21.811138 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:21.811777 22545 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 10.
I20260709 12:19:21.765421 28406 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:21.730646 28432 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.818486 22473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "65951063312d4a1e9123f92354101c71"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:21.820359 22473 raft_consensus.cc:606] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Received request to transfer leadership to TS 65951063312d4a1e9123f92354101c71
I20260709 12:19:21.821425 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:21.823462 22549 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:21.819375 28406 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.797111 28521 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:21.828315 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:21.819059 28468 raft_consensus.cc:3055] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:21.829456 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:21.835945 22471 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 LEADER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:21.835940 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:21.849677 28406 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:21.833616 28403 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:21.856459 28403 raft_consensus.cc:697] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 19 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:21.857374 28403 consensus_queue.cc:237] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.859545 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:21.860420 23123 raft_consensus.cc:2393] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 11: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:21.866513 23131 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [term 14 LEARNER]: Advancing to term 15
I20260709 12:19:21.866659 28432 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:21.830735 28521 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.870148 22474 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
W20260709 12:19:21.870564 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 103230us
I20260709 12:19:21.871423 23095 leader_election.cc:400] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 12. Current term is 13.
W20260709 12:19:21.941079 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.831820 28401 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:21.945650 28401 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.947968 28401 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:21.831525 28468 raft_consensus.cc:740] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:21.949712 28468 consensus_queue.cc:260] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.950834 28468 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:21.872303 28343 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:21.944591 28309 raft_consensus.cc:3055] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:21.953526 28309 raft_consensus.cc:740] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:21.954545 28309 consensus_queue.cc:260] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:21.955787 28309 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:21.968348 22547 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:19:21.953583 28343 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.974687 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:21.975844 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:21.965245 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:21.976909 22544 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:21.977156 22547 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:19:21.958434 28521 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:21.978214 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:21.978960 22548 raft_consensus.cc:2368] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 12. Current term is 13.
I20260709 12:19:21.969576 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:21.979918 22551 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:21.984387 28450 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:21.985821 22549 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:21.986907 28450 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:21.993997 22441 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:21.995151 22399 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:19:22.000869 22515 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
W20260709 12:19:22.011654 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:22.020993 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 149683us
I20260709 12:19:22.022378 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:22.025089 22441 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:22.027280 23131 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [term 15 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:19:22.029100 22515 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:22.029971 22551 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:19:22.030401 22515 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:22.037199 22544 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 19.
I20260709 12:19:22.038322 22551 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:21.975868 28343 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:22.044922 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:22.046721 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:22.021670 28450 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:22.045418 22441 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:22.031386 28516 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:22.068645 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:22.072036 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:22.068799 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:22.079221 28428 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.079777 22398 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
I20260709 12:19:22.074851 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:22.079794 28428 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:22.083385 28428 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:22.075870 28456 consensus_queue.cc:1048] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:19:22.089291 28407 tablet_copy_client.cc:538] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:19:22.100626 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 55280.3us
I20260709 12:19:22.071501 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:22.033342 28406 consensus_queue.cc:1059] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 12:19:22.105778 22398 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:22.106222 28450 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:22.106666 28450 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:22.107026 28450 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:22.109975 28521 consensus_queue.cc:1059] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:22.048077 28414 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:22.116983 23095 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:22.050674 28417 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:22.050397 28458 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:22.128854 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:22.134302 22394 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:22.130089 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:22.042981 28432 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:22.132972 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:22.142791 22397 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:22.133234 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:22.148228 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 46014.2us
I20260709 12:19:22.150549 22441 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:22.042450 28342 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:22.105894 28408 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:22.131832 22401 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 24 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:19:22.160992 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:22.136427 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:22.138537 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:22.167730 22398 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:22.155697 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:22.156247 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:22.172493 28466 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:22.174962 28466 raft_consensus.cc:697] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:22.175940 28498 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:22.133795 28456 raft_consensus.cc:3055] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:22.178010 22441 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:22.181384 22441 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:22.186650 22515 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:22.187690 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:22.193081 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:22.193377 22397 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:22.134089 28420 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 12:19:22.170085 28423 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:22.198491 22515 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:22.213279 22515 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:22.215013 22515 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:22.206280 28342 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:22.201690 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:22.203097 22393 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:19:22.179075 28408 raft_consensus.cc:697] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:22.175990 28466 consensus_queue.cc:237] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:22.222671 22515 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:22.226130 28423 raft_consensus.cc:3055] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:22.226948 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:22.228556 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:22.197402 28472 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:19:22.211549 28468 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:22.230175 28414 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:22.230935 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:22.179292 28456 raft_consensus.cc:740] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:22.229595 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:22.231556 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:22.264983 22402 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:19:22.266279 22515 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:22.231935 22516 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:22.232642 22400 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:22.197716 28498 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:22.237357 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:22.199291 28418 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:22.272084 22470 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:19:22.235348 22397 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:19:22.280440 22402 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 25.
I20260709 12:19:22.217315 28432 raft_consensus.cc:2764] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:19:22.217144 28417 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:22.262624 28423 raft_consensus.cc:740] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:22.267247 28439 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:22.238443 28516 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:19:22.284950 28468 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:22.313458 22475 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:19:22.237632 28342 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:22.287379 28418 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:19:22.317842 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 177328us
I20260709 12:19:22.319677 23095 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:22.284368 28427 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:19:22.339998 28490 raft_consensus.cc:3055] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:19:22.340502 28490 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:22.315389 28417 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:22.328807 28418 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:22.336174 28406 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:22.381786 22468 raft_consensus.cc:1240] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 12:19:22.326808 28528 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
W20260709 12:19:22.389401 22441 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.3:38645 timed out after 1.614s (SENT) [suppressed 5 similar messages]
I20260709 12:19:22.336441 28420 consensus_queue.cc:1059] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 12:19:22.353864 28423 consensus_queue.cc:260] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:22.341398 28490 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:22.314531 28456 consensus_queue.cc:260] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:22.406517 28342 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:22.378882 28396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:34092 (request call id 736) took 3367 ms. Trace:
W20260709 12:19:22.406265 28538 log.cc:927] Time spent T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:19:22.386194 28406 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:19:22.408684 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 133026us
W20260709 12:19:22.408368 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 212194us
I20260709 12:19:22.411082 28396 rpcz_store.cc:276] 0709 12:19:18.981699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:18.981876 (+   177us) service_pool.cc:224] Handling call
0709 12:19:19.370884 (+389008us) ts_tablet_manager.cc:934] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
0709 12:19:21.545625 (+2174741us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:19:21.862095 (+316470us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:21.862216 (+   121us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:19:22.274540 (+412324us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:19:22.300165 (+ 25625us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:22.343768 (+ 43603us) ts_tablet_manager.cc:989] Replica registered.
0709 12:19:22.348829 (+  5061us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":49391,"tablet-copy.queue_time_us":331498,"thread_start_us":528764,"threads_started":2}
I20260709 12:19:22.417688 28396 tablet_copy_client.cc:806] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:22.418303 28396 tablet_copy_client.cc:670] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:22.344269 28408 consensus_queue.cc:237] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:22.400961 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 168581us
W20260709 12:19:22.392632 28513 log.cc:927] Time spent T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.956s	user 0.020s	sys 0.000s
I20260709 12:19:22.428061 22399 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:19:22.428757 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:22.569695 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:22.434791 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 166938us
I20260709 12:19:22.498426 28309 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:22.566596 28450 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:22.546620 28540 log.cc:927] Time spent T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 12:19:22.568148 28545 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:19:22.533646 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 3581) took 1286 ms. Trace:
I20260709 12:19:22.811074 22546 rpcz_store.cc:276] 0709 12:19:21.247503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.247662 (+   159us) service_pool.cc:224] Handling call
0709 12:19:21.248007 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:21.260959 (+ 12952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:21.260991 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:21.268347 (+  7356us) log.cc:844] Serialized 26 byte log entry
0709 12:19:21.343504 (+ 75157us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:21.343536 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:21.343585 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:22.274271 (+930686us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:19:22.533288 (+259017us) raft_consensus.cc:1685] finished
0709 12:19:22.533313 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:22.533570 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12494,"raft.queue_time_us":14123,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":11140,"spinlock_wait_cycles":26258304,"thread_start_us":40330,"threads_started":1,"wal-append.queue_time_us":123511}
I20260709 12:19:22.413002 28406 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:22.410845 28490 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:19:22.413321 28535 consensus_queue.cc:1175] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b8621fa34be04d3fa2d68a300f858cd1" responder_term: 13 status { last_received { term: 13 index: 13 } last_committed_idx: 13 last_received_current_leader { term: 13 index: 13 } }
W20260709 12:19:22.589248 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:22.414709 28423 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:22.540740 28401 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.576768 28407 tablet_bootstrap.cc:492] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:19:22.430464 28456 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:22.446020 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:22.831197 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:22.493328 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:22.744436 22398 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.013s	sys 0.011s
W20260709 12:19:22.768338 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 310846us
W20260709 12:19:22.832537 22398 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.013s	sys 0.012s
I20260709 12:19:22.747736 22515 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
W20260709 12:19:22.783608 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 394083us
I20260709 12:19:22.739295 28342 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:19:22.828370 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:22.781524 28437 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:22.798113 28521 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:22.839102 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:22.836170 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 88532.3us
W20260709 12:19:22.850323 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 429434us
I20260709 12:19:22.840569 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:22.803974 28309 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:22.933104 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:22.968989 22473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50990 (request call id 73) took 1047 ms. Trace:
I20260709 12:19:22.969621 22473 rpcz_store.cc:276] 0709 12:19:21.818184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.818360 (+   176us) service_pool.cc:224] Handling call
0709 12:19:22.865513 (+1047153us) spinlock_profiling.cc:243] Waited 9.61 ms on lock 0x7b540011b5a0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8ad1520 00007fb4f8b4e652 00007fb4fdb1c60a 00007fb4f70a27d4 00007fb4f70a2762 00007fb4f70a2691 00007fb4f70a260c 00007fb4f70a18c2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:22.865844 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22101760}
W20260709 12:19:23.005748 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 165120us
I20260709 12:19:23.006626 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:22.861322 28432 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:22.883255 28448 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.847529 28551 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:22.830221 28401 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:23.000021 28478 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.861795 28431 consensus_queue.cc:1059] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.163s
I20260709 12:19:22.861589 28468 consensus_queue.cc:1059] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.164s
I20260709 12:19:22.846836 28437 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:22.846395 28342 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:23.052469 22473 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:19:22.863474 28521 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.054826 28417 raft_consensus.cc:2764] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 12:19:23.081387 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 230229us
I20260709 12:19:23.082701 23094 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:23.099552 28543 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:23.101999 23094 leader_election.cc:400] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 12. Current term is 13.
I20260709 12:19:23.102489 23094 leader_election.cc:403] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:19:23.074594 28552 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:23.107853 22549 raft_consensus.cc:1240] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:23.038450 28448 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:23.076246 28569 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:23.077450 28431 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 12:19:23.098030 28418 consensus_meta.cc:287] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.707s	user 0.010s	sys 0.000s
W20260709 12:19:23.103940 28537 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.795s	user 0.009s	sys 0.006s
I20260709 12:19:23.083425 28565 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:23.044641 28478 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:23.130200 28572 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:23.117834 28417 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:23.138922 28497 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:23.139221 28521 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:23.100355 28543 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:23.117493 28431 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:19:23.162773 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 156219us
I20260709 12:19:23.127553 28468 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:23.137117 28500 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:23.135181 28450 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:23.154256 28556 log.cc:927] Time spent T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 12:19:23.178956 22516 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:23.184019 22516 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:23.136020 28420 consensus_queue.cc:1059] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:19:23.151456 28564 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:23.129599 28418 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.124491 28569 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.178658 28560 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:23.193691 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 91846.3us
I20260709 12:19:23.205679 23095 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:19:23.188041 28309 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:23.187846 28521 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:23.153934 28417 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.136552 28565 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.214102 22473 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:19:23.229823 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:23.175856 28468 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:23.231355 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:23.234946 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:23.236573 22469 raft_consensus.cc:1240] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:23.238783 22548 raft_consensus.cc:2393] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 17: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:23.239980 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:23.186277 28551 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:19:23.209389 28558 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:23.150888 28572 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:23.207054 28450 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
W20260709 12:19:23.252053 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.258574 22547 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:19:23.189262 28500 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:23.259382 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:23.219352 28521 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:23.251708 22548 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:19:23.261842 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 49698.2us
I20260709 12:19:23.231360 28418 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:23.238669 28437 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:23.266510 28435 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:23.267062 28425 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:23.279048 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:23.238023 28420 raft_consensus.cc:3055] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:23.269891 28434 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:23.272939 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 440058us
W20260709 12:19:23.275131 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 59413.7us
W20260709 12:19:23.283752 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 88374.5us
I20260709 12:19:23.276747 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:23.260586 28563 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:19:23.283249 22442 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:23.256204 28552 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.250088 28588 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:23.285938 23094 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:23.196208 28564 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.254045 28342 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:23.269897 28574 raft_consensus.cc:2804] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:23.273542 28521 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:23.311681 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:23.216557 28560 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.308564 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:23.309953 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:23.309427 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:23.301592 22399 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:19:23.315255 22442 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:23.282482 28420 raft_consensus.cc:740] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:19:23.309701 28550 log.cc:927] Time spent T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.193s	user 0.001s	sys 0.001s
I20260709 12:19:23.327720 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:19:23.364650 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:23.366420 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.313562 28448 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:23.283803 28435 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.290349 28425 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:23.378468 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 47571.4us
I20260709 12:19:23.423576 22442 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:23.263095 28558 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.421547 28549 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:23.421838 28589 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:23.366096 28465 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:19:23.422003 28575 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:23.289860 28584 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.100s
I20260709 12:19:23.302503 28434 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:23.432981 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.321209 28342 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 12:19:23.303983 28552 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:23.439519 28420 consensus_queue.cc:260] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:23.440407 28581 log.cc:927] Time spent T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:19:23.441238 28420 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:23.442355 28255 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:23.304652 28588 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.445073 28588 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:23.368995 28500 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:23.433424 28571 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:23.366686 28576 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:23.433315 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 141600us
W20260709 12:19:23.472882 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 49415.4us
I20260709 12:19:23.486717 22442 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:23.488421 22442 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:19:23.476523 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 180465us
I20260709 12:19:23.462764 22548 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
W20260709 12:19:23.482806 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 196940us
I20260709 12:19:23.500582 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:23.501052 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:23.502441 22394 raft_consensus.cc:1240] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:23.507871 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:23.501508 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:23.478309 22366 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:23.513548 22366 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:23.514168 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:19:23.561244 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 45885.2us
I20260709 12:19:23.563683 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:19:23.468775 28423 consensus_meta.cc:287] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.642s	user 0.006s	sys 0.002s
W20260709 12:19:23.476052 28406 consensus_meta.cc:287] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.004s
I20260709 12:19:23.452970 28590 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:23.448231 28456 consensus_meta.cc:287] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.003s
W20260709 12:19:23.454923 28567 log.cc:927] Time spent T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 12:19:23.449618 28435 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:23.450286 28549 raft_consensus.cc:697] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:23.569242 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:23.445744 28588 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:23.473011 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 3181) took 1269 ms. Trace:
I20260709 12:19:23.566186 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:23.453125 28562 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:23.453315 28587 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.470296 28425 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:23.472527 28418 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:23.465689 28543 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:23.450728 28569 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:23.465289 28417 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:23.454138 28565 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:23.466542 28592 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:23.468012 28560 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:23.464700 28564 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:23.447376 28558 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:23.556722 28500 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:19:23.588363 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:19:23.680681 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 205251us
I20260709 12:19:23.646587 23129 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:19:23.563757 28497 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:19:23.686118 22440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.045s	sys 0.083s
I20260709 12:19:23.686400 28434 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:23.686991 28577 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.687286 28582 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:23.515889 28388 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.556753 28551 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.563212 28465 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.647162 22398 rpcz_store.cc:276] 0709 12:19:22.203963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.204092 (+   129us) service_pool.cc:224] Handling call
0709 12:19:22.204425 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:22.204754 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:22.204782 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:22.205302 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 12:19:22.833030 (+627728us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:22.833076 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.833153 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:23.472719 (+639566us) raft_consensus.cc:1685] finished
0709 12:19:23.472760 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:23.472913 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1112,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":627348,"threads_started":1,"wal-append.queue_time_us":858549}
I20260709 12:19:23.660405 22551 raft_consensus.cc:2410] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
W20260709 12:19:23.584904 28490 consensus_meta.cc:287] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.001s
W20260709 12:19:23.667877 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 102535us
W20260709 12:19:23.669340 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 105026us
I20260709 12:19:23.597939 28488 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:23.557178 28255 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.108s
I20260709 12:19:23.468748 28571 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:23.659884 28435 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.587388 28590 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:23.659654 28574 raft_consensus.cc:697] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:23.684619 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:23.694829 28465 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.686030 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:23.578492 28406 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:23.686471 22440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.045s	sys 0.083s
I20260709 12:19:23.598834 28601 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 12:19:23.693348 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:23.696419 28549 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.699290 22397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 870) took 1159 ms. Trace:
I20260709 12:19:23.699501 23126 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:23.699811 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:19:23.678449 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.471297 28504 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:23.710206 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:23.687831 28500 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 25 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:23.709447 22515 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:23.713016 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:23.679065 28579 consensus_queue.cc:1059] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:19:23.679752 28501 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.119s
I20260709 12:19:23.672129 28562 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.719813 22544 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:23.718550 22397 rpcz_store.cc:276] 0709 12:19:22.539907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.541203 (+  1296us) service_pool.cc:224] Handling call
0709 12:19:22.541803 (+   600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:22.542211 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:22.542241 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:22.542746 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:19:23.000309 (+457563us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:19:23.000349 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.000414 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:23.699085 (+698671us) raft_consensus.cc:1685] finished
0709 12:19:23.699104 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:23.699221 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1132,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":457178,"threads_started":1,"wal-append.queue_time_us":695729}
I20260709 12:19:23.689345 28551 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:23.736629 23124 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:19:23.742717 22515 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:23.743268 23130 raft_consensus.cc:1240] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:23.717665 28611 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:23.737332 28434 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:23.752681 28543 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:23.721796 28488 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:23.753959 23123 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:23.710191 28435 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.693712 28388 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:23.762972 22544 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 11.
I20260709 12:19:23.671868 28587 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:23.687529 28577 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:23.765295 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 44325.6us
I20260709 12:19:23.758610 28562 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:19:23.769781 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:23.760010 28593 consensus_queue.cc:1059] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.185s
I20260709 12:19:23.769280 28543 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:23.771662 28488 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:23.773166 28574 consensus_queue.cc:237] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:23.737845 28342 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:23.768944 28434 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:23.790800 28465 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:23.791489 28434 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:23.792142 28488 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:23.793823 28435 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:23.687901 28592 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.760721 28575 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 12. Current term is 13.
I20260709 12:19:23.782974 23129 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:19:23.771968 28604 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:23.786877 28543 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:23.775076 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:23.787621 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:23.797664 28598 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:19:23.857195 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:23.860531 28577 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:23.871580 28388 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:23.872215 28497 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:23.802502 28342 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.854043 28417 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:23.873591 28571 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:23.875525 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:23.876185 22545 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:19:23.861682 22398 raft_consensus.cc:2393] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 15: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:23.862784 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:23.869925 28562 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:23.870569 28396 tablet_copy_client.cc:538] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:23.766224 28611 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.877131 28612 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.796620 28500 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:23.877597 22402 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
I20260709 12:19:23.878554 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:23.910676 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:23.885219 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:23.912108 22545 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 12.
I20260709 12:19:23.902186 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:23.913594 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.912887 22399 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
I20260709 12:19:23.919548 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:23.911955 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:23.910259 22442 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:23.924507 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:23.924842 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:23.922811 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:23.922824 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:23.927048 28612 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.929428 28612 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:23.926817 22544 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 14.
W20260709 12:19:23.946067 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.932684 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:23.931506 22398 raft_consensus.cc:1240] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:19:23.936265 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:23.937392 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:23.950191 22542 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
I20260709 12:19:23.902781 28468 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:23.956496 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43060 (request call id 767) took 2176 ms. Trace:
I20260709 12:19:23.869931 28592 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:23.957397 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 47239.1us
I20260709 12:19:23.917832 28601 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.960417 22471 rpcz_store.cc:276] 0709 12:19:21.755493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.756284 (+   791us) service_pool.cc:224] Handling call
0709 12:19:21.756533 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:21.836480 (+ 79947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.931746 (+2095266us) spinlock_profiling.cc:243] Waited 79.2 ms on lock 0x7b54002b3754. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:23.931912 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182076160}
I20260709 12:19:23.962296 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:23.883133 28587 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:23.964141 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:23.971042 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:23.971654 22399 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:23.923645 28593 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:23.877633 28562 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.873651 28417 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:23.933524 28596 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:23.967115 22402 raft_consensus.cc:2410] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:19:23.932444 28590 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:23.921705 28588 consensus_queue.cc:1059] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:19:23.903306 28536 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
W20260709 12:19:23.986652 28521 consensus_meta.cc:287] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.661s	user 0.012s	sys 0.004s
I20260709 12:19:23.987108 28521 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.988603 22547 raft_consensus.cc:2393] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 17: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:23.963666 28612 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:19:23.983047 22543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54498 (request call id 3190) took 2403 ms (client timeout 1614 ms). Trace:
I20260709 12:19:23.985126 28562 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:23.975786 28468 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.961602 22442 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:19:23.992238 22543 rpcz_store.cc:269] 0709 12:19:21.579729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.580269 (+   540us) service_pool.cc:224] Handling call
0709 12:19:23.982773 (+2402504us) spinlock_profiling.cc:243] Waited 94.5 ms on lock 0x7b540040ef54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:23.982923 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217374976}
I20260709 12:19:23.994575 22543 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:19:23.996354 28468 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:23.985038 28607 log.cc:927] Time spent T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:19:23.990440 28521 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:23.990949 28611 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:24.000036 28468 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:24.005060 28551 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:24.017670 28417 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:23.991429 28596 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:23.974859 28601 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:23.980059 28593 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:23.992152 28612 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:24.031674 28478 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:24.036939 22543 raft_consensus.cc:1240] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:24.031085 28401 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:24.043347 28593 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:24.034031 28260 raft_consensus.cc:993] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:24.044852 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:24.045894 28612 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:24.040630 28431 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:24.051424 28553 raft_consensus.cc:993] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:24.035609 28543 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:24.060027 22399 raft_consensus.cc:2468] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:19:24.061573 22543 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 12:19:23.965016 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 225480us
W20260709 12:19:24.065243 28530 log.cc:927] Time spent T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 1.889s	user 0.022s	sys 0.006s
I20260709 12:19:24.067827 28588 raft_consensus.cc:3055] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:24.068271 28588 raft_consensus.cc:740] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:24.068876 28596 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:24.071929 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 110410us
I20260709 12:19:24.079830 28472 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:24.080323 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:24.082746 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:24.080271 28472 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:24.083359 22544 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:19:24.084798 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 3200) took 2303 ms. Trace:
I20260709 12:19:24.069126 28588 consensus_queue.cc:260] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:24.084494 22366 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:24.087836 28427 raft_consensus.cc:1081] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:24.091277 28554 raft_consensus.cc:1081] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:24.079967 28551 raft_consensus.cc:3055] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:24.079392 28543 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:24.081503 28604 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.092602 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:24.098766 22396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:19:24.099444 22396 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:24.099802 22396 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:24.088449 28472 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:24.104547 22366 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:24.106693 22366 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:24.090291 28478 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:24.111312 22366 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:24.082742 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:24.095552 28588 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:24.112860 28424 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:24.116024 22543 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
I20260709 12:19:24.095180 28551 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:24.119695 22396 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:24.104216 28445 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:24.132814 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:24.108562 28428 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:24.135228 22366 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:19:24.147841 28529 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 1.975s	user 0.002s	sys 0.013s
I20260709 12:19:24.149922 28578 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:24.150029 22396 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:24.113724 28478 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:24.119019 28388 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:24.152762 28578 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:24.143965 28601 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:24.153853 22366 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:24.170276 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:24.171705 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:24.231629 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:24.277071 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.283638 28504 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:24.118587 28604 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:24.118892 28497 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:19:24.161365 28478 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:24.307976 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.247900 28601 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:24.246048 28554 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.284600 28543 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:24.291028 28468 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.311528 28601 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:24.167680 28388 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:24.335350 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 3592) took 1091 ms. Trace:
I20260709 12:19:24.325434 22475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 3409) took 2084 ms. Trace:
W20260709 12:19:24.337663 22440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.025s	sys 0.063s
W20260709 12:19:24.314069 28549 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.030s	sys 0.057s
W20260709 12:19:24.340153 22440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.025s	sys 0.063s
I20260709 12:19:24.339956 22551 rpcz_store.cc:276] 0709 12:19:23.234468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.234689 (+   221us) service_pool.cc:224] Handling call
0709 12:19:24.325201 (+1090512us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400140fd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:24.325344 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":976324992}
W20260709 12:19:24.347682 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.340684 22475 rpcz_store.cc:276] 0709 12:19:22.236640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.238002 (+  1362us) service_pool.cc:224] Handling call
0709 12:19:22.275446 (+ 37444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:22.313997 (+ 38551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.320074 (+2006077us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b5400047754. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:24.320304 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86828672}
I20260709 12:19:24.351540 22366 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:24.350252 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:24.352537 22471 raft_consensus.cc:3055] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:24.325935 28601 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:19:24.319582 28574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.016s	sys 0.010s
I20260709 12:19:24.355253 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:24.352882 22471 raft_consensus.cc:740] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:24.355403 22473 raft_consensus.cc:1275] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:24.358636 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:24.359234 22473 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:19:24.348428 28549 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.031s	sys 0.059s
I20260709 12:19:24.359846 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:24.362684 22468 raft_consensus.cc:2393] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 19: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:24.318517 28543 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:24.358415 22471 consensus_queue.cc:260] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:24.346771 28388 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:24.354068 28396 tablet_bootstrap.cc:492] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
W20260709 12:19:24.366297 23131 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.029s	sys 0.069s
W20260709 12:19:24.425392 23131 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.029s	sys 0.069s
I20260709 12:19:24.364151 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:24.351886 28424 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.319944 28468 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:24.305848 28551 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:24.404304 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:24.316579 28554 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:24.357713 28574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.016s	sys 0.011s
I20260709 12:19:24.351401 28498 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:24.406548 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:24.367338 22477 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:19:24.410087 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:24.359061 28401 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:24.421164 28578 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:24.423377 28260 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.426457 22473 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:24.447681 22551 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:24.086642 22550 rpcz_store.cc:276] 0709 12:19:21.779027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.780020 (+   993us) service_pool.cc:224] Handling call
0709 12:19:21.780393 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:21.795819 (+ 15426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:21.795849 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:21.796404 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 12:19:22.155327 (+358923us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:22.881932 (+726605us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:19:24.047717 (+1165785us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b18003d02a0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f86fc4bc 00007fb4f5a4a48b 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a64455 00007fb4fc54c3c7 00007fb4f8b5e9a7 00007fb4f8b6e0bf
0709 12:19:24.047864 (+   147us) log.cc:844] Serialized 14 byte log entry
0709 12:19:24.081633 (+ 33769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.081707 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:24.081747 (+    40us) raft_consensus.cc:1685] finished
0709 12:19:24.081757 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:24.081900 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55755,"prepare.queue_time_us":263577,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":58779,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":6117,"spinlock_wait_cycles":7956736,"thread_start_us":500141,"threads_started":2,"wal-append.queue_time_us":467976}
W20260709 12:19:24.465951 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.454387 22396 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 25 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 12:19:24.543898 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 65931.5us
I20260709 12:19:24.527223 22469 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:19:24.542418 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:24.549162 22474 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:24.550428 22472 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
W20260709 12:19:24.551201 22443 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.019s	sys 0.037s
W20260709 12:19:24.555974 22443 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.019s	sys 0.037s
I20260709 12:19:24.556118 22550 raft_consensus.cc:1240] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:24.554250 22471 raft_consensus.cc:3060] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:24.526454 28623 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 12:19:24.538954 28585 log.cc:927] Time spent T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 1.120s	user 0.000s	sys 0.003s
I20260709 12:19:24.465615 28551 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:24.568894 22396 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:19:24.463143 28604 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:24.571409 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.465335 28468 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:24.452325 28424 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:24.472348 28612 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:24.560791 28592 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:24.598526 28466 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:24.599241 28466 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:24.603572 28572 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:24.601478 28466 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:24.560096 28260 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:24.576889 28458 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.613755 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:24.587975 28626 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:19:24.591778 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.577330 28408 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:24.559855 28445 consensus_queue.cc:1059] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:19:24.572841 28500 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:19:24.562381 28472 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:24.497993 28498 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:24.613406 28592 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:24.620880 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 3215) took 1551 ms. Trace:
I20260709 12:19:24.622453 22470 raft_consensus.cc:1240] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 19. Current term is 20. Ops: []
W20260709 12:19:24.619140 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:24.621836 28588 consensus_meta.cc:287] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.500s	user 0.007s	sys 0.004s
I20260709 12:19:24.630064 22546 rpcz_store.cc:276] 0709 12:19:23.069753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.069887 (+   134us) service_pool.cc:224] Handling call
0709 12:19:23.070176 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:23.073191 (+  3015us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:23.073218 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:23.078276 (+  5058us) log.cc:844] Serialized 26 byte log entry
0709 12:19:23.194628 (+116352us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:23.194665 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.194734 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:24.525627 (+1330893us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:19:24.616370 (+ 90743us) raft_consensus.cc:1685] finished
0709 12:19:24.616389 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:24.620799 (+  4410us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2609,"raft.queue_time_us":28743,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":146,"spinlock_wait_cycles":8758016,"thread_start_us":78045,"threads_started":1,"wal-append.queue_time_us":199589}
I20260709 12:19:24.585906 28255 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:19:24.586858 22551 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 21.
I20260709 12:19:24.605587 28587 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:24.636346 22366 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:24.637333 22476 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 19. Current term is 20. Ops: []
I20260709 12:19:24.622118 28626 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:24.645895 28543 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:24.618759 28606 consensus_queue.cc:1059] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:19:24.672313 28498 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:24.618582 28458 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:24.675678 28458 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:24.676793 28554 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:24.647673 28528 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:19:24.620805 28388 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:24.679605 22471 raft_consensus.cc:2468] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:24.623730 28408 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:24.694312 22402 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.009s	sys 0.010s
I20260709 12:19:24.672376 28592 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:24.640300 28587 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:24.692030 28528 raft_consensus.cc:697] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 21 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:19:24.700409 22402 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.009s	sys 0.010s
I20260709 12:19:24.716867 28424 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:24.711697 28592 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.744647 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:24.745477 22402 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:24.746166 22398 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 25 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 24. Current term is 25. Ops: [23.13-24.14]
I20260709 12:19:24.746994 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:24.754302 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 3214) took 1685 ms. Trace:
I20260709 12:19:24.754746 22549 rpcz_store.cc:276] 0709 12:19:23.069443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.069565 (+   122us) service_pool.cc:224] Handling call
0709 12:19:23.078471 (+  8906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:23.108360 (+ 29889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.754059 (+1645699us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b54001ead54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:24.754236 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67022080}
I20260709 12:19:24.755156 28546 raft_consensus.cc:3055] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:24.755569 28546 raft_consensus.cc:740] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:24.738719 28626 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:24.733143 28592 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:24.756461 28546 consensus_queue.cc:260] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:24.758152 28592 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:24.729015 28605 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:24.758598 28612 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:24.757628 28546 raft_consensus.cc:3060] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:24.759840 28342 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:24.733290 28500 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:24.734776 28388 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:24.735661 28472 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:24.779280 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:24.778159 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:24.783707 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:24.784919 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:24.785885 22394 raft_consensus.cc:2410] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:19:24.786481 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:19:24.741801 28409 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
W20260709 12:19:24.766989 22516 connection.cc:256] RPC call timeout handler was delayed by -1.3167967859999408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
I20260709 12:19:24.788605 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:24.791317 22477 raft_consensus.cc:2410] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:19:24.790699 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:24.740089 28260 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:24.789901 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:24.790095 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:24.796011 22400 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:24.789785 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:24.796728 22395 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 20.
I20260709 12:19:24.788928 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:24.791381 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:19:24.793371 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 177751us
I20260709 12:19:24.794654 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:24.794755 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:24.796180 22471 raft_consensus.cc:2393] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 17: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:24.792439 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:24.798899 23095 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:24.799539 22468 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:24.800030 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:24.800855 22471 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 20: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:24.801383 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:24.798908 22477 raft_consensus.cc:2410] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:19:24.802146 22395 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:19:24.805042 23095 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:24.797592 22397 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:24.808203 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:24.809651 22474 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:19:24.780179 28437 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:24.813872 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:24.812815 22477 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 25 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 12:19:24.764653 28528 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:24.794572 28408 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:24.819473 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.817687 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:24.821275 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:24.766191 28605 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:24.822108 22477 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:24.766382 28490 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:24.809105 28535 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:24.809568 28592 raft_consensus.cc:2804] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:24.827342 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:24.779667 28500 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:24.829545 23126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41028 (request call id 1011) took 1104 ms. Trace:
I20260709 12:19:24.830104 23126 rpcz_store.cc:276] 0709 12:19:23.720571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.721751 (+  1180us) service_pool.cc:224] Handling call
0709 12:19:24.103961 (+382210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.104175 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:24.104203 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:24.104243 (+    40us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:19:24.104277 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.104330 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:24.824857 (+720527us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b540090c750. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:24.824987 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":816648448}
I20260709 12:19:24.825344 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:24.832894 22471 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:24.829825 28490 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:24.836776 28490 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:24.838003 22400 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
W20260709 12:19:24.838217 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.840083 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:24.842351 22473 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:24.816735 28437 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:24.842352 22477 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:19:24.829622 28535 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:24.839493 28630 log.cc:927] Time spent T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.144s	user 0.001s	sys 0.001s
W20260709 12:19:24.859401 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 68416.1us
I20260709 12:19:24.863248 28342 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:24.863850 28342 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:24.845222 28592 raft_consensus.cc:697] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 12 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:24.859797 28535 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:24.862610 28587 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:24.865869 28606 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:24.894908 28437 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:24.895730 28500 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:24.890802 28634 log.cc:927] Time spent T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:19:24.901840 28504 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:24.902391 28504 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:24.906910 28431 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:19:24.906713 28592 consensus_queue.cc:237] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:24.911574 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:24.912106 22516 connection.cc:256] RPC call timeout handler was delayed by -1.050583491999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
I20260709 12:19:24.913745 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:24.958695 22296 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50176 (request call id 303) took 4250 ms. Trace:
I20260709 12:19:24.960412 28580 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:19:24.961933 28601 consensus_meta.cc:287] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.002s
I20260709 12:19:24.962117 28572 consensus_queue.cc:1048] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:24.962406 28601 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:24.963231 28406 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:24.965355 28601 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:24.962687 28552 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:24.891681 28342 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:24.969691 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:24.975596 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:24.976382 28536 raft_consensus.cc:3055] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:24.976645 28414 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:24.977202 28414 raft_consensus.cc:697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:24.978130 28414 consensus_queue.cc:237] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:24.982591 28578 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:24.984823 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:24.985584 28578 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:24.986011 28578 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:24.986415 28578 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:24.988739 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:24.932462 28605 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:24.893535 28606 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:24.991657 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:24.987251 28536 raft_consensus.cc:740] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:24.976935 28468 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:24.993870 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:24.994179 28468 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:24.994623 28468 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:24.994765 28604 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:24.995247 28604 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:24.995641 28604 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:24.995952 28590 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:24.996352 28590 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:24.996696 28590 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:24.999178 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:19:25.000044 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.000427 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.000677 22515 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:25.001610 22516 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:25.002269 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:25.002859 23131 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
W20260709 12:19:25.003899 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.004475 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:25.004989 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.005590 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:25.005626 22544 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 16.
I20260709 12:19:25.007042 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:25.008791 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:25.009346 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:25.007766 23131 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
W20260709 12:19:25.011293 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.011786 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.012372 22549 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
I20260709 12:19:25.013350 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:25.014168 28420 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.014678 28420 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.016156 28504 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:25.016716 28420 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:25.010383 23123 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:19:25.014423 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:25.020183 23127 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:24.995301 28639 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:19:24.992316 28342 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:25.023082 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:25.014183 23126 raft_consensus.cc:2410] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 12:19:25.034883 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:25.035396 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:25.036650 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41012 (request call id 1032) took 2154 ms. Trace:
I20260709 12:19:25.035234 23094 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:25.043184 23131 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:25.043385 23125 rpcz_store.cc:276] 0709 12:19:22.882289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.886540 (+  4251us) service_pool.cc:224] Handling call
0709 12:19:22.886961 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:23.075100 (+188139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:23.075133 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:24.590031 (+1514898us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b2c000d5f38. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f744da11 00007fb4f745d372 00007fb4f8b8fa01 00007fb4f8b5443a 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2
0709 12:19:24.590435 (+   404us) log.cc:844] Serialized 26 byte log entry
0709 12:19:24.846544 (+256109us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:24.846589 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.846668 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:25.036357 (+189689us) raft_consensus.cc:1685] finished
0709 12:19:25.036378 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.036578 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21235,"raft.queue_time_us":253651,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":14930,"spinlock_wait_cycles":4585344,"thread_start_us":442666,"threads_started":2,"wal-append.queue_time_us":259937}
I20260709 12:19:25.048064 23094 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:25.049134 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:25.055271 23094 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:25.021258 28552 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:25.048436 23127 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:25.041878 28342 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:25.065207 28342 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:25.059774 28536 consensus_queue.cc:260] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.066824 28536 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:25.068109 28468 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:25.048956 28420 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:25.063390 28647 log.cc:927] Time spent T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:19:25.070062 28414 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:25.059952 28546 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:25.073788 28546 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:25.074225 28546 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:25.074421 28468 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:25.058569 28552 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:25.078038 28552 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:25.080857 28622 raft_consensus.cc:3055] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:25.081348 28622 raft_consensus.cc:740] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:25.082556 28606 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:25.082192 28622 consensus_queue.cc:260] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.070842 28543 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.040647 28604 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.085458 28543 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:25.088632 28578 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:25.086431 28622 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:25.091078 28578 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:25.092941 28604 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:25.094858 28590 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:24.959174 22296 rpcz_store.cc:276] 0709 12:19:20.665901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.666087 (+   186us) service_pool.cc:224] Handling call
0709 12:19:21.142367 (+476280us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b540038b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abe090 00007fb4f8b5cf3a 00007fb4fe912e9c 00007fb4fea1104e 00007fb4fced22a4 00007fb4fced2232 00007fb4fced2161 00007fb4fced20dc 00007fb4fced1392 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:24.916336 (+3773969us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:21.548118 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:21.548652 (+   534us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:21.548686 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:19:21.548705 (+    19us) tablet.cc:662] Decoding operations
0709 12:19:21.549115 (+   410us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:21.549167 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:21.553814 (+  4647us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:19:21.554142 (+   328us) tablet.cc:701] Row locks acquired
0709 12:19:21.554160 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:19:21.554310 (+   150us) write_op.cc:270] Start()
0709 12:19:21.554405 (+    95us) write_op.cc:276] Timestamp: P: 1783599561554261 usec, L: 0
0709 12:19:21.554426 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:19:21.555068 (+   642us) log.cc:844] Serialized 923 byte log entry
0709 12:19:21.833403 (+278335us) op_driver.cc:464] REPLICATION: finished
0709 12:19:22.298717 (+465314us) write_op.cc:301] APPLY: starting
0709 12:19:22.298811 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:22.407200 (+108389us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:22.413955 (+  6755us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:22.570861 (+156906us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:22.571079 (+   218us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:19:22.571128 (+    49us) write_op.cc:312] APPLY: finished
0709 12:19:22.571349 (+   221us) log.cc:844] Serialized 33 byte log entry
0709 12:19:22.571541 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:22.571618 (+    77us) write_op.cc:454] Released schema lock
0709 12:19:22.571655 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:22.572060 (+   405us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:22.572094 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":84638,"reported_tablets":2,"spinlock_wait_cycles":39409536,"child_traces":[["op",{"apply.queue_time_us":452217,"apply.run_cpu_time_us":6168,"apply.run_wall_time_us":273291,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12507,"num_ops":2,"prepare.queue_time_us":77215,"prepare.run_cpu_time_us":2643,"prepare.run_wall_time_us":7233,"replication_time_us":271216,"thread_start_us":346689,"threads_started":2}]]}
W20260709 12:19:25.133334 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.137892 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:25.138859 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 137146us
I20260709 12:19:25.140413 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:25.142357 22396 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 13.
I20260709 12:19:25.145198 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:25.152622 22546 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:25.152998 22543 raft_consensus.cc:2410] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 26 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 12:19:25.154374 22551 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:25.057523 23094 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:25.165225 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 107669us
W20260709 12:19:25.166451 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.159669 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:25.174571 23094 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:25.184614 28401 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:25.185750 28401 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.187813 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:25.083527 28414 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:25.189204 28406 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:25.189599 28414 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:25.191196 28478 consensus_meta.cc:287] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.880s	user 0.012s	sys 0.000s
I20260709 12:19:25.191963 28478 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:25.195842 28428 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.196322 28437 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.196857 28428 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:25.201701 28456 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:25.202013 28504 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:25.202778 28456 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:25.203939 28456 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:25.195904 28420 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:25.211407 28490 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:25.214311 28654 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:25.214967 28654 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:25.215512 28654 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:25.218222 28653 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:25.222586 28601 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:25.223603 22543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 3618) took 1059 ms. Trace:
I20260709 12:19:25.223842 28601 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.224226 22543 rpcz_store.cc:276] 0709 12:19:24.163840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.171458 (+  7618us) service_pool.cc:224] Handling call
0709 12:19:25.223137 (+1051679us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b5400178c54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:25.223395 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2252952960}
I20260709 12:19:25.226032 28584 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:19:25.226502 22548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 3600) took 1948 ms (client timeout 1891 ms). Trace:
W20260709 12:19:25.227021 22548 rpcz_store.cc:269] 0709 12:19:23.278457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.278757 (+   300us) service_pool.cc:224] Handling call
0709 12:19:25.226095 (+1947338us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b540042c054. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:25.226283 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420724608}
I20260709 12:19:25.227916 28437 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:25.230979 23130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34092 (request call id 762) took 1717 ms. Trace:
I20260709 12:19:25.231531 23130 rpcz_store.cc:276] 0709 12:19:23.513417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.562837 (+ 49420us) service_pool.cc:224] Handling call
0709 12:19:23.563211 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:23.748284 (+185073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.230298 (+1482014us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b5400b04fd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:25.230734 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401155968}
I20260709 12:19:25.234539 28592 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:25.239473 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:25.239720 28653 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:19:25.240113 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 64773.3us
I20260709 12:19:25.240780 28653 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:25.242697 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.244164 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:25.244691 28653 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:25.246428 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.246693 28255 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:25.247619 28255 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.210893 28420 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:25.249724 28420 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:25.251197 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 3598) took 1978 ms. Trace:
I20260709 12:19:25.251588 22547 rpcz_store.cc:276] 0709 12:19:23.272869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.273423 (+   554us) service_pool.cc:224] Handling call
0709 12:19:25.250808 (+1977385us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54004213d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:25.251016 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619124608}
I20260709 12:19:25.253204 22542 raft_consensus.cc:1240] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:19:25.213532 28490 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.257005 28490 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:25.258611 22396 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 16.
I20260709 12:19:25.260898 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:25.272010 28437 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:25.272266 28428 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:25.275427 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:25.275472 28504 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:25.277200 28504 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:25.277655 28504 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:25.277683 28588 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:25.278473 28588 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:25.278939 28588 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:25.266431 28401 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:25.283118 28584 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:25.285921 23124 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: []
W20260709 12:19:25.286473 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.286228 28584 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.278956 28551 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.291384 28551 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:25.291808 28584 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:25.294423 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49290 (request call id 1129) took 1546 ms. Trace:
I20260709 12:19:25.286098 28592 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:25.272305 28601 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:25.294806 22542 rpcz_store.cc:276] 0709 12:19:23.742013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.052024 (+310011us) service_pool.cc:224] Handling call
0709 12:19:25.252573 (+1200549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:25.253684 (+  1111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.286776 (+ 33092us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54004213d0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:25.288024 (+  1248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2759977728}
I20260709 12:19:25.312644 22297 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32988 (request call id 186) took 3900 ms. Trace:
I20260709 12:19:25.314450 22298 catalog_manager.cc:5697] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 18 to 19, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 19 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:25.318202 22293 catalog_manager.cc:5697] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 10 to 12, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 12 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:25.322571 28543 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:25.323894 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:25.325117 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.329107 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:25.330240 22402 raft_consensus.cc:2410] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
W20260709 12:19:25.330799 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.331262 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.332067 22548 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
I20260709 12:19:25.333256 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:25.330821 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:25.326152 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.336972 28584 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.338349 28342 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:25.340852 28342 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:25.343570 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:25.297821 28255 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:25.344990 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.336848 22396 raft_consensus.cc:2410] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:19:25.345276 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:25.345755 22542 raft_consensus.cc:2368] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16.
I20260709 12:19:25.329479 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:25.347498 22400 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:25.348263 23095 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:25.348475 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:25.349869 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:25.351963 22399 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:25.353597 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:25.353991 28551 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:25.297315 28592 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:25.378083 22543 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:25.313138 22297 rpcz_store.cc:276] 0709 12:19:21.411613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.411737 (+   124us) service_pool.cc:224] Handling call
0709 12:19:25.312368 (+3900631us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:21.649591 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:21.650146 (+   555us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:21.650177 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:19:21.650194 (+    17us) tablet.cc:662] Decoding operations
0709 12:19:21.650770 (+   576us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:21.650822 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:21.650859 (+    37us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:19:21.651234 (+   375us) tablet.cc:701] Row locks acquired
0709 12:19:21.651251 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:19:21.651391 (+   140us) write_op.cc:270] Start()
0709 12:19:21.651503 (+   112us) write_op.cc:276] Timestamp: P: 1783599561651344 usec, L: 0
0709 12:19:21.651524 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:19:21.700476 (+ 48952us) log.cc:844] Serialized 1674 byte log entry
0709 12:19:22.272412 (+571936us) op_driver.cc:464] REPLICATION: finished
0709 12:19:22.572469 (+300057us) write_op.cc:301] APPLY: starting
0709 12:19:22.572546 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:23.085329 (+512783us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:23.105555 (+ 20226us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:23.658372 (+552817us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:23.676566 (+ 18194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:19:23.680704 (+  4138us) write_op.cc:312] APPLY: finished
0709 12:19:23.704994 (+ 24290us) log.cc:844] Serialized 49 byte log entry
0709 12:19:24.108058 (+403064us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:24.118162 (+ 10104us) write_op.cc:454] Released schema lock
0709 12:19:24.120408 (+  2246us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:24.158613 (+ 38205us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:24.160346 (+  1733us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":778147,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":291147,"apply.run_cpu_time_us":80432,"apply.run_wall_time_us":1576456,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16760,"num_ops":4,"prepare.queue_time_us":138,"prepare.run_cpu_time_us":3297,"prepare.run_wall_time_us":51180,"replication_time_us":586834,"thread_start_us":810416,"threads_started":2,"wal-append.queue_time_us":640626}]]}
I20260709 12:19:25.361711 28478 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:25.362196 28255 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.387077 22395 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:25.387844 28255 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:25.390511 28255 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:25.364287 22551 raft_consensus.cc:1240] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:25.365253 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.366297 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.344871 28414 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.398013 28414 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:25.401876 28420 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.404348 28420 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:25.404496 28588 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.370684 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:25.372092 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:25.372471 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:25.372890 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:25.338263 28584 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.373072 28403 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:25.416393 28403 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:25.416841 28403 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:25.417799 28584 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:25.375063 22398 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:25.376756 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:19:25.375734 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 188211us
I20260709 12:19:25.387038 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:25.377009 22399 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 21 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 20. Current term is 21. Ops: []
I20260709 12:19:25.391108 28406 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:25.420689 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:25.422616 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:19:25.425450 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 241712us
I20260709 12:19:25.426626 28551 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:25.427479 28551 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:25.427853 28403 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.427794 28551 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:25.428658 28551 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:19:25.429397 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 185510us
W20260709 12:19:25.424461 28407 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:19:25.434451 28504 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.436830 28504 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:25.408973 22515 leader_election.cc:336] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Timed out: RequestConsensusVote RPC to 127.20.191.4:34357 timed out after 1.509s (SENT)
I20260709 12:19:25.456233 22515 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:25.410933 28590 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:25.459569 28590 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:25.362682 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.437373 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:25.440557 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:25.461162 28543 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:25.461549 28543 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:25.443470 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:25.462020 28543 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:19:25.392848 28535 consensus_meta.cc:287] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.007s
I20260709 12:19:25.448607 23094 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:19:25.458398 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 49597us
I20260709 12:19:25.419831 22543 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:25.494343 23127 raft_consensus.cc:2393] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 15: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:25.492708 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:19:25.537529 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 89109.4us
I20260709 12:19:25.543444 28551 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:25.544031 22547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "367745908a334997957e47f869d9fb14"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54498
I20260709 12:19:25.544862 22547 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:25.545233 22547 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:25.546074 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.546895 22542 raft_consensus.cc:2393] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 17: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:25.549211 22399 raft_consensus.cc:1240] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:25.552393 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.551689 28551 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:25.550335 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 56525.3us
I20260709 12:19:25.553408 28546 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.555701 28546 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:19:25.556540 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.557363 28573 consensus_queue.cc:1059] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:25.558947 28427 raft_consensus.cc:3055] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:25.559324 28427 raft_consensus.cc:740] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:25.560459 28427 consensus_queue.cc:260] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.561995 28427 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:25.562638 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:25.570923 28551 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:25.571767 28551 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:25.572402 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:25.573158 22550 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:25.574318 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:19:25.588969 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 50670.1us
I20260709 12:19:25.592459 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:25.540798 28403 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:25.541508 28406 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:25.597481 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.594732 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.594053 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.600237 22542 raft_consensus.cc:2368] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17.
I20260709 12:19:25.591091 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.605068 22549 raft_consensus.cc:2393] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 16: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:25.494555 28535 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.607025 22545 raft_consensus.cc:1240] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:25.607499 22543 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:19:25.610272 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:25.599318 28406 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:25.622324 22548 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:25.562142 28552 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:25.628574 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.625154 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.629556 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.602947 28584 consensus_queue.cc:1059] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:19:25.635870 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.627589 28406 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:25.648691 22551 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 20.
I20260709 12:19:25.638849 28592 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:25.683763 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 92967us
I20260709 12:19:25.642993 28414 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:25.711320 28592 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:25.714171 22544 raft_consensus.cc:1275] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:19:25.718076 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 283912us
I20260709 12:19:25.692854 28403 consensus_queue.cc:1059] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:19:25.723410 28420 raft_consensus.cc:3055] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:25.723953 28420 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:25.726073 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:19:25.737375 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 83388us
W20260709 12:19:25.754107 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.725116 28420 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.706441 28654 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:25.760190 28504 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:25.750329 28588 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:25.772267 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:25.726094 28427 consensus_queue.cc:1059] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:19:25.771634 22550 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
W20260709 12:19:25.777045 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.777055 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.786258 22551 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:25.757232 28414 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.785316 22546 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:25.783407 28551 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:25.801277 23127 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:25.791486 28578 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:25.797211 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:19:25.804193 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 323677us
I20260709 12:19:25.773886 28573 consensus_queue.cc:1059] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:19:25.793320 28342 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:25.808799 22399 pending_rounds.cc:85] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 8
I20260709 12:19:25.795382 28535 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:25.781136 28255 consensus_queue.cc:1059] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:19:25.800024 28552 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:25.810019 22399 pending_rounds.cc:107] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:19:25.820940 22399 raft_consensus.cc:2889] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:25.825519 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 45523us
I20260709 12:19:25.826563 28578 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:25.827819 28420 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:25.828958 28578 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:25.830327 28660 log.cc:927] Time spent T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:19:25.832556 28543 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:25.809965 28342 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:25.835703 28342 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:25.802651 28504 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:25.798125 28427 consensus_queue.cc:1059] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:19:25.880227 28654 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:25.882140 28592 raft_consensus.cc:3055] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:25.882635 28592 raft_consensus.cc:740] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:25.883582 28592 consensus_queue.cc:260] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:25.885218 28592 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:25.889681 28568 raft_consensus.cc:3055] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:25.890170 28568 raft_consensus.cc:740] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:25.891191 28568 consensus_queue.cc:260] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:25.891474 28401 consensus_queue.cc:1059] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:25.892498 28568 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:25.895890 22366 leader_election.cc:400] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17.
I20260709 12:19:25.896277 22366 leader_election.cc:403] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:25.898609 28385 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:25.899070 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:25.909862 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:25.910640 22402 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:19:25.915331 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:25.915509 28543 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:25.916640 28414 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:25.917481 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:25.918084 22397 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:19:25.918967 22547 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:25.870359 28528 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:25.963371 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.963333 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:19:25.963810 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 179077us
W20260709 12:19:25.966971 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.966785 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:25.941711 28478 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:19:25.968396 23130 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 17: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:25.948215 22547 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:25.979909 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:25.981925 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 142740us
I20260709 12:19:25.988482 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:25.989991 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:25.992925 22551 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:25.996843 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:25.998636 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:26.003418 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:19:26.010281 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 257931us
I20260709 12:19:26.009061 22543 raft_consensus.cc:3055] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:26.012104 22543 raft_consensus.cc:740] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:26.015009 22545 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:26.015775 22515 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:25.971402 28528 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:26.019047 22402 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
I20260709 12:19:26.026346 22543 consensus_queue.cc:260] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:26.046450 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 54448us
I20260709 12:19:26.014680 28573 consensus_queue.cc:1243] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer b8621fa34be04d3fa2d68a300f858cd1 log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:19:26.032013 28414 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:26.051050 22515 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:26.052748 22515 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:26.066980 22398 raft_consensus.cc:1240] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16. Ops: []
W20260709 12:19:26.073742 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.074527 22543 raft_consensus.cc:3060] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:26.064076 28504 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:26.084147 22402 raft_consensus.cc:1240] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:26.063644 28590 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:26.077836 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:26.091390 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:26.091645 28671 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.092190 28671 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:26.092613 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:26.094328 28671 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:26.094486 28528 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:26.097383 22515 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:26.098516 28406 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:26.106046 23122 raft_consensus.cc:2393] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 16: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:26.110143 28385 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:26.090873 28590 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:26.114331 28683 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:26.118806 23095 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:26.123589 23094 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:26.124300 28407 tablet_bootstrap.cc:492] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:26.129583 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.157034 22469 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:26.130901 28406 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:26.133229 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.129833 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.134317 28603 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.116839 28572 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:26.145742 22545 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:19:26.154461 22543 raft_consensus.cc:1275] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:26.159674 22470 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 20: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:26.160138 22476 raft_consensus.cc:2393] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 16: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:26.159932 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:26.160398 28407 tablet_bootstrap.cc:492] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
W20260709 12:19:26.160729 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 45136.5us
I20260709 12:19:26.161165 28406 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:26.160656 22401 raft_consensus.cc:1240] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:26.161710 23094 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:26.162266 28592 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:26.159700 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:26.154855 28590 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:26.176519 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:26.170737 22397 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:19:26.160626 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:19:26.181599 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.181802 28406 raft_consensus.cc:697] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 17 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:26.183245 22548 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:26.183892 28604 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:26.184193 28406 consensus_queue.cc:237] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:26.184443 28604 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:26.186154 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.186633 28604 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:26.187505 28536 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:26.188071 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.188885 23094 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:26.176311 28546 consensus_queue.cc:1059] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:19:26.190229 28535 raft_consensus.cc:2804] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:26.190419 28592 raft_consensus.cc:3055] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:26.190876 28592 raft_consensus.cc:740] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:26.190933 28535 raft_consensus.cc:697] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:26.191845 28592 consensus_queue.cc:260] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:26.191968 28535 consensus_queue.cc:237] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:26.193887 28674 log.cc:927] Time spent T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:19:26.194176 28536 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.194619 28668 raft_consensus.cc:2764] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:19:26.194885 28536 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:26.195655 28427 raft_consensus.cc:3055] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:26.196699 28427 raft_consensus.cc:740] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:26.198240 28427 consensus_queue.cc:260] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:26.199533 23125 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:26.201670 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.196827 28603 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:26.196985 28683 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:26.207249 28621 raft_consensus.cc:3055] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:19:26.207697 28621 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:26.208649 28621 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:26.196516 28478 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17.
I20260709 12:19:26.211315 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.212211 22470 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:26.167989 28572 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:26.213096 28572 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:26.213704 28255 raft_consensus.cc:3055] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:26.214139 28255 raft_consensus.cc:740] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:26.215366 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:26.215090 28255 consensus_queue.cc:260] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:26.215991 22477 raft_consensus.cc:2376] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16. Re-sending same reply.
I20260709 12:19:26.216254 28255 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:26.217752 28601 raft_consensus.cc:3055] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:26.218149 28601 raft_consensus.cc:740] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:26.219053 28601 consensus_queue.cc:260] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:26.220572 28601 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:26.223202 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:26.229729 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.230696 22472 raft_consensus.cc:2393] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 19: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:26.230839 28621 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:26.245996 28592 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:26.246593 28683 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:26.247321 28407 ts_tablet_manager.cc:1403] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 3.671s	user 0.094s	sys 0.070s
I20260709 12:19:26.247674 28427 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:26.250211 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:26.250238 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.259109 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.259382 22470 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:19:26.259910 22473 raft_consensus.cc:2393] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 20: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:26.254611 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:26.260955 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.261188 22468 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:26.252033 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.261441 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:26.252166 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.252444 28668 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:26.252861 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.253387 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.254684 28584 consensus_queue.cc:1048] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:26.263787 22474 raft_consensus.cc:2393] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 14: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:26.256920 28536 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:26.250937 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.265753 22515 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:26.266137 28396 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.079s	user 0.003s	sys 0.000s
I20260709 12:19:26.267084 28668 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:26.285006 23095 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:26.291066 22548 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
W20260709 12:19:26.294601 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 398875us
I20260709 12:19:26.295426 22366 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:26.298396 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:26.296162 28584 raft_consensus.cc:2804] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:26.317643 28584 raft_consensus.cc:697] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:26.318385 28342 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:26.320695 28342 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:26.302670 22402 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 21 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 20. Current term is 21. Ops: []
I20260709 12:19:26.316717 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:26.318856 28686 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:26.328138 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:26.320613 28681 consensus_queue.cc:1059] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:19:26.330485 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:26.332760 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:26.333886 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:26.329928 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.335397 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:26.336108 22473 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:26.337050 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:26.338136 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:26.339133 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:26.340093 22402 raft_consensus.cc:1240] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:26.341009 28686 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:26.343582 28686 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:26.344487 22394 raft_consensus.cc:2410] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:19:26.348062 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.349496 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:26.339288 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.350883 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:26.352972 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.351162 22398 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:26.352443 22366 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:26.358354 22473 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:19:26.363529 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.326965 28478 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:26.367666 22366 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:26.364938 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:26.369671 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:26.374369 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:26.375335 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.379040 22471 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:26.366003 28420 consensus_meta.cc:287] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.006s
I20260709 12:19:26.383147 22470 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:26.383867 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.361811 28686 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:26.386353 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:26.362411 28546 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.359936 28342 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:26.389189 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.391276 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:26.385869 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:26.392652 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:26.394004 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.318783 28584 consensus_queue.cc:237] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:26.395099 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.395982 22441 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:26.397521 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:26.400832 22366 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:26.402833 23127 raft_consensus.cc:2410] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 12:19:26.404722 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.370739 28478 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:26.415486 22477 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:26.415593 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:26.417845 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.380951 28668 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.427196 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:26.428099 28688 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:26.422811 28683 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:26.429441 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:26.434192 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.433352 23124 raft_consensus.cc:1240] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:26.430573 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:26.433033 22549 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
W20260709 12:19:26.439536 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.440120 22402 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:26.421916 28478 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:26.421480 28603 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:26.446234 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:26.447376 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 56202.7us
I20260709 12:19:26.449084 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:26.447060 22544 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 19.
I20260709 12:19:26.413182 28546 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:26.431218 28686 raft_consensus.cc:697] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:26.439646 28673 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:26.437465 28543 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:26.465651 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:26.469719 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 72470.2us
I20260709 12:19:26.436730 28342 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:26.475095 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:26.477502 22402 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:26.463014 28604 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.446199 28688 raft_consensus.cc:697] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:26.485107 28688 consensus_queue.cc:237] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:26.453784 28683 raft_consensus.cc:697] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:26.465113 28690 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:26.481424 22366 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:26.489435 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:26.421085 28407 raft_consensus.cc:359] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:26.494148 22476 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:19:26.472802 28543 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:26.491256 28690 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:26.496163 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.471527 28414 consensus_queue.cc:1059] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:19:26.509654 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:26.454921 28668 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:26.508517 22366 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:26.497418 28543 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:26.497536 28407 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:19:26.504633 28690 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:26.492069 28604 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:26.534832 22548 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 12:19:26.539748 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 44978us
I20260709 12:19:26.526185 28385 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.541913 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.543325 28679 raft_consensus.cc:2764] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:19:26.549008 22473 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
W20260709 12:19:26.552076 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:26.559175 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 56732.7us
I20260709 12:19:26.574395 28342 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:26.575240 28342 consensus_queue.cc:1059] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:26.579025 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:26.579744 22474 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:26.585184 28670 raft_consensus.cc:3055] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:26.585685 28670 raft_consensus.cc:740] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:26.586635 28670 consensus_queue.cc:260] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:26.587898 28670 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:26.589448 22469 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 19.
I20260709 12:19:26.591427 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.592577 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.591562 28546 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:26.543488 28622 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:26.593681 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:26.596501 22476 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:26.587296 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:26.597623 22401 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:26.594594 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:26.605059 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:26.624517 22397 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 19: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:26.605589 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:26.502810 28686 consensus_queue.cc:237] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:26.605204 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:26.627506 22472 raft_consensus.cc:2393] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 17: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:26.610929 22475 raft_consensus.cc:2410] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:19:26.615711 22396 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:26.618425 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:26.675911 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 81718.5us
I20260709 12:19:26.677564 22469 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:26.682233 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 121742us
I20260709 12:19:26.684722 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:26.685842 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:26.692703 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:26.557909 28385 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:26.626158 28342 raft_consensus.cc:3055] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:19:26.696098 22366 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:26.699915 28401 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:26.700408 28401 raft_consensus.cc:697] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:26.700583 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:26.700853 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:26.701337 22473 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 20: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:26.702265 28528 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:26.702873 22441 leader_election.cc:400] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16.
I20260709 12:19:26.703204 22441 leader_election.cc:403] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:26.704018 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:26.703722 28401 consensus_queue.cc:237] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:26.557312 28683 consensus_queue.cc:237] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:26.684762 28427 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:26.706002 28427 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:26.706373 28427 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:26.698663 22472 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:26.704279 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:26.724375 22474 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:26.723613 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:26.729676 22441 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:26.732080 28543 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:26.735378 28572 consensus_meta.cc:287] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.002s
I20260709 12:19:26.735886 28572 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:26.737902 28671 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:26.740695 28572 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:26.570906 28407 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:26.744903 22394 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 20.
I20260709 12:19:26.699152 28342 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:26.756008 22441 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:26.760939 28709 log.cc:927] Time spent T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:19:26.717242 28568 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16.
I20260709 12:19:26.766501 22477 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
W20260709 12:19:26.772734 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 71941.3us
I20260709 12:19:26.774083 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:26.776044 22366 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:26.779686 22366 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:26.764286 28671 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:26.796998 22477 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
I20260709 12:19:26.801911 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:26.783259 28622 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:19:26.804421 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 48545.2us
I20260709 12:19:26.791261 22469 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:26.782688 28688 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:26.809542 22441 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:26.786599 28682 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:19:26.815631 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.780095 28601 consensus_queue.cc:1059] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
W20260709 12:19:26.803172 28621 consensus_meta.cc:287] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.002s
I20260709 12:19:26.822466 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:26.803122 28668 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:26.812130 28622 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:26.838352 28622 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:19:26.832828 28699 log.cc:927] Time spent T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.276s	user 0.004s	sys 0.000s
I20260709 12:19:26.839233 28407 ts_tablet_manager.cc:1434] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.591s	user 0.004s	sys 0.006s
W20260709 12:19:26.833622 28716 log.cc:927] Time spent T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:19:26.834930 28604 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:26.811823 28688 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:26.813161 28414 consensus_queue.cc:1059] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:19:26.844921 22471 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:26.819121 28683 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:19:26.823292 28590 consensus_meta.cc:287] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.005s
I20260709 12:19:26.863592 28590 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:26.864774 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.865371 28385 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:26.845685 22470 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:26.850605 28720 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:26.866092 28720 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:26.862838 28427 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:26.851156 28668 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:26.846403 28688 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:26.866956 28668 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:26.868937 28668 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:26.852061 28546 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:26.853116 23130 raft_consensus.cc:1240] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:26.853262 28406 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.870862 28406 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:26.839573 28407 ts_tablet_manager.cc:1467] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: Tablet startup took 591ms
W20260709 12:19:26.853469 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.855049 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:26.874701 23124 raft_consensus.cc:2393] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 18: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:26.843433 22441 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:26.825914 28543 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:26.869681 28546 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:26.881196 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.866539 28720 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:26.875622 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:26.885628 28385 consensus_queue.cc:1059] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:26.885954 28504 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.888036 28504 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:26.892233 22548 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:26.893188 22547 raft_consensus.cc:1240] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:26.893873 22545 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:26.894940 28546 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:26.895104 22542 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:26.807735 28342 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:26.896714 28342 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:26.898427 28504 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:26.899609 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:26.900207 23124 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 11.
I20260709 12:19:26.901187 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:26.901594 22548 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:19:26.902398 28406 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:26.902535 28590 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:26.905018 28385 raft_consensus.cc:3055] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:26.901908 22547 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
I20260709 12:19:26.906651 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:26.907538 23130 raft_consensus.cc:2410] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:19:26.909674 22515 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:26.907612 28414 raft_consensus.cc:3055] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:19:26.949896 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:26.937197 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.922106 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:26.914469 22293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50166 (request call id 333) took 4454 ms. Trace:
I20260709 12:19:26.952451 22298 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50158 (request call id 299) took 6251 ms. Trace:
W20260709 12:19:26.921969 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 74921.7us
I20260709 12:19:26.915343 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:26.914600 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:26.913100 22468 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 21.
I20260709 12:19:26.984551 22399 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:19:26.918617 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:19:26.916689 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 73330.3us
W20260709 12:19:26.931046 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:26.913957 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.986816 22551 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13.
I20260709 12:19:26.989312 22516 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:26.912618 28385 raft_consensus.cc:740] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:26.994553 22441 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:26.975747 22545 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 20.
I20260709 12:19:26.916476 28686 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 12:19:26.977571 28720 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:26.846752 28690 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:26.979421 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.882494 28401 raft_consensus.cc:3055] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:26.922382 28590 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:26.917726 28707 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:19:26.919338 28427 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:26.924412 28543 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:26.917554 28711 raft_consensus.cc:3055] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:19:26.974255 23094 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:26.996040 28681 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:27.006219 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:27.014192 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:27.016501 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.962477 28414 raft_consensus.cc:740] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:26.997411 22441 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:26.997560 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:27.018682 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 44510.3us
I20260709 12:19:27.014366 22398 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:19:26.952617 28584 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:27.005954 28342 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:26.974509 22298 rpcz_store.cc:276] 0709 12:19:20.700762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.700913 (+   151us) service_pool.cc:224] Handling call
0709 12:19:26.952387 (+6251474us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:26.053981 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:26.179901 (+125920us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:26.182650 (+  2749us) write_op.cc:435] Acquired schema lock
0709 12:19:26.182671 (+    21us) tablet.cc:662] Decoding operations
0709 12:19:26.217481 (+ 34810us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:26.217530 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:26.217561 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:26.217739 (+   178us) tablet.cc:701] Row locks acquired
0709 12:19:26.217751 (+    12us) write_op.cc:260] PREPARE: finished
0709 12:19:26.217924 (+   173us) write_op.cc:270] Start()
0709 12:19:26.218035 (+   111us) write_op.cc:276] Timestamp: P: 1783599566217874 usec, L: 0
0709 12:19:26.218052 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:19:26.218694 (+   642us) log.cc:844] Serialized 538 byte log entry
0709 12:19:26.608452 (+389758us) op_driver.cc:464] REPLICATION: finished
0709 12:19:26.707426 (+ 98974us) write_op.cc:301] APPLY: starting
0709 12:19:26.707500 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:26.708411 (+   911us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:26.708505 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:26.709268 (+   763us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:26.709420 (+   152us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:19:26.709460 (+    40us) write_op.cc:312] APPLY: finished
0709 12:19:26.738851 (+ 29391us) log.cc:844] Serialized 25 byte log entry
0709 12:19:26.739038 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:26.739124 (+    86us) write_op.cc:454] Released schema lock
0709 12:19:26.739165 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:26.739558 (+   393us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:26.739583 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":250471,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":98768,"apply.run_cpu_time_us":3018,"apply.run_wall_time_us":32073,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4190,"num_ops":1,"prepare.queue_time_us":695156,"prepare.run_cpu_time_us":3354,"prepare.run_wall_time_us":171320,"replication_time_us":390258,"thread_start_us":115551,"threads_started":1}]]}
I20260709 12:19:27.008431 28679 consensus_queue.cc:1059] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:27.003018 28528 consensus_queue.cc:1059] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:19:27.010270 22297 catalog_manager.cc:5697] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:27.022488 22395 raft_consensus.cc:2368] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 17. Current term is 18.
I20260709 12:19:27.024500 28718 raft_consensus.cc:3055] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:27.024868 28718 raft_consensus.cc:740] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:27.001088 28590 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.025982 28590 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:27.018071 22516 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:26.952829 28478 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:27.001327 28401 raft_consensus.cc:740] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:26.996069 28601 consensus_queue.cc:1059] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 12:19:27.018950 28724 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:27.030969 22366 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:26.990471 28504 consensus_queue.cc:1059] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:19:27.033437 28427 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:27.036090 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:27.041265 22441 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:27.031708 28572 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:27.021715 28543 raft_consensus.cc:697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:27.047469 28543 consensus_queue.cc:237] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:27.049479 28414 consensus_queue.cc:260] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:27.027125 28535 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:19:27.051450 28546 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:27.052081 28590 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:27.052587 28401 consensus_queue.cc:260] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:27.027256 28406 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:27.054066 28406 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.054463 28406 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:27.030397 28584 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:27.016480 28711 raft_consensus.cc:740] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:27.056505 28584 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:27.056775 28711 consensus_queue.cc:260] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:27.058177 28711 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:27.059147 22400 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:27.059343 28478 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:26.973943 22293 rpcz_store.cc:276] 0709 12:19:22.460318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.460517 (+   199us) service_pool.cc:224] Handling call
0709 12:19:23.903085 (+1442568us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b540038b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abe090 00007fb4f8b5cf3a 00007fb4fe912e9c 00007fb4fea1104e 00007fb4fced22a4 00007fb4fced2232 00007fb4fced2161 00007fb4fced20dc 00007fb4fced1392 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:26.914372 (+3011287us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:25.804777 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:25.886053 (+ 81276us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:25.886119 (+    66us) write_op.cc:435] Acquired schema lock
0709 12:19:25.886139 (+    20us) tablet.cc:662] Decoding operations
0709 12:19:25.886556 (+   417us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:25.886653 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:25.886681 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:25.886988 (+   307us) tablet.cc:701] Row locks acquired
0709 12:19:25.887035 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:19:25.887243 (+   208us) write_op.cc:270] Start()
0709 12:19:25.887390 (+   147us) write_op.cc:276] Timestamp: P: 1783599565887171 usec, L: 0
0709 12:19:25.887426 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:19:25.888270 (+   844us) log.cc:844] Serialized 534 byte log entry
0709 12:19:26.401865 (+513595us) op_driver.cc:464] REPLICATION: finished
0709 12:19:26.541709 (+139844us) write_op.cc:301] APPLY: starting
0709 12:19:26.557479 (+ 15770us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:26.580405 (+ 22926us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:26.580521 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:26.581268 (+   747us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:26.581563 (+   295us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:19:26.581624 (+    61us) write_op.cc:312] APPLY: finished
0709 12:19:26.607980 (+ 26356us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b540038b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b5132a 00007fb4f8ad6f14 00007fb4f8ad6ec3 00007fb4f8ad6e38 00007fb4f8ad6df3 00007fb4f8ad60dc 00007fb4f8affe16 00007fb4f8ae7cbb 00007fb4f8ad239d 00007fb4f8ad5d75
0709 12:19:26.696395 (+ 88415us) log.cc:844] Serialized 25 byte log entry
0709 12:19:26.706402 (+ 10007us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:26.706491 (+    89us) write_op.cc:454] Released schema lock
0709 12:19:26.706547 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:26.707074 (+   527us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:26.707101 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1092134,"reported_tablets":1,"spinlock_wait_cycles":660580096,"child_traces":[["op",{"apply.queue_time_us":117085,"apply.run_cpu_time_us":4456,"apply.run_wall_time_us":174810,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8317,"num_ops":1,"prepare.queue_time_us":460150,"prepare.run_cpu_time_us":21768,"prepare.run_wall_time_us":234716,"raft.queue_time_us":673251,"raft.run_cpu_time_us":74212,"raft.run_wall_time_us":386586,"replication_time_us":476937,"spinlock_wait_cycles":40233344,"thread_start_us":552154,"threads_started":4,"wal-append.queue_time_us":162323}]]}
I20260709 12:19:27.025660 28718 consensus_queue.cc:260] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:27.061106 28718 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:27.062695 22441 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:27.064337 28690 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:27.064713 28572 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:27.065239 28572 raft_consensus.cc:697] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:27.054067 28401 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:27.066254 28572 consensus_queue.cc:237] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:27.067636 23130 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:27.065044 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:27.062865 28720 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:27.045152 28396 tablet_bootstrap.cc:492] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:27.101696 28573 consensus_queue.cc:1048] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:27.093345 22297 catalog_manager.cc:5697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 16 to 17, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 17 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:27.107765 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 78565.9us
I20260709 12:19:27.109189 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:27.102243 28622 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:27.106089 22297 catalog_manager.cc:5697] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:27.108506 22366 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:27.111164 22297 catalog_manager.cc:5697] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 17 to 19, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 19 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:26.872144 28407 ts_tablet_manager.cc:1469] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: Trace:
0709 12:19:19.360234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.360416 (+   182us) service_pool.cc:224] Handling call
0709 12:19:19.535254 (+174838us) ts_tablet_manager.cc:934] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
0709 12:19:20.863588 (+1328334us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:19:21.058595 (+195007us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:21.058726 (+   131us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:19:21.234784 (+176058us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:19:21.235066 (+   282us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:21.238201 (+  3135us) ts_tablet_manager.cc:989] Replica registered.
0709 12:19:21.238272 (+    71us) inbound_call.cc:177] Queueing success response
0709 12:19:21.435927 (+197655us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b18003592c0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f59e1c0a 00007fb4ff121219 00007fb4f590bed8 00007fb4f5a66de2 00007fb4fdacbd23 00007fb4fdacb55d 00007fb4fdb673d8 00007fb4fdb98f4e 00007fb4fdb7dfdd
0709 12:19:22.576342 (+1140415us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:19:26.247809 (+3671467us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:19:26.268273 (+ 20464us) tablet_replica.cc:261] Starting instrumentation
0709 12:19:26.268916 (+   643us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":64104,"mutex_wait_us":3717,"raft.queue_time_us":19690,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":8406,"spinlock_wait_cycles":10177920,"tablet-copy.queue_time_us":111756,"tablet-download-pool.queue_time_us":20157,"tablet-download-pool.run_cpu_time_us":1286,"tablet-download-pool.run_wall_time_us":808323,"thread_start_us":161624,"threads_started":2}
I20260709 12:19:27.104303 28681 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:27.105599 28478 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:27.101438 28584 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.099663 28427 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:19:27.119139 22297 catalog_manager.cc:5697] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 11 to 12, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 12 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:27.126660 22468 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:27.111994 28720 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:19:27.130931 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.125432 28584 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:27.122714 28478 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.133910 28478 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:27.134336 28584 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:27.134893 28584 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:27.135349 28584 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:27.122622 28427 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:27.139422 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:27.138852 22297 catalog_manager.cc:5697] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 11 to 13, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 13 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:27.142491 23130 raft_consensus.cc:2468] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:27.140053 22546 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 16.
I20260709 12:19:27.147220 23094 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:27.140581 22297 catalog_manager.cc:5697] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:27.151415 22551 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:19:27.151583 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.151146 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:27.152884 22546 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:27.138130 28427 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:27.155180 22297 catalog_manager.cc:5697] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 14 to 15, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 15 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:27.154361 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 89392.9us
I20260709 12:19:27.154958 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:27.153941 28396 tablet_bootstrap.cc:492] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:19:27.157644 22548 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:27.159888 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:27.158121 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.162462 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.163039 22469 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 21.
I20260709 12:19:27.148020 28688 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:27.163489 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.163908 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:27.164628 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.155696 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.167416 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:27.168462 28688 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:27.169277 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:27.145342 28720 raft_consensus.cc:697] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:27.170574 28720 consensus_queue.cc:237] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:27.149976 28414 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:27.171967 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:27.173225 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.173990 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:27.151535 28403 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:27.174542 22474 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:27.160009 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:27.178133 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:27.179373 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:27.179704 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.179917 28403 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.180326 28403 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:27.164173 28535 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:19:27.183429 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:27.152784 28686 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:19:27.191286 22472 raft_consensus.cc:1240] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:27.191609 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.192469 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.192828 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.192835 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:27.198858 22474 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 20.
I20260709 12:19:27.192106 22477 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:27.216729 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.216931 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:19:27.201582 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.173513 28478 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:27.326696 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.189491 22394 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:27.515511 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.219094 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:27.225422 22548 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
W20260709 12:19:27.375216 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.192644 22546 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:19:27.208395 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.202338 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:27.320608 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:27.418469 22515 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:19:27.550678 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 132289us
I20260709 12:19:27.324753 22475 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:27.554044 22543 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:19:27.236363 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.214546 22398 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:27.298602 23125 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [term 15 LEARNER]: Advancing to term 16
W20260709 12:19:27.409576 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:27.557530 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.193491 22470 raft_consensus.cc:1240] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:19:27.545895 22551 raft_consensus.cc:2368] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 19. Current term is 20.
I20260709 12:19:27.298450 22476 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 14.
W20260709 12:19:27.407385 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 238163us
I20260709 12:19:27.298516 22550 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:27.377019 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.540441 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.217896 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.194166 28396 ts_tablet_manager.cc:1403] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 2.859s	user 0.065s	sys 0.027s
I20260709 12:19:27.540851 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.590929 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:27.547605 23095 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.067s (SENT) [suppressed 36 similar messages]
I20260709 12:19:27.596060 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.596678 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:27.599149 22474 raft_consensus.cc:3060] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:27.600328 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:27.207319 28686 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.302014 28724 raft_consensus.cc:697] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:27.609138 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:27.610316 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:27.605463 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 57886.8us
I20260709 12:19:27.501881 28590 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:27.613574 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.296653 28732 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:27.194307 28622 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:27.448397 28406 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:27.607662 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.596338 28711 raft_consensus.cc:2804] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:27.623725 22477 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
I20260709 12:19:27.611734 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.612349 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:27.406643 28725 log.cc:927] Time spent T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 12:19:27.456545 28668 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:27.611202 23095 leader_election.cc:336] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.531s (SENT)
I20260709 12:19:27.603427 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:27.324702 28584 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:27.206423 28546 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.395s
I20260709 12:19:27.615752 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.616135 22476 raft_consensus.cc:3055] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:27.632071 22476 raft_consensus.cc:740] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:27.629577 22543 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
I20260709 12:19:27.412703 28679 raft_consensus.cc:3055] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:19:27.618865 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 54297us
I20260709 12:19:27.619443 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.615164 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.546710 28573 consensus_queue.cc:1059] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:19:27.609477 28686 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:19:27.622066 28342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.009s	sys 0.023s
I20260709 12:19:27.638947 22475 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 14.
I20260709 12:19:27.646023 22474 raft_consensus.cc:2468] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:19:27.627969 23095 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:27.655907 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.658685 22472 raft_consensus.cc:1275] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:19:27.513695 28385 consensus_queue.cc:260] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:27.630772 28723 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:27.657547 28342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.009s	sys 0.023s
I20260709 12:19:27.637363 28679 raft_consensus.cc:740] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:27.661592 22476 consensus_queue.cc:260] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:27.656661 28584 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:27.711639 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.647171 28711 raft_consensus.cc:697] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:19:27.715057 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 61521.8us
I20260709 12:19:27.712606 22470 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 16.
W20260709 12:19:27.718227 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.706461 28588 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.724800 22476 raft_consensus.cc:3060] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:27.705145 28420 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:27.717795 28414 consensus_meta.cc:287] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.000s
I20260709 12:19:27.653606 28403 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:27.636474 28668 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:27.738690 22516 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:27.740419 22398 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 20.
I20260709 12:19:27.728116 28588 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:27.748248 22486 tablet_copy_service.cc:342] P 25ebf14868c042dca42f54b3e251e1b2: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-7f7fcc060e2443ad87cf29161f3ea079 received from {username='slave'} at 127.0.0.1:43060
I20260709 12:19:27.748796 22486 tablet_copy_service.cc:434] P 25ebf14868c042dca42f54b3e251e1b2: ending tablet copy session 65951063312d4a1e9123f92354101c71-7f7fcc060e2443ad87cf29161f3ea079 on tablet 7f7fcc060e2443ad87cf29161f3ea079 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:19:27.750181 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:27.751466 28478 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:27.718883 28723 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:27.753882 28723 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:27.755347 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:27.759851 28735 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:19:27.762120 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 150935us
I20260709 12:19:27.761720 28711 consensus_queue.cc:237] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:27.762956 28406 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:27.764297 22516 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
W20260709 12:19:27.764544 23095 leader_election.cc:336] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.623s (SENT)
I20260709 12:19:27.764968 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:27.765795 28406 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:27.769192 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:27.742007 28546 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:27.719274 28584 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:27.772290 28427 consensus_meta.cc:287] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.000s
I20260709 12:19:27.787662 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:27.788396 22546 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:27.780184 22366 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:27.789505 22366 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:27.797746 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:27.772261 28414 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:19:27.801268 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.799846 28478 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:27.807789 22551 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:19:27.798745 22398 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
I20260709 12:19:27.799527 22366 leader_election.cc:400] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 19. Current term is 20.
I20260709 12:19:27.812780 22366 leader_election.cc:403] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:19:27.743513 28420 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:27.723361 28724 consensus_queue.cc:237] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:27.839552 22476 raft_consensus.cc:1275] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:19:27.821192 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:27.839947 23095 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:19:27.847090 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 49543.7us
I20260709 12:19:27.847779 22366 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:27.846731 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:27.847896 28732 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:27.809981 28735 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:27.860661 28742 log.cc:927] Time spent T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:19:27.857863 28590 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:27.857683 28401 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.004s
W20260709 12:19:27.858117 28739 log.cc:927] Time spent T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:19:27.863485 22551 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:27.859119 28668 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:27.865077 22545 raft_consensus.cc:2955] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:27.860695 28670 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:27.867066 28670 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:27.868929 28601 consensus_queue.cc:1059] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:27.870591 28420 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:27.845700 28723 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:19:27.872581 28670 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:27.872803 28584 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:27.747151 28679 consensus_queue.cc:260] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:27.876327 28690 raft_consensus.cc:3055] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:27.876761 28690 raft_consensus.cc:740] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:27.877136 28403 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:27.877978 28670 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.840479 28478 raft_consensus.cc:697] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:27.878460 28670 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:27.802629 28743 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:27.883500 22546 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:27.886708 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:27.889294 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:27.893451 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:27.895018 22366 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:27.904414 22401 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:19:27.800583 28427 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:27.899324 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.906601 23125 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [term 16 LEARNER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:19:27.854502 28740 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:19:27.805493 28504 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:19:27.859253 28747 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:27.904057 22398 raft_consensus.cc:2368] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 13. Current term is 14.
I20260709 12:19:27.852224 28738 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 19. Current term is 20.
I20260709 12:19:27.876317 28688 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:27.914474 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:27.916392 23095 leader_election.cc:400] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 13. Current term is 14.
I20260709 12:19:27.918051 23095 leader_election.cc:403] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:27.894529 28743 raft_consensus.cc:697] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:27.925609 23094 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:27.877575 28690 consensus_queue.cc:260] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:27.912796 28732 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.910928 28535 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:27.927145 28572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.006s	sys 0.008s
I20260709 12:19:27.922106 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:27.917464 28729 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:27.915102 28747 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.932693 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:27.909885 28734 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:27.941433 23124 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [term 19 LEARNER]: Advancing to term 20
I20260709 12:19:27.926584 28403 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:19:27.879238 28478 consensus_queue.cc:237] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:27.918744 28414 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:19:27.922798 28590 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:27.948731 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:27.935683 28688 raft_consensus.cc:697] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:27.947145 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:19:27.951097 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 201183us
I20260709 12:19:27.958230 23130 raft_consensus.cc:2393] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 12: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
W20260709 12:19:27.945531 28572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.007s	sys 0.008s
I20260709 12:19:27.936395 28420 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:27.950366 23095 leader_election.cc:336] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.867s (SENT)
I20260709 12:19:27.949141 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:27.955188 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.959739 22542 raft_consensus.cc:2393] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 12: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:27.969156 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:27.933301 28686 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:27.946799 28747 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:27.971103 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:27.971055 22516 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:27.945273 28535 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:27.960515 28690 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:27.951895 28729 raft_consensus.cc:697] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:27.992200 23125 raft_consensus.cc:1240] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:27.949188 28622 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:19:27.985534 28734 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:27.999815 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:27.985780 28723 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:28.010159 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:28.013625 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:28.017640 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:28.018249 22551 raft_consensus.cc:2368] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 13. Current term is 14.
I20260709 12:19:28.018381 28733 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:28.022179 28733 raft_consensus.cc:697] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:19:28.022361 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.951714 28396 raft_consensus.cc:359] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:27.997946 28590 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:28.033244 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:28.040159 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:28.040551 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.041831 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.042676 22474 raft_consensus.cc:2410] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:19:28.042776 22516 leader_election.cc:400] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 17. Current term is 18.
I20260709 12:19:28.043164 22516 leader_election.cc:403] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:19:27.948622 28732 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:28.011538 28734 raft_consensus.cc:697] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:28.054756 22396 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:19:28.023033 28733 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:28.044862 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:28.048873 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:28.041263 22472 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:19:28.013072 28572 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:19:28.052289 22516 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:28.044047 22476 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:19:28.041283 28414 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:19:28.057951 23095 leader_election.cc:336] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.878s (SENT)
I20260709 12:19:28.058811 23094 leader_election.cc:400] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 13. Current term is 14.
I20260709 12:19:27.991962 28688 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:28.041633 28342 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:19:28.038905 28396 raft_consensus.cc:740] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:19:27.999627 28743 consensus_queue.cc:237] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:28.073930 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.053480 28723 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 17. Current term is 18.
I20260709 12:19:28.054672 28590 raft_consensus.cc:697] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:28.057974 28670 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:28.070056 28427 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:28.070636 22543 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
W20260709 12:19:28.088613 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 188740us
I20260709 12:19:28.087805 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:28.111111 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 53203.9us
W20260709 12:19:28.104753 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 166786us
W20260709 12:19:28.113395 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 154860us
I20260709 12:19:28.113927 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:28.129648 28734 consensus_queue.cc:237] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:28.130445 28720 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:28.131446 28590 consensus_queue.cc:237] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:28.134739 28732 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:28.063534 28729 consensus_queue.cc:237] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:28.138393 28535 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:28.091970 28342 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:28.142161 28342 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:28.150928 22441 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:28.154234 28686 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:28.158768 28670 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:28.151654 23131 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
W20260709 12:19:28.153416 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:28.165234 23095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.161839 22442 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:28.110381 28724 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:28.114534 28572 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:28.207791 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:28.208895 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:28.217998 23095 leader_election.cc:336] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.977s (SENT)
W20260709 12:19:28.218389 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 96016us
I20260709 12:19:28.167619 28723 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:28.218499 23095 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:28.220522 22398 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 20. Current term is 21. Ops: []
I20260709 12:19:28.167315 28414 raft_consensus.cc:697] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:28.226960 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:28.236168 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:28.241683 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:28.243844 22399 raft_consensus.cc:2410] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:19:28.242091 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:19:28.247350 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 96588us
I20260709 12:19:28.247983 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:28.234500 28535 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:28.238025 28723 raft_consensus.cc:697] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:19:28.259052 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 61777.2us
I20260709 12:19:28.239229 28724 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:28.261260 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:28.193655 28396 consensus_queue.cc:260] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:28.274205 22441 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:28.257798 28765 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:28.261925 28771 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:28.255607 28735 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
W20260709 12:19:28.280450 28761 log.cc:927] Time spent T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:19:28.290167 22441 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:28.281126 28755 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:28.284509 28771 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:28.294603 28771 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:28.295523 28765 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:28.266108 28747 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:28.313464 23129 raft_consensus.cc:2393] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 18: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:28.318140 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:28.330531 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.281507 28414 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:28.338361 23131 raft_consensus.cc:1275] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 12:19:28.302050 28588 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:28.342398 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:28.338781 23131 pending_rounds.cc:85] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: Aborting all ops after (but not including) 12
I20260709 12:19:28.343760 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:28.313548 28584 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.345535 23131 pending_rounds.cc:107] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 12:19:28.348054 23131 raft_consensus.cc:2889] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:28.348694 28772 log.cc:927] Time spent T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:19:28.353130 22544 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:28.301713 28723 consensus_queue.cc:237] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:28.365609 22549 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 25 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 14. (term mismatch)
I20260709 12:19:28.365429 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:28.355341 28342 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:28.366266 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:28.367065 22550 raft_consensus.cc:1240] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 21. Current term is 22. Ops: []
I20260709 12:19:28.367408 22549 pending_rounds.cc:85] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 13
I20260709 12:19:28.367697 22549 pending_rounds.cc:107] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 24.14
I20260709 12:19:28.367928 22549 raft_consensus.cc:2889] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:28.368120 28342 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:28.367184 23128 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:28.370060 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:19:28.370570 28778 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:19:28.365869 28767 log.cc:927] Time spent T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:19:28.373623 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:28.374425 22469 raft_consensus.cc:2376] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 21. Re-sending same reply.
I20260709 12:19:28.375569 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.376592 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:28.375792 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:28.377180 22469 raft_consensus.cc:2376] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14. Re-sending same reply.
W20260709 12:19:28.368839 28741 log.cc:927] Time spent T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.585s	user 0.002s	sys 0.003s
I20260709 12:19:28.378333 22549 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:28.377209 22470 raft_consensus.cc:2368] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 19. Current term is 20.
I20260709 12:19:28.380748 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.381705 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.382606 22477 raft_consensus.cc:2368] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17.
I20260709 12:19:28.386093 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.386657 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.385660 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:28.387465 22477 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 20.
I20260709 12:19:28.388420 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.389300 22475 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:19:28.375666 28396 ts_tablet_manager.cc:1434] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.773s	user 0.011s	sys 0.000s
I20260709 12:19:28.355739 28584 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:28.396620 22549 raft_consensus.cc:1240] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:19:28.394615 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.406090 22468 raft_consensus.cc:2368] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15.
I20260709 12:19:28.406461 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:28.407668 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:28.408514 22549 raft_consensus.cc:2393] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 18: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:28.399797 23126 raft_consensus.cc:1240] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:19:28.409372 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:28.405055 28771 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:28.390810 28396 ts_tablet_manager.cc:1467] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71: Tablet startup took 794ms
I20260709 12:19:28.391427 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.392063 23095 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:28.412114 22477 raft_consensus.cc:2376] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14. Re-sending same reply.
I20260709 12:19:28.394147 22470 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 20: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:28.414059 22544 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:19:28.416630 28707 raft_consensus.cc:3055] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:19:28.436360 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 44371.5us
I20260709 12:19:28.437506 23095 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:28.537474 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:28.563006 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.510579 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:28.395347 28535 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:28.612888 22477 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 19: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:28.397635 28403 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 13. Current term is 14.
I20260709 12:19:28.630378 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.490617 28590 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.534001 28588 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:28.404343 28747 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:28.632591 22477 raft_consensus.cc:2376] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13. Re-sending same reply.
I20260709 12:19:28.490366 28707 raft_consensus.cc:740] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:28.405215 28762 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:28.716917 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.602531 28546 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:28.391139 28406 consensus_queue.cc:1059] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.246s
I20260709 12:19:28.618115 28668 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.736768 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.635525 28765 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.717135 28732 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:28.748843 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.750283 28745 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:28.743875 28732 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:28.741369 28546 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:28.755024 28584 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:19:28.756094 22543 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:28.756839 28546 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:28.727151 28590 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:28.741918 28723 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.758062 28478 consensus_queue.cc:1059] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:28.749527 22477 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:28.742550 28771 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:28.758704 28723 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:28.782965 23122 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:28.763777 22543 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:19:28.410173 28396 ts_tablet_manager.cc:1469] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71: Trace:
0709 12:19:18.981699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:18.981876 (+   177us) service_pool.cc:224] Handling call
0709 12:19:19.370884 (+389008us) ts_tablet_manager.cc:934] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
0709 12:19:21.545625 (+2174741us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:19:21.862095 (+316470us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:21.862216 (+   121us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:19:22.274540 (+412324us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:19:22.300165 (+ 25625us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:22.343768 (+ 43603us) ts_tablet_manager.cc:989] Replica registered.
0709 12:19:22.348829 (+  5061us) inbound_call.cc:177] Queueing success response
0709 12:19:24.322371 (+1973542us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:19:27.609826 (+3287455us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:19:27.748398 (+138572us) tablet_replica.cc:261] Starting instrumentation
0709 12:19:27.748992 (+   594us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":49391,"raft.queue_time_us":1637,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":6760,"tablet-copy.queue_time_us":331498,"tablet-download-pool.queue_time_us":2605,"tablet-download-pool.run_cpu_time_us":1467,"tablet-download-pool.run_wall_time_us":1438954,"thread_start_us":528764,"threads_started":2}
I20260709 12:19:28.801512 22543 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:28.804144 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:28.804994 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:28.805541 22470 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:28.806792 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.792141 28688 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.809217 22471 raft_consensus.cc:2393] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 20: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:28.792711 28753 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:28.794708 28745 raft_consensus.cc:3055] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:19:28.756618 28707 consensus_queue.cc:260] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:28.744553 28765 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:28.748034 28668 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:28.823696 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 386253us
I20260709 12:19:28.797101 28763 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:19:28.825630 22473 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:28.829742 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:28.830067 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:28.830382 22474 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:28.830727 22469 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 19: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:28.831436 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.832652 22551 raft_consensus.cc:1275] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:28.814268 28745 raft_consensus.cc:740] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:28.832901 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:28.834553 22471 raft_consensus.cc:2376] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 13. Re-sending same reply.
I20260709 12:19:28.832461 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.835525 22469 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 14.
I20260709 12:19:28.836269 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:28.809474 28478 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:19:28.833827 22470 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
I20260709 12:19:28.838080 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.826481 28764 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.838711 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.839083 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:28.839756 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:28.847046 22469 raft_consensus.cc:2376] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15. Re-sending same reply.
I20260709 12:19:28.826576 28707 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:28.848815 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.841452 22474 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
I20260709 12:19:28.838219 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:28.840664 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:28.813392 28688 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:28.847048 22473 raft_consensus.cc:2368] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 19. Current term is 20.
I20260709 12:19:28.850595 22470 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:28.854349 23126 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:28.858068 28690 consensus_queue.cc:1048] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:28.859421 28723 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:28.867035 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:28.875077 22473 raft_consensus.cc:2468] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:19:28.875447 28732 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:28.876019 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.876638 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:28.876904 28668 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:28.877190 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.878401 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.878567 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.879359 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.879878 22474 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:19:28.878525 28745 consensus_queue.cc:260] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:28.882412 28745 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:28.885628 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:28.886685 22470 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
I20260709 12:19:28.889601 22472 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:19:28.825071 28753 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:28.895318 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 57163.8us
I20260709 12:19:28.896693 22441 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:28.896813 23095 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:28.897581 22551 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:19:28.849447 28764 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:28.899091 28794 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:28.885576 28762 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:28.901739 22441 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:28.901714 23095 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:28.902004 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:28.907348 22441 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:28.906311 23095 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:19:28.894539 28622 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.908988 23095 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:28.905508 28792 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:28.909693 28798 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:28.909900 28792 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:28.910312 28792 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:28.910703 28584 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:28.911047 28546 consensus_queue.cc:1048] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 12:19:28.902731 28427 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:28.907924 28406 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:28.915647 28584 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:28.917848 28427 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.918066 28584 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:28.915576 28749 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:28.915786 28747 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:28.903851 28794 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:28.905977 28762 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:28.928629 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.924083 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:28.910923 28403 consensus_queue.cc:1048] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:19:28.926373 28794 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:28.933432 22551 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:19:28.936075 23131 raft_consensus.cc:1240] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:28.942970 28753 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:28.936100 28764 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:28.944099 28584 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:28.934368 28732 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:28.918409 28427 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:28.961916 28732 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:28.963861 28427 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:28.964282 28732 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:28.966281 28785 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.208s	user 0.003s	sys 0.000s
I20260709 12:19:28.934809 28668 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.916049 28622 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:28.983588 28622 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:28.975061 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 67771.7us
W20260709 12:19:28.987592 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 82790.8us
I20260709 12:19:28.976675 28504 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:28.976766 28427 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:28.990541 22366 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:28.992666 28801 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:28.993160 28801 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:28.993003 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:28.993729 22544 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:28.994905 28801 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:28.996116 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:28.991737 28764 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:19:28.996743 23126 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:19:28.997114 28584 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:28.995821 28504 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:29.004462 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:29.005282 22470 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:29.009199 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.002257 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:29.010206 23131 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:19:29.002692 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:29.000519 22476 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:19:29.011510 22472 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:29.017831 22476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:29.018674 22476 raft_consensus.cc:606] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:29.021786 22470 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:29.022979 22477 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:19:29.024035 22472 raft_consensus.cc:2468] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 22.
I20260709 12:19:29.026414 22474 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:29.029819 22472 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:29.030364 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:29.031170 22398 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:29.032160 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:29.034098 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:29.041483 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:29.046146 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:29.047720 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:29.048576 22398 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:29.059430 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:29.110749 22473 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 20.
I20260709 12:19:29.022063 28749 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:29.062824 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:29.024633 28427 consensus_queue.cc:1059] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 12:19:29.069561 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:29.079303 28504 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:29.085210 28795 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:19:29.086783 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49290 (request call id 1170) took 1090 ms. Trace:
I20260709 12:19:29.116923 22542 rpcz_store.cc:276] 0709 12:19:27.996617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.996862 (+   245us) service_pool.cc:224] Handling call
0709 12:19:29.086559 (+1089697us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54003f52d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:29.086716 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745037056}
I20260709 12:19:29.091341 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:29.023877 28794 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 12:19:28.991761 28792 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:28.991372 28668 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:29.095163 28573 consensus_queue.cc:1059] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:19:29.156515 28573 raft_consensus.cc:3055] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:29.156893 28573 raft_consensus.cc:740] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:29.097651 28590 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:29.104894 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:29.135433 28723 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:29.118440 22394 raft_consensus.cc:2410] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:19:29.132720 22474 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:29.053988 28622 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:29.137938 22395 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
W20260709 12:19:29.138957 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 143463us
W20260709 12:19:29.140021 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 115907us
I20260709 12:19:29.142189 22470 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:19:29.174674 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:29.150365 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:29.135666 28543 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:29.175499 28543 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:29.176621 28803 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:29.177050 28803 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.177369 28803 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:29.177670 28543 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:29.155594 28668 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:29.152982 22442 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:19:29.114717 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.161234 22400 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:29.073576 28762 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:29.149648 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 115633us
I20260709 12:19:29.188426 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:29.189177 22516 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:29.178898 28690 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 12:19:29.157724 28573 consensus_queue.cc:260] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:29.198606 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:29.197551 28590 raft_consensus.cc:2804] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:19:29.138402 28749 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:29.192334 28723 raft_consensus.cc:697] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:29.186465 28622 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:29.218405 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.203474 28711 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:19:29.224028 22367 leader_election.cc:336] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.597s (SENT)
I20260709 12:19:29.210264 28812 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:29.204751 28724 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:19:29.246497 28812 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:29.248677 28812 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:29.218852 28590 raft_consensus.cc:697] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 22 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:19:29.250586 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.210696 28668 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:19:29.253216 22367 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:19:29.254473 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 59292.6us
I20260709 12:19:29.255386 28813 consensus_queue.cc:1059] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:29.256143 28681 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.259974 22470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:29.246145 28711 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.261168 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:29.245167 28805 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:29.262250 22544 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
W20260709 12:19:29.265475 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.265172 28807 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
W20260709 12:19:29.266994 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:29.267411 22367 connection.cc:256] RPC call timeout handler was delayed by -1.0932824090000395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.39020000000000005s for a response
W20260709 12:19:29.267660 28806 log.cc:927] Time spent T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:19:29.269290 28796 raft_consensus.cc:3055] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:29.269743 28796 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:29.270612 28796 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:29.271598 28723 consensus_queue.cc:237] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:29.274308 28762 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:29.275259 28590 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:29.271040 28622 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:29.266620 28808 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:19:29.245559 28755 consensus_queue.cc:1059] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:19:29.262507 28690 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:29.263461 28711 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:29.292752 28755 consensus_queue.cc:1243] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:19:29.293579 28762 raft_consensus.cc:3055] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:29.293994 28762 raft_consensus.cc:740] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:29.294853 28762 consensus_queue.cc:260] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:29.271739 28796 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:29.299630 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:29.300340 22544 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:29.302582 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:29.296299 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 45405.8us
W20260709 12:19:29.328192 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 86271.2us
I20260709 12:19:29.330399 23130 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 12:19:29.303354 22549 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
I20260709 12:19:29.278918 28801 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:29.334688 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 66452.1us
W20260709 12:19:29.335892 22367 leader_election.cc:336] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.690s (SENT)
I20260709 12:19:29.338498 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:29.341153 28690 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:29.341746 28690 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:29.343947 28690 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:29.349459 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:29.261586 28681 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:29.350203 22542 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 16.
I20260709 12:19:29.327808 28732 raft_consensus.cc:3055] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:19:29.355733 22402 raft_consensus.cc:2393] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 17: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:29.328374 28792 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:29.359316 22515 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:29.359820 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:29.361001 22515 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:29.356312 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:29.356455 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:29.286828 28805 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:29.367189 22470 raft_consensus.cc:606] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:29.367656 22470 raft_consensus.cc:614] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:29.372128 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:29.365878 22516 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:29.376158 28748 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:29.376389 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.376745 28748 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:29.367311 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:29.379074 28748 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:29.355631 28732 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:29.387965 28732 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:29.389190 28732 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:29.395133 22560 tablet_copy_service.cc:342] P 8c3bcfa13ca74a24ab8999a408532932: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-cbdd827fb2d34627bbd307872debd3d3 received from {username='slave'} at 127.0.0.1:49290
I20260709 12:19:29.395756 22560 tablet_copy_service.cc:434] P 8c3bcfa13ca74a24ab8999a408532932: ending tablet copy session 65951063312d4a1e9123f92354101c71-cbdd827fb2d34627bbd307872debd3d3 on tablet cbdd827fb2d34627bbd307872debd3d3 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:19:29.395915 28805 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:29.397317 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.386497 28681 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:29.399441 28801 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:29.405066 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 202293us
W20260709 12:19:29.404793 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 43869.8us
I20260709 12:19:29.406204 22516 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:29.406337 22441 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:29.416813 22544 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 18.
I20260709 12:19:29.418275 22441 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:29.425660 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:29.426802 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.429739 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:29.430650 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:29.434055 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:29.434746 22474 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 20.
I20260709 12:19:29.431272 22398 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
W20260709 12:19:29.438010 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 75877.7us
I20260709 12:19:29.370882 28724 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:29.452677 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:29.454016 22441 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:29.459460 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:29.428745 28783 log.cc:927] Time spent T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:19:29.363374 28763 consensus_queue.cc:1059] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 12:19:29.420596 28807 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:29.464932 22397 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:19:29.425050 28813 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:29.425411 28681 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:29.429574 28427 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:19:29.475659 22468 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:29.464042 28749 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:29.473909 28794 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:19:29.478233 28813 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.473646 28748 consensus_queue.cc:1048] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:19:29.536615 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:29.537222 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:29.541283 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.546660 22367 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:29.549160 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:29.549926 22397 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:29.529222 28813 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:29.534444 28414 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:29.507395 28681 consensus_queue.cc:1059] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 12:19:29.565008 22442 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:29.554067 28690 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:19:29.554852 28763 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:29.587424 22549 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:29.596104 28827 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:29.595284 28746 raft_consensus.cc:3055] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:19:29.608508 23095 leader_election.cc:336] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.727s (SENT)
W20260709 12:19:29.629148 23095 leader_election.cc:336] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 1.639s (SENT)
I20260709 12:19:29.629635 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:29.631839 28834 raft_consensus.cc:3055] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:29.632344 28834 raft_consensus.cc:740] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:29.632685 23130 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:19:29.631969 23122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41028 (request call id 1040) took 1707 ms (client timeout 1618 ms). Trace:
I20260709 12:19:29.633200 28834 consensus_queue.cc:260] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:29.633926 23122 rpcz_store.cc:269] 0709 12:19:27.924553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.924870 (+   317us) service_pool.cc:224] Handling call
0709 12:19:29.630450 (+1705580us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b540055e1d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:29.631876 (+  1426us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1773181696}
W20260709 12:19:29.626986 28797 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.830s	user 0.006s	sys 0.000s
I20260709 12:19:29.643100 23128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41028 (request call id 1045) took 1152 ms. Trace:
I20260709 12:19:29.643462 23128 rpcz_store.cc:276] 0709 12:19:28.490798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.490964 (+   166us) service_pool.cc:224] Handling call
0709 12:19:28.491318 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:28.734260 (+242942us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:28.734294 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:28.735010 (+   716us) log.cc:844] Serialized 26 byte log entry
0709 12:19:28.745947 (+ 10937us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:28.745988 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:28.746057 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:29.611267 (+865210us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:19:29.642804 (+ 31537us) raft_consensus.cc:1685] finished
0709 12:19:29.642830 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:29.643042 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86759,"raft.queue_time_us":231938,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":9728,"spinlock_wait_cycles":2843392,"thread_start_us":112568,"threads_started":2,"wal-append.queue_time_us":8142}
W20260709 12:19:29.645315 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:29.646449 28833 log.cc:927] Time spent T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:19:29.647598 28573 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:29.648401 28601 raft_consensus.cc:3055] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:29.648833 28601 raft_consensus.cc:740] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:29.649721 28601 consensus_queue.cc:260] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:29.650730 28601 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:29.655400 28688 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:29.614137 28830 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 12:19:29.614547 28828 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:19:29.614254 28746 raft_consensus.cc:740] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:29.590034 28763 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:29.669396 28420 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:29.704028 28820 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:19:29.723986 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 295540us
I20260709 12:19:29.728897 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:29.729609 23128 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:19:29.734248 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.676370 28803 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:29.722456 28668 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:29.750275 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:29.750916 23125 raft_consensus.cc:2376] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14. Re-sending same reply.
W20260709 12:19:29.757380 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 350703us
I20260709 12:19:29.758349 23126 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 12:19:29.767210 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:29.768865 23094 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:29.768748 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:29.770804 23131 raft_consensus.cc:2393] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 12: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:29.772282 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:29.772403 28728 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:29.772967 23125 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:29.771687 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:19:29.776865 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:29.782712 28838 log.cc:927] Time spent T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:19:29.783370 23094 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:29.784817 23128 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
W20260709 12:19:29.785921 28832 log.cc:927] Time spent T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 12:19:29.787420 23130 raft_consensus.cc:1240] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:29.788720 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:29.792480 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:29.750264 28668 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:29.813155 28812 consensus_meta.cc:287] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.000s
W20260709 12:19:29.818074 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.821698 28401 consensus_queue.cc:1059] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:29.773102 28728 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:29.824947 28728 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:29.828050 28803 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:29.828660 23127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41028 (request call id 1042) took 1705 ms. Trace:
I20260709 12:19:29.753571 28711 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:29.784785 28792 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:29.816018 28812 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:29.829543 28792 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:29.831204 28792 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:29.831648 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 3666) took 1713 ms. Trace:
W20260709 12:19:29.831548 23095 leader_election.cc:336] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Timed out: RequestConsensusVote RPC to 127.20.191.2:46187 timed out after 2.067s (SENT)
I20260709 12:19:29.832039 22550 rpcz_store.cc:276] 0709 12:19:28.118299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.119192 (+   893us) service_pool.cc:224] Handling call
0709 12:19:28.124860 (+  5668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:28.367417 (+242557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.831405 (+1463988us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b540008bbd4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:29.831586 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555817344}
I20260709 12:19:29.814826 28763 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:29.772307 28831 log.cc:927] Time spent T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:19:29.747320 28718 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:19:29.829087 23127 rpcz_store.cc:276] 0709 12:19:28.123439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.123552 (+   113us) service_pool.cc:224] Handling call
0709 12:19:28.152243 (+ 28691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:29.096428 (+944185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:29.096459 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:29.096506 (+    47us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:19:29.096537 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.828403 (+731866us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b540035be54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:29.828454 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:29.828599 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2170854656}
I20260709 12:19:29.837318 28820 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:29.837853 28820 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:29.840842 28762 raft_consensus.cc:3060] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:29.841320 28711 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:29.849725 28746 consensus_queue.cc:260] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:29.851378 28746 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:29.859867 28766 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 1.604s	user 0.004s	sys 0.014s
I20260709 12:19:29.864291 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 3477) took 1060 ms. Trace:
I20260709 12:19:29.864780 22477 rpcz_store.cc:276] 0709 12:19:28.803398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.803921 (+   523us) service_pool.cc:224] Handling call
0709 12:19:29.864020 (+1060099us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54002021d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:29.864164 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416681856}
I20260709 12:19:29.837309 28420 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:29.866973 28385 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:29.867866 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.871935 28720 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:29.875989 28720 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:29.881788 28668 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:29.887238 28812 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:29.889103 28720 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:29.899063 28796 consensus_meta.cc:287] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.000s
I20260709 12:19:29.899988 28735 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:19:29.900467 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.900636 28735 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:29.904351 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 154943us
W20260709 12:19:29.906810 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 431008us
I20260709 12:19:29.908807 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:29.895038 28679 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:29.907676 22441 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:29.916887 22545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 3663) took 2052 ms. Trace:
I20260709 12:19:29.910022 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:29.915432 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:29.915685 22367 leader_election.cc:400] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17.
I20260709 12:19:29.920384 22550 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:29.917230 22545 rpcz_store.cc:276] 0709 12:19:27.864001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.864139 (+   138us) service_pool.cc:224] Handling call
0709 12:19:27.864464 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:27.864867 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:27.937218 (+ 72351us) log.cc:844] Serialized 14 byte log entry
0709 12:19:28.084110 (+146892us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:28.113508 (+ 29398us) log.cc:844] Serialized 52 byte log entry
0709 12:19:28.113662 (+   154us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:28.113694 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:28.113789 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:29.859330 (+1745541us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b2400218348. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f58ed9c4 00007fb4f58ebacb 00007fb4f5aa6dc9 00007fb4f5aa6a55 00007fb4f5aa609d 00007fb4f86d810e 00007fb4f86ef88c 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221
0709 12:19:29.903159 (+ 43829us) raft_consensus.cc:1685] finished
0709 12:19:29.916696 (+ 13537us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:29.916831 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3209,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":4443,"spinlock_wait_cycles":30471040,"thread_start_us":91744,"threads_started":1,"wal-append.queue_time_us":258324}
I20260709 12:19:29.935951 22402 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:29.940431 23095 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:29.942890 22545 raft_consensus.cc:1240] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:29.945549 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:29.946410 23131 raft_consensus.cc:2393] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 15: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:29.947299 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:29.946821 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:29.947863 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:29.948148 22544 raft_consensus.cc:2410] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:19:29.948210 22545 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 18: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:29.948998 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:29.950136 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:29.952333 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:29.895161 28813 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:29.956284 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:29.953698 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:29.956985 22474 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:19:29.954398 22367 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:29.916334 28723 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.989845 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:29.991144 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:29.960575 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:29.993156 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:29.993744 22474 raft_consensus.cc:2376] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17. Re-sending same reply.
I20260709 12:19:29.963089 28535 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:29.963349 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49290 (request call id 1166) took 2040 ms. Trace:
I20260709 12:19:29.963871 22547 raft_consensus.cc:1240] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:29.964560 28792 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:29.966149 28420 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.006825 28420 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:29.955132 28573 consensus_queue.cc:1059] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:19:30.008469 28573 raft_consensus.cc:3055] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:30.008795 28573 raft_consensus.cc:740] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:29.967398 28765 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:30.009717 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 71603.5us
I20260709 12:19:30.009608 28573 consensus_queue.cc:260] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:29.971813 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:30.010855 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.973201 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:30.004678 28723 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:29.973608 28414 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:30.013162 28414 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:30.014261 28723 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:29.928133 28829 consensus_queue.cc:1059] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 12:19:30.015262 22543 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:30.015595 28829 raft_consensus.cc:3055] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:19:30.015949 28829 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:30.016074 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:30.016744 28829 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:29.975145 28813 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:29.978101 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:29.921213 28801 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:30.024078 22542 raft_consensus.cc:2393] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 15: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:29.954444 28794 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.923889 28753 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:30.025871 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:30.001398 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:30.003204 22475 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:19:30.027154 22542 raft_consensus.cc:2393] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 18: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:29.921033 28668 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:29.924175 28720 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:29.998512 22546 rpcz_store.cc:276] 0709 12:19:27.923196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.928269 (+  5073us) service_pool.cc:224] Handling call
0709 12:19:27.928577 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:27.928900 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:27.928926 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:27.940235 (+ 11309us) log.cc:844] Serialized 26 byte log entry
0709 12:19:29.647500 (+1707265us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b180044fe60. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a49e07 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a66c02 00007fb4f86ee20b 00007fb4f86f3d23 00007fb4f86f40d1 00007fb4f8b0fa0f
0709 12:19:29.721942 (+ 74442us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:19:29.721989 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.722069 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:29.963065 (+240996us) raft_consensus.cc:1685] finished
0709 12:19:29.963083 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:29.963293 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4185,"raft.queue_time_us":98,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6418,"spinlock_wait_cycles":12097280,"thread_start_us":74210,"threads_started":1,"wal-append.queue_time_us":1980713}
I20260709 12:19:30.005919 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:30.012140 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:30.018677 22367 leader_election.cc:400] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15.
I20260709 12:19:29.941812 28732 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:30.018869 22441 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:29.981094 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:30.014274 28792 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:30.024143 28796 consensus_queue.cc:1059] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:30.027817 22477 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:30.010774 28849 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:30.039703 22441 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:30.041532 28753 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:30.042587 28753 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:30.043058 28753 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.044091 28420 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.046375 28753 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:30.046085 28735 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:29.996990 22550 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:30.024048 28818 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.049563 22366 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:30.042766 22367 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:30.050326 22441 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:30.049649 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:30.036130 22516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.029s	sys 0.070s
W20260709 12:19:30.052768 22516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.029s	sys 0.070s
I20260709 12:19:30.053737 28796 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:30.038033 28732 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:30.055696 28732 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:30.056150 22441 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:30.056001 28820 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:30.029129 28829 raft_consensus.cc:3060] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:30.032454 28720 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.059908 28720 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:30.032626 28765 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:30.031514 28668 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:30.026417 28601 consensus_queue.cc:1175] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "25ebf14868c042dca42f54b3e251e1b2" responder_term: 21 status { last_received { term: 20 index: 11 } last_committed_idx: 11 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:30.061396 28790 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.062687 28790 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.063452 28668 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:30.063838 22393 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:19:30.064875 28818 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:30.066792 22401 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:30.067472 28796 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:30.068149 28834 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:30.068392 28504 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:30.069025 28504 raft_consensus.cc:697] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:30.068405 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 3501) took 1039 ms. Trace:
I20260709 12:19:30.069604 22401 rpcz_store.cc:276] 0709 12:19:29.028978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.031900 (+  2922us) service_pool.cc:224] Handling call
0709 12:19:30.068224 (+1036324us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001e4454. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:30.068346 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2377469824}
I20260709 12:19:30.070120 28504 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.065088 22367 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:30.028697 28794 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:30.069312 28764 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.073493 28679 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:30.073312 28764 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:30.074462 22442 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:30.075656 22442 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:19:30.075608 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 292313us
I20260709 12:19:30.077219 23094 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:30.078567 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:30.083462 22473 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:19:30.083909 22473 pending_rounds.cc:85] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 10
I20260709 12:19:30.084131 22473 pending_rounds.cc:107] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:19:30.084347 22473 raft_consensus.cc:2889] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:30.084376 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:30.084792 22472 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 18.
I20260709 12:19:30.087602 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "277d262725804effb16ede64e81d19c8"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:30.050642 22550 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:30.088280 22475 raft_consensus.cc:606] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:30.072283 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:30.089313 22475 raft_consensus.cc:614] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:30.095764 22477 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:19:30.083437 28755 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:30.083244 28796 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:30.110023 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:30.112593 28746 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:30.118628 28720 consensus_queue.cc:1059] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:30.122687 28818 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:30.124042 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:30.125713 28782 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 1.785s	user 0.006s	sys 0.003s
I20260709 12:19:30.110463 28590 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:19:30.108232 28749 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:30.086319 28535 raft_consensus.cc:2764] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:19:30.123965 28414 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.061478 28385 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:30.157097 28764 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:30.157527 28811 raft_consensus.cc:1064] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:19:30.160028 28811 consensus_queue.cc:237] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.168622 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:30.169364 22398 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:30.132833 22475 raft_consensus.cc:1240] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:30.130885 28820 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:30.133232 28762 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:30.133652 28794 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:30.134213 22441 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:30.088421 23094 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:30.136323 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:19:30.186257 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 97906.5us
I20260709 12:19:30.137621 22395 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
W20260709 12:19:30.138237 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 66032.4us
I20260709 12:19:30.188491 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:30.130569 22469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:30.190049 22469 raft_consensus.cc:606] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:30.190420 22469 raft_consensus.cc:614] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:30.191423 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:30.192456 28746 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:30.141677 22542 raft_consensus.cc:2393] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 21: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:30.198777 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:30.142735 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:30.143579 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:30.207427 22367 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:30.208590 28478 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:19:30.210196 22367 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:30.144323 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:19:30.151758 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.141152 28755 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:30.212086 28755 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:30.156838 28414 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:30.168506 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41028 (request call id 1037) took 2246 ms. Trace:
I20260709 12:19:30.219465 23124 rpcz_store.cc:276] 0709 12:19:27.923530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.932763 (+  9233us) service_pool.cc:224] Handling call
0709 12:19:27.941289 (+  8526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:28.270490 (+329201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:28.270519 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:28.271334 (+   815us) log.cc:844] Serialized 26 byte log entry
0709 12:19:28.341498 (+ 70164us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:19:28.342584 (+  1086us) log.cc:844] Serialized 14 byte log entry
0709 12:19:28.342786 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:28.342854 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:28.416108 (+ 73254us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b18003ef2c0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:19:30.125234 (+1709126us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:19:30.168224 (+ 42990us) raft_consensus.cc:1685] finished
0709 12:19:30.168246 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:30.168409 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":765,"prepare.queue_time_us":900,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":1901,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":9465,"spinlock_wait_cycles":11701888,"thread_start_us":54310,"threads_started":1,"wal-append.queue_time_us":65047}
I20260709 12:19:30.133590 28790 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:30.176883 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 236510us
I20260709 12:19:30.226071 22477 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:30.229992 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:30.230798 22542 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:19:30.235021 28746 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:30.239857 28478 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:19:30.241539 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.243170 22367 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:30.244218 28790 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:30.251669 22477 raft_consensus.cc:2468] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 21.
I20260709 12:19:30.256517 22367 leader_election.cc:400] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 19. Current term is 20.
I20260709 12:19:30.275127 22367 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
W20260709 12:19:30.277727 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 143590us
I20260709 12:19:30.148684 28590 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.283584 23095 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:30.285256 22367 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:30.287415 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:30.150731 28796 raft_consensus.cc:697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:30.294595 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:30.239019 28755 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:30.298182 28790 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:19:30.311671 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.315804 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:19:30.290647 28743 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.896s	user 0.011s	sys 0.015s
I20260709 12:19:30.154729 28420 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:30.172693 28818 raft_consensus.cc:3055] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:30.309243 22398 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:19:30.310366 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:30.319238 22474 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
I20260709 12:19:30.300271 22367 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:30.290025 28834 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:30.288522 28535 raft_consensus.cc:2804] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:30.290529 28746 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:30.292387 28590 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:30.171754 28749 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.332464 22516 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:30.336123 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:30.320271 28743 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.925s	user 0.012s	sys 0.016s
I20260709 12:19:30.289750 28414 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:19:30.288192 28762 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.324952 28818 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:30.336956 28728 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:30.368537 22396 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 14. Current term is 15. Ops: []
W20260709 12:19:30.372620 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:30.363705 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 63540.8us
I20260709 12:19:30.325346 28812 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:30.387425 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.394513 22367 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:30.395932 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:30.348167 28535 raft_consensus.cc:697] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 18 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:30.364284 28768 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.399284 22367 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:30.343060 28723 consensus_queue.cc:1059] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:19:30.411032 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:30.412190 22476 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:30.413604 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:30.384940 28572 raft_consensus.cc:2804] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:19:30.418402 22476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:30.419067 22476 raft_consensus.cc:606] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:30.416114 22367 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:30.391863 28855 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:19:30.429138 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.429685 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:30.432097 22398 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:19:30.408526 28743 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:19:30.456146 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 175493us
I20260709 12:19:30.458568 22515 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:30.388378 28812 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:30.425554 28478 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:30.405472 28728 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:19:30.427515 28809 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:30.496483 22474 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16. Ops: []
W20260709 12:19:30.472174 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 188657us
I20260709 12:19:30.480136 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:30.497241 22398 raft_consensus.cc:3060] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:30.489734 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:30.491086 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:30.500252 22395 raft_consensus.cc:2368] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 17. Current term is 18.
I20260709 12:19:30.417155 28796 consensus_queue.cc:237] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:30.491842 28572 raft_consensus.cc:697] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 21 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:30.505237 23095 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:30.416095 28768 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:30.508104 22475 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:30.508265 22474 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:19:30.509871 28857 log.cc:927] Time spent T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:19:30.511054 28755 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:30.512111 28762 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:30.514062 28879 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:30.538111 28879 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.538542 28879 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:30.541139 28749 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:30.514246 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:30.543769 23127 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:19:30.543962 28385 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:30.515097 28711 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:30.516005 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:30.461644 28855 raft_consensus.cc:697] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 17 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:30.523790 22398 raft_consensus.cc:2468] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 18.
I20260709 12:19:30.517666 28535 consensus_queue.cc:237] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.548305 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:30.548364 22401 raft_consensus.cc:2410] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:19:30.552625 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:30.554584 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:30.555652 22398 raft_consensus.cc:2410] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for term 15 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
W20260709 12:19:30.556907 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 98436.3us
I20260709 12:19:30.561369 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:30.562007 23131 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:30.564726 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:30.567365 23126 raft_consensus.cc:2393] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 13: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:30.424355 28818 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.567103 22441 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:19:30.570261 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:30.573107 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:30.573429 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:30.573975 22548 raft_consensus.cc:2393] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 15: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:30.577531 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:30.578125 23125 raft_consensus.cc:1217] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 12:19:30.578387 22551 raft_consensus.cc:2368] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 17. Current term is 18.
I20260709 12:19:30.580377 22515 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:30.581604 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:30.588905 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:30.591034 28855 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.595608 23131 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
W20260709 12:19:30.597051 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.568559 28851 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.583191 28707 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:30.634433 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:30.635191 23123 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
W20260709 12:19:30.635928 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.636154 22297 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32988 (request call id 187) took 3652 ms. Trace:
I20260709 12:19:30.638893 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:30.642263 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:30.643980 23126 raft_consensus.cc:1275] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:30.621291 28851 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.648422 28851 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:30.607401 28572 consensus_queue.cc:237] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:30.606973 28771 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:30.646111 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:30.655038 22397 raft_consensus.cc:2368] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 17. Current term is 18.
I20260709 12:19:30.634465 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 3247) took 2317 ms. Trace:
I20260709 12:19:30.655467 22547 rpcz_store.cc:276] 0709 12:19:28.317358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.317531 (+   173us) service_pool.cc:224] Handling call
0709 12:19:29.963707 (+1646176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:30.004260 (+ 40553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.634254 (+629994us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54000659d0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:30.634382 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3730385280}
I20260709 12:19:30.655467 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:30.657262 22400 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:30.658711 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:30.661254 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:30.664724 22474 raft_consensus.cc:2393] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 15: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:30.666428 23094 leader_election.cc:400] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 17. Current term is 18.
I20260709 12:19:30.666977 23094 leader_election.cc:403] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:19:30.620909 28707 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:30.651542 28867 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:30.636583 22297 rpcz_store.cc:276] 0709 12:19:26.983595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.983773 (+   178us) service_pool.cc:224] Handling call
0709 12:19:30.636088 (+3652315us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:27.940426 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:28.002071 (+ 61645us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:28.008704 (+  6633us) write_op.cc:435] Acquired schema lock
0709 12:19:28.011254 (+  2550us) tablet.cc:662] Decoding operations
0709 12:19:28.158036 (+146782us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:28.158094 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:28.158128 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:19:28.158796 (+   668us) tablet.cc:701] Row locks acquired
0709 12:19:28.158822 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:19:28.158969 (+   147us) write_op.cc:270] Start()
0709 12:19:28.159087 (+   118us) write_op.cc:276] Timestamp: P: 1783599568158918 usec, L: 0
0709 12:19:28.159109 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:19:28.240004 (+ 80895us) log.cc:844] Serialized 3256 byte log entry
0709 12:19:28.744142 (+504138us) op_driver.cc:464] REPLICATION: finished
0709 12:19:28.858054 (+113912us) write_op.cc:301] APPLY: starting
0709 12:19:28.858140 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:28.902793 (+ 44653us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:28.905427 (+  2634us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:28.918600 (+ 13173us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:28.918822 (+   222us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 12:19:28.918868 (+    46us) write_op.cc:312] APPLY: finished
0709 12:19:28.919130 (+   262us) log.cc:844] Serialized 81 byte log entry
0709 12:19:28.919318 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:28.919442 (+   124us) write_op.cc:454] Released schema lock
0709 12:19:28.919490 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:28.919911 (+   421us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:28.919937 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4272,"reported_tablets":15,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":113674,"apply.run_cpu_time_us":12376,"apply.run_wall_time_us":61816,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37647,"num_ops":8,"prepare.queue_time_us":529470,"prepare.run_cpu_time_us":12574,"prepare.run_wall_time_us":350509,"raft.queue_time_us":372081,"raft.run_cpu_time_us":19384,"raft.run_wall_time_us":81191,"replication_time_us":584861,"thread_start_us":768727,"threads_started":4,"wal-append.queue_time_us":54716,"wal-append.run_cpu_time_us":109118,"wal-append.run_wall_time_us":1664796}]]}
I20260709 12:19:30.676378 22472 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:19:30.677137 22515 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
W20260709 12:19:30.681929 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 268407us
I20260709 12:19:30.608469 28815 consensus_queue.cc:1059] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:19:30.688882 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:30.674695 28707 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:30.707691 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:30.712795 28771 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:30.685220 28867 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 17. Current term is 18.
I20260709 12:19:30.715202 22471 raft_consensus.cc:2368] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 19. Current term is 20.
I20260709 12:19:30.717828 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:30.718478 22472 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:19:30.720870 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:30.721946 28878 raft_consensus.cc:3055] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:30.722393 28878 raft_consensus.cc:740] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:30.723275 28878 consensus_queue.cc:260] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.724520 28879 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.726342 22515 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:30.715376 28851 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:30.734956 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:30.735809 22402 raft_consensus.cc:2393] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 18: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:30.736546 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:30.729296 22471 raft_consensus.cc:1240] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:19:30.744392 22515 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
W20260709 12:19:30.742182 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 237022us
I20260709 12:19:30.748323 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:30.717139 28812 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:30.751883 23095 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:30.724484 28878 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:30.720889 28768 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:30.756474 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:30.755290 23095 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:19:30.756978 22544 raft_consensus.cc:1240] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:30.759799 23095 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:30.756927 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:30.762045 22397 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:19:30.764796 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:30.743187 28720 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:30.765862 28867 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:30.781867 28885 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:19:30.787122 22394 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:30.790035 22400 raft_consensus.cc:2468] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 13.
W20260709 12:19:30.794341 28881 log.cc:927] Time spent T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:19:30.799373 28601 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.799993 28601 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:30.801147 28873 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.801692 28873 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.811477 28543 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.812142 28543 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:30.814924 28543 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:30.757473 28771 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:30.821889 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:30.824640 28420 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:30.825407 28420 raft_consensus.cc:697] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 17 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:19:30.827792 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 68059.9us
W20260709 12:19:30.799283 28869 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:19:30.840628 22397 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:19:30.839504 28868 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:30.848384 28889 consensus_queue.cc:1059] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:19:30.850420 22400 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:19:30.853302 28746 consensus_meta.cc:287] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.516s	user 0.006s	sys 0.002s
W20260709 12:19:30.821698 28864 log.cc:927] Time spent T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 12:19:30.743551 28851 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.858888 28879 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:30.826551 28420 consensus_queue.cc:237] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:30.867838 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 104887us
I20260709 12:19:30.805058 28885 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:30.805423 28867 raft_consensus.cc:697] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 18 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:30.877030 22400 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:19:30.883306 28867 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.869342 28746 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:30.869406 28868 raft_consensus.cc:697] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:30.885447 28868 consensus_queue.cc:237] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:30.879699 28590 consensus_meta.cc:287] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 12:19:30.899469 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:30.900053 22397 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:30.891414 28601 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:30.934060 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:30.934243 22516 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:30.935225 22442 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:30.939584 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:30.940723 23126 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 17 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:30.934721 22397 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 21.
I20260709 12:19:30.946388 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:30.946996 22397 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:30.954042 22402 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:30.879370 28885 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:30.956625 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:30.933445 28755 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:30.958444 28755 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:30.943928 28601 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.959683 28601 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:30.960865 28755 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:30.962496 22442 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:19:30.964334 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 96506.3us
I20260709 12:19:30.966818 23095 leader_election.cc:400] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 17. Current term is 18.
I20260709 12:19:30.973675 23095 leader_election.cc:400] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for earlier term 17. Current term is 18.
I20260709 12:19:30.974931 23095 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:30.976109 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:30.945140 28873 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:30.960903 28894 log.cc:927] Time spent T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:19:30.979125 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:30.956214 28855 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:30.989274 22442 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:30.900943 28590 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:30.992302 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:30.963994 28792 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:30.975559 28879 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:30.998040 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:30.987452 28812 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:30.986443 28846 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:31.000800 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:31.000026 22516 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:30.990878 28815 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:30.988102 28755 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:30.996389 28807 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:30.996171 28841 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:31.020527 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:31.018280 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:31.022589 28846 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:19:30.999850 28604 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:19:31.022341 28755 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.029984 28720 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:30.997030 28879 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:31.044083 28879 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:31.046880 28590 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:30.994992 28855 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:31.049122 28855 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:30.994681 28899 raft_consensus.cc:2804] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:31.049520 28851 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:31.034283 22543 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:19:31.004335 28572 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:31.050072 28899 raft_consensus.cc:697] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:31.051056 28899 consensus_queue.cc:237] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:31.053870 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.054160 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:31.054373 28885 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:31.056836 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:31.001240 28792 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:31.051023 23094 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:31.057006 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:31.056174 28884 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:19:31.067413 28573 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:31.073964 28885 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:31.066231 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:31.074406 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:31.055183 28572 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.075090 23125 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 20.
I20260709 12:19:31.089624 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:31.042485 28755 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:31.090339 22402 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:31.101050 22515 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:31.063352 28883 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 12:19:31.106914 28590 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:31.107334 28590 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:31.107738 28590 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:31.074402 28885 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.091256 28572 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:31.092024 28855 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:19:31.112939 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 116130us
I20260709 12:19:31.093549 28884 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:19:31.063645 28707 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:31.122998 28707 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:31.114187 28885 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:31.115253 28811 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.115178 28855 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.116724 28884 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.115840 28604 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:31.129539 28855 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:31.126469 22402 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 21.
I20260709 12:19:31.133317 22516 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:31.131624 28884 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:31.129693 28811 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:31.140489 28720 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:19:31.133317 28604 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:19:31.152194 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.152580 22473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 3454) took 1717 ms. Trace:
I20260709 12:19:31.153014 22473 rpcz_store.cc:276] 0709 12:19:29.433656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.444764 (+ 11108us) service_pool.cc:224] Handling call
0709 12:19:29.466496 (+ 21732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:30.085046 (+618550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.150655 (+1065609us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b5400046854. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:31.150852 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1399946112}
W20260709 12:19:31.154596 28860 log.cc:927] Time spent T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.734s	user 0.002s	sys 0.002s
I20260709 12:19:31.156025 22468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43060 (request call id 828) took 1174 ms. Trace:
I20260709 12:19:31.156404 22468 rpcz_store.cc:276] 0709 12:19:29.981482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.009410 (+ 27928us) service_pool.cc:224] Handling call
0709 12:19:30.009790 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:30.010095 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:30.010119 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:30.010590 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:19:30.199927 (+189337us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:19:30.199974 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.200053 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:31.153960 (+953907us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:19:31.155721 (+  1761us) raft_consensus.cc:1685] finished
0709 12:19:31.155742 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:31.155966 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1259,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":10919168,"thread_start_us":188913,"threads_started":1,"wal-append.queue_time_us":358851}
I20260709 12:19:31.166006 28735 consensus_queue.cc:1059] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:31.166972 28846 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:31.167737 28872 raft_consensus.cc:3055] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:31.168176 28872 raft_consensus.cc:740] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:19:31.168898 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.169023 28872 consensus_queue.cc:260] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:31.167865 28735 consensus_queue.cc:1048] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:19:31.168799 22399 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:31.170740 28724 raft_consensus.cc:3055] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:31.182911 23125 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [term 16 LEARNER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:31.185328 22366 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:31.185849 28872 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:31.186690 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:31.164455 28720 raft_consensus.cc:697] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 21 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
W20260709 12:19:31.192131 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.191442 28679 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:31.182022 28724 raft_consensus.cc:740] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:31.200151 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:31.207820 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:31.208681 23131 raft_consensus.cc:2393] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 18: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:31.210887 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50990 (request call id 78) took 1004 ms. Trace:
I20260709 12:19:31.211316 22476 rpcz_store.cc:276] 0709 12:19:30.206943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.418270 (+211327us) service_pool.cc:224] Handling call
0709 12:19:31.210541 (+792271us) spinlock_profiling.cc:243] Waited 84.9 ms on lock 0x7b54004a2020. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8ad1520 00007fb4f8b4e652 00007fb4fdb1c60a 00007fb4f70a27d4 00007fb4f70a2762 00007fb4f70a2691 00007fb4f70a260c 00007fb4f70a18c2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:31.210816 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195200256}
I20260709 12:19:31.212474 28885 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:31.214342 22367 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:31.196023 28679 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.215730 22367 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:19:31.214382 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.217231 28679 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:31.217423 28764 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:31.223174 28811 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:31.223683 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 3495) took 2931 ms. Trace:
I20260709 12:19:31.225095 28746 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:31.225557 28688 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:31.240123 22396 rpcz_store.cc:276] 0709 12:19:28.292016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.292201 (+   185us) service_pool.cc:224] Handling call
0709 12:19:28.295187 (+  2986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:30.369059 (+2073872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.223430 (+854371us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b5400226d54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:31.223600 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4767848832}
I20260709 12:19:31.231629 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:31.220028 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:31.245913 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:31.235244 22515 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:31.233505 22367 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:31.249576 28809 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:31.236318 22366 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:31.199433 28792 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:31.231388 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:31.253183 28735 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:19:31.243391 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:31.259734 28601 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:31.255955 22367 leader_election.cc:400] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 19. Current term is 20.
I20260709 12:19:31.272537 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 3519) took 1182 ms. Trace:
I20260709 12:19:31.273097 22401 rpcz_store.cc:276] 0709 12:19:30.072186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.072656 (+   470us) service_pool.cc:224] Handling call
0709 12:19:31.254422 (+1181766us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b54002da354. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:31.254564 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1061947520}
I20260709 12:19:31.282534 28879 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:31.284883 28879 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:31.289753 28885 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:31.294046 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:31.300390 28590 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:31.301570 28818 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:19:31.306226 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 69966.7us
I20260709 12:19:31.309644 23095 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:31.314560 23095 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:31.328354 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 46573.7us
I20260709 12:19:31.333140 22544 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:19:31.241602 28755 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:31.334374 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:31.316409 28792 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:31.340140 28884 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:31.322698 28535 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:31.313290 28917 consensus_queue.cc:1059] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 12:19:31.343686 28917 raft_consensus.cc:3055] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:19:31.344055 28917 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:31.344830 28917 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:31.243090 28720 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:31.322598 28764 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:31.357045 22366 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:31.358649 28728 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:31.363233 28823 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:31.363560 28590 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:31.364028 28823 raft_consensus.cc:697] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:31.364967 28823 consensus_queue.cc:237] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:31.365296 22400 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 14. (term mismatch)
I20260709 12:19:31.365926 22400 pending_rounds.cc:85] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 13
I20260709 12:19:31.366163 22400 pending_rounds.cc:107] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 14.14
I20260709 12:19:31.366405 22400 raft_consensus.cc:2889] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:31.367115 28746 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:31.364986 28897 raft_consensus.cc:3055] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:31.368969 28897 raft_consensus.cc:740] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:31.370394 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:31.372910 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:31.373559 22393 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:31.374931 28792 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:31.377902 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:31.378523 22396 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:31.379789 28572 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:31.380995 22547 raft_consensus.cc:2393] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 17: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:31.385878 22396 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
I20260709 12:19:31.371990 28917 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:31.396100 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:31.396849 22400 raft_consensus.cc:2368] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13.
I20260709 12:19:31.398119 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:31.371026 28897 consensus_queue.cc:260] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:31.402693 22544 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:31.405380 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:31.407120 22400 raft_consensus.cc:3060] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:31.409041 23131 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:19:31.417156 22544 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:31.411616 28897 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:31.398856 28764 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:19:31.422132 28590 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:31.430315 28590 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:31.427886 28735 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:31.432734 28478 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:31.426165 28688 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 12:19:31.439929 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:31.459695 22475 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:19:31.461048 22393 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 22.
I20260709 12:19:31.442126 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:31.461875 22473 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 20.
I20260709 12:19:31.448962 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:31.463778 22470 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 16.
I20260709 12:19:31.464767 22393 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:31.451665 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:31.467644 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:31.468290 22474 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 20.
W20260709 12:19:31.453905 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 317624us
I20260709 12:19:31.439630 22476 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 19. Current term is 20. Ops: []
I20260709 12:19:31.440404 22469 raft_consensus.cc:1240] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:31.431584 28735 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:31.450805 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:31.473201 22471 raft_consensus.cc:2410] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:19:31.469822 22442 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:31.474437 22442 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:31.465634 22470 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:19:31.475623 22400 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:19:31.479450 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:31.480448 22476 raft_consensus.cc:2410] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:19:31.481421 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:31.482209 22474 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 20.
I20260709 12:19:31.486792 22544 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:19:31.483309 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:31.489147 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:31.512051 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:31.497445 22471 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:31.498042 22474 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:19:31.497061 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:31.516458 22470 raft_consensus.cc:2393] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 20: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:19:31.472373 28922 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.060s	user 0.002s	sys 0.000s
I20260709 12:19:31.518550 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:31.452000 28839 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.433100 28812 raft_consensus.cc:697] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:31.526010 22472 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:19:31.472460 28924 log.cc:927] Time spent T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.057s	user 0.000s	sys 0.008s
I20260709 12:19:31.526854 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:19:31.504427 28921 log.cc:927] Time spent T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.094s	user 0.001s	sys 0.003s
I20260709 12:19:31.437183 28820 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.439354 28755 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:31.451838 28573 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.434260 28590 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:31.526494 28805 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:31.529433 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:31.504868 28762 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:19:31.517659 28919 log.cc:927] Time spent T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.003s
I20260709 12:19:31.490897 28679 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:31.504824 28911 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:31.525259 28841 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.530627 22470 raft_consensus.cc:1275] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:19:31.622362 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:31.491194 28792 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:19:31.519310 28842 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.636037 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:31.636406 22470 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:31.560467 22471 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 21.
I20260709 12:19:31.562731 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:31.563782 28805 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:31.525139 28746 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 12:19:31.653157 22400 raft_consensus.cc:1240] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:31.551856 28573 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:31.641923 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:31.651057 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:31.664824 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:31.632817 22472 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
I20260709 12:19:31.668081 22402 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:19:31.671021 22468 raft_consensus.cc:2393] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 20: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:31.542716 28839 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:31.549022 28820 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:31.565387 28911 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:31.651010 28925 log.cc:927] Time spent T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:19:31.690804 22402 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:31.635330 28762 raft_consensus.cc:697] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:19:31.697646 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 168904us
W20260709 12:19:31.683699 28919 log.cc:927] Time spent T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:19:31.701411 23095 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:31.702598 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:31.703279 22469 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:31.703661 23095 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:31.683368 28572 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:31.706620 22477 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:19:31.707535 22441 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:31.707471 22367 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:31.690769 28420 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:19:31.705219 28855 consensus_meta.cc:287] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.001s
I20260709 12:19:31.693614 28911 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:31.654827 28842 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:31.709477 28823 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:19:31.708987 28851 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:31.638666 28841 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:31.719519 28790 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:31.681443 28724 consensus_queue.cc:260] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:31.752816 28724 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:31.755393 28927 log.cc:927] Time spent T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:19:31.757117 28928 log.cc:927] Time spent T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:19:31.718233 28905 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:19:31.757992 28905 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.758400 28905 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:31.748885 28573 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:31.735795 28855 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:31.749261 28762 consensus_queue.cc:237] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:31.751087 28842 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:31.734163 28420 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:31.779942 28420 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:31.745959 28931 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:31.705886 28909 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:19:31.692996 28812 consensus_queue.cc:237] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:31.747313 28851 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:31.773460 28735 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:31.746214 28823 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:31.918134 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 3278) took 1059 ms. Trace:
I20260709 12:19:31.918701 22394 rpcz_store.cc:276] 0709 12:19:30.860904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.861159 (+   255us) service_pool.cc:224] Handling call
0709 12:19:30.861546 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:30.861900 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:19:31.247338 (+385438us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b180037a3e0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f59e1c0a 00007fb4ff121219 00007fb4f5a69a40 00007fb4f5a644e4 00007fb4f5a64455 00007fb4fc54c3c7 00007fb4f8b5e9a7 00007fb4f8b6e0bf 00007fb4f8b6e038
0709 12:19:31.247574 (+   236us) log.cc:844] Serialized 14 byte log entry
0709 12:19:31.386769 (+139195us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:31.387314 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:19:31.387635 (+   321us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:31.387883 (+   248us) log.cc:844] Serialized 14 byte log entry
0709 12:19:31.394838 (+  6955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.394910 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:31.912527 (+517617us) raft_consensus.cc:1685] finished
0709 12:19:31.912553 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:31.912680 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20863,"prepare.queue_time_us":388820,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":74,"raft.queue_time_us":20863,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":14431,"spinlock_wait_cycles":19689856,"thread_start_us":126897,"threads_started":1,"wal-append.queue_time_us":160303}
I20260709 12:19:31.905582 28851 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:31.909514 28823 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:19:31.929237 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 193228us
I20260709 12:19:31.930408 22367 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
W20260709 12:19:31.941044 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 233551us
W20260709 12:19:31.944098 28900 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 1.063s	user 0.000s	sys 0.012s
I20260709 12:19:31.948611 22441 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:31.955669 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:31.957474 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:31.958159 22468 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:31.958163 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:31.959512 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:31.946703 28923 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:31.948979 28805 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:31.950707 28820 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:31.961550 28794 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:19:31.979368 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:31.982764 22401 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:31.983893 28911 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:31.984956 22401 raft_consensus.cc:1275] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:19:31.973091 28841 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:31.986539 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:31.992527 22468 raft_consensus.cc:2410] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:19:31.966465 28839 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:31.967619 28923 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
W20260709 12:19:31.997174 28932 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:19:32.004395 28478 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:32.018711 28604 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:32.019975 23126 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:19:32.027256 28601 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:32.034533 28601 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:32.036722 28601 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:32.036949 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:32.037196 28764 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:32.038837 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:32.039601 22469 raft_consensus.cc:2393] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 17: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:32.028205 28911 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:32.048966 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:32.054198 28905 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:32.056757 28939 log.cc:927] Time spent T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:19:32.060097 28905 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:32.065176 22442 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:32.069962 28679 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:32.071367 28720 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:32.072072 28342 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.071913 28720 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:32.072597 28342 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:32.073123 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:32.072450 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:32.073235 22547 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:32.074072 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:32.074318 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:32.074759 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:32.075618 22542 raft_consensus.cc:2410] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:19:32.076599 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:32.077397 22544 raft_consensus.cc:2410] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:19:32.077997 22551 raft_consensus.cc:3060] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:32.070257 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.079107 22547 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:19:32.079823 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.081136 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:32.081897 22402 raft_consensus.cc:2393] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 17: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:32.082119 28872 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.082779 22397 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:32.082603 28872 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:32.083626 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:32.083773 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:32.084698 28872 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:32.084898 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:32.085366 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:32.100338 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:32.081751 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:32.102111 28931 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.102447 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:32.103601 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:32.104341 28720 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:32.105302 28889 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:32.085579 22551 raft_consensus.cc:1275] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:19:32.112537 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 47464us
I20260709 12:19:32.129914 22442 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:32.113931 22544 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:32.000792 28923 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:32.114365 22476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.029s	sys 0.023s
I20260709 12:19:32.114902 22516 leader_election.cc:400] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13.
W20260709 12:19:32.133092 22476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.030s	sys 0.024s
I20260709 12:19:32.133149 22516 leader_election.cc:403] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:19:32.114924 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:32.113273 22399 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 21.
I20260709 12:19:32.133812 22543 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:32.137032 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:32.137692 22551 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:32.148947 22551 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 21.
I20260709 12:19:32.147900 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:32.117925 28707 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:32.132036 28807 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:32.128816 28905 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:32.146925 28755 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:32.149394 28818 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13.
I20260709 12:19:32.160264 22442 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:32.148764 28841 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.164611 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:19:32.166679 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 176988us
I20260709 12:19:32.180187 22544 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 13.
I20260709 12:19:32.181495 22543 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:19:32.182910 22366 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:32.163666 28572 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:19:32.181960 22551 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:19:32.128090 28931 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:32.166426 28792 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:32.147279 28823 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:32.175119 28807 raft_consensus.cc:697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:32.179476 28707 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:19:32.135972 28889 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:32.167490 28885 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 12:19:32.193794 28768 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:32.173130 28905 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:32.182983 28841 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:32.205852 28679 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:32.176697 28936 consensus_queue.cc:1059] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:19:32.204792 28707 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.207741 28728 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:19:32.211324 28572 raft_consensus.cc:697] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:32.200366 28792 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:32.264114 28792 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:32.266027 28931 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:32.268141 28905 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:32.269783 28889 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:32.270928 28897 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:19:32.226843 28937 log.cc:927] Time spent T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 12:19:32.278359 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:32.231606 28768 raft_consensus.cc:697] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:32.279654 28768 consensus_queue.cc:237] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:32.262071 28809 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:32.272480 28897 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:32.251854 28818 consensus_queue.cc:1059] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
W20260709 12:19:32.303205 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 77923.6us
I20260709 12:19:32.253132 28707 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:32.264175 28823 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:32.314864 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:32.319859 28851 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:32.322162 28851 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:32.323087 28934 raft_consensus.cc:3055] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:32.323516 28934 raft_consensus.cc:740] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:32.324321 28934 consensus_queue.cc:260] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:32.325465 28934 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:32.274719 28807 consensus_queue.cc:237] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:32.332103 23094 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:32.333033 23094 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:32.333827 28889 consensus_queue.cc:1059] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:32.334326 28909 consensus_queue.cc:1048] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:32.335623 28909 raft_consensus.cc:2804] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:19:32.336087 28909 raft_consensus.cc:697] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 21 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:32.336364 28944 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.336827 28944 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:32.337633 28905 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:32.338160 28905 raft_consensus.cc:697] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:32.339007 28905 consensus_queue.cc:237] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:32.259163 28872 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 12:19:32.344851 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:19:32.346318 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 136570us
I20260709 12:19:32.346668 23126 raft_consensus.cc:1240] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:32.347970 28884 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:32.336922 28909 consensus_queue.cc:237] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:32.350535 28572 consensus_queue.cc:237] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:32.317162 28792 consensus_queue.cc:1048] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:19:32.290099 28923 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:32.356473 28923 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:32.359040 28884 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:32.359634 28884 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:32.361815 28884 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:32.303014 28811 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:32.348119 28817 raft_consensus.cc:993] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:32.347370 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:32.368229 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:32.377503 23122 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
W20260709 12:19:32.393553 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 46258.3us
I20260709 12:19:32.401270 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:32.302187 28809 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:32.411911 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:32.419838 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:32.398008 28842 raft_consensus.cc:1081] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:32.404680 28889 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:19:32.426453 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 174119us
I20260709 12:19:32.427239 22515 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:32.380355 28811 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:32.436828 28878 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:32.439888 28878 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:32.440300 28878 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:32.442792 28478 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:32.443357 28478 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:32.448652 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:32.450003 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:32.450537 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:32.453210 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:32.453898 22551 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:19:32.456087 22544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54498
W20260709 12:19:32.456965 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 142389us
I20260709 12:19:32.465353 22544 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:32.465961 22544 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:32.469681 28944 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:32.469969 28679 raft_consensus.cc:697] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:32.470208 28953 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.470772 28953 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:32.470983 28679 consensus_queue.cc:237] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:32.472998 28953 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:32.474105 28846 consensus_queue.cc:1048] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:32.489599 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:32.497572 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:32.498510 23131 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
W20260709 12:19:32.499048 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 94748.1us
I20260709 12:19:32.500231 22548 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:32.509940 22441 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:32.487704 28953 raft_consensus.cc:3055] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:19:32.514155 22515 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:32.501871 28944 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.507905 28792 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.528573 22441 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:32.530596 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:32.507086 28478 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:32.506052 22544 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:32.533566 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:32.539127 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:32.532135 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:32.520702 28953 raft_consensus.cc:740] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:32.532681 28573 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:19:32.587680 28933 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:32.522085 28839 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:32.539901 28792 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:32.533532 28944 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:32.769999 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 97699.2us
I20260709 12:19:32.520056 28771 consensus_queue.cc:1059] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 12:19:32.593400 28885 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:32.523489 28841 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:32.695504 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 163435us
I20260709 12:19:32.791354 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:32.786810 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:32.792461 22548 raft_consensus.cc:2410] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:19:32.794521 22441 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:32.797210 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 277970us
I20260709 12:19:32.833034 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:32.833313 22441 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:32.761963 28749 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:32.642959 28934 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.791764 28885 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.864916 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:32.867043 22393 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:32.863204 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:32.884106 28796 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:32.832804 28573 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:32.761500 28933 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:32.847152 28841 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:32.847400 28846 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.848032 28953 consensus_queue.cc:260] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.096951 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:32.989708 22544 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:32.896145 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:33.094769 28934 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:32.884627 28796 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.870393 28805 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:19:32.900631 28855 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:32.989432 28867 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:19:32.908807 28967 log.cc:927] Time spent T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.061s	user 0.001s	sys 0.001s
W20260709 12:19:33.093262 28978 log.cc:927] Time spent T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:19:32.895041 28972 log.cc:927] Time spent T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.182s	user 0.003s	sys 0.000s
W20260709 12:19:32.896349 28956 log.cc:927] Time spent T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:19:32.887316 28885 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:32.906848 28961 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:32.896560 28572 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.092417 28809 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.124176 28938 raft_consensus.cc:2955] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 9 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:33.118541 28953 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:32.894887 28959 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:32.971501 28839 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:32.915891 28792 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:32.894629 28905 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:33.012147 28931 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:32.917114 28944 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:32.910580 28668 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:19:33.155625 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 290774us
I20260709 12:19:33.122396 28867 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.110306 28846 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:33.121816 28707 consensus_meta.cc:287] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.803s	user 0.011s	sys 0.000s
I20260709 12:19:33.067199 28749 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:19:33.135074 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 250865us
I20260709 12:19:33.030193 28817 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.117432 28796 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:33.137917 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.164954 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 3719) took 1085 ms. Trace:
W20260709 12:19:33.158443 28878 consensus_meta.cc:287] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.717s	user 0.011s	sys 0.002s
I20260709 12:19:32.891004 28811 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:33.165354 22549 rpcz_store.cc:276] 0709 12:19:32.079128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.086911 (+  7783us) service_pool.cc:224] Handling call
0709 12:19:32.087212 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:32.111042 (+ 23830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:32.111078 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:32.111628 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:19:32.416034 (+304406us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:19:32.416091 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.416170 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:33.164714 (+748544us) raft_consensus.cc:1685] finished
0709 12:19:33.164736 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:33.164889 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5295,"raft.queue_time_us":6775,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":34737,"thread_start_us":293616,"threads_started":1,"wal-append.queue_time_us":401229}
I20260709 12:19:33.136371 28572 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:33.139909 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 369129us
I20260709 12:19:33.136482 28961 raft_consensus.cc:697] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:33.179857 28961 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.000511 28573 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:33.159584 22516 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:33.177675 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:33.163583 28342 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:33.203346 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:33.205201 22549 raft_consensus.cc:2393] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 18: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:33.174613 22441 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:33.206939 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 44086.6us
I20260709 12:19:33.208376 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:33.210134 28969 raft_consensus.cc:1064] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:19:33.211098 28951 raft_consensus.cc:3055] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:33.211560 28951 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:33.212497 28951 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.214330 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:33.143877 28959 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.145533 28839 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:33.213615 28951 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:33.169467 28817 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.229784 28735 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:33.233103 28959 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.163861 28707 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.169606 28749 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.243391 28984 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.162765 28905 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.237656 28590 raft_consensus.cc:3055] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:33.239097 28572 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:33.239578 28724 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:33.244592 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:33.250739 28965 log.cc:927] Time spent T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.407s	user 0.001s	sys 0.001s
I20260709 12:19:33.247545 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:33.162614 28931 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.218138 28768 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:19:33.220619 28820 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:33.255121 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:33.332964 22475 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:33.334079 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:33.334642 22475 raft_consensus.cc:3055] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:33.256541 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:33.257009 22474 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:19:33.335423 22477 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:33.336184 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:33.267407 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.169826 28878 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.282953 28794 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:33.344048 28817 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:33.270088 22400 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:33.345355 22551 raft_consensus.cc:1240] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:33.236881 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49290 (request call id 1203) took 1159 ms. Trace:
W20260709 12:19:33.244506 28979 log.cc:927] Time spent T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.336s	user 0.003s	sys 0.000s
I20260709 12:19:33.255887 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:33.279127 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:33.282881 22402 raft_consensus.cc:2410] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:19:33.245574 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:33.284992 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:33.279587 28985 log.cc:927] Time spent T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:19:33.288836 28846 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:33.289327 28905 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.280481 28984 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.279822 28590 raft_consensus.cc:740] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:33.249377 28841 consensus_queue.cc:1059] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:19:33.249432 28942 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:33.344511 28762 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:33.244076 28992 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:33.269919 28923 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:33.298640 28867 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:19:33.248461 28573 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.392056 28990 consensus_queue.cc:1059] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:33.344079 28794 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.393151 28573 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:33.304781 28885 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.393970 28931 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:33.394423 28794 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:33.395251 28885 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:33.395766 28984 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.310811 28987 raft_consensus.cc:1064] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:19:33.388008 28762 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.250051 28679 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.314010 28989 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:33.314280 28807 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.316113 22476 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:33.316560 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:33.316798 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:33.331743 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:33.334930 22475 raft_consensus.cc:740] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:33.340794 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
W20260709 12:19:33.408836 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 68143.5us
I20260709 12:19:33.337422 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:33.410125 22474 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:33.346114 22547 rpcz_store.cc:276] 0709 12:19:32.076950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.077059 (+   109us) service_pool.cc:224] Handling call
0709 12:19:32.078828 (+  1769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:32.079443 (+   615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.236662 (+1157219us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b540031c4d0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:33.236815 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3413760}
I20260709 12:19:33.348120 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:33.411710 22470 raft_consensus.cc:3060] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:33.357259 22477 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:19:33.413738 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:33.415023 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:33.322196 28724 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:33.420236 22545 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
W20260709 12:19:33.372612 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 101792us
I20260709 12:19:33.294224 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:33.421183 22472 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:19:33.375248 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:33.375443 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:33.376446 22365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.031s	sys 0.076s
W20260709 12:19:33.422569 22365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.031s	sys 0.076s
I20260709 12:19:33.423017 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:33.424052 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.422408 22468 raft_consensus.cc:2393] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 18: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:33.424202 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:33.376610 22550 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:19:33.355121 28878 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:33.389096 23129 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
I20260709 12:19:33.398888 28923 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.404032 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:33.406098 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:33.421327 22548 raft_consensus.cc:2393] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 16: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:33.425837 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:33.430094 23124 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:33.430208 22477 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:19:33.366111 28746 consensus_queue.cc:1059] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:19:33.421192 22475 consensus_queue.cc:260] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.398669 28987 consensus_queue.cc:237] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.446659 22476 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 21.
I20260709 12:19:33.451210 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:33.448541 23124 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:33.452539 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:33.452075 22476 raft_consensus.cc:2410] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:19:33.419701 28990 consensus_queue.cc:1243] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer b8621fa34be04d3fa2d68a300f858cd1 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:19:33.386339 28942 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.392158 28796 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.420589 28679 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.422626 28846 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:19:33.463960 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:33.470817 22477 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 22.
I20260709 12:19:33.467425 22472 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:33.454252 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:33.427912 28917 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:33.489159 22470 raft_consensus.cc:2468] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 21.
I20260709 12:19:33.465679 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:33.453855 23125 raft_consensus.cc:2955] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 9 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:33.422392 28768 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:33.427560 28811 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:33.491994 22470 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 20. Current term is 21. Ops: [18.12-20.13]
I20260709 12:19:33.491583 22547 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 18.
I20260709 12:19:33.492651 22544 raft_consensus.cc:2955] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 9 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:33.434630 28809 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:33.399484 28992 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.449272 28573 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:19:33.481333 28688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.008s	sys 0.016s
I20260709 12:19:33.450167 28944 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:33.519256 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:33.521621 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.498618 22468 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 12:19:33.428026 28724 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.470647 29001 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:33.428371 28807 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.529162 23130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41028 (request call id 1074) took 1409 ms. Trace:
I20260709 12:19:33.539669 23130 rpcz_store.cc:276] 0709 12:19:32.120096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.120481 (+   385us) service_pool.cc:224] Handling call
0709 12:19:32.120791 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:32.214387 (+ 93596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:32.214422 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:32.214464 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:32.214501 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.528947 (+1314446us) spinlock_profiling.cc:243] Waited 93.4 ms on lock 0x7b54005b0ed4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:33.528995 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:33.529105 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214741248}
W20260709 12:19:33.515792 28688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.009s	sys 0.016s
I20260709 12:19:33.494076 28768 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.495458 28794 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:33.555454 28794 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.497252 28809 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.526283 28573 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.559391 28796 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:33.553023 22470 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:33.517793 28931 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:33.565452 22543 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:33.422775 28989 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.573194 28989 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:33.495373 28917 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.559633 28809 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.581180 22470 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:33.557665 28794 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.552997 28768 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:33.497032 28811 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.559639 28573 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.471336 28590 consensus_queue.cc:260] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.593951 28917 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.538717 28944 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:33.547986 29001 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:33.615628 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.616919 22470 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:19:33.586571 28993 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:33.590055 28794 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.598415 28573 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:33.626017 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:33.627480 22470 raft_consensus.cc:2368] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 21. Current term is 22.
I20260709 12:19:33.577876 28931 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:33.614569 28917 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:33.636772 28992 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.637063 29004 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:33.637696 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:33.628530 28923 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:33.622974 28762 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:33.624846 28993 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.663836 28724 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:33.626765 28794 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.682950 28794 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:33.683972 28999 log.cc:927] Time spent T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:19:33.684186 28749 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.630138 28573 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.685377 28839 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.687500 28573 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.691151 28811 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.692793 28942 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.694078 29001 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:33.695875 28944 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.696512 28944 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:33.697079 28944 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.694393 28934 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:33.637573 29004 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.702801 28931 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.703426 28679 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.703895 28917 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.705127 28807 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:33.710804 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 80425.1us
I20260709 12:19:33.721159 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:33.722520 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:33.723330 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:33.723762 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:33.724463 23126 raft_consensus.cc:2393] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 17: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:33.725281 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:33.725317 28951 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:33.725898 22545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49290 (request call id 1211) took 1173 ms. Trace:
I20260709 12:19:33.726117 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:33.727270 23124 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:19:33.727632 29004 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:33.729082 22471 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:19:33.733603 23095 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:33.735033 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:33.735867 28951 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:33.736322 23095 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:33.736536 28951 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:33.737203 28951 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:33.739252 28917 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.739936 28841 raft_consensus.cc:3055] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:33.740353 28841 raft_consensus.cc:740] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:33.742035 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:33.661528 28993 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:33.751034 22545 rpcz_store.cc:276] 0709 12:19:32.663868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.914909 (+251041us) service_pool.cc:224] Handling call
0709 12:19:32.915184 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:33.420646 (+505462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.725572 (+304926us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b540040f454. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:33.725824 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1160946048}
I20260709 12:19:33.761847 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:33.764998 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:33.766008 23124 raft_consensus.cc:2410] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
W20260709 12:19:33.766386 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.774736 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:33.863941 28997 consensus_queue.cc:1059] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:33.864714 28952 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:33.868709 28805 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:33.869308 28805 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.871407 22441 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:19:33.879891 22367 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:33.895838 22367 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:33.878539 28898 raft_consensus.cc:3055] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:33.754011 28942 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:33.755168 28823 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:33.858783 28573 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:33.901705 22367 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:33.905931 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:33.879478 28944 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:33.886490 28728 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.878971 28811 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:33.905440 22469 raft_consensus.cc:2955] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 9 to 12, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:33.911913 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41028 (request call id 1077) took 1423 ms. Trace:
I20260709 12:19:33.741421 28841 consensus_queue.cc:260] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.931831 23122 rpcz_store.cc:276] 0709 12:19:32.488215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.488339 (+   124us) service_pool.cc:224] Handling call
0709 12:19:32.488708 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:32.488945 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:19:33.663811 (+1174866us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b18000eeea0. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f86fc4bc 00007fb4f5a4a48b 00007fb4fe8a49a9 00007fb4f5a6669b 00007fb4f5a6493f 00007fb4f5a64455 00007fb4fc54c3c7 00007fb4f8b5e9a7 00007fb4f8b6e0bf
0709 12:19:33.663983 (+   172us) log.cc:844] Serialized 14 byte log entry
0709 12:19:33.911518 (+247535us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:33.911580 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:19:33.911637 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.911713 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:33.911849 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":279094,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":19883,"spinlock_wait_cycles":35371776,"thread_start_us":505363,"threads_started":2}
I20260709 12:19:33.905177 28809 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:33.902184 28601 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:19:33.902329 28898 raft_consensus.cc:740] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:33.939019 28841 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:33.931454 22367 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:33.911499 28823 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:33.932749 28728 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.911700 28942 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.949395 28809 raft_consensus.cc:697] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:33.912352 28573 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:33.969476 22367 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:19:33.970685 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.973551 23124 raft_consensus.cc:1240] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:33.942324 28811 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:33.981081 28971 log.cc:927] Time spent T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 1.072s	user 0.000s	sys 0.004s
I20260709 12:19:33.963896 28897 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:33.965047 28889 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:33.980903 29013 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:33.984952 28959 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:19:33.992106 28889 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:34.007025 28573 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:34.007295 29009 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.418s	user 0.002s	sys 0.000s
I20260709 12:19:34.008294 28805 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:34.009267 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.982970 28829 consensus_queue.cc:1059] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 12:19:34.010823 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.011742 28590 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:34.012104 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.014155 28959 raft_consensus.cc:697] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:34.015130 28959 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:34.016108 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.016034 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:34.017273 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:33.991276 28991 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:34.019001 28991 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:34.019455 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:34.019753 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.020184 22395 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
I20260709 12:19:34.020931 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.021703 28991 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:33.999123 29016 log.cc:927] Time spent T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:19:33.999706 28981 log.cc:927] Time spent T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.880s	user 0.000s	sys 0.012s
W20260709 12:19:34.003400 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.004522 28728 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:33.974489 28898 consensus_queue.cc:260] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:34.041676 28898 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:34.041844 22401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 960) took 1506 ms. Trace:
I20260709 12:19:34.005353 22544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 3735) took 1243 ms. Trace:
I20260709 12:19:33.998425 28986 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:34.042232 22401 rpcz_store.cc:276] 0709 12:19:32.535062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.535205 (+   143us) service_pool.cc:224] Handling call
0709 12:19:32.535510 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:32.540171 (+  4661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:32.540202 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:32.540659 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:19:32.772738 (+232079us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:32.772826 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.773048 (+   222us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:33.999455 (+1226407us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b240019b788. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f58ed9c4 00007fb4f58ebacb 00007fb4f5aa6dc9 00007fb4f5aa6a55 00007fb4f5aa609d 00007fb4f86d810e 00007fb4f86ef88c 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221
0709 12:19:34.041521 (+ 42066us) raft_consensus.cc:1685] finished
0709 12:19:34.041541 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:34.041747 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72741,"raft.queue_time_us":5243,"raft.run_cpu_time_us":3117,"raft.run_wall_time_us":101071,"spinlock_wait_cycles":4450176,"thread_start_us":226469,"threads_started":1,"wal-append.queue_time_us":535471}
I20260709 12:19:34.023797 28823 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:33.986304 29004 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.042635 22544 rpcz_store.cc:276] 0709 12:19:32.761760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.121124 (+359364us) service_pool.cc:224] Handling call
0709 12:19:33.121461 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:33.159734 (+ 38273us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:19:33.365828 (+206094us) log.cc:844] Serialized 14 byte log entry
0709 12:19:33.492415 (+126587us) log.cc:844] Serialized 14 byte log entry
0709 12:19:33.546282 (+ 53867us) log.cc:844] Serialized 14 byte log entry
0709 12:19:33.546522 (+   240us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:33.546568 (+    46us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:19:33.546615 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.679798 (+133183us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b1800337180. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a67522 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:19:33.695172 (+ 15374us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b1800337180. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a67522 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:19:34.005129 (+309957us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b540040ef54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:34.005169 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:34.005298 (+   129us) inbound_call.cc:177] Queueing success response
0709 12:19:34.006618 (+  1320us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
Metrics: {"mutex_wait_us":939,"prepare.queue_time_us":231704,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":20062,"raft.queue_time_us":4872,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":31576,"spinlock_wait_cycles":172320640,"thread_start_us":321158,"threads_started":2,"wal-append.queue_time_us":187235}
I20260709 12:19:34.002926 28969 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 14, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:34.027709 28942 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:34.030761 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.082562 22468 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:19:34.036109 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:34.084528 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.085330 22468 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 20: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:34.040930 28809 consensus_queue.cc:237] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:34.086172 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.087422 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.087960 22468 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:34.040450 29015 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:34.096405 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:19:34.040889 29024 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:19:34.042177 28811 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:34.049090 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:34.052862 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.054756 22542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49290 (request call id 1209) took 1634 ms. Trace:
I20260709 12:19:34.033252 28917 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.058873 28933 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:34.064528 28968 raft_consensus.cc:3055] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:34.071208 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.072491 22475 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:33.975167 28768 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:34.072913 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:33.990039 28897 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:34.132622 28768 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:34.133349 28897 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:34.073602 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:34.074093 29004 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:34.134171 23128 raft_consensus.cc:2368] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16.
I20260709 12:19:34.081162 28707 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:34.053241 29022 log.cc:927] Time spent T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 12:19:34.052795 29021 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:19:34.034464 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.048002 23095 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:19:34.145699 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 97758.4us
I20260709 12:19:34.089103 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.089258 22441 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:34.147876 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 58703.7us
I20260709 12:19:33.997339 29013 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:34.089855 22367 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:34.091537 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:34.162446 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:34.088349 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.112170 28846 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:34.105890 23125 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [term 14 LEARNER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:34.100133 23126 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 12:19:34.165485 23126 pending_rounds.cc:85] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: Aborting all ops after (but not including) 14
I20260709 12:19:34.094236 29015 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:34.110457 22476 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:34.117893 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.119727 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.121356 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:34.169389 22546 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:19:34.110368 22542 rpcz_store.cc:276] 0709 12:19:32.420205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.420585 (+   380us) service_pool.cc:224] Handling call
0709 12:19:32.420917 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:32.431355 (+ 10438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:32.431389 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:32.431881 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:19:32.515729 (+ 83848us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:32.515773 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.515845 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:33.980429 (+1464584us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:19:34.054470 (+ 74041us) raft_consensus.cc:1685] finished
0709 12:19:34.054496 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:34.054698 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31745,"raft.queue_time_us":14570,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":2652,"spinlock_wait_cycles":141703552,"thread_start_us":83549,"threads_started":1,"wal-append.queue_time_us":476785}
I20260709 12:19:34.122301 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.085635 28951 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:34.130116 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.126626 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.174365 22477 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:34.108979 28823 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:34.139238 23094 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:34.147138 22543 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:19:34.163565 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:34.179320 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.181653 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.093195 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:34.125538 28968 raft_consensus.cc:740] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:34.164505 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.165756 23126 pending_rounds.cc:107] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 12:19:34.190987 23126 raft_consensus.cc:2889] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:34.166440 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:34.192734 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.170639 22547 raft_consensus.cc:2393] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 21: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:34.174374 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.194315 22394 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:34.176760 28746 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:34.184551 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:34.187486 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.191666 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:34.176260 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 86528.4us
I20260709 12:19:34.165197 28707 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:34.165833 29013 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:34.163798 28898 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:34.164319 28936 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.125030 28917 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:34.188930 28823 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:34.216285 23124 raft_consensus.cc:1240] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:34.216876 22475 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:19:34.145893 28897 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:19:34.196760 28990 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.173247 29015 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:34.164734 28768 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:34.215451 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:34.173877 28846 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:34.219028 28968 consensus_queue.cc:260] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:34.222575 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.669530 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.672168 22470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 3517) took 1326 ms. Trace:
I20260709 12:19:34.673588 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.674880 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.673592 22470 rpcz_store.cc:276] 0709 12:19:33.346178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.635977 (+289799us) service_pool.cc:224] Handling call
0709 12:19:33.636304 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:33.728104 (+ 91800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:33.728134 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:33.728745 (+   611us) log.cc:844] Serialized 52 byte log entry
0709 12:19:33.962757 (+234012us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:19:33.984725 (+ 21968us) log.cc:844] Serialized 14 byte log entry
0709 12:19:34.079848 (+ 95123us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b1800237400. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:19:34.671498 (+591650us) log.cc:844] Serialized 14 byte log entry
0709 12:19:34.671731 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.671821 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:34.671964 (+   143us) raft_consensus.cc:1685] finished
0709 12:19:34.671977 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:34.672115 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1368976,"prepare.queue_time_us":705362,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":73,"raft.queue_time_us":95759,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":3626,"spinlock_wait_cycles":3755392,"thread_start_us":179303,"threads_started":1,"wal-append.queue_time_us":217758}
I20260709 12:19:34.675621 22544 raft_consensus.cc:2368] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16.
I20260709 12:19:34.676064 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.676347 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.676954 28897 consensus_queue.cc:1243] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:19:34.653344 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.390530 28889 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:34.221117 28898 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.302579 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.682057 28846 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:34.328403 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 154505us
I20260709 12:19:34.683144 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.685647 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.309355 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 3731) took 1850 ms. Trace:
I20260709 12:19:34.679240 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.687942 22551 rpcz_store.cc:276] 0709 12:19:32.458860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.464849 (+  5989us) service_pool.cc:224] Handling call
0709 12:19:32.465163 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:33.345798 (+880635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.309013 (+963215us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b540008cad4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:34.309268 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2023846784}
I20260709 12:19:34.695868 28990 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:34.696841 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.684365 22545 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:34.678682 22367 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:34.697942 22544 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 20.
W20260709 12:19:34.358533 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.574756 29004 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:34.360602 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.296607 29005 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:34.701053 29005 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:34.686841 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.689618 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:34.703495 29005 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:34.704085 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:34.704675 22402 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:34.704895 22551 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 20.
I20260709 12:19:34.688803 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.690984 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:34.706058 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.706324 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:34.598282 29032 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
I20260709 12:19:34.693287 22396 raft_consensus.cc:1240] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 20. Current term is 21. Ops: []
I20260709 12:19:34.713608 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.198423 28746 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:34.256044 28936 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:34.714361 28917 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:34.715176 22549 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:19:34.707118 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.715969 22551 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
W20260709 12:19:34.300356 28973 log.cc:927] Time spent T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 1.392s	user 0.005s	sys 0.000s
W20260709 12:19:34.716886 29031 log.cc:927] Time spent T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.529s	user 0.006s	sys 0.001s
I20260709 12:19:34.717646 28936 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:34.718235 28746 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:34.660602 22515 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:19:34.719089 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 58573.4us
I20260709 12:19:34.291198 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.718991 22298 catalog_manager.cc:5697] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:34.206382 28707 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.723814 28707 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:34.724056 22298 catalog_manager.cc:5697] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 19 to 20, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 20 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:34.687877 28898 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:34.687512 22477 raft_consensus.cc:1275] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:19:34.669010 22546 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 22.
I20260709 12:19:34.290246 28909 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:34.680262 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.710317 22401 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:34.727391 28961 raft_consensus.cc:2804] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:34.678239 22472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 3522) took 1086 ms. Trace:
I20260709 12:19:34.735097 28961 raft_consensus.cc:697] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:34.712646 22402 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:19:34.738394 22402 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:19:34.728346 28590 consensus_meta.cc:287] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.000s
I20260709 12:19:34.685719 28968 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:34.686053 28768 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:34.736091 28961 consensus_queue.cc:237] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:34.688235 22470 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 21.
I20260709 12:19:34.739506 28909 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.735991 22549 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:19:34.698096 28990 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:34.748593 28746 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:34.653224 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 514025us
I20260709 12:19:34.816586 23094 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:34.817885 23094 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:34.749688 29013 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:34.685847 22475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36296 (request call id 3512) took 1421 ms (client timeout 1515 ms). Trace:
I20260709 12:19:34.754822 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.820392 22547 raft_consensus.cc:2393] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 22: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:34.755064 28811 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.756783 28796 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:34.742059 28823 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:34.742624 28604 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:34.757117 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 78491.6us
I20260709 12:19:34.849836 22367 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:34.765085 28955 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:34.765637 28790 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:34.766449 22468 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:19:34.850716 22468 pending_rounds.cc:85] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 11
I20260709 12:19:34.851008 22468 pending_rounds.cc:107] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:19:34.851254 22468 raft_consensus.cc:2889] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:34.852619 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:34.413968 29006 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.856s	user 0.002s	sys 0.002s
W20260709 12:19:34.768472 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.768440 22395 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:19:34.770447 28933 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:34.772356 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:34.773658 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:34.778026 22397 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 12:19:34.856033 22516 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.191.1:37927 timed out after 1.515s (SENT) [suppressed 17 similar messages]
I20260709 12:19:34.784482 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.726257 22298 catalog_manager.cc:5697] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:34.773454 28898 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:34.794239 22474 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:19:34.704679 22545 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:19:34.866374 22400 raft_consensus.cc:1240] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:34.867373 22298 catalog_manager.cc:5697] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:34.860948 22548 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:34.800599 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:34.870079 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.868813 22298 catalog_manager.cc:5697] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 19 to 20, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 20 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:34.735306 22472 rpcz_store.cc:276] 0709 12:19:33.591925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.744460 (+152535us) service_pool.cc:224] Handling call
0709 12:19:33.859188 (+114728us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:33.859439 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:19:33.934412 (+ 74973us) log.cc:844] Serialized 14 byte log entry
0709 12:19:34.671171 (+736759us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b1800237580. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f59e1c0a 00007fb4ff121219 00007fb4f5a69a40 00007fb4f5a644e4 00007fb4f5a64455 00007fb4fc54c3c7 00007fb4f8b5e9a7 00007fb4f8b6e0bf 00007fb4f8b6e038
0709 12:19:34.676850 (+  5679us) log.cc:844] Serialized 14 byte log entry
0709 12:19:34.677930 (+  1080us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:34.677980 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:34.678030 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.678089 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:34.678188 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2623,"prepare.queue_time_us":767037,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":68,"raft.queue_time_us":1911,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"spinlock_wait_cycles":15275264,"thread_start_us":95283,"threads_started":2,"wal-append.queue_time_us":115486}
I20260709 12:19:34.787323 29015 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:34.820019 22475 rpcz_store.cc:269] 0709 12:19:33.264284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.333841 (+ 69557us) service_pool.cc:224] Handling call
0709 12:19:34.071893 (+738052us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b54004a2020. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8ac9a1d 00007fb4f8ab01a4 00007fb4f8b32447 00007fb4f8b4afe7 00007fb4f8b4c7de 00007fb4f8b5827c 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591
0709 12:19:34.685788 (+613895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49174912}
I20260709 12:19:34.824404 28951 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:34.845629 29025 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:34.855144 22468 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:19:34.859854 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 87567.7us
I20260709 12:19:34.871423 22298 catalog_manager.cc:5697] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 15 to 16, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 16 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:34.875458 22441 leader_election.cc:400] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16.
I20260709 12:19:34.875754 22441 leader_election.cc:403] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:34.876448 22441 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:34.786357 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:34.856952 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:34.862895 22367 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:34.860481 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:34.806895 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:34.848670 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:34.870209 23124 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:34.845395 28905 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:34.879174 22397 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 21.
I20260709 12:19:34.875766 22298 catalog_manager.cc:5697] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:34.883771 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:34.884344 22397 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:34.886336 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:34.886889 22402 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 25.
I20260709 12:19:34.880352 22470 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:19:34.892841 22298 catalog_manager.cc:5697] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 19 to 20, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 20 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:34.894356 22397 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:34.877660 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:34.870347 28812 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:34.853873 28867 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
W20260709 12:19:34.901407 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 79852.6us
I20260709 12:19:34.853188 28790 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:34.825872 28909 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:34.854409 28796 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:34.893270 28990 raft_consensus.cc:3060] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:19:34.906045 22401 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:34.854547 28811 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:34.904399 22441 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:34.898047 29011 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:34.855844 28604 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:34.900710 28936 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:34.899694 29025 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:34.859503 28955 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:34.912560 22441 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:34.903606 28898 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:34.916980 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36286 (request call id 3529) took 1660 ms. Trace:
I20260709 12:19:34.897673 28905 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:34.912256 28812 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:19:34.923018 22469 rpcz_store.cc:276] 0709 12:19:33.256528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.257384 (+   856us) service_pool.cc:224] Handling call
0709 12:19:33.308425 (+ 51041us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:33.308905 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:33.308934 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:33.316366 (+  7432us) log.cc:844] Serialized 582 byte log entry
0709 12:19:33.488237 (+171871us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:19:33.904816 (+416579us) log.cc:844] Serialized 14 byte log entry
0709 12:19:33.964597 (+ 59781us) log.cc:844] Serialized 14 byte log entry
0709 12:19:33.964839 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.964915 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:34.345815 (+380900us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b4400022b4c. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f598dc85 00007fb4f598e6a2 00007fb4f87001db 00007fb4f86fbaaf 00007fb4f86ef86e 00007fb4f86eebb6 00007fb4f86ee7d8 00007fb4f86f8221 00007fb4f86f81d9 00007fb4f86f8169
0709 12:19:34.916701 (+570886us) raft_consensus.cc:1685] finished
0709 12:19:34.916732 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:34.916893 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4436,"prepare.queue_time_us":441115,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":38270,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":13824,"spinlock_wait_cycles":7619968,"thread_start_us":586139,"threads_started":2,"wal-append.queue_time_us":241467}
I20260709 12:19:34.930853 22402 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:19:34.932824 28955 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:34.933108 28905 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:34.934967 28811 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:34.935614 28811 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:34.936228 28811 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:34.936568 28811 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:34.936921 28811 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:34.917294 29025 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:34.916493 29013 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:34.943711 28746 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:34.944217 22471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.026s	sys 0.050s
W20260709 12:19:34.944624 22471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.026s	sys 0.050s
I20260709 12:19:34.949143 22441 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:34.950865 22471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 3520) took 1587 ms. Trace:
I20260709 12:19:34.951359 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:34.956573 22395 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:19:34.958164 22471 rpcz_store.cc:276] 0709 12:19:33.363837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.739175 (+375338us) service_pool.cc:224] Handling call
0709 12:19:33.739500 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:33.740909 (+  1409us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:19:34.142467 (+401558us) log.cc:844] Serialized 14 byte log entry
0709 12:19:34.950407 (+807940us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:34.950488 (+    81us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:34.950550 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.950629 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:34.950788 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4497,"prepare.queue_time_us":198367,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"thread_start_us":1203274,"threads_started":2}
I20260709 12:19:34.939662 28812 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:34.984108 22441 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:35.005023 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:35.013257 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:35.014050 22395 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:34.982947 28839 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:19:35.022426 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.022234 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:35.025333 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:35.025432 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:35.026207 22395 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:35.030073 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:35.008363 28936 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:35.034061 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:35.043536 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:35.045701 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:35.048749 22441 leader_election.cc:400] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16.
W20260709 12:19:35.068828 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 163517us
W20260709 12:19:35.071899 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:35.072355 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:35.072772 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.075698 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:35.078042 28707 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:35.078650 29025 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:35.069926 28768 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:35.080471 28707 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:35.082180 22476 raft_consensus.cc:2393] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 16: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:35.035526 28817 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:35.021169 28790 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:35.029727 28839 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:35.086668 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:35.067323 28735 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:35.110881 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:35.114177 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:35.119457 22395 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 22.
I20260709 12:19:35.121407 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:35.124136 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:35.135653 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 65905.4us
I20260709 12:19:35.087064 28590 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.082152 28989 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:35.141579 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:35.075896 29013 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:19:35.087592 29015 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:35.098711 28817 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.107538 28839 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:35.139870 28735 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:35.148995 28996 log.cc:927] Time spent T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 1.700s	user 0.009s	sys 0.002s
W20260709 12:19:35.167187 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.169597 28604 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:35.170112 28909 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:35.175048 29016 log.cc:927] Time spent T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:19:35.146632 28796 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:35.174572 28955 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:35.185853 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 323015us
I20260709 12:19:35.182825 22366 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:19:35.186503 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 330487us
I20260709 12:19:35.228665 28933 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:35.258231 28933 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:35.260540 22367 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:35.262019 29015 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:35.257241 28817 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:35.259632 28955 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:35.226966 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.264925 22395 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
I20260709 12:19:35.266824 28764 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:35.267369 28764 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:35.267760 28764 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:19:35.256719 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 52189.7us
I20260709 12:19:35.082419 29037 consensus_queue.cc:1048] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.115s
I20260709 12:19:35.257293 22397 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:19:35.279284 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:35.263254 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 80528us
I20260709 12:19:35.109112 28812 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:35.274627 22367 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:35.285077 22366 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:35.190485 28968 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.303165 22366 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:19:35.304158 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 267266us
I20260709 12:19:35.311101 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:35.275100 28768 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:35.266187 28955 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:35.312624 22442 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:35.260915 28933 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:35.328359 22366 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:35.331844 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:35.330497 22442 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:35.264343 28735 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:35.334631 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 259133us
I20260709 12:19:35.273913 28590 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:35.337687 22442 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:35.331475 28796 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:35.275547 28989 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:35.313206 28790 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:35.296049 28604 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:19:35.346599 22366 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:35.344933 22442 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:35.351140 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:35.352262 22366 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:35.354720 23124 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 12.
I20260709 12:19:35.309508 28968 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:35.354154 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36286 (request call id 3541) took 1467 ms. Trace:
I20260709 12:19:35.356943 22476 rpcz_store.cc:276] 0709 12:19:33.887071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.227568 (+340497us) service_pool.cc:224] Handling call
0709 12:19:35.353943 (+1126375us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b5400211e54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:35.354083 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922043776}
I20260709 12:19:35.357743 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:35.360128 22468 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 19.
I20260709 12:19:35.360235 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:35.358632 28823 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:35.338979 28933 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:35.347544 28842 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:35.401254 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 124619us
I20260709 12:19:35.400017 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:35.382457 29046 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:19:35.353163 29015 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:19:35.404191 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 52011.7us
I20260709 12:19:35.347889 28955 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:35.407742 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:35.409026 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:35.360843 28735 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:35.412883 22394 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:35.332760 28768 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:35.362375 28765 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:35.348488 28885 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 12:19:35.381804 28990 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 15. Current term is 16.
I20260709 12:19:35.392659 28590 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:35.425792 29040 log.cc:927] Time spent T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:19:35.405019 28936 raft_consensus.cc:697] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:35.413053 28944 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:35.414588 29046 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:35.436897 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 92052.6us
I20260709 12:19:35.460479 22442 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:35.417060 28601 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:35.427553 28735 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:35.442482 22548 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 17. Current term is 18. Ops: [15.13-17.14]
I20260709 12:19:35.441404 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:35.442750 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:35.471863 22545 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:35.443477 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:35.443691 29043 log.cc:927] Time spent T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:19:35.445791 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 87720.1us
I20260709 12:19:35.477845 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:35.478642 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:19:35.411041 22477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.009s	sys 0.015s
I20260709 12:19:35.421749 28762 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:35.481220 28762 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:35.451457 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:35.482838 22544 raft_consensus.cc:2393] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 15: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:35.483635 28905 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:35.484165 28905 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:35.453188 22546 raft_consensus.cc:1240] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:35.454864 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:35.462471 22516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.486686 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:35.427549 29050 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:35.488773 22473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43060 (request call id 858) took 1526 ms. Trace:
I20260709 12:19:35.428576 28765 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:35.489727 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:35.490495 22547 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:35.491726 28765 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:35.404838 29047 consensus_queue.cc:1059] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:19:35.493206 29047 raft_consensus.cc:3055] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:35.493528 29047 raft_consensus.cc:740] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:35.494040 29065 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.489172 22473 rpcz_store.cc:276] 0709 12:19:33.962757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.691988 (+729231us) service_pool.cc:224] Handling call
0709 12:19:34.692252 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:34.692605 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:34.692634 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:34.693156 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 12:19:35.009872 (+316716us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:19:35.017606 (+  7734us) log.cc:844] Serialized 14 byte log entry
0709 12:19:35.026897 (+  9291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:35.026976 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:35.488575 (+461599us) raft_consensus.cc:1685] finished
0709 12:19:35.488597 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:35.488717 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8976,"prepare.queue_time_us":7439,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":11980,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":12382,"thread_start_us":316319,"threads_started":1,"wal-append.queue_time_us":624202}
I20260709 12:19:35.495673 28905 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:35.495843 28768 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:35.497144 22516 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:35.498122 28936 consensus_queue.cc:237] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:35.499286 28604 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:35.499920 28604 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:35.498584 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:35.500838 29061 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:35.501260 28590 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:35.501636 28590 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:35.502020 28590 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:35.503788 22442 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:35.505785 29053 log.cc:927] Time spent T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:19:35.506657 22442 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:35.506736 28604 consensus_queue.cc:1059] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:35.507519 28604 consensus_queue.cc:1243] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer b8621fa34be04d3fa2d68a300f858cd1 log is divergent from this leader: its last log entry 21.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:19:35.507978 28604 raft_consensus.cc:3055] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:19:35.507885 22442 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:35.505959 28796 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:35.508711 28842 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:35.506067 28933 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:35.510588 28823 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:35.512293 22442 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:35.512208 22545 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 19.
I20260709 12:19:35.514420 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:35.480715 23129 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:35.514487 23094 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:19:35.479913 22477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.009s	sys 0.016s
I20260709 12:19:35.427685 28961 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:35.531684 22547 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:19:35.461971 29046 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:35.508379 28604 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:35.528719 28933 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:35.531672 28909 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:35.545810 29045 log.cc:927] Time spent T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:19:35.537192 28961 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:35.556389 28988 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.494632 29065 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:35.530824 28984 consensus_queue.cc:1059] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:19:35.557463 28817 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:35.517534 28905 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:35.531880 28768 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:19:35.576965 28905 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:35.579185 28905 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:35.585172 28735 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:35.586229 29050 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:35.586789 29050 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:35.588621 28989 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:35.567425 28762 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:35.575080 28811 consensus_meta.cc:287] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.635s	user 0.006s	sys 0.006s
I20260709 12:19:35.510680 29047 consensus_queue.cc:260] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:35.569370 28764 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:35.575755 28984 consensus_queue.cc:1243] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:19:35.591069 28968 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:35.570209 28988 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:35.601364 28811 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:35.624814 28811 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:35.627390 28988 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:35.608489 28604 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:35.629426 28604 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:35.590327 28839 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:35.635809 28839 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:35.607647 29065 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:35.638080 28817 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:35.640431 28897 raft_consensus.cc:3055] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:35.640971 28897 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:35.641993 28897 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:35.615715 28961 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:35.617700 28764 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:35.614241 29047 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:35.647853 29046 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:35.650034 29046 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:35.653882 28897 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:35.659337 29050 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:35.415427 22366 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:19:35.687124 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 271510us
I20260709 12:19:35.689642 22366 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:35.692910 22366 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:35.702647 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 3309) took 1009 ms. Trace:
I20260709 12:19:35.703141 22396 rpcz_store.cc:276] 0709 12:19:34.692980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.713846 (+ 20866us) service_pool.cc:224] Handling call
0709 12:19:34.714154 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:34.757692 (+ 43538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:34.757724 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:35.404445 (+646721us) spinlock_profiling.cc:243] Waited 42.2 ms on lock 0x7b2c00106b88. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f744da11 00007fb4f745d372 00007fb4f8b8fa01 00007fb4f8b5443a 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2
0709 12:19:35.404826 (+   381us) log.cc:844] Serialized 26 byte log entry
0709 12:19:35.701401 (+296575us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:19:35.701520 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:35.701693 (+   173us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:35.701836 (+   143us) raft_consensus.cc:1685] finished
0709 12:19:35.701870 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:35.702417 (+   547us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43143,"raft.queue_time_us":43278,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":97163136,"thread_start_us":282502,"threads_started":1,"wal-append.queue_time_us":181106}
I20260709 12:19:35.428084 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:35.425218 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:35.477308 22441 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:19:35.719115 22475 raft_consensus.cc:1240] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:35.719455 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:35.723367 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:35.719175 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 241792us
I20260709 12:19:35.724653 22468 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 20.
W20260709 12:19:35.721585 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 209212us
I20260709 12:19:35.729326 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:35.732971 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:19:35.735191 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:35.737521 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 206354us
I20260709 12:19:35.737926 22550 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 11.
I20260709 12:19:35.741077 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:35.742198 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36296 (request call id 3524) took 1687 ms. Trace:
I20260709 12:19:35.742964 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:35.742694 22477 rpcz_store.cc:276] 0709 12:19:34.054896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.739354 (+684458us) service_pool.cc:224] Handling call
0709 12:19:34.808788 (+ 69434us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:34.809148 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:34.809177 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:34.815706 (+  6529us) log.cc:844] Serialized 52 byte log entry
0709 12:19:35.734282 (+918576us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:19:35.735080 (+   798us) log.cc:844] Serialized 14 byte log entry
0709 12:19:35.735488 (+   408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:35.735628 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:35.735694 (+    66us) raft_consensus.cc:1685] finished
0709 12:19:35.735710 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:35.736621 (+   911us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b5400328f50. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:35.741993 (+  5372us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":500,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":34697,"spinlock_wait_cycles":158946176,"thread_start_us":862467,"threads_started":1,"wal-append.queue_time_us":567057}
I20260709 12:19:35.758391 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:35.759336 22549 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:35.749457 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:35.751684 22393 raft_consensus.cc:3060] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:35.737727 22545 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:19:35.753597 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:19:35.763396 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.763895 22544 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:35.754132 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:35.767756 22442 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:35.769852 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:35.770218 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:35.771776 23094 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:35.774811 23126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:35.775668 23128 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [term 20 LEARNER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:19:35.778532 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:35.786449 28679 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:35.787505 28764 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:35.788420 28768 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:35.787549 28812 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:35.789701 28823 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:35.790176 28743 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:19:35.790740 28855 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.791147 28762 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:35.818308 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:35.818542 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:35.789662 28735 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:19:35.828356 28768 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:35.830174 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:35.831275 22473 raft_consensus.cc:2393] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:35.831772 28768 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:35.833863 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:35.834868 22476 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 16.
I20260709 12:19:35.835620 28842 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.836267 28842 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:35.837534 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 70118.1us
I20260709 12:19:35.848927 28936 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:35.849901 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.849696 28936 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:35.850729 28817 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:35.851270 28817 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:35.851740 28817 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:35.852973 28839 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:35.854004 28812 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:35.856449 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 87829.3us
I20260709 12:19:35.856892 28812 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:35.857848 28768 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:19:35.858305 28768 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:35.858508 22544 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 21.
I20260709 12:19:35.858785 29063 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:35.859570 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:35.861423 28823 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:35.862704 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 91408.4us
I20260709 12:19:35.864068 23094 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:35.864444 28823 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:35.865217 28899 raft_consensus.cc:2804] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:35.865978 28899 raft_consensus.cc:697] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 19 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:35.867574 28899 consensus_queue.cc:237] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:35.869155 23095 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:35.871151 28984 consensus_queue.cc:1059] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:35.872924 28984 raft_consensus.cc:3055] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:35.873975 28957 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 12:19:35.877643 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:35.878499 23131 raft_consensus.cc:3060] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:35.881359 29038 consensus_queue.cc:1059] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:35.878494 29069 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.882408 29038 consensus_queue.cc:1243] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:19:35.853030 22441 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:35.818342 28855 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:35.883750 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:35.884614 28796 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:35.818531 28762 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:35.885443 28762 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:35.886214 28765 raft_consensus.cc:2804] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:35.886893 28765 raft_consensus.cc:697] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:35.885366 28796 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:35.887995 28765 consensus_queue.cc:237] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:35.889107 28796 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:35.890626 22545 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:19:35.791574 28885 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.100s
I20260709 12:19:35.818320 29067 raft_consensus.cc:2764] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:19:35.893813 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:35.661541 29050 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:35.897464 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:35.862720 22442 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:35.899340 22549 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
I20260709 12:19:35.901093 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:35.873483 28984 raft_consensus.cc:740] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:35.839423 28735 raft_consensus.cc:2764] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:19:35.907485 28855 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:35.882680 29069 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:35.901127 28768 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:19:35.899946 28936 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:35.925900 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:35.926242 23131 raft_consensus.cc:2468] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
I20260709 12:19:35.938133 22550 raft_consensus.cc:2368] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 18. Current term is 19.
I20260709 12:19:35.946420 22441 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:35.949930 22441 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:35.927477 28855 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:35.932636 28812 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:35.955463 22393 raft_consensus.cc:2468] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:19:35.952610 28936 raft_consensus.cc:2804] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:19:35.956745 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 99497.4us
I20260709 12:19:35.949795 29069 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:35.967607 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:35.967284 28601 raft_consensus.cc:2764] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 12:19:35.969511 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 107013us
I20260709 12:19:35.969931 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:35.969552 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:35.970640 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:35.970664 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:35.952950 28855 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:35.969203 22543 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:19:35.972988 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:35.974979 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:35.975524 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 111632us
I20260709 12:19:35.977444 23094 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:19:35.983505 22367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.012s	sys 0.017s
W20260709 12:19:35.983973 22367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.012s	sys 0.017s
I20260709 12:19:35.975003 28905 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:35.974579 28855 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:35.985064 28905 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:35.985543 28905 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:35.986342 22442 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:35.972769 28796 raft_consensus.cc:2804] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:19:35.984880 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 653066us
I20260709 12:19:35.993185 28988 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:35.993731 28988 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:35.994237 28988 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:35.995484 23095 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:19:35.997598 29037 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:35.998098 29037 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.998546 29037 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:36.001120 22442 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:35.973133 28936 raft_consensus.cc:697] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:36.002205 29011 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:35.988936 28842 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:36.010339 22441 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:36.014864 28796 raft_consensus.cc:697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:35.990275 28812 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:36.006793 29011 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.025002 22550 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:19:36.027298 29058 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:36.031309 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:36.040964 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:36.036262 22516 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:36.049077 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:36.049198 28812 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:36.049729 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:36.050096 23131 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:36.052318 28812 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:36.053184 28590 consensus_meta.cc:287] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.009s
I20260709 12:19:36.053665 28590 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:36.054200 28796 consensus_queue.cc:237] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:36.056058 28590 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:35.998210 28984 consensus_queue.cc:260] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:36.049084 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 48124.5us
I20260709 12:19:36.026124 29011 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:36.011430 29063 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:19:36.070418 28936 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:36.074136 28768 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:36.076699 28768 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 26 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:36.079981 22546 raft_consensus.cc:1240] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:19:36.091022 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:36.092835 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:19:36.095270 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 98430.6us
I20260709 12:19:36.103207 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:36.105154 28889 consensus_queue.cc:1059] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
W20260709 12:19:36.105473 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 83570.9us
I20260709 12:19:36.105335 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:19:36.107278 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 97002.9us
I20260709 12:19:36.104925 28990 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:36.085264 28817 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:36.102604 28768 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:36.110818 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:36.110309 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:36.119323 22366 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:36.121670 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:36.121824 28823 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:36.122107 28957 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:36.122810 22442 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:36.123973 29050 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:19:36.124214 22442 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:36.126325 28812 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:36.126555 28990 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:19:36.105981 28762 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:36.131357 22477 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
I20260709 12:19:36.122906 28823 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:36.134654 29082 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:36.135232 29082 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.135625 29082 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:36.136646 22543 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 20.
I20260709 12:19:36.142431 28762 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:36.151610 22515 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:36.152604 28768 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:36.153029 28768 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:36.153362 28768 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:19:36.153944 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 55273.5us
I20260709 12:19:36.154496 28855 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:36.157444 22517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:36.166766 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 67878.7us
I20260709 12:19:36.135728 28823 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:36.176343 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 47494.2us
W20260709 12:19:36.183002 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 52725.6us
I20260709 12:19:36.197675 22550 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:36.197916 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:36.199512 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:36.200083 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:36.200845 22394 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 22.
I20260709 12:19:36.201589 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:36.202306 22396 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:19:36.203416 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:36.205929 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:36.199615 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:36.200929 22398 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 16: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:36.213007 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:36.201256 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:36.217031 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:36.219369 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:36.229272 22396 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:19:36.231145 28984 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:36.234539 28817 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:36.240312 22442 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:36.241324 22442 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:36.242218 28933 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:36.242602 28855 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:36.242929 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:36.243810 22477 raft_consensus.cc:606] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:36.244171 22477 raft_consensus.cc:614] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:36.242640 28933 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.246081 28933 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:36.250108 28817 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:19:36.250679 28817 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.251109 28817 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:19:36.252226 29085 log.cc:927] Time spent T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:19:36.253944 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:36.260849 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:36.261798 22549 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 12:19:36.262992 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:36.263540 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:36.263896 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:36.264950 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:36.265936 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:36.266947 22298 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50176 (request call id 304) took 6865 ms. Trace:
I20260709 12:19:36.267582 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:36.268186 22473 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:36.268777 22293 catalog_manager.cc:5697] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 18 to 19, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 19 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:36.270462 22477 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:19:36.270833 22477 pending_rounds.cc:85] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 9
I20260709 12:19:36.271214 22477 pending_rounds.cc:107] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:19:36.261700 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:36.272622 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:36.273293 22468 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:36.271914 22477 raft_consensus.cc:2889] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:36.270807 22293 catalog_manager.cc:5697] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 11 to 13, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 13 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:36.275745 22293 catalog_manager.cc:5697] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 16 to 18, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 18 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:36.267305 22298 rpcz_store.cc:276] 0709 12:19:29.401310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.401538 (+   228us) service_pool.cc:224] Handling call
0709 12:19:36.266718 (+6865180us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:35.422258 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:35.486120 (+ 63862us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:35.486156 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:19:35.486172 (+    16us) tablet.cc:662] Decoding operations
0709 12:19:35.487019 (+   847us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:35.487078 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:35.487103 (+    25us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:19:35.487734 (+   631us) tablet.cc:701] Row locks acquired
0709 12:19:35.487748 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:19:35.487891 (+   143us) write_op.cc:270] Start()
0709 12:19:35.488010 (+   119us) write_op.cc:276] Timestamp: P: 1783599575487843 usec, L: 0
0709 12:19:35.488027 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:19:35.488697 (+   670us) log.cc:844] Serialized 3286 byte log entry
0709 12:19:35.655822 (+167125us) op_driver.cc:464] REPLICATION: finished
0709 12:19:35.659086 (+  3264us) write_op.cc:301] APPLY: starting
0709 12:19:35.659214 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:35.876120 (+216906us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:35.876326 (+   206us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:36.115171 (+238845us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:36.115504 (+   333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 12:19:36.115562 (+    58us) write_op.cc:312] APPLY: finished
0709 12:19:36.116112 (+   550us) log.cc:844] Serialized 81 byte log entry
0709 12:19:36.116384 (+   272us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:36.116673 (+   289us) write_op.cc:454] Released schema lock
0709 12:19:36.116750 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:36.117286 (+   536us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:36.117317 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":602312,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":2936,"apply.run_cpu_time_us":16945,"apply.run_wall_time_us":458155,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37647,"num_ops":8,"prepare.queue_time_us":484587,"prepare.run_cpu_time_us":33362,"prepare.run_wall_time_us":167138,"raft.queue_time_us":49447,"raft.run_cpu_time_us":3227,"raft.run_wall_time_us":3228,"replication_time_us":167626,"thread_start_us":405981,"threads_started":4,"wal-append.queue_time_us":114977}]]}
W20260709 12:19:36.272171 29084 log.cc:927] Time spent T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.175s	user 0.001s	sys 0.007s
I20260709 12:19:36.277227 22293 catalog_manager.cc:5697] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:36.284528 22543 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:19:36.222014 28988 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:36.285241 22293 catalog_manager.cc:5697] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 9 to 12, term changed from 15 to 16, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1), 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:36.286648 23123 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 16: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:36.288340 28988 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:36.289727 22471 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 12:19:36.291100 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 70197.4us
I20260709 12:19:36.293725 22475 raft_consensus.cc:1240] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:19:36.294696 22470 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:19:36.295117 29063 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:36.299038 22473 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:19:36.300037 22402 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:19:36.299886 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:36.293365 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 52115.5us
I20260709 12:19:36.302039 28601 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:36.301982 28823 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:36.302644 22293 catalog_manager.cc:5697] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:36.303181 28601 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:36.304409 23125 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:36.304667 22293 catalog_manager.cc:5697] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 14 to 17, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 17 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:36.305534 28601 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:36.306283 29063 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:36.313150 28735 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:36.313887 28823 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:36.313623 28735 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:36.314625 28735 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:36.313179 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:36.316099 29063 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:36.307499 28905 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:36.309587 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.310022 28765 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:19:36.310737 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 87711.7us
I20260709 12:19:36.314463 28823 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:36.318099 23128 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 19. Current term is 20. Ops: []
I20260709 12:19:36.319003 29067 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:36.317471 28765 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:36.321107 29067 consensus_queue.cc:1059] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:36.322371 28590 raft_consensus.cc:3055] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:36.322732 28590 raft_consensus.cc:740] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:36.323827 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:36.323657 28590 consensus_queue.cc:260] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:36.324183 28936 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:36.328037 22366 leader_election.cc:400] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 18. Current term is 19.
I20260709 12:19:36.327527 22293 catalog_manager.cc:5697] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:36.328375 22366 leader_election.cc:403] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:19:36.318769 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:36.332695 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:36.333634 28823 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:36.333909 28604 consensus_queue.cc:1059] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:36.336822 28604 raft_consensus.cc:3055] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:36.337256 28604 raft_consensus.cc:740] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:36.343335 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:36.343991 22394 raft_consensus.cc:3060] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:36.347950 22293 catalog_manager.cc:5697] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:36.351872 22442 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:36.352202 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:36.354668 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:36.355242 23095 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:19:36.338950 28590 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:36.356546 28796 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:36.362140 28765 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:36.362576 28768 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:36.338235 28604 consensus_queue.cc:260] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:36.388799 22394 raft_consensus.cc:2468] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 19.
I20260709 12:19:36.388636 22516 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:36.357682 22293 catalog_manager.cc:5697] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 16 to 17, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 17 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:36.317051 29011 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:36.391255 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 63395us
I20260709 12:19:36.363186 29082 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:36.331911 29037 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:36.391250 29038 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:36.356158 28905 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:36.354400 28817 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:36.411286 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:36.411878 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:36.416442 22393 raft_consensus.cc:2393] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 22: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:36.396677 28796 raft_consensus.cc:697] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:36.415501 22477 raft_consensus.cc:2393] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 20: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:36.410627 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:36.337744 28735 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:36.415344 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:36.424093 22470 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:36.419694 23122 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:36.353576 29063 consensus_queue.cc:1059] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 12:19:36.425740 22396 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:19:36.428519 22366 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:36.413012 29038 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.432927 22468 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:36.439836 22476 raft_consensus.cc:2393] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 23: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:36.430888 22293 catalog_manager.cc:5697] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 13 to 14, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 14 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:36.435467 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:19:36.448952 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 93249.1us
I20260709 12:19:36.453076 22471 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:36.437055 29038 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:36.449005 22293 catalog_manager.cc:5697] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:36.453264 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:36.455338 22468 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:36.425084 28933 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:36.451076 28957 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:19:36.424254 28601 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:19:36.455328 28604 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:36.468227 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:36.478935 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:36.497439 22473 raft_consensus.cc:2393] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 18: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:36.500636 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:36.493572 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:36.521430 22475 raft_consensus.cc:606] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:36.521896 22475 raft_consensus.cc:614] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:36.520402 22396 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:19:36.522756 22398 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:19:36.474301 29091 log.cc:927] Time spent T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 12:19:36.474747 29094 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:19:36.487910 29037 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:36.580237 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:36.468456 29065 raft_consensus.cc:2764] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:19:36.488206 28957 raft_consensus.cc:697] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:36.584327 28957 consensus_queue.cc:237] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:36.534757 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:36.535693 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:36.491024 29082 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:36.536633 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:36.469146 29093 log.cc:927] Time spent T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:19:36.592096 22395 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
I20260709 12:19:36.492707 28817 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:36.491783 28768 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:36.539597 28990 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:36.549366 22468 raft_consensus.cc:2410] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:19:36.593668 28990 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:36.554597 29038 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:36.594842 22472 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:36.595918 28990 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:36.596380 29038 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:36.558099 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:36.468689 28944 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 18. Current term is 19.
I20260709 12:19:36.477948 28796 consensus_queue.cc:237] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:36.469331 28735 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:36.477739 29011 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:36.552299 29067 raft_consensus.cc:3055] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:19:36.594105 22441 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:36.597280 22476 raft_consensus.cc:1240] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:36.550686 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:36.606418 22393 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:19:36.498085 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:36.607857 22470 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
I20260709 12:19:36.613304 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:36.616003 22441 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:36.619387 22441 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:36.620239 28765 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:19:36.621708 22441 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:36.620983 28765 consensus_queue.cc:1059] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:36.624387 22469 raft_consensus.cc:2393] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 20: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:36.627363 22398 raft_consensus.cc:2468] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 20.
I20260709 12:19:36.608484 29067 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:36.632442 28933 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:36.634706 22471 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
W20260709 12:19:36.642720 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 204946us
I20260709 12:19:36.623888 28936 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:36.651754 28762 raft_consensus.cc:3055] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:36.652244 28762 raft_consensus.cc:740] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:36.625031 28812 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:36.624219 28990 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.635390 28765 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:36.653247 28762 consensus_queue.cc:260] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:36.661415 28812 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.637331 29011 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 12:19:36.663626 28601 consensus_queue.cc:1059] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 12:19:36.678774 28812 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:36.679766 28990 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:36.711033 22475 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:36.697603 28762 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:36.730822 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:36.731460 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:36.731638 22471 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:36.732080 22473 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:36.740865 22473 raft_consensus.cc:2468] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
I20260709 12:19:36.742338 22471 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 20.
I20260709 12:19:36.742038 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:36.754760 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:36.756918 22400 raft_consensus.cc:3055] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:19:36.757431 22400 raft_consensus.cc:740] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
W20260709 12:19:36.769125 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.780448 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:36.779623 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:36.781153 22394 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:36.785421 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:36.788585 22394 raft_consensus.cc:2468] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:36.793648 22393 raft_consensus.cc:1275] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:19:36.794050 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:36.796224 22400 consensus_queue.cc:260] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:36.797607 22400 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:36.806349 22367 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:36.807802 22367 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:36.806409 22396 raft_consensus.cc:2468] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 23.
I20260709 12:19:36.811784 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:36.813352 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 264940us
I20260709 12:19:36.814643 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:36.772328 22442 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:36.823879 22551 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 26 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 25. Current term is 26. Ops: []
W20260709 12:19:36.826896 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 305295us
I20260709 12:19:36.828125 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:36.832218 23127 raft_consensus.cc:2368] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 17. Current term is 18.
I20260709 12:19:36.834972 22367 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:36.836723 22400 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 12:19:36.837188 22400 pending_rounds.cc:85] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 15
W20260709 12:19:36.838001 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 65762.1us
I20260709 12:19:36.837656 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6bd9e32472432889b9795a2e3653d6" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:36.839026 22442 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:36.840824 23122 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:36.841816 23128 raft_consensus.cc:1240] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:36.843019 22549 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:36.827703 29050 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:19:36.847283 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:36.823311 28944 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:36.837502 22400 pending_rounds.cc:107] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 20.16
I20260709 12:19:36.855192 22400 raft_consensus.cc:2917] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Aborting config change with OpId 20.16: Aborted: Op aborted by new leader
I20260709 12:19:36.856247 22400 raft_consensus.cc:2889] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:36.857946 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.849198 23095 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:36.859328 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.845822 28936 raft_consensus.cc:2804] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:19:36.864955 22542 raft_consensus.cc:1275] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:19:36.865847 22441 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:36.866366 23130 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:19:36.850015 28842 raft_consensus.cc:2804] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:36.874351 22546 raft_consensus.cc:2393] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 18: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:36.875427 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:36.880520 23125 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:36.868624 28988 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:36.877641 29099 raft_consensus.cc:2749] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:36.854568 28933 consensus_queue.cc:1048] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:19:36.853406 28957 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:19:36.859777 28812 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:36.885960 23125 raft_consensus.cc:3060] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:19:36.914724 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 83730.5us
I20260709 12:19:36.888070 29011 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:19:36.944132 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 76403us
I20260709 12:19:36.973220 22441 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:36.947639 28990 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:36.991092 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 136325us
I20260709 12:19:36.900168 29067 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:36.985684 28842 raft_consensus.cc:697] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:36.999193 22441 leader_election.cc:400] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 17. Current term is 18.
W20260709 12:19:37.000423 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 103117us
I20260709 12:19:36.994547 29011 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:19:37.004166 23095 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.007040 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:37.008450 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:37.011523 22542 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:19:37.012836 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:37.013888 22547 raft_consensus.cc:2393] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 14: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
W20260709 12:19:37.014115 29120 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.093s	user 0.000s	sys 0.003s
I20260709 12:19:37.016784 28842 consensus_queue.cc:237] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:37.032773 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b42c69680a57493c942307ff09185b72"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:37.033552 22475 raft_consensus.cc:606] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.056082 22395 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
W20260709 12:19:37.031435 28590 consensus_meta.cc:287] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.000s
W20260709 12:19:37.060097 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 60752.7us
I20260709 12:19:37.042622 28988 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:37.063884 28936 raft_consensus.cc:697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:19:37.079329 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 74521.1us
I20260709 12:19:37.080252 22442 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:37.079969 28936 consensus_queue.cc:237] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:37.066210 28988 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:37.072362 28812 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:37.060173 29117 consensus_queue.cc:1059] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 12:19:37.065407 28990 consensus_queue.cc:1059] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:19:37.090740 28988 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:37.102607 22516 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
W20260709 12:19:37.090979 29101 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
W20260709 12:19:37.115633 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.116232 29117 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:19:37.116667 29117 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:37.117507 29117 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:37.118822 29117 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:19:37.119313 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 274173us
I20260709 12:19:37.120060 22366 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.121928 29050 consensus_queue.cc:1059] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:19:37.122323 29118 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:19:37.123064 29050 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:37.123418 29115 log.cc:927] Time spent T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:19:37.123764 29050 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:37.124814 29105 raft_consensus.cc:3055] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:37.125224 29105 raft_consensus.cc:740] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:37.126071 29105 consensus_queue.cc:260] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:37.126785 22442 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:37.127334 29105 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:37.128408 29127 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:37.128998 29127 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:37.130122 29011 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:19:37.117652 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:37.093207 29116 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 12:19:37.105486 29124 raft_consensus.cc:2804] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:19:37.154212 29124 raft_consensus.cc:697] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:37.154031 29122 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 12:19:37.154814 29122 consensus_queue.cc:1243] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer 65951063312d4a1e9123f92354101c71 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:19:37.155164 29124 consensus_queue.cc:237] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:37.156306 29104 consensus_queue.cc:1175] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b8621fa34be04d3fa2d68a300f858cd1" responder_term: 25 status { last_received { term: 25 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 25 index: 14 } }
I20260709 12:19:37.142053 28817 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:37.157805 28817 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.158222 28817 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:37.131443 29127 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:37.161288 23125 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 12:19:37.131551 29011 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:37.110021 28590 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:37.169871 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 67374.2us
I20260709 12:19:37.176380 22516 leader_election.cc:400] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 21. Current term is 22.
W20260709 12:19:37.177827 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.178184 28765 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:37.178797 28765 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:37.181983 28590 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:37.182917 28765 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:37.161741 23125 pending_rounds.cc:85] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: Aborting all ops after (but not including) 15
I20260709 12:19:37.188555 23125 pending_rounds.cc:107] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 20.16
I20260709 12:19:37.188886 23125 raft_consensus.cc:2917] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Aborting config change with OpId 20.16: Aborted: Op aborted by new leader
I20260709 12:19:37.189280 23125 raft_consensus.cc:2889] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [term 21 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:37.190974 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 157579us
I20260709 12:19:37.191792 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:19:37.204867 23122 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 19. Current term is 20. Ops: []
I20260709 12:19:37.211254 23125 pending_rounds.cc:85] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: Aborting all ops after (but not including) 9
W20260709 12:19:37.211686 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 91730.3us
I20260709 12:19:37.211632 23125 pending_rounds.cc:107] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:19:37.212265 23125 raft_consensus.cc:2889] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:37.212648 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 365915us
I20260709 12:19:37.212482 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.214954 29011 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:37.216023 28812 raft_consensus.cc:3055] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:37.216427 28812 raft_consensus.cc:740] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:37.217183 29011 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:37.211844 29128 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:37.218194 29128 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:37.218564 29128 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:37.219061 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:37.222611 22544 raft_consensus.cc:1275] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:19:37.224435 28988 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:37.230786 22516 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:37.217288 28812 consensus_queue.cc:260] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:37.232183 28812 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:37.232278 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:37.233253 22367 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.236958 22544 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:37.234964 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:19:37.233858 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 172287us
I20260709 12:19:37.226946 29117 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 12:19:37.251480 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:37.251119 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 124402us
I20260709 12:19:37.225656 29133 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:37.252926 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:37.254452 22475 raft_consensus.cc:606] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:37.254832 22475 raft_consensus.cc:614] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:37.258044 29067 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:37.251371 28765 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:19:37.264443 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:37.251334 28936 consensus_queue.cc:1048] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:19:37.212052 29082 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:19:37.266403 29065 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:37.267633 29082 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:37.268062 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:37.268857 22367 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.270371 22367 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.268792 22397 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:19:37.270928 22549 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:19:37.239509 29113 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:37.224364 29101 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 12:19:37.273164 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 44732.1us
I20260709 12:19:37.268983 29132 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:37.253825 28590 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:19:37.299839 22441 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:37.302471 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:37.303324 22402 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:37.242357 29050 consensus_queue.cc:1059] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 12:19:37.291628 23095 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:37.283583 28842 consensus_queue.cc:1048] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:19:37.308827 29132 raft_consensus.cc:697] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:37.312211 23128 raft_consensus.cc:1240] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:37.312769 29132 consensus_queue.cc:237] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:37.313910 22516 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:37.315117 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:37.315943 29106 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:37.316720 28768 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:19:37.317195 28768 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.317575 28768 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:37.268091 28817 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:37.309893 22442 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.322837 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:37.325350 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:37.295051 29105 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:19:37.328831 22402 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:19:37.328787 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:37.330634 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:37.331445 22471 raft_consensus.cc:2368] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14.
I20260709 12:19:37.330688 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:37.278419 28762 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.035s
I20260709 12:19:37.334858 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:37.338408 22394 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:37.306375 28601 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:37.338491 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:37.321373 28933 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:37.344280 22442 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.288378 29063 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:19:37.328073 28990 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:37.346705 22399 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:19:37.353901 29105 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:37.359994 29105 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:37.360715 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 69170.4us
I20260709 12:19:37.361155 28988 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:37.362010 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:37.363258 23095 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:37.363685 29140 log.cc:927] Time spent T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:19:37.357606 28796 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:37.364447 28796 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:37.364852 28796 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:37.369457 29128 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:37.371778 29128 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:37.372601 29038 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:37.375818 29138 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:37.355031 28990 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:37.378460 28990 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:37.382810 29101 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:37.383412 29038 consensus_queue.cc:1059] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:37.353292 28601 raft_consensus.cc:697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:37.383455 29101 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:37.363129 29119 consensus_queue.cc:1059] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 12:19:37.386777 29101 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:37.388119 28988 raft_consensus.cc:3055] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:37.388543 28988 raft_consensus.cc:740] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:37.389436 28988 consensus_queue.cc:260] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:37.391474 28988 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:37.392561 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:37.393302 22475 raft_consensus.cc:2468] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:37.393678 28765 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:37.394183 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:37.344591 29037 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:19:37.406224 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 109764us
I20260709 12:19:37.407876 22367 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.385103 28601 consensus_queue.cc:237] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:37.417966 22473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:37.418678 22473 raft_consensus.cc:606] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.419227 22473 raft_consensus.cc:614] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:37.438527 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:37.439392 22545 raft_consensus.cc:2393] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 15: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:37.439603 29143 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:37.440673 22547 raft_consensus.cc:1275] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:19:37.363902 29137 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:37.440996 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.395040 29134 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:37.464529 22394 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:19:37.467901 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:37.469908 22473 raft_consensus.cc:2393] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 17: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:37.436327 29063 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:19:37.472963 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 177183us
I20260709 12:19:37.458045 29143 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:37.477090 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.478018 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:37.475541 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.421612 28768 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:37.483436 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:37.493602 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:37.493467 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:37.497531 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:19:37.502429 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 77079.2us
I20260709 12:19:37.502570 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.506628 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:37.525358 22470 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 26.
I20260709 12:19:37.534266 22516 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:37.535074 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 139835us
I20260709 12:19:37.495131 28933 consensus_queue.cc:1059] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
W20260709 12:19:37.537876 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.538980 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:37.539752 22477 raft_consensus.cc:2393] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 14: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:37.540558 29065 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:37.541337 29113 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.541946 29113 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:37.542701 29146 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:19:37.544330 29113 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:37.536820 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:37.484418 29063 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:37.474185 29134 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:37.536365 23095 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:37.546929 29148 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:37.546996 29101 consensus_queue.cc:1059] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:37.548208 22367 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.506644 29050 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:37.549623 23095 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.538048 28933 raft_consensus.cc:3055] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:37.553469 28933 raft_consensus.cc:740] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:37.554378 28933 consensus_queue.cc:260] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:37.555548 28933 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:37.556049 28897 raft_consensus.cc:2804] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:37.556607 28897 raft_consensus.cc:697] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 17 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:37.557489 28897 consensus_queue.cc:237] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:37.558955 22516 leader_election.cc:400] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14.
I20260709 12:19:37.559317 22516 leader_election.cc:403] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:19:37.559957 28590 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.560489 28590 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:37.562744 28590 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:37.564806 22471 raft_consensus.cc:1275] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:37.565855 22472 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:19:37.566262 22468 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:19:37.566221 22516 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:37.566476 28590 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 13. Current term is 14.
I20260709 12:19:37.569515 22477 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 12:19:37.555703 28796 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:37.581192 22473 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:19:37.564996 29134 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:37.581673 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:37.569375 22476 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:37.582496 29067 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:19:37.567004 22472 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 21. Current term is 22. Ops: []
I20260709 12:19:37.582950 29151 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:19:37.583679 29063 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:37.580302 28768 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:37.587705 28990 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:37.584040 23095 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.591920 22367 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:37.592542 29142 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:37.625123 29142 raft_consensus.cc:697] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:37.626151 29142 consensus_queue.cc:237] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:37.626873 29158 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:37.592975 29148 consensus_queue.cc:1059] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:37.631243 29148 raft_consensus.cc:3055] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:37.596356 29137 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:37.600353 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:37.631438 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:37.632208 22545 raft_consensus.cc:2393] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 14: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:37.632083 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:37.633522 22545 raft_consensus.cc:1240] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:37.609936 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:37.615141 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:37.617728 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:37.635422 29148 raft_consensus.cc:740] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:37.635993 22543 raft_consensus.cc:2393] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 18: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:37.636384 29148 consensus_queue.cc:260] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:37.637691 29148 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:37.639031 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:37.639541 23127 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:37.639631 22402 raft_consensus.cc:3060] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:37.640964 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:37.641557 22397 raft_consensus.cc:2376] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 19. Re-sending same reply.
I20260709 12:19:37.650806 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:37.651335 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:37.651150 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:37.652122 22401 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:37.652211 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:37.652560 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:37.653322 22401 raft_consensus.cc:1240] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:19:37.653646 22400 raft_consensus.cc:1240] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:19:37.654515 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:37.655642 29105 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:37.670742 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:37.615820 29101 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
W20260709 12:19:37.675709 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 91738.9us
I20260709 12:19:37.617816 29038 consensus_queue.cc:1048] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 12:19:37.641780 29151 raft_consensus.cc:697] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 20 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:37.644022 29147 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:37.694584 22400 raft_consensus.cc:1240] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
W20260709 12:19:37.701964 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 81160.5us
I20260709 12:19:37.704851 22398 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:37.705138 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:19:37.706965 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 85141.7us
I20260709 12:19:37.707167 23095 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:37.692257 29157 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:37.709836 29157 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:37.706001 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:37.709378 22474 raft_consensus.cc:1240] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:19:37.707732 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:19:37.714238 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.735733 29065 consensus_queue.cc:1059] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:37.736774 29065 consensus_queue.cc:1243] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:19:37.741536 29151 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:37.745342 22402 raft_consensus.cc:2468] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 18.
I20260709 12:19:37.737469 29067 raft_consensus.cc:3055] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:37.750424 22397 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:37.752439 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:37.753758 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:37.734535 29147 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:19:37.758318 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:19:37.762684 29162 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:37.763234 29162 raft_consensus.cc:697] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:37.764159 29162 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:37.729444 28590 consensus_queue.cc:1048] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:19:37.770010 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:37.770637 22468 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:37.751042 29158 raft_consensus.cc:697] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:37.749653 29067 raft_consensus.cc:740] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:37.773835 22468 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:37.774936 22470 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:19:37.776072 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:37.781704 22472 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17. Ops: [15.14-16.15]
I20260709 12:19:37.782703 22476 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:19:37.749264 28768 consensus_queue.cc:1059] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:19:37.773380 29113 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:37.755889 28735 consensus_queue.cc:1059] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:19:37.786597 28796 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:37.820940 28768 consensus_queue.cc:1243] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 12:19:37.893464 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 139752us
I20260709 12:19:37.889618 28990 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:37.892053 28796 raft_consensus.cc:493] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
W20260709 12:19:37.916529 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 146851us
I20260709 12:19:37.918120 29174 consensus_queue.cc:1059] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:37.920625 29147 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 26 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:37.922024 29147 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:37.918479 22441 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:37.926738 29180 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.927313 29180 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:37.927995 29179 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:37.893852 28735 consensus_queue.cc:1243] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer 25ebf14868c042dca42f54b3e251e1b2 log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:19:37.941303 29113 raft_consensus.cc:697] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:37.877730 29067 consensus_queue.cc:260] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:37.945115 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:37.975919 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.892138 29158 consensus_queue.cc:237] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:37.946583 28796 raft_consensus.cc:515] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:38.041712 28817 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:38.042773 28796 leader_election.cc:290] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:38.045068 29113 consensus_queue.cc:237] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:38.092774 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 159081us
I20260709 12:19:38.094198 22397 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 22. Current term is 23. Ops: [20.13-22.14]
I20260709 12:19:38.033730 28735 raft_consensus.cc:3055] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:19:38.100072 22367 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:38.101254 22545 raft_consensus.cc:3055] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:19:38.101639 22545 raft_consensus.cc:740] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:38.103485 29172 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.104012 29172 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.103960 22545 consensus_queue.cc:260] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.106297 29172 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:38.106676 22545 raft_consensus.cc:3060] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:38.098176 28735 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:38.113560 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:38.122108 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:38.118943 29143 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:38.124405 29143 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:38.124763 29143 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:38.121486 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:38.113133 28735 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.131692 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:38.131875 28735 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:38.156961 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:38.125887 22545 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 12:19:38.175108 22545 pending_rounds.cc:85] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 11
I20260709 12:19:38.175421 22545 pending_rounds.cc:107] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 12:19:38.175657 22545 raft_consensus.cc:2889] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:38.100690 29067 raft_consensus.cc:3060] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:38.181473 29166 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:38.182124 29166 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.184181 29166 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:38.185168 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2850432f3942ddadf16c096755b5b5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:38.189960 23095 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:38.195267 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:38.195820 22473 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
W20260709 12:19:38.197831 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.199047 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:38.200456 22477 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 17. Current term is 18. Ops: []
W20260709 12:19:38.186761 29063 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
W20260709 12:19:38.208633 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 51789.1us
I20260709 12:19:38.212726 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:38.213594 22477 raft_consensus.cc:2393] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 17: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:38.214311 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:38.219944 22471 raft_consensus.cc:1275] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:19:38.223419 22441 leader_election.cc:304] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:38.186375 29148 consensus_queue.cc:1059] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:19:38.211606 29104 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.231177 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:38.232703 22476 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:38.187069 29050 consensus_queue.cc:1059] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:19:38.235128 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:38.264328 22397 raft_consensus.cc:2393] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 14: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:38.193717 29166 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:19:38.235757 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:38.236402 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:38.237910 29173 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:38.238334 29090 raft_consensus.cc:2804] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:38.252225 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:19:38.253096 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.253414 29180 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:38.256517 29165 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:38.258100 28817 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:38.230728 28796 raft_consensus.cc:2749] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:38.261862 22547 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:19:38.291271 22547 pending_rounds.cc:85] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 10
I20260709 12:19:38.291561 22547 pending_rounds.cc:107] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:19:38.291981 22547 raft_consensus.cc:2889] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:38.193662 29099 consensus_queue.cc:1059] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:19:38.213586 28936 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.268545 29173 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:38.273746 29090 raft_consensus.cc:697] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 18 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:38.314952 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
W20260709 12:19:38.290951 29156 log.cc:927] Time spent T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.316s	user 0.004s	sys 0.005s
W20260709 12:19:38.310808 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.312546 22476 raft_consensus.cc:2468] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 21.
I20260709 12:19:38.319494 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:38.321098 22550 raft_consensus.cc:3055] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:19:38.321616 22550 raft_consensus.cc:740] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:38.322624 22550 consensus_queue.cc:260] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.325333 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:38.276624 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 72386.1us
I20260709 12:19:38.325973 22473 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:38.323738 22550 raft_consensus.cc:3060] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:19:38.329319 22477 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 20. Current term is 21. Ops: [19.13-20.14]
I20260709 12:19:38.270845 29101 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:19:38.291226 29166 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:38.269217 29104 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:38.314016 29173 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:38.343405 22442 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:38.345009 22442 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:38.349428 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:38.350111 22394 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:38.327577 29011 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:38.354888 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:38.291559 29165 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:38.333370 29037 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:38.361507 22516 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:38.354516 28762 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:38.314297 28936 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.372885 29090 consensus_queue.cc:237] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:38.375394 29037 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:38.346158 29147 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:38.346172 28812 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:38.382658 22402 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:19:38.391297 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:38.364336 29184 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:38.388844 29147 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.393603 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:38.407701 22442 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:38.354563 29011 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.343027 29166 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.434283 29166 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:38.406801 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:38.434719 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:38.435256 22473 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 20.
W20260709 12:19:38.405131 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 62471us
I20260709 12:19:38.436764 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:38.437463 22470 raft_consensus.cc:2393] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 26: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:38.410311 29082 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:38.410720 22516 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:38.414018 28933 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:19:38.392079 29180 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:38.422542 22468 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:19:38.423174 28936 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:38.445309 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:38.402901 28817 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.023s
W20260709 12:19:38.426920 29182 log.cc:927] Time spent T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:19:38.428462 29165 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:38.430801 29146 raft_consensus.cc:3055] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:38.431557 29143 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.441010 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:38.414407 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:38.457636 22402 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:19:38.458644 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:38.459735 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:38.387799 28762 raft_consensus.cc:697] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:38.446048 29147 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:38.405365 28812 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.446302 22473 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:38.424727 29037 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:38.450057 22470 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:19:38.434202 29011 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:38.472216 22400 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:38.452000 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:38.454500 22550 raft_consensus.cc:1275] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 14. (term mismatch)
I20260709 12:19:38.460944 22516 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:38.447853 28590 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:38.472896 22550 pending_rounds.cc:85] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 13
I20260709 12:19:38.444546 29180 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:38.473241 22468 raft_consensus.cc:2393] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 13: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:38.468652 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:38.447537 28990 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:38.484424 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.458098 29146 raft_consensus.cc:740] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:38.473241 22550 pending_rounds.cc:107] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 12:19:38.487584 22550 raft_consensus.cc:2889] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:38.488956 22402 raft_consensus.cc:1275] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:19:38.493964 28768 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 23 current term: 23 is higher.
I20260709 12:19:38.496351 22468 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17. Ops: [15.14-16.15]
I20260709 12:19:38.473385 29180 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:38.489197 29147 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:38.509986 28812 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:38.473886 28990 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.510908 28762 consensus_queue.cc:237] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.514969 29146 consensus_queue.cc:260] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:38.516079 29146 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:38.517897 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 62292.4us
I20260709 12:19:38.518682 29143 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:38.520787 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:38.512472 29147 raft_consensus.cc:697] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:38.522229 29147 consensus_queue.cc:237] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:38.525439 29067 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:38.574120 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 50188.2us
W20260709 12:19:38.574419 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 60556.5us
I20260709 12:19:38.520620 28990 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:38.524755 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:38.575613 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:38.579800 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:38.586614 22516 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:38.588222 29185 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:19:38.591270 29185 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:19:38.588476 29065 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:38.592046 29138 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:38.592639 29138 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:38.595458 29138 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:38.600937 29082 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:38.616045 29173 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:38.632505 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:38.636449 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:38.800570 22514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:38.848898 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 266481us
W20260709 12:19:38.850315 22367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.783210 29157 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.848798 29090 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:38.856830 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:38.852058 28944 raft_consensus.cc:3055] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:38.860140 29067 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:38.861583 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:38.855346 29158 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:38.857651 29146 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:38.867036 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:38.867835 22468 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 12:19:38.868468 22468 pending_rounds.cc:85] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 13
I20260709 12:19:38.868652 22468 pending_rounds.cc:107] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 12:19:38.868839 22468 raft_consensus.cc:2889] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:38.864101 29067 raft_consensus.cc:493] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.859753 29090 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:38.867103 29082 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:38.864475 28590 consensus_queue.cc:1059] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:19:38.864455 28944 raft_consensus.cc:740] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:38.854848 29157 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:38.863662 29147 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:38.872396 29067 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:38.872255 29158 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.878161 28590 raft_consensus.cc:3055] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:38.878618 28590 raft_consensus.cc:740] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:38.876427 29208 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:38.879411 28590 consensus_queue.cc:260] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.870024 29146 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.870428 29173 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:38.880522 29201 log.cc:927] Time spent T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.390s	user 0.001s	sys 0.000s
I20260709 12:19:38.882054 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:38.882404 29128 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.887198 29065 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:38.888501 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:38.888763 29158 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:38.889053 29090 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:19:38.890194 22516 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:38.885074 28590 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:38.903976 29065 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.905516 29065 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:38.905685 22469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43060 (request call id 882) took 1417 ms. Trace:
I20260709 12:19:38.881150 29147 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.889194 29132 raft_consensus.cc:3055] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:38.907404 29132 raft_consensus.cc:740] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:38.907691 29147 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:38.908182 29132 consensus_queue.cc:260] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.909338 29132 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:38.892220 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:38.909948 29173 raft_consensus.cc:2804] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:19:38.895833 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:38.906153 22469 rpcz_store.cc:276] 0709 12:19:37.487225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.487369 (+   144us) service_pool.cc:224] Handling call
0709 12:19:37.500870 (+ 13501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:37.582425 (+ 81555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:37.582461 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:37.582526 (+    65us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:19:37.582559 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:38.904250 (+1321691us) spinlock_profiling.cc:243] Waited 75 ms on lock 0x7b5400210f54. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:38.904303 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:38.904453 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172438400}
I20260709 12:19:38.912388 29173 raft_consensus.cc:697] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:38.913030 29157 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:38.913630 29173 consensus_queue.cc:237] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.914330 29065 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.919394 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:38.909889 22398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48924 (request call id 3343) took 1251 ms. Trace:
I20260709 12:19:38.893133 29146 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:38.903697 29128 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:38.921684 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:38.920929 22398 rpcz_store.cc:276] 0709 12:19:37.652534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.653399 (+   865us) service_pool.cc:224] Handling call
0709 12:19:37.653677 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:37.705379 (+ 51702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:38.903989 (+1198610us) spinlock_profiling.cc:243] Waited 51 ms on lock 0x7b54002da854. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:38.904377 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117285248}
I20260709 12:19:38.928697 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:38.929723 22469 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 18.
I20260709 12:19:38.919478 29065 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:38.926498 28762 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.939414 28990 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.940029 28990 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.928638 28944 consensus_queue.cc:260] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:38.942251 28990 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:38.942898 28944 raft_consensus.cc:3060] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:38.944612 22402 raft_consensus.cc:1275] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:19:38.947063 22394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58054 (request call id 991) took 1306 ms. Trace:
I20260709 12:19:38.947464 22394 rpcz_store.cc:276] 0709 12:19:37.640273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.641410 (+  1137us) service_pool.cc:224] Handling call
0709 12:19:37.641663 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:38.350496 (+708833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:38.946810 (+596314us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b5400037ad4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:38.947001 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1628855168}
I20260709 12:19:38.951184 29192 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:38.946625 29067 raft_consensus.cc:515] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:38.953589 29067 leader_election.cc:290] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:38.955744 29128 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:38.935787 29180 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:38.956513 22394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52914
I20260709 12:19:38.957160 22394 raft_consensus.cc:606] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Received request to transfer leadership
I20260709 12:19:38.958544 29180 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:38.930716 29147 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:19:38.964933 29147 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.965327 29147 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:19:38.965464 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.974984 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:38.978194 29146 consensus_queue.cc:1059] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:19:38.978811 28590 consensus_queue.cc:1059] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:38.979617 29158 raft_consensus.cc:3055] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:38.979998 29158 raft_consensus.cc:740] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:38.980435 23122 raft_consensus.cc:1240] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 17 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17. Ops: [16.15-16.15]
I20260709 12:19:38.980777 29158 consensus_queue.cc:260] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:38.981439 28590 raft_consensus.cc:3055] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:38.981842 28590 raft_consensus.cc:740] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:38.982023 22366 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:38.982314 29158 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:38.982658 28590 consensus_queue.cc:260] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:38.984160 28590 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:38.978266 22477 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:38.987825 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:38.988363 22468 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:38.986977 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:19:38.993721 22368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.990514 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:38.990443 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:39.019261 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.996511 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.021162 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:39.022022 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:39.007148 22468 raft_consensus.cc:2468] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:38.990312 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:38.985036 29132 raft_consensus.cc:2749] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:39.025214 22472 raft_consensus.cc:1240] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:39.025718 22549 raft_consensus.cc:2393] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 18: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:39.026531 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:39.030902 23122 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 16: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:39.030879 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:39.034571 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:39.034922 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:38.992794 29146 raft_consensus.cc:993] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:39.036991 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:39.038049 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:39.040138 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:39.035851 23094 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:39.025249 28957 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:39.042097 28957 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:39.042807 29145 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.043385 29145 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.044432 28957 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:39.045318 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:39.046309 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:39.046505 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:39.045984 22402 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 22.
I20260709 12:19:39.051458 23128 raft_consensus.cc:2393] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 12: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:39.047556 22516 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:39.053254 28590 raft_consensus.cc:2804] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:39.050730 28957 raft_consensus.cc:1081] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:39.054208 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:39.051646 23094 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:39.055495 29202 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:39.045545 29145 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:38.993705 28601 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:39.001160 29192 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:39.042869 29038 raft_consensus.cc:2749] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:39.065443 28590 raft_consensus.cc:697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:38.992674 28817 consensus_queue.cc:1048] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 12:19:39.069680 22477 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 12.
I20260709 12:19:38.974838 28762 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.070967 28590 consensus_queue.cc:237] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.080787 29104 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:39.084328 23095 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:39.085937 22471 raft_consensus.cc:1217] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 LEADER]: Deduplicated request from leader. Original: 18.11->[19.12-22.14]   Dedup: 20.13->[22.14-22.14]
I20260709 12:19:39.086213 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.086519 22471 raft_consensus.cc:1240] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 LEADER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 22. Current term is 23. Ops: [19.12-22.14]
I20260709 12:19:39.084357 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dee89f230e46e8a6f8e492cd0ca0d4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.033980 28735 consensus_queue.cc:1059] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:19:39.090011 29165 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:39.090747 28957 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:39.093561 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.094029 29138 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:39.095000 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:38.136761 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:39.075237 29192 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.099948 29192 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:39.089588 28735 raft_consensus.cc:3055] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:39.101099 28735 raft_consensus.cc:740] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:39.102017 28735 consensus_queue.cc:260] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.103037 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.103363 28735 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:39.103824 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.105180 22550 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:39.094256 22545 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:39.106576 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.107123 22545 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:39.093744 29124 raft_consensus.cc:3055] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:39.107458 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:39.111775 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:39.112154 22543 raft_consensus.cc:1240] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:19:39.112381 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54498 (request call id 3389) took 1350 ms. Trace:
I20260709 12:19:39.112778 22547 rpcz_store.cc:276] 0709 12:19:37.761755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.763724 (+  1969us) service_pool.cc:224] Handling call
0709 12:19:37.764085 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:38.292414 (+528329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.112108 (+819694us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54001405d4. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b54e01 00007fb4f8b5383e 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6
0709 12:19:39.112297 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1143604480}
I20260709 12:19:39.114193 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.115020 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:39.115063 22547 raft_consensus.cc:2393] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 19: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:39.115899 29184 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:39.116096 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.116401 29184 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:39.116562 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.128278 22547 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 22.
I20260709 12:19:39.119186 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.130136 22550 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:39.132767 22550 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:19:39.118556 23128 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:19:39.134675 29137 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:39.135221 29137 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.137369 29137 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:39.120651 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.137887 22395 raft_consensus.cc:1275] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:19:39.125452 22551 raft_consensus.cc:1240] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:39.071233 28601 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.109048 29124 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:39.108563 22548 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
W20260709 12:19:39.142045 22515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.143687 22550 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:39.145190 22402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52914
I20260709 12:19:39.149282 22402 raft_consensus.cc:606] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Received request to transfer leadership
I20260709 12:19:39.145493 22516 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:39.141851 29158 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.152221 29124 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.152717 29158 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.153565 29124 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:39.154918 29158 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:39.155361 22475 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 26 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:19:39.151099 28601 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:39.146864 29127 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.156586 29127 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.164932 29127 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:39.160179 29143 consensus_queue.cc:1059] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:19:39.161391 22441 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:19:39.149433 22394 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:39.168002 22441 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:39.179375 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:39.180877 22394 raft_consensus.cc:2410] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 18 because replica has last-logged OpId of term: 16 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 12:19:39.190925 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.151230 29202 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:39.173735 22550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54496
I20260709 12:19:39.192288 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.192873 22550 raft_consensus.cc:493] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:39.194566 22550 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:39.185364 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:39.201599 29143 raft_consensus.cc:3055] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:19:39.202112 29143 raft_consensus.cc:740] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:39.203009 29143 consensus_queue.cc:260] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.204243 29143 raft_consensus.cc:3060] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:39.200172 22441 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:39.194306 22442 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:39.207890 22366 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:39.166600 29063 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:39.213433 22366 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:39.216086 22442 leader_election.cc:304] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:39.219409 22366 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:39.179512 29114 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:39.198366 28817 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:39.213901 29011 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:39.232030 22441 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:39.214522 28812 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:19:39.234828 29063 raft_consensus.cc:697] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:39.240171 28762 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:39.218389 28842 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:19:39.241526 22442 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:39.230175 29114 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.214545 28936 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:19:39.168793 29147 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.245941 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:39.218035 28944 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:39.248337 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:39.250392 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:39.250841 29122 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:39.224710 29116 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:39.244807 22396 raft_consensus.cc:1240] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:19:39.230895 29141 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:39.234978 29128 raft_consensus.cc:2749] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:39.206537 29172 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
W20260709 12:19:39.269999 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 50698.9us
W20260709 12:19:39.272197 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 186522us
I20260709 12:19:39.274483 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:39.294535 22366 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:39.267361 29127 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:39.282976 22477 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:19:39.298380 22542 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 20. Current term is 21. Ops: []
I20260709 12:19:39.296527 22366 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:39.302812 22366 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:39.284838 22550 raft_consensus.cc:515] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.253046 28842 consensus_queue.cc:1243] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer 8c3bcfa13ca74a24ab8999a408532932 log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:19:39.272233 29173 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:39.235109 29106 consensus_queue.cc:1059] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:19:39.283089 29146 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:39.294632 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:39.235208 28817 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:39.267769 29114 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:39.247864 29011 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.298365 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:39.279675 29132 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:39.272058 28944 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.307133 28897 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:39.309099 23125 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:19:39.248833 29134 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:39.315531 22543 raft_consensus.cc:1240] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:39.327468 29082 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.327328 29137 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.270249 28936 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.319922 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:39.267396 29145 consensus_queue.cc:1059] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:19:39.272435 28933 consensus_queue.cc:1048] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:19:39.298909 28957 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:19:39.312157 29141 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:19:39.327929 29166 consensus_queue.cc:1059] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:19:39.386988 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:19:39.343065 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 44772.4us
I20260709 12:19:39.387634 23128 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:39.315455 29158 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:39.252887 28765 consensus_queue.cc:1048] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:19:39.361940 23095 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:39.393580 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:39.334896 28817 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:39.333446 29116 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.275662 29063 consensus_queue.cc:237] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.342489 29011 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:19:39.407661 22285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 113595us
I20260709 12:19:39.383352 22550 leader_election.cc:290] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:39.412575 29212 log.cc:927] Time spent T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:19:39.413633 23128 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:39.382109 29082 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.415650 29082 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:39.394403 29119 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.416374 29119 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.418503 29119 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:39.381628 29218 consensus_queue.cc:1048] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 12:19:39.381615 29137 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.383586 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.384258 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.338433 28988 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:39.426998 29147 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:39.312031 29113 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:39.383064 22399 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 13.
I20260709 12:19:39.359234 29208 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:39.337509 29146 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.360443 28944 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:39.329522 29173 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.438128 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:39.395305 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:39.316577 22366 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:39.363806 29174 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:19:39.361325 29134 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:39.425566 29137 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:39.398773 22516 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:39.381167 28936 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:19:39.451617 29134 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:39.329691 29184 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.407102 29101 raft_consensus.cc:3055] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:19:39.393930 29214 log.cc:927] Time spent T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:19:39.363926 28897 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:39.446848 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 130368us
I20260709 12:19:39.450079 22442 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:39.398411 22401 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 15. (term mismatch)
I20260709 12:19:39.431169 29192 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:39.470937 29192 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.471396 29192 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:39.452309 29166 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:19:39.454057 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 68307.2us
W20260709 12:19:39.457919 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 59224.5us
W20260709 12:19:39.446930 29215 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:19:39.477272 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:39.430759 29116 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.466809 22366 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:39.469041 29184 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:39.470114 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:39.489440 22399 raft_consensus.cc:2393] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 15: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:39.464174 22401 pending_rounds.cc:85] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 14
I20260709 12:19:39.485946 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:39.477977 22394 raft_consensus.cc:3055] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:39.479967 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:39.480708 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.484318 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:39.476930 29128 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:39.486186 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:39.486430 28897 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:39.490733 22401 pending_rounds.cc:107] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 16.15
I20260709 12:19:39.493732 22474 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:39.495214 29128 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.504444 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:39.508730 22401 raft_consensus.cc:2889] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:39.494967 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:39.505630 29116 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:39.490650 29158 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:39.461458 29101 raft_consensus.cc:740] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:39.458948 29141 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:39.493590 23128 raft_consensus.cc:2410] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:19:39.495323 22394 raft_consensus.cc:740] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:39.510146 22472 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:39.462922 28735 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:39.526401 22474 raft_consensus.cc:2468] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 21.
I20260709 12:19:39.471208 29173 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:39.506125 28988 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:39.548053 29166 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:19:39.548287 28590 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:39.555917 28590 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:39.550395 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 83654.6us
I20260709 12:19:39.509796 29128 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:39.556778 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 68257.3us
I20260709 12:19:39.554648 22393 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:19:39.557478 22366 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:39.553349 29141 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.561936 28590 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:39.562530 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.489733 28817 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.567601 28817 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:39.573976 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:39.576797 22472 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
W20260709 12:19:39.578871 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 113942us
I20260709 12:19:39.561295 22394 consensus_queue.cc:260] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.580593 22394 raft_consensus.cc:3060] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:39.581849 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:39.569267 28936 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.583268 22515 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:39.590454 28590 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:39.590600 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.592036 22394 raft_consensus.cc:2468] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:39.499262 29192 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.594336 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:39.595201 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:39.594998 22400 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:19:39.599318 29146 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:39.587832 29166 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:39.606684 23095 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:39.610037 22545 raft_consensus.cc:1240] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:39.584558 28735 raft_consensus.cc:697] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:39.621976 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.622762 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:39.622659 22551 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:19:39.624827 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.625042 23095 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:39.558254 29101 consensus_queue.cc:260] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.630013 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:39.636292 22516 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:39.641811 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.642341 22516 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:39.595746 28897 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 12:19:39.627372 29132 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:39.629963 29232 raft_consensus.cc:2749] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:39.658677 22516 leader_election.cc:304] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:39.659288 29101 raft_consensus.cc:3060] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:39.644670 28957 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:19:39.681759 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:39.646287 29082 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:39.647801 29137 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:39.663602 29063 raft_consensus.cc:2804] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:19:39.685195 22441 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:39.685431 29234 raft_consensus.cc:2804] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:39.627394 29114 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:39.689446 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 51225.9us
I20260709 12:19:39.709057 22400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff6628c2d6a44791975f2350758cb3db"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52914
I20260709 12:19:39.709733 22400 raft_consensus.cc:606] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Received request to transfer leadership
I20260709 12:19:39.710063 22400 raft_consensus.cc:614] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:39.713061 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:39.713245 22477 raft_consensus.cc:1240] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Rejecting Update request from peer 65951063312d4a1e9123f92354101c71 for earlier term 20. Current term is 21. Ops: [19.15-20.16]
I20260709 12:19:39.701207 29122 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:39.701593 28735 consensus_queue.cc:237] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.720777 29228 raft_consensus.cc:1064] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:19:39.709295 29234 raft_consensus.cc:697] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:39.694937 29137 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.710223 29063 raft_consensus.cc:697] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:39.729166 29227 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.729703 29227 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:39.722375 29241 log.cc:927] Time spent T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:19:39.743470 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:39.744318 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.722289 28944 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.749557 28944 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:39.749845 29157 consensus_queue.cc:1059] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:39.752140 22548 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:19:39.751646 29234 consensus_queue.cc:237] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.711596 29240 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.103s
I20260709 12:19:39.753568 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:39.756141 29237 raft_consensus.cc:3055] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:19:39.756574 29237 raft_consensus.cc:740] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:19:39.760361 29223 log.cc:927] Time spent T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.308s	user 0.000s	sys 0.002s
I20260709 12:19:39.708119 29011 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.763994 22475 raft_consensus.cc:1240] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:19:39.765841 29128 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.769397 28936 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:39.768137 28957 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:19:39.770946 29137 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:39.775825 22471 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:19:39.781136 29183 raft_consensus.cc:493] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:39.790210 29174 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:39.790696 22477 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:19:39.766558 29063 consensus_queue.cc:237] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.791996 22470 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:39.802282 22469 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:39.801911 29183 raft_consensus.cc:515] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.806758 29183 leader_election.cc:290] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:39.811231 22396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 3622) took 1432 ms. Trace:
I20260709 12:19:39.811681 22396 rpcz_store.cc:276] 0709 12:19:38.378970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.381865 (+  2895us) service_pool.cc:224] Handling call
0709 12:19:39.125626 (+743761us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b5800003c98. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f58efdb1 00007fb4f5a2fb71 00007fb4f5a2fa22 00007fb4fe9488d9 00007fb4fdaa2ee0 00007fb4fdb6c0ab 00007fb4fdb6c131 00007fb4fdb2dfc0 00007fb4fdb18929 00007fb4fdb183d2 00007fb4f708fbd4
0709 12:19:39.244567 (+118941us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:39.279636 (+ 35069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.811020 (+531384us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54001e3a50. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b538ad 00007fb4fdb18419 00007fb4f708fbd4 00007fb4f708fb62 00007fb4f708fa91 00007fb4f708fa0c 00007fb4f708ecc2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:39.811165 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275617408}
I20260709 12:19:39.808871 29106 consensus_queue.cc:1059] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:19:39.810786 28768 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:19:39.814517 29187 raft_consensus.cc:3055] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:39.772536 29228 consensus_queue.cc:237] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 15, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.814980 29187 raft_consensus.cc:740] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:39.816579 29187 consensus_queue.cc:260] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.817471 29192 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:39.817862 29187 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:39.757414 29237 consensus_queue.cc:260] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.821600 29237 raft_consensus.cc:3060] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:39.821928 29128 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:39.834739 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:39.814709 29134 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.824642 28768 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 12:19:39.838102 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:39.846555 29227 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:39.856624 29138 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.858172 29184 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:39.873607 29199 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:39.872758 29138 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.880404 29138 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:39.893405 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.892179 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.899551 22551 pending_rounds.cc:85] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: Aborting all ops after (but not including) 12
I20260709 12:19:39.899927 22551 pending_rounds.cc:107] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:19:39.900188 22551 raft_consensus.cc:2889] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:39.872653 29246 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:39.908361 23127 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:39.911098 29067 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:19:39.917656 29251 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.898270 29184 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.912155 28944 raft_consensus.cc:3055] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:39.929057 29251 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.911398 29246 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:39.938271 29134 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:39.940966 22443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.941123 29184 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:39.950243 29246 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:39.941970 28944 raft_consensus.cc:740] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:39.961550 28944 consensus_queue.cc:260] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:39.987084 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:39.990067 29114 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:40.008004 22293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32988 (request call id 188) took 4093 ms. Trace:
I20260709 12:19:40.012037 29251 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:40.011562 22297 catalog_manager.cc:5697] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 12 to 15, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 15 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:40.017472 22402 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:40.019381 22549 raft_consensus.cc:1240] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:19:40.020025 22297 catalog_manager.cc:5697] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 24 to 25, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 25 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:40.021257 29141 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:40.022082 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:40.026268 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:40.027280 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:40.028400 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:40.028975 22394 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:19:40.022153 22297 catalog_manager.cc:5697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:40.024354 29011 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:40.037070 22398 raft_consensus.cc:1240] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:40.037070 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:40.038429 22397 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:40.037531 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:40.040077 22399 raft_consensus.cc:2410] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:19:40.041914 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:40.042672 22401 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:40.043743 29132 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:40.045600 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:40.047158 22395 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:19:40.048056 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:40.050101 22442 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:40.050696 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:40.051293 22393 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 26.
I20260709 12:19:40.056318 22516 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:40.060693 22398 raft_consensus.cc:1240] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:40.063143 22399 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 12:19:40.063576 22399 pending_rounds.cc:85] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 11
I20260709 12:19:40.063796 22399 pending_rounds.cc:107] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 12:19:40.064010 22399 raft_consensus.cc:2889] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:40.066598 22398 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:40.069075 22400 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 26 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:19:40.072408 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:40.073017 22549 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 19.
I20260709 12:19:40.074240 22395 raft_consensus.cc:1275] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 12:19:40.074635 22395 pending_rounds.cc:85] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Aborting all ops after (but not including) 13
I20260709 12:19:40.074888 22395 pending_rounds.cc:107] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 12:19:40.075115 22395 raft_consensus.cc:2889] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:40.008380 22293 rpcz_store.cc:276] 0709 12:19:35.915013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.915321 (+   308us) service_pool.cc:224] Handling call
0709 12:19:40.007903 (+4092582us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:36.862864 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:36.863654 (+   790us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:36.863707 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:19:36.863721 (+    14us) tablet.cc:662] Decoding operations
0709 12:19:36.881731 (+ 18010us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:36.881919 (+   188us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:36.881950 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:19:36.902710 (+ 20760us) tablet.cc:701] Row locks acquired
0709 12:19:36.902772 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:19:36.902983 (+   211us) write_op.cc:270] Start()
0709 12:19:36.903145 (+   162us) write_op.cc:276] Timestamp: P: 1783599576902907 usec, L: 0
0709 12:19:36.903174 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:19:36.903997 (+   823us) log.cc:844] Serialized 4772 byte log entry
0709 12:19:37.060771 (+156774us) op_driver.cc:464] REPLICATION: finished
0709 12:19:37.111450 (+ 50679us) write_op.cc:301] APPLY: starting
0709 12:19:37.111529 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:37.220451 (+108922us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:37.220568 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:37.386328 (+165760us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:37.386577 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 12:19:37.386620 (+    43us) write_op.cc:312] APPLY: finished
0709 12:19:37.386936 (+   316us) log.cc:844] Serialized 113 byte log entry
0709 12:19:37.387117 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:37.387285 (+   168us) write_op.cc:454] Released schema lock
0709 12:19:37.387333 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:37.387725 (+   392us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:37.387752 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":29786,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":50411,"apply.run_cpu_time_us":18160,"apply.run_wall_time_us":276254,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54407,"num_ops":12,"prepare.queue_time_us":162642,"prepare.run_cpu_time_us":5738,"prepare.run_wall_time_us":41478,"replication_time_us":157391,"thread_start_us":161048,"threads_started":2}]]}
I20260709 12:19:40.079331 22394 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 23.
I20260709 12:19:40.079883 22442 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:40.084831 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:40.069012 29067 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:40.088335 23095 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:40.087637 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:40.092460 22398 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 16.
I20260709 12:19:40.077500 28990 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:40.096552 23095 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:40.097664 22397 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:19:40.077308 28765 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 12:19:40.094394 29114 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:19:40.111127 29067 consensus_queue.cc:1048] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:40.080655 29063 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:19:40.098896 29184 consensus_queue.cc:1059] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:19:40.098975 29218 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:40.086190 29180 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:19:40.084270 29147 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:19:40.125921 28990 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:40.126403 28990 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:40.099516 29134 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:40.128742 29134 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:40.130097 23095 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:40.131065 29251 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.131222 29038 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:40.131592 29251 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:40.102389 29202 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:40.137753 29202 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:40.138582 29202 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:40.138842 22476 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:40.140506 28944 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:40.140127 28990 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:40.131606 29038 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.163542 22401 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:19:40.136436 29251 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:40.175980 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:40.176141 29114 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:40.176718 29114 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:19:40.186736 23127 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:19:40.189203 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:40.189474 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:40.189560 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:40.190162 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:40.190341 23127 raft_consensus.cc:3060] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:40.191005 22545 raft_consensus.cc:2410] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:19:40.180799 22366 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:40.192637 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f65bed92f9e64bb9955b9ba82a1645c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:40.201195 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:40.201983 22544 raft_consensus.cc:3060] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:19:40.205227 23123 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [term 21 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:19:40.207875 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:40.207916 29101 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:40.212425 29101 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:40.212822 29101 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:40.169059 29038 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:40.219054 28812 raft_consensus.cc:3055] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:40.219583 28812 raft_consensus.cc:740] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:40.220422 28812 consensus_queue.cc:260] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:40.223408 28990 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:40.225911 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:40.227664 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:40.234285 22474 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 12:19:40.237787 22442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:40.238859 22347 auto_rebalancer.cc:893] Removing replace marker failed: Replica b8621fa34be04d3fa2d68a300f858cd1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:40.239313 22347 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:19:40.239586 22347 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:19:40.242420 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:40.244104 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:40.243079 22400 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:40.243050 23128 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:19:40.246143 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:40.245527 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:40.211807 23130 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:40.238889 22442 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:40.252772 22545 raft_consensus.cc:1275] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:19:40.255411 29145 consensus_queue.cc:1059] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:40.256665 29145 raft_consensus.cc:3055] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:40.257189 29145 raft_consensus.cc:740] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:40.258170 29145 consensus_queue.cc:260] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:40.261039 22469 raft_consensus.cc:2393] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 15: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:40.263373 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:40.154541 28735 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:19:40.259397 29145 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:40.221660 28812 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:40.281284 22475 raft_consensus.cc:2393] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 19: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:40.275677 22469 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:40.275982 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:40.276638 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:40.277524 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dae2730adf94f9da39f2dffbb692494" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:40.283629 22468 raft_consensus.cc:1275] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:19:40.278527 22441 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:40.286156 23127 raft_consensus.cc:2468] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:19:40.311887 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:40.223457 29134 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:40.315285 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 76494.8us
I20260709 12:19:40.319315 29063 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:19:40.322187 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.322279 22442 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:40.324244 28762 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.324736 28762 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:40.326785 28762 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:40.327332 28762 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:40.328435 22477 raft_consensus.cc:1240] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:40.330044 22400 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:40.321060 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:40.334693 22473 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 12.
I20260709 12:19:40.335930 22400 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:40.344657 22544 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 23.
W20260709 12:19:40.353962 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 75536.8us
I20260709 12:19:40.352528 22442 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:40.346698 28765 raft_consensus.cc:2804] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:19:40.328811 29239 consensus_queue.cc:1059] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 12:19:40.313634 29065 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:19:40.338621 28762 raft_consensus.cc:697] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:40.333613 29180 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 12:19:40.371490 22442 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:40.381317 22441 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:40.388302 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:40.390825 22400 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
I20260709 12:19:40.394563 23130 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:40.407234 23128 raft_consensus.cc:1275] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 12:19:40.407598 23128 pending_rounds.cc:85] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: Aborting all ops after (but not including) 15
I20260709 12:19:40.407793 23128 pending_rounds.cc:107] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 12:19:40.407989 23128 raft_consensus.cc:2889] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:40.409986 22400 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:19:40.412349 29172 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:40.379629 29184 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:40.426208 28796 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:40.385878 29119 raft_consensus.cc:2804] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:40.424693 22442 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:40.358871 29106 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:19:40.437953 22441 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:40.427065 29172 consensus_queue.cc:1048] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:19:40.420682 29229 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:40.450409 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:40.419416 28765 raft_consensus.cc:697] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 23 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:40.450958 28842 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:19:40.455552 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.451188 28990 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:19:40.466718 28842 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.477993 28842 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:40.480310 28765 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:40.477881 28762 consensus_queue.cc:237] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:40.485905 29128 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:19:40.452872 29208 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:19:40.469010 29114 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:40.487283 29202 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:40.488669 29114 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 27 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:40.489406 29202 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:40.489691 29229 raft_consensus.cc:697] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:40.489329 22475 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 27 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 26. Current term is 27. Ops: []
I20260709 12:19:40.494059 23122 raft_consensus.cc:1240] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:40.494776 22474 raft_consensus.cc:2410] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:19:40.475533 29011 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:19:40.494587 29038 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:40.454200 29119 raft_consensus.cc:697] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:40.440022 29101 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:40.511291 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:40.514919 22394 raft_consensus.cc:1240] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:19:40.515594 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:40.484318 22441 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:40.533069 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 48880.8us
I20260709 12:19:40.521337 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:40.542737 23095 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:40.544979 29232 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:40.564824 22441 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:40.568459 22441 leader_election.cc:304] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:40.569676 23122 raft_consensus.cc:1240] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:19:40.532410 29218 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:40.552538 28796 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:19:40.572958 29184 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:19:40.580447 28812 raft_consensus.cc:2749] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:40.580921 28936 consensus_queue.cc:1048] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:19:40.581866 29145 consensus_queue.cc:1059] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:40.552492 29082 consensus_queue.cc:1059] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:19:40.573792 29101 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:40.574149 29119 consensus_queue.cc:237] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:40.593973 22475 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:40.595752 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:40.592554 29065 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.598616 29082 raft_consensus.cc:3055] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:40.623260 23127 raft_consensus.cc:1240] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:40.574832 29240 raft_consensus.cc:3055] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:40.570624 29122 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:40.627060 22544 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 19.
I20260709 12:19:40.635140 22366 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:40.568611 29180 consensus_queue.cc:1059] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 12:19:40.617859 28768 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.609505 29229 consensus_queue.cc:237] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:40.631927 29240 raft_consensus.cc:740] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:40.663100 29240 consensus_queue.cc:260] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:40.664609 29240 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:40.618131 29082 raft_consensus.cc:740] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:40.669548 29082 consensus_queue.cc:260] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:40.670790 29082 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:40.673919 28768 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:40.676368 28768 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:40.629720 29172 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:40.677531 29172 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:40.679735 29172 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:40.634440 29106 consensus_queue.cc:1059] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 12:19:40.682199 29038 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:40.683077 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:40.585336 29147 consensus_queue.cc:1059] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:19:40.708220 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:40.721695 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:40.722886 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:40.724180 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:40.593077 29218 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:40.732563 23094 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:40.723616 22400 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
I20260709 12:19:40.649148 29239 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:40.629858 29065 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:40.747038 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:40.705740 29101 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.756752 29101 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:40.755165 29239 raft_consensus.cc:697] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 19 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:40.759004 29101 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:40.759380 29239 consensus_queue.cc:237] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:40.760224 28842 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:40.761991 29063 raft_consensus.cc:3055] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:40.763172 29218 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:40.763952 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:40.764487 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:40.752177 29037 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:40.776906 22542 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:19:40.748382 29187 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:19:40.776504 22400 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 14.
I20260709 12:19:40.765059 28735 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.780100 23095 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:40.775281 29063 raft_consensus.cc:740] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:40.793625 22475 raft_consensus.cc:2393] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 20: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:40.785701 29218 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:40.795742 29229 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:40.784152 28735 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:40.802457 29218 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:40.822474 29231 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.840204 29218 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:40.873965 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:40.874591 22395 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:19:40.876184 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 154814us
I20260709 12:19:40.876425 28590 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:19:40.836700 29229 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:40.877174 28590 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:40.879354 28590 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:40.880539 28590 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:19:40.885906 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:40.886564 22544 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:40.887934 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:40.892030 28842 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:40.893784 29065 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:40.835055 29063 consensus_queue.cc:260] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:40.895278 29063 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:40.899048 29229 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:40.868095 29231 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:40.899703 22395 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 20.
I20260709 12:19:40.900915 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:40.891507 22366 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:40.901584 23128 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:40.904011 22515 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:40.907150 22400 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:40.907790 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:40.906260 29286 log.cc:927] Time spent T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:19:40.910121 28735 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:40.905944 29287 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:19:40.914737 28590 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:19:40.904891 29240 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:40.942726 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:40.915069 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
W20260709 12:19:40.917513 29280 log.cc:927] Time spent T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.160s	user 0.002s	sys 0.000s
W20260709 12:19:40.924021 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 343844us
I20260709 12:19:40.927382 22442 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:40.907742 29172 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:40.937282 29208 raft_consensus.cc:3055] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:40.939704 22396 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:19:40.945894 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:40.946696 28590 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:40.949088 28590 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.938639 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:40.949460 28590 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:40.949793 22395 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:19:40.919873 29218 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:40.950083 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:40.949105 23128 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
I20260709 12:19:40.943852 29240 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.953543 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:40.956105 22366 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:40.945873 29231 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:40.963346 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:40.967789 22442 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:40.954705 29128 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:19:40.969185 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:40.973073 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:40.964148 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:40.948134 29172 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.971764 22367 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:40.948009 29208 raft_consensus.cc:740] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:40.980758 29231 raft_consensus.cc:3060] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:40.983878 23129 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:40.984874 23095 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:41.011904 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:41.012615 22470 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:40.985437 29251 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:41.012110 29037 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:41.013633 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:40.979714 28590 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:41.015647 29251 consensus_queue.cc:1048] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:41.017163 22545 raft_consensus.cc:2393] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 20: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:41.017679 28590 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:41.018169 23095 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:41.019546 29202 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:19:41.021710 23095 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:40.964282 29240 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:41.033991 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:41.032573 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:41.036015 22473 raft_consensus.cc:2393] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 15: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:40.990016 28765 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:41.032706 22441 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:40.971115 29101 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:40.977596 29172 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:41.044768 22470 raft_consensus.cc:2393] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 19: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:19:41.053450 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 81753.5us
I20260709 12:19:40.967520 29119 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 12:19:41.051641 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:41.055282 22475 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:41.056226 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:19:41.057363 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 48046.1us
I20260709 12:19:41.059460 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:41.030519 29128 raft_consensus.cc:697] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:41.062250 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:41.069788 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:41.044243 29101 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.040603 28765 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:41.074656 22547 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:19:41.075431 22548 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 17: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:41.076150 22367 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:41.076556 22396 raft_consensus.cc:2393] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 20: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:41.087177 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:41.061115 29292 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:41.068617 29063 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:41.074321 29232 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:41.105401 22400 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:19:41.084249 29101 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:41.086648 28765 raft_consensus.cc:3060] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:41.072532 29145 consensus_queue.cc:1059] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:19:41.103070 29063 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:41.128961 29295 log.cc:927] Time spent T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:19:41.142807 29288 log.cc:927] Time spent T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.307s	user 0.003s	sys 0.000s
I20260709 12:19:41.154707 23129 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 12:19:41.144150 29294 log.cc:927] Time spent T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:19:41.145134 29063 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:41.067526 29208 consensus_queue.cc:260] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:41.144843 29128 consensus_queue.cc:237] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:41.187155 29302 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:19:41.216492 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 194992us
I20260709 12:19:41.217505 23095 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:41.222892 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:41.175082 29306 consensus_queue.cc:1059] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 12:19:41.220803 29308 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:41.225986 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
W20260709 12:19:41.226562 29305 log.cc:927] Time spent T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:19:41.226150 29308 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:41.227744 29308 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:41.232600 29293 log.cc:927] Time spent T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 12:19:41.237434 29208 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:41.238898 29308 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:41.243064 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:41.245648 29227 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.248128 29218 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:41.226820 22475 raft_consensus.cc:2393] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 in current term 15: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:41.265247 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:41.289149 22551 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 27.
I20260709 12:19:41.267132 29067 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:19:41.342891 22549 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
W20260709 12:19:41.274864 29082 consensus_meta.cc:287] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.604s	user 0.013s	sys 0.000s
I20260709 12:19:41.351329 29184 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:41.328943 29202 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.358428 29202 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:41.267556 29227 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:41.372344 22544 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
W20260709 12:19:41.364665 29304 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.154s	user 0.001s	sys 0.001s
W20260709 12:19:41.410704 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 58444.5us
I20260709 12:19:41.415186 29063 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:41.430604 22441 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:41.434693 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 88917.2us
I20260709 12:19:41.453368 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:41.454418 22402 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 14.
I20260709 12:19:41.447189 28812 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:19:41.447523 29202 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:41.476063 22551 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:19:41.476217 28812 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 27 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:41.529939 29312 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.527247 29011 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:41.553791 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 111997us
I20260709 12:19:41.537352 29308 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:41.562798 29101 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:41.565315 29231 consensus_meta.cc:287] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.000s
I20260709 12:19:41.565734 28812 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:41.545610 28765 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:41.565387 29101 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:41.570441 29101 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:41.570930 29101 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:41.573314 29231 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:41.573196 29240 consensus_meta.cc:287] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.529s	user 0.002s	sys 0.006s
I20260709 12:19:41.586225 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
W20260709 12:19:41.607175 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 166239us
I20260709 12:19:41.619174 22394 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:19:41.573186 29101 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:41.557139 29011 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:41.618474 29172 consensus_meta.cc:287] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.003s
I20260709 12:19:41.613164 29065 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.555646 29312 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:41.618206 28735 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:19:41.627635 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 153754us
I20260709 12:19:41.630501 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:41.630752 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:41.631430 23127 raft_consensus.cc:1240] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Rejecting Update request from peer 8c3bcfa13ca74a24ab8999a408532932 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:41.612535 29240 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:41.624053 29328 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:41.655435 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:41.629886 29323 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:41.663409 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:41.664760 29101 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:19:41.661401 29011 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:41.625907 29172 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:41.671705 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:41.673303 22542 raft_consensus.cc:2393] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 19: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:41.673805 22395 raft_consensus.cc:2393] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 18: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:41.681363 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:41.682242 22544 raft_consensus.cc:2393] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 18: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:41.685302 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:41.685958 23127 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:41.669677 28768 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.677984 29323 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:41.689370 29172 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:41.690908 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:41.630193 29065 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:41.691196 29312 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:41.669759 29240 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:41.695220 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:41.701884 28768 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:41.703423 29322 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:41.665544 29330 consensus_queue.cc:1059] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:19:41.684736 29331 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:41.663758 29328 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:41.636816 28735 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:41.721675 28735 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:41.715435 23127 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 19.
I20260709 12:19:41.723711 28768 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:41.728508 22366 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:41.728624 22544 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:19:41.731593 29240 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:41.732218 29240 raft_consensus.cc:697] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:41.733245 29240 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:41.749356 29227 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:41.753276 29328 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:41.756193 28762 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:41.757287 28590 raft_consensus.cc:3055] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:41.757696 28590 raft_consensus.cc:740] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:41.758589 28590 consensus_queue.cc:260] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:41.759779 28590 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:41.719312 29331 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.762217 29331 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:41.762835 28765 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:41.763734 28765 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:41.764218 28765 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:41.729177 29322 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:41.770519 29322 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:41.775097 28765 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:41.782251 23129 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:41.783874 29310 raft_consensus.cc:3055] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:41.784359 29310 raft_consensus.cc:740] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:41.786473 28990 raft_consensus.cc:2955] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 LEADER]: Committing config change with OpId 21.17: config changed from index 14 to 17, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:41.790390 29312 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.790966 29312 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:41.793218 29312 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:41.796000 28936 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:41.796196 29011 raft_consensus.cc:493] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:41.796802 29011 raft_consensus.cc:515] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:41.797313 29302 raft_consensus.cc:3055] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:41.796058 29122 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:41.798341 29122 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:41.805092 29011 leader_election.cc:290] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:41.807689 29323 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:41.805794 29302 raft_consensus.cc:740] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:41.808980 29302 consensus_queue.cc:260] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:41.810292 29302 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:41.810961 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:41.811666 22546 raft_consensus.cc:2393] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 17: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:41.810377 22550 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:19:41.813122 22546 raft_consensus.cc:2955] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Committing config change with OpId 21.17: config changed from index 14 to 17, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:41.731835 29300 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.603s	user 0.003s	sys 0.009s
I20260709 12:19:41.819418 29165 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:41.819969 29165 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:41.785243 29310 consensus_queue.cc:260] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:41.822039 29165 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:41.811738 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:41.800433 29122 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:41.826445 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:41.827109 23127 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 19.
I20260709 12:19:41.828346 29331 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:41.829612 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:41.830739 29065 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:41.832253 29122 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:41.841032 22475 raft_consensus.cc:1240] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:41.841354 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:41.842175 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:41.842783 22470 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:41.842492 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:41.852777 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:41.854038 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:41.855331 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:41.856140 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:41.836582 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:41.856034 22473 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
I20260709 12:19:41.859179 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:41.858904 22395 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:19:41.835692 22477 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:19:41.859175 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:41.860394 23095 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:41.796715 28936 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:41.871450 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:41.865693 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:41.871027 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:41.878827 22397 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:41.877734 22401 raft_consensus.cc:2468] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:19:41.889003 22399 raft_consensus.cc:1275] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:41.889991 22470 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
I20260709 12:19:41.892378 23095 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:41.890162 22366 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:41.894210 22366 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:41.894948 23128 raft_consensus.cc:1240] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:19:41.896582 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:41.900785 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59a53e40d134aaa9cfbc682ee81be3e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:41.901417 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:41.901552 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:41.902545 23127 raft_consensus.cc:2393] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 19: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
W20260709 12:19:41.903743 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.910838 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:41.911676 22475 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
I20260709 12:19:41.886677 29232 raft_consensus.cc:2804] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:41.919297 23129 raft_consensus.cc:2955] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Committing config change with OpId 21.17: config changed from index 14 to 17, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:41.907176 29312 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:41.958236 22442 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:41.900717 29284 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.916249 29326 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:41.956439 28944 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.956139 29311 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:41.947911 29313 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:41.930619 29011 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.077s
I20260709 12:19:41.983312 29312 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.930374 29321 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.094s
I20260709 12:19:41.994146 29326 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.992893 29232 raft_consensus.cc:697] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:42.006477 29227 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:42.037947 29331 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:42.038488 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 143481us
I20260709 12:19:41.993271 29284 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:42.044502 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:42.017683 29119 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:19:42.014863 29312 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:42.001924 28944 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:42.041450 29128 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.056201 29128 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:42.058485 29128 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:42.015110 29326 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:19:42.048347 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 90194.9us
I20260709 12:19:42.054352 28936 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:42.044024 28765 raft_consensus.cc:493] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:42.063946 22442 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:42.069121 29232 consensus_queue.cc:237] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:42.076539 29310 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:42.078903 29063 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:42.091533 29284 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:42.092163 29339 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.050s	user 0.001s	sys 0.001s
I20260709 12:19:42.092844 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:42.100993 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:42.101691 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:42.103001 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:42.103320 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:42.103999 22472 raft_consensus.cc:2410] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:19:42.104298 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:42.103045 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:42.108320 22367 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:42.106796 22442 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:42.110082 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:42.110826 22399 raft_consensus.cc:2410] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:19:42.111440 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:42.112169 22393 raft_consensus.cc:2393] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 15: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:42.109705 22471 raft_consensus.cc:2393] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 19: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:42.117959 22402 raft_consensus.cc:2393] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 18: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:42.067188 29302 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.119167 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:42.113453 29229 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:42.121857 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:42.045132 29313 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:42.128747 22367 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:42.131157 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:42.132125 22475 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:42.123255 22441 leader_election.cc:304] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:42.123282 22471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
W20260709 12:19:42.112883 29335 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:19:42.124737 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:42.113610 29239 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:42.091612 28944 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:42.138134 22471 raft_consensus.cc:606] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:42.154249 22471 raft_consensus.cc:614] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:42.065518 28765 raft_consensus.cc:515] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:42.118602 29347 raft_consensus.cc:2804] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:42.113618 29145 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:19:42.144671 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:42.126662 22393 raft_consensus.cc:2955] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Committing config change with OpId 21.17: config changed from index 14 to 17, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:42.146749 22474 raft_consensus.cc:2393] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 18: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:42.120834 22516 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:42.156179 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:42.141490 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:42.178433 22401 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:42.127687 29229 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.190654 29229 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:42.152894 29332 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:42.128103 29302 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:42.193830 22400 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
I20260709 12:19:42.174371 28590 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:42.194425 28590 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:42.179819 22442 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:42.194991 29302 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:42.199110 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 75914.9us
I20260709 12:19:42.137426 29231 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:42.208071 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:42.187286 28765 leader_election.cc:290] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:42.118891 29284 consensus_queue.cc:1048] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:19:42.213578 22543 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 18.
I20260709 12:19:42.221511 22366 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:42.223445 28590 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:42.217255 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 96487.2us
I20260709 12:19:42.240947 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:42.245285 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 45425.6us
I20260709 12:19:42.215914 29011 raft_consensus.cc:2749] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:19:42.257268 22397 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:19:42.254055 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:42.218119 29347 raft_consensus.cc:697] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:42.229211 29292 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:42.232156 29299 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:19:42.273944 28590 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:42.261474 29302 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:42.253187 29231 raft_consensus.cc:697] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:42.288430 22398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:19:42.265985 29292 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.284371 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:42.289178 22398 raft_consensus.cc:606] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:42.295249 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:42.297398 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.301878 22543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:42.302932 22543 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:42.304926 22366 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:42.282806 29345 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.289072 29302 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.311455 28842 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.293776 29292 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:42.285212 28936 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.307758 29322 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:42.333639 22543 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:19:42.335889 22397 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 27 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:19:42.310864 29239 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:42.314100 29298 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:19:42.328210 29302 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:42.337563 29322 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:42.339661 29239 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:42.338200 28936 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:42.364867 29298 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:42.366014 28936 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:42.355512 29322 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:42.350975 29313 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:42.344527 29227 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 12:19:42.330739 28842 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:42.348814 29323 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
W20260709 12:19:42.388952 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 140727us
I20260709 12:19:42.389576 23095 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:42.390913 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:42.392912 23095 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:42.328030 29345 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:42.368034 29239 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:42.396881 29151 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:42.393936 29327 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.394224 29037 raft_consensus.cc:2749] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:42.346458 29231 consensus_queue.cc:237] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:42.412878 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:42.419442 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:42.422417 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:42.423177 22551 raft_consensus.cc:2410] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:19:42.341079 29347 consensus_queue.cc:237] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:42.365679 29298 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:42.427896 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:42.428577 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:42.429354 22544 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 27 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:19:42.422010 29327 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:42.434959 29327 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:42.445426 29345 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:42.417796 29364 consensus_queue.cc:1059] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:19:42.451282 29298 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:42.452385 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:42.453039 22542 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 27.
I20260709 12:19:42.393922 29326 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:42.455504 22395 raft_consensus.cc:2368] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 19. Current term is 20.
I20260709 12:19:42.457396 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:42.458786 22366 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:19:42.470875 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 55991.8us
I20260709 12:19:42.472316 29327 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:19:42.472869 29327 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.473301 29327 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:19:42.463204 29240 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:42.476661 29240 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:42.479825 23128 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:19:42.482224 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:42.484365 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:42.497355 23128 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 17: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:42.503470 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:42.472987 29326 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:42.465401 29306 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:42.505223 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:42.507603 22476 raft_consensus.cc:1240] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:42.469640 29187 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:42.514242 22474 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 19.
I20260709 12:19:42.514467 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:42.515130 23127 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:42.516654 29187 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:42.518838 29187 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:42.519497 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:42.521951 29240 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:42.527890 28842 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:42.533896 29306 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:42.536274 29306 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:42.538257 29128 raft_consensus.cc:3055] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:42.538757 29128 raft_consensus.cc:740] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:42.539526 29128 consensus_queue.cc:260] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:42.540940 29128 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:42.543058 22442 leader_election.cc:400] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 19. Current term is 20.
I20260709 12:19:42.543421 22442 leader_election.cc:403] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:42.545595 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:42.548453 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:42.545511 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:42.547605 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2
I20260709 12:19:42.551211 22441 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:42.560237 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:42.560916 22545 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 16.
I20260709 12:19:42.565291 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:42.570039 29348 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:42.572290 29327 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:42.566742 29229 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:42.579936 29229 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:42.580700 22472 raft_consensus.cc:2393] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 16: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
W20260709 12:19:42.581001 29312 consensus_meta.cc:287] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.001s
I20260709 12:19:42.581465 29312 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:42.582715 22396 raft_consensus.cc:2393] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 16: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:42.583660 29312 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:42.501784 29323 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.064s
I20260709 12:19:42.500026 29302 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:42.589257 29323 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:42.593875 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:42.598114 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 55203.4us
I20260709 12:19:42.597193 23127 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 20.
I20260709 12:19:42.611160 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:42.562799 29299 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:42.612027 22398 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:19:42.607594 22515 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:42.614640 22473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b42c69680a57493c942307ff09185b72"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:42.620106 22473 raft_consensus.cc:606] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:42.620488 22473 raft_consensus.cc:614] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:42.621636 22474 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:42.623675 29327 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 28 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:42.624769 22399 raft_consensus.cc:1240] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 28 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 27. Current term is 28. Ops: [27.16-27.16]
I20260709 12:19:42.589394 29302 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:42.556833 29322 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:42.630098 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:42.631094 22395 raft_consensus.cc:2410] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:19:42.629952 28590 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:42.634097 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:42.614542 29344 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:19:42.640988 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 45123.8us
I20260709 12:19:42.640028 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:42.640735 22398 raft_consensus.cc:2393] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 16: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:42.644016 22544 raft_consensus.cc:2410] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:19:42.589856 29323 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:42.646514 22551 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:42.627530 29299 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:42.653529 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:42.653990 22441 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:42.656463 22542 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:19:42.634433 29359 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:19:42.660405 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:42.661095 22550 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:42.658325 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:42.663144 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:42.648173 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:42.666378 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:19:42.657011 29365 log.cc:927] Time spent T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:19:42.652732 29299 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:42.667766 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:42.667651 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:42.669497 22442 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:42.671546 29119 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:42.675740 29302 raft_consensus.cc:993] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:42.676254 29302 raft_consensus.cc:1081] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:42.676909 29348 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:42.677336 29348 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.678530 29360 consensus_queue.cc:1059] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:19:42.679894 29360 raft_consensus.cc:3055] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:19:42.680249 29360 raft_consensus.cc:740] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:42.681021 29360 consensus_queue.cc:260] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:42.683341 22441 leader_election.cc:304] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:42.672716 22546 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:19:42.646222 29038 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:19:42.677667 29348 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:42.684268 29011 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:42.702138 22544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54496
I20260709 12:19:42.703188 22544 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:42.703670 22544 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:42.706126 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:19:42.708540 22440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:42.732455 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 149036us
I20260709 12:19:42.732873 22550 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
I20260709 12:19:42.735100 22546 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 28.
I20260709 12:19:42.712391 22366 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:42.753553 22367 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
W20260709 12:19:42.740134 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 56421.9us
W20260709 12:19:42.740698 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 57442.2us
I20260709 12:19:42.687204 29101 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:42.743302 22542 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:19:42.756886 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 44577.9us
I20260709 12:19:42.751049 23094 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:42.757962 22366 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:42.738440 29332 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:42.768013 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:42.740689 29360 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:19:42.768332 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:42.772861 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:42.775512 22393 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:42.745039 29357 raft_consensus.cc:2749] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:19:42.782420 22393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:42.775079 22515 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:42.785660 22393 raft_consensus.cc:2393] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 15: Already voted for candidate b8621fa34be04d3fa2d68a300f858cd1 in this term.
I20260709 12:19:42.786904 22515 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:42.784040 22366 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:42.777259 22544 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:42.784312 22401 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:19:42.773730 22398 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:19:42.791682 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:19:42.797868 22544 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:42.788368 28944 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:42.765865 29325 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:19:42.765245 29326 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:42.819211 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:42.780484 29251 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:42.787528 29101 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:42.768405 29231 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:42.819909 22544 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 16.
W20260709 12:19:42.811167 29368 log.cc:927] Time spent T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:19:42.792986 29240 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.765293 29239 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:42.765359 29292 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:42.803694 29332 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:19:42.811689 29063 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:42.799484 29065 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:42.836853 29239 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:42.836709 22441 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:42.830385 28762 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.854279 28762 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:42.856635 28762 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:42.828190 29325 raft_consensus.cc:697] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:42.857921 29325 consensus_queue.cc:237] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:42.821540 29251 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.859536 29251 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:42.822763 29326 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:42.799654 29202 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:19:42.864326 22297 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50166 (request call id 334) took 10703 ms. Trace:
I20260709 12:19:42.831452 29322 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:42.831313 29231 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:42.870255 29231 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:42.832916 29240 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:42.832940 29127 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:19:42.873498 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:42.874437 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:42.896224 29359 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 19. Current term is 20.
I20260709 12:19:42.867400 29323 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:42.910873 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:42.911106 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:42.911835 23128 raft_consensus.cc:2393] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 17: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:42.918113 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:42.928036 29326 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:42.930848 29292 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:42.931651 29180 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.932184 29180 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:42.934999 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 98368.6us
I20260709 12:19:42.936115 22441 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:42.936160 29011 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:42.937923 29011 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:42.935024 29134 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:42.939770 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:42.940412 22399 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
I20260709 12:19:42.948323 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:42.953066 22442 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:42.960566 22551 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:42.965845 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:42.966502 22394 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:42.951349 22298 catalog_manager.cc:5697] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 14 to 16, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 16 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:42.968736 22298 catalog_manager.cc:5697] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:42.970436 22298 catalog_manager.cc:5697] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 18 to 21, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 21 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:42.972126 22298 catalog_manager.cc:5697] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 17 to 21, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 21 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:42.973959 22298 catalog_manager.cc:5697] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 20 to 22, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 22 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:42.980598 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:42.975322 22298 catalog_manager.cc:5697] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 16 to 18, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 18 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:42.991549 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:42.987659 22298 catalog_manager.cc:5697] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 20 to 22, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 22 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:42.996968 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:42.997664 22550 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:42.915170 29251 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:43.009687 22550 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:19:42.996359 22298 catalog_manager.cc:5697] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 18 to 21, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 21 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:43.012404 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:43.013051 23129 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:19:42.867322 29037 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.131s
I20260709 12:19:42.980598 29134 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:43.042044 29134 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.042447 29134 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:19:43.031975 29350 log.cc:927] Time spent T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.290s	user 0.000s	sys 0.004s
I20260709 12:19:43.034708 29332 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 28 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:43.037138 22515 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:42.999429 29065 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.056905 23130 raft_consensus.cc:2368] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17.
I20260709 12:19:43.057076 29065 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:43.059921 29065 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:43.039924 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:43.037751 22366 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:43.062225 22366 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:43.063251 29302 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:43.063603 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:43.064852 29326 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:43.065364 29326 raft_consensus.cc:697] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:43.055083 22400 raft_consensus.cc:1275] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:19:43.067277 29326 consensus_queue.cc:237] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:43.063421 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:43.071832 29239 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:43.062255 29332 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:42.864763 22297 rpcz_store.cc:276] 0709 12:19:32.161339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.161495 (+   156us) service_pool.cc:224] Handling call
0709 12:19:42.864241 (+10702746us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:40.191848 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:40.351477 (+159629us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:40.353399 (+  1922us) write_op.cc:435] Acquired schema lock
0709 12:19:40.356725 (+  3326us) tablet.cc:662] Decoding operations
0709 12:19:40.474482 (+117757us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:40.474560 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:40.474586 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:19:40.474919 (+   333us) tablet.cc:701] Row locks acquired
0709 12:19:40.474936 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:19:40.475085 (+   149us) write_op.cc:270] Start()
0709 12:19:40.475213 (+   128us) write_op.cc:276] Timestamp: P: 1783599580475036 usec, L: 0
0709 12:19:40.475234 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:19:40.509563 (+ 34329us) log.cc:844] Serialized 1308 byte log entry
0709 12:19:41.114618 (+605055us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b540038b154. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b4fe28 00007fb4fc58a581 00007fb4fc589d58 00007fb4fc58e9f1 00007fb4fc58e9a9 00007fb4fc58e939 00007fb4fc58e901 00007fb4fc58db2d 0000000000388634 0000000000388479
0709 12:19:41.252185 (+137567us) op_driver.cc:464] REPLICATION: finished
0709 12:19:41.469037 (+216852us) write_op.cc:301] APPLY: starting
0709 12:19:41.475562 (+  6525us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:41.560671 (+ 85109us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:41.560694 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:41.683149 (+122455us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:41.704884 (+ 21735us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:19:41.704935 (+    51us) write_op.cc:312] APPLY: finished
0709 12:19:41.705186 (+   251us) log.cc:844] Serialized 41 byte log entry
0709 12:19:41.705366 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:41.705461 (+    95us) write_op.cc:454] Released schema lock
0709 12:19:41.705508 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:41.706041 (+   533us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:41.706070 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1097638,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":196965,"apply.run_cpu_time_us":7411,"apply.run_wall_time_us":243512,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16697,"num_ops":3,"prepare.queue_time_us":85064,"prepare.run_cpu_time_us":32241,"prepare.run_wall_time_us":926873,"raft.queue_time_us":242025,"raft.run_cpu_time_us":19328,"raft.run_wall_time_us":230201,"replication_time_us":736533,"spinlock_wait_cycles":77393792,"thread_start_us":639512,"threads_started":4,"wal-append.queue_time_us":334826,"wal-append.run_cpu_time_us":29811,"wal-append.run_wall_time_us":1843453}]]}
I20260709 12:19:43.012971 22298 catalog_manager.cc:5697] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 13 to 16, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 16 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:43.083976 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:43.085603 22548 raft_consensus.cc:1240] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Rejecting Update request from peer b8621fa34be04d3fa2d68a300f858cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:43.087406 22544 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:19:43.090005 22366 leader_election.cc:400] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17.
I20260709 12:19:43.090161 22298 catalog_manager.cc:5697] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:43.089396 29322 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:43.003966 29180 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:43.052816 29240 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:43.063652 29302 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:43.106156 29037 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.106318 29378 consensus_queue.cc:1059] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:43.106932 29348 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:43.112506 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 56365.1us
I20260709 12:19:43.055932 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:43.124410 29037 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:43.124336 29240 raft_consensus.cc:3055] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:43.105463 22298 catalog_manager.cc:5697] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 15 to 17, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 17 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:43.121704 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:43.101176 29322 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.130340 29240 raft_consensus.cc:740] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:43.148438 29381 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:19:43.159061 28762 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:43.142405 29322 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:43.159142 29348 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:43.025473 22394 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:19:43.117748 29302 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:43.208293 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 89511.5us
I20260709 12:19:43.212678 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:43.216665 22398 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:43.211217 22442 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:43.219201 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:43.137465 22298 catalog_manager.cc:5697] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:43.220757 22298 catalog_manager.cc:5697] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 12 to 14, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 14 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:43.222699 22298 catalog_manager.cc:5697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 17 to 19, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 19 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:43.161998 29239 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:43.234799 22474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:43.235443 22474 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:43.236335 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:43.237049 22468 raft_consensus.cc:2368] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16.
I20260709 12:19:43.238099 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:43.259099 28842 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:43.259733 28842 raft_consensus.cc:697] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:43.260603 28842 consensus_queue.cc:237] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:43.262125 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:43.262514 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:43.263124 22475 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:43.230322 29284 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:43.264340 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:43.269263 29187 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:43.269999 29251 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:43.270687 29297 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:43.287245 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:43.261919 29229 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:43.275429 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:43.304996 22472 raft_consensus.cc:2393] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 16: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:43.273571 22470 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:19:43.198518 29101 raft_consensus.cc:697] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:43.274520 22516 leader_election.cc:400] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16.
I20260709 12:19:43.277369 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:43.282660 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:43.307680 22476 raft_consensus.cc:2468] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:43.307209 22516 leader_election.cc:403] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:19:43.295809 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:43.309062 22546 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:43.271195 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:43.302347 22400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:43.285465 22398 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:19:43.269933 29180 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:43.319233 28590 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 15. Current term is 16.
W20260709 12:19:43.318984 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 44610us
I20260709 12:19:43.329895 22546 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
I20260709 12:19:43.336045 22474 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
I20260709 12:19:43.331405 23094 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:43.341952 22468 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 20.
I20260709 12:19:43.264492 29284 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:43.367611 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:43.368111 22543 raft_consensus.cc:1275] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:19:43.352828 22516 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:43.375464 28590 raft_consensus.cc:2804] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:43.375988 28590 raft_consensus.cc:697] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:43.302275 29187 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:43.307163 29297 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:43.360284 22442 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:43.378314 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:43.307628 29240 consensus_queue.cc:260] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:43.386883 29165 raft_consensus.cc:2804] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:43.327996 29229 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:43.397686 22475 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 20.
I20260709 12:19:43.451004 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:43.455062 22401 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
I20260709 12:19:43.429322 28590 consensus_queue.cc:237] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:43.457217 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:43.459013 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:43.440836 22544 raft_consensus.cc:3060] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:19:43.447978 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:43.441035 22397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
W20260709 12:19:43.462103 22366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.446517 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:43.463338 22542 raft_consensus.cc:2410] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65951063312d4a1e9123f92354101c71 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:19:43.465994 22395 raft_consensus.cc:2368] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 16. Current term is 17.
W20260709 12:19:43.420118 29360 consensus_meta.cc:287] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.000s
W20260709 12:19:43.419283 29299 consensus_meta.cc:287] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.732s	user 0.007s	sys 0.011s
I20260709 12:19:43.482417 22367 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:43.491781 23094 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:43.495400 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:43.501546 22544 raft_consensus.cc:2468] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:19:43.408223 29284 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:43.420176 29359 raft_consensus.cc:2804] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:43.506817 22469 raft_consensus.cc:2410] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for term 28 because replica has last-logged OpId of term: 27 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 15.
I20260709 12:19:43.518323 29151 raft_consensus.cc:2749] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:43.412485 29037 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:43.409198 29229 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:43.414949 29165 raft_consensus.cc:697] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 17 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:43.438850 29297 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:43.435724 29187 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:43.530604 22551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.018s	sys 0.023s
W20260709 12:19:43.543267 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 47955.1us
I20260709 12:19:43.548362 22516 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:43.544440 29379 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:43.412190 29322 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:43.403270 29134 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:43.525804 29383 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:43.401403 29101 consensus_queue.cc:237] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:43.486696 29302 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:43.570966 23129 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:19:43.525449 29299 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:43.551563 29379 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:43.558202 29187 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:43.506979 29325 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:19:43.585211 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:43.589955 29011 consensus_queue.cc:1048] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:43.591770 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:43.592530 22475 raft_consensus.cc:2368] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 19. Current term is 20.
I20260709 12:19:43.600641 29127 raft_consensus.cc:493] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:43.601233 29127 raft_consensus.cc:515] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:43.583176 29310 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 12:19:43.603364 29127 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:43.610991 29134 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:43.611570 22549 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:43.614032 29322 leader_election.cc:290] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:43.618160 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:43.618940 22396 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:43.566293 29359 raft_consensus.cc:697] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:43.633751 22394 raft_consensus.cc:3060] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:43.567637 29165 consensus_queue.cc:237] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:43.581297 29379 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:19:43.645267 29396 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.115s	user 0.001s	sys 0.001s
I20260709 12:19:43.632627 29037 raft_consensus.cc:2955] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:43.648542 29359 consensus_queue.cc:237] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:43.611308 29299 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:43.659942 23122 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:19:43.655696 22549 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 20.
W20260709 12:19:43.679486 29397 log.cc:927] Time spent T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:19:43.681681 29302 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:43.682854 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:43.683598 22551 raft_consensus.cc:2368] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17.
I20260709 12:19:43.686367 22551 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 28 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:19:43.673743 22394 raft_consensus.cc:2468] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
I20260709 12:19:43.688872 22366 leader_election.cc:400] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17.
I20260709 12:19:43.689328 22366 leader_election.cc:403] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:19:43.676359 22396 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 20.
I20260709 12:19:43.688580 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:19:43.690840 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 160564us
I20260709 12:19:43.695696 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:43.696468 23122 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:43.698088 22442 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:43.688758 29383 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:43.708225 22544 raft_consensus.cc:2955] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:43.708122 29119 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:19:43.677341 29325 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.041s
W20260709 12:19:43.731175 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 149619us
I20260709 12:19:43.731848 29119 raft_consensus.cc:697] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:43.721582 29302 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) with higher term. Message: Invalid argument: T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 16. Current term is 17.
I20260709 12:19:43.735565 29119 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:43.741039 23122 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:43.751278 22515 leader_election.cc:304] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:43.752112 28590 raft_consensus.cc:2804] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:43.752681 28590 raft_consensus.cc:697] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:43.753646 28590 consensus_queue.cc:237] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:43.755064 22397 raft_consensus.cc:2955] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:43.724110 29378 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
W20260709 12:19:43.752521 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 166766us
I20260709 12:19:43.726577 29383 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:43.763006 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 207140us
I20260709 12:19:43.773720 22516 leader_election.cc:400] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 16. Current term is 17.
I20260709 12:19:43.779862 22516 leader_election.cc:403] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:43.783815 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:43.784698 22398 raft_consensus.cc:2368] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 19. Current term is 20.
I20260709 12:19:43.790970 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:43.791764 22471 raft_consensus.cc:2368] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 19. Current term is 20.
I20260709 12:19:43.793802 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:43.794137 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:43.794286 22367 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:43.797978 22516 leader_election.cc:400] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 19. Current term is 20.
I20260709 12:19:43.799628 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:43.803279 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:43.804056 22477 raft_consensus.cc:3060] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:19:43.812788 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:43.815881 23130 raft_consensus.cc:2368] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14.
I20260709 12:19:43.824586 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c69680a57493c942307ff09185b72" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:43.806916 29240 raft_consensus.cc:3060] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:43.797462 29402 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 16. Current term is 17.
I20260709 12:19:43.840656 22477 raft_consensus.cc:2468] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 14.
I20260709 12:19:43.822029 29332 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:19:43.844074 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 43592.9us
I20260709 12:19:43.859522 22516 leader_election.cc:400] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 19. Current term is 20.
I20260709 12:19:43.859982 22516 leader_election.cc:403] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:19:43.855077 29332 raft_consensus.cc:697] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:43.887823 22516 leader_election.cc:400] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 19. Current term is 20.
I20260709 12:19:43.872937 29297 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 19. Current term is 20.
W20260709 12:19:43.908363 29409 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:19:43.958446 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:43.962075 23130 raft_consensus.cc:2393] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 15: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
W20260709 12:19:43.969429 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 60654.5us
I20260709 12:19:43.958024 29383 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:43.980077 29412 log.cc:927] Time spent T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:19:43.973758 29401 log.cc:927] Time spent T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 12:19:43.983737 22549 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 3868) took 1313 ms (client timeout 1603 ms). Trace:
W20260709 12:19:43.988788 22549 rpcz_store.cc:269] 0709 12:19:42.662666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:42.662875 (+   209us) service_pool.cc:224] Handling call
0709 12:19:43.975617 (+1312742us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b540042c054. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:43.975727 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2179685120}
I20260709 12:19:43.997723 22471 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 28 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 16. (term mismatch)
I20260709 12:19:43.998761 22471 pending_rounds.cc:85] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2: Aborting all ops after (but not including) 15
I20260709 12:19:43.998996 22471 pending_rounds.cc:107] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2: Aborting uncommitted NO_OP operation due to leader change: 27.16
I20260709 12:19:43.999235 22471 raft_consensus.cc:2889] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:44.003032 22476 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:19:44.009919 22441 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:44.022214 22473 raft_consensus.cc:2955] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:44.023496 22441 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:44.024238 28765 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:44.025100 28765 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:43.960240 29332 consensus_queue.cc:237] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:44.042953 22441 leader_election.cc:400] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14.
I20260709 12:19:44.043339 22441 leader_election.cc:403] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:19:44.087096 29418 log.cc:927] Time spent T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.119s	user 0.004s	sys 0.000s
W20260709 12:19:44.095749 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 52958.7us
I20260709 12:19:44.009653 29407 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:44.096309 29386 log.cc:927] Time spent T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.004s
W20260709 12:19:44.089547 29390 log.cc:927] Time spent T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.059s	user 0.000s	sys 0.006s
I20260709 12:19:44.141368 22549 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:19:44.097170 29385 log.cc:927] Time spent T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.065s	user 0.003s	sys 0.007s
W20260709 12:19:44.203109 29398 log.cc:927] Time spent T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:19:44.183295 29379 consensus_meta.cc:287] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932: Time spent flushing consensus metadata: real 0.515s	user 0.004s	sys 0.006s
W20260709 12:19:44.184693 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 79001.5us
I20260709 12:19:44.141368 29348 raft_consensus.cc:2749] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) with higher term. Message: Invalid argument: T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 for earlier term 13. Current term is 14.
I20260709 12:19:44.248205 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:44.249846 22477 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:19:44.245218 29427 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:19:44.256517 22549 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:44.250483 29347 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.171661 29407 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:44.246762 29379 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:44.252935 29240 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:19:44.254492 29381 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 12:19:44.305457 22473 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 15.
W20260709 12:19:44.307731 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 51475us
I20260709 12:19:44.262965 29239 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:19:44.309171 22367 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71
I20260709 12:19:44.317132 22542 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:44.317258 22543 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:44.318316 22399 raft_consensus.cc:2468] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
I20260709 12:19:44.281405 29347 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:44.322343 29145 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:44.323648 29347 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:44.319016 29332 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:44.327982 29332 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:44.328840 29332 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:44.331588 29379 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:44.327843 29407 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:44.342430 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:44.345556 22394 raft_consensus.cc:1275] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:19:44.346608 22395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:44.347920 22396 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:19:44.366176 22549 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:19:44.368050 29240 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:44.373369 22542 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 20.
W20260709 12:19:44.376572 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 57380us
I20260709 12:19:44.379676 29438 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:19:44.382668 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 125312us
I20260709 12:19:44.398100 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:44.399693 22469 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:19:44.404261 22544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:44.408567 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:44.418370 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:44.419160 23129 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:44.427438 22398 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:19:44.442298 29165 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:44.444936 29415 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:44.449362 22551 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:19:44.457798 29240 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:19:44.497094 22399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48924 (request call id 3426) took 1119 ms. Trace:
I20260709 12:19:44.507309 22394 raft_consensus.cc:1275] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:19:44.497617 22399 rpcz_store.cc:276] 0709 12:19:43.377732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.378037 (+   305us) service_pool.cc:224] Handling call
0709 12:19:44.496830 (+1118793us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b54000a9454. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4f8abd571 00007fb4f8b582fa 00007fb4fdb19b17 00007fb4f70946d4 00007fb4f7094662 00007fb4f7094591 00007fb4f709450c 00007fb4f70937c2 00007fb4f6e8f48c 00007fb4f6e8e8c6 00007fb4f6e8e26f
0709 12:19:44.496984 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1852861696}
W20260709 12:19:44.528016 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 66725.3us
W20260709 12:19:44.531208 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 115689us
W20260709 12:19:44.544909 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 114300us
I20260709 12:19:44.547222 22441 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:19:44.558054 22549 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:19:44.559474 22542 raft_consensus.cc:1275] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:19:44.561359 22441 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:44.569675 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:44.570477 22401 raft_consensus.cc:2368] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 19. Current term is 20.
W20260709 12:19:44.595731 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 45626.6us
W20260709 12:19:44.607154 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 45891.2us
I20260709 12:19:44.532717 29297 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:44.543668 29298 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:19:44.622090 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 95836.7us
I20260709 12:19:44.606065 29437 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:44.533368 29332 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:44.633862 29437 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.623032 29297 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:44.646728 22395 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 15.
I20260709 12:19:44.656231 29297 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:44.662089 29443 log.cc:927] Time spent T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:19:44.631421 29298 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:44.641791 29184 consensus_queue.cc:1048] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:19:44.642064 29227 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:19:44.653494 29437 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:44.727691 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 88376.9us
I20260709 12:19:44.730688 29414 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:44.732025 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:44.678251 29063 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:44.732641 22477 raft_consensus.cc:606] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:19:44.733385 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 92882.7us
I20260709 12:19:44.752298 29332 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:44.762804 29298 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:44.774557 29360 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:44.775484 29428 consensus_queue.cc:1048] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:44.776196 28842 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:44.776712 28842 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:44.785966 28842 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:44.739094 29292 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:19:44.793306 29453 log.cc:927] Time spent T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.003s
I20260709 12:19:44.794039 22469 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:19:44.795913 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:44.732982 29063 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:44.799888 29063 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:44.808499 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:44.809190 22477 raft_consensus.cc:606] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:44.809530 22477 raft_consensus.cc:614] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:44.821524 22395 raft_consensus.cc:1275] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:44.832297 22395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "277d262725804effb16ede64e81d19c8"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:19:44.833022 22395 raft_consensus.cc:606] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:44.833436 22395 raft_consensus.cc:614] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:44.837951 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 160792us
I20260709 12:19:44.841399 22516 leader_election.cc:400] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 19. Current term is 20.
I20260709 12:19:44.844933 22516 leader_election.cc:403] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:19:44.849936 22399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:44.850023 22542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:44.855758 29302 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:19:44.859079 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 307630us
I20260709 12:19:44.867619 22399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "444001888258449e8c4f5fd4ad540389"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:19:44.868718 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:44.869725 23130 raft_consensus.cc:2393] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 in current term 15: Already voted for candidate 65951063312d4a1e9123f92354101c71 in this term.
I20260709 12:19:44.869011 22399 raft_consensus.cc:606] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:44.872273 22399 raft_consensus.cc:614] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:44.886844 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:44.890398 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:44.890388 22441 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:44.911527 29227 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:19:44.846901 29298 consensus_queue.cc:1048] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:19:44.849411 29444 consensus_queue.cc:1048] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:19:44.955929 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:44.955947 22398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:44.958685 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:44.983729 22471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a6a426ef4624f2cb84081714ee42138"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:44.984476 22471 raft_consensus.cc:606] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:44.984935 22471 raft_consensus.cc:614] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:44.989636 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:44.972062 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:44.945652 29227 raft_consensus.cc:493] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:45.001981 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:44.957816 29420 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927) with higher term. Message: Invalid argument: T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 for earlier term 19. Current term is 20.
W20260709 12:19:44.991847 29431 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:19:45.008983 29299 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:19:45.009168 29227 raft_consensus.cc:515] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:45.051250 29460 log.cc:927] Time spent T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
W20260709 12:19:45.084784 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 47982.7us
W20260709 12:19:45.113157 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 149753us
I20260709 12:19:45.047796 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
W20260709 12:19:45.121517 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 87046.7us
I20260709 12:19:45.127045 29437 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:45.128353 22469 raft_consensus.cc:2368] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 15. Current term is 16.
I20260709 12:19:45.137136 29227 leader_election.cc:290] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:45.139866 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:45.143926 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:45.146220 22396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:45.146911 22396 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:45.150072 29477 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:19:45.118115 29434 log.cc:927] Time spent T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.005s
I20260709 12:19:45.158425 22396 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
I20260709 12:19:45.199299 23130 raft_consensus.cc:1275] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:45.201016 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e53d64761746008e02335e67f74c08" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:45.249924 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 49248.6us
I20260709 12:19:45.255267 22442 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
W20260709 12:19:45.260053 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 103285us
I20260709 12:19:45.198091 29437 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:45.275225 29134 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:19:45.123004 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 75330.7us
I20260709 12:19:45.320091 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:45.309417 29134 raft_consensus.cc:697] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:45.336318 29374 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:45.323293 29477 consensus_queue.cc:1048] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:19:45.381661 29229 raft_consensus.cc:993] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:45.382282 29229 raft_consensus.cc:1081] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
W20260709 12:19:45.386435 29471 log.cc:927] Time spent T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1: Append to log took a long time: real 0.436s	user 0.009s	sys 0.000s
W20260709 12:19:45.391577 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 106095us
I20260709 12:19:45.409061 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:45.409727 23129 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:45.419440 22550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54498
I20260709 12:19:45.420182 22550 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:45.420574 22550 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:45.433457 23129 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 16.
W20260709 12:19:45.445271 29481 log.cc:927] Time spent T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:19:45.449323 22550 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:45.461848 22441 leader_election.cc:304] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:45.464061 29127 raft_consensus.cc:2749] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:45.472591 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:45.473290 22394 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:45.473378 22550 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:45.485205 22367 leader_election.cc:400] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 15. Current term is 16.
I20260709 12:19:45.485663 22367 leader_election.cc:403] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:19:45.488432 29475 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187) with higher term. Message: Invalid argument: T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8621fa34be04d3fa2d68a300f858cd1 for earlier term 15. Current term is 16.
I20260709 12:19:45.396937 29134 consensus_queue.cc:237] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:45.497323 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:45.498006 22470 raft_consensus.cc:3055] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:19:45.498332 22470 raft_consensus.cc:740] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:45.511507 22394 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 21.
I20260709 12:19:45.512857 22516 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:45.514783 22470 consensus_queue.cc:260] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:45.519794 22470 raft_consensus.cc:3060] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:45.527673 29417 raft_consensus.cc:2804] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:19:45.528295 29417 raft_consensus.cc:697] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:45.529162 29417 consensus_queue.cc:237] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:45.538164 29441 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:45.538771 29441 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:45.570978 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 44415.7us
W20260709 12:19:45.579778 22441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.591909 22470 raft_consensus.cc:2468] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 21.
I20260709 12:19:45.546182 29441 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:45.618646 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1" is_pre_election: true
I20260709 12:19:45.632666 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:45.639170 23095 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:45.648032 29496 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:19:45.664364 29472 log.cc:927] Time spent T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.711s	user 0.004s	sys 0.009s
I20260709 12:19:45.716163 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:45.716985 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:45.724637 22296 catalog_manager.cc:5697] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 18 to 19, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 19 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
W20260709 12:19:45.734864 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 177543us
I20260709 12:19:45.885367 22296 catalog_manager.cc:5697] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 14 to 15, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 15 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:45.948120 22476 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:19:45.955605 29415 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
W20260709 12:19:46.062686 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 110061us
I20260709 12:19:46.074590 22400 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:19:46.137398 22298 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50176 (request call id 305) took 7838 ms. Trace:
W20260709 12:19:46.185453 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 64339.4us
I20260709 12:19:46.193430 29348 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:46.152839 22298 rpcz_store.cc:276] 0709 12:19:38.242240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.242447 (+   207us) service_pool.cc:224] Handling call
0709 12:19:46.080402 (+7837955us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:43.574473 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:43.616378 (+ 41905us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:43.616415 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:19:43.616433 (+    18us) tablet.cc:662] Decoding operations
0709 12:19:43.617722 (+  1289us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:43.617827 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:43.617854 (+    27us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:19:43.619425 (+  1571us) tablet.cc:701] Row locks acquired
0709 12:19:43.619445 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:19:43.619597 (+   152us) write_op.cc:270] Start()
0709 12:19:43.619727 (+   130us) write_op.cc:276] Timestamp: P: 1783599583619544 usec, L: 0
0709 12:19:43.619747 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:19:43.644446 (+ 24699us) log.cc:844] Serialized 5539 byte log entry
0709 12:19:44.063476 (+419030us) op_driver.cc:464] REPLICATION: finished
0709 12:19:44.399505 (+336029us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b18002f5000. stack: 00007fb4f5a35343 00007fb4f5a35240 00007fb4f53c41d4 00007fb4ff102304 00007fb4ff102299 00007fb4fe92fab1 00007fb4fe93c281 00007fb4f5a673f3 00007fb4f5a697c1 00007fb4f5a69779 00007fb4f5a69709 00007fb4f5a696d1 00007fb4f5a689cd 0000000000388634 0000000000388479 00007fb4f5a4a83a
0709 12:19:44.399640 (+   135us) write_op.cc:301] APPLY: starting
0709 12:19:44.399743 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:44.523503 (+123760us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:44.523526 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:44.750596 (+227070us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:44.750887 (+   291us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0709 12:19:44.750931 (+    44us) write_op.cc:312] APPLY: finished
0709 12:19:44.751267 (+   336us) log.cc:844] Serialized 129 byte log entry
0709 12:19:44.766829 (+ 15562us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:44.767012 (+   183us) write_op.cc:454] Released schema lock
0709 12:19:44.767068 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:44.820761 (+ 53693us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:44.820791 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":906746,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":188226,"apply.run_cpu_time_us":21763,"apply.run_wall_time_us":421089,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62787,"num_ops":14,"prepare.queue_time_us":292453,"prepare.run_cpu_time_us":7247,"prepare.run_wall_time_us":123027,"raft.queue_time_us":152840,"raft.run_cpu_time_us":49459,"raft.run_wall_time_us":186250,"replication_time_us":442818,"spinlock_wait_cycles":3829120,"thread_start_us":456021,"threads_started":4,"wal-append.queue_time_us":123752,"wal-append.run_cpu_time_us":14732,"wal-append.run_wall_time_us":1981885}]]}
I20260709 12:19:46.259868 23130 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:19:46.333053 22399 raft_consensus.cc:1275] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:19:46.377347 29127 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:46.383145 29417 consensus_queue.cc:1048] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:46.397187 22293 catalog_manager.cc:5697] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 20 to 21, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2), now has a pending config: VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1), VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2), VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3), VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 21 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } } pending_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:46.401273 22293 catalog_manager.cc:5697] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 17 to 19, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 19 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:46.403764 22293 catalog_manager.cc:5697] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.406204 22293 catalog_manager.cc:5697] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 17 to 21, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 21 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:46.407964 22293 catalog_manager.cc:5697] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 13 to 17, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 17 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.410154 22293 catalog_manager.cc:5697] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 13 to 14, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 14 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:46.412101 22293 catalog_manager.cc:5697] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 16 to 18, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 18 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.413992 22293 catalog_manager.cc:5697] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 11 to 12, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 12 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:46.415820 22293 catalog_manager.cc:5697] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 16 to 17, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 17 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:46.555040 22296 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50158 (request call id 300) took 10479 ms. Trace:
I20260709 12:19:46.557745 22296 rpcz_store.cc:276] 0709 12:19:35.976995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.983360 (+  6365us) service_pool.cc:224] Handling call
0709 12:19:46.455849 (+10472489us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:46.041561 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:46.042398 (+   837us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:46.042461 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:19:46.042496 (+    35us) tablet.cc:662] Decoding operations
0709 12:19:46.043137 (+   641us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:46.043257 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:46.043287 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:19:46.043814 (+   527us) tablet.cc:701] Row locks acquired
0709 12:19:46.043876 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:19:46.044227 (+   351us) write_op.cc:270] Start()
0709 12:19:46.044423 (+   196us) write_op.cc:276] Timestamp: P: 1783599586044059 usec, L: 0
0709 12:19:46.044463 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:19:46.045544 (+  1081us) log.cc:844] Serialized 923 byte log entry
0709 12:19:46.351556 (+306012us) op_driver.cc:464] REPLICATION: finished
0709 12:19:46.352960 (+  1404us) write_op.cc:301] APPLY: starting
0709 12:19:46.353067 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:46.355787 (+  2720us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:46.355911 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:46.357408 (+  1497us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:46.357784 (+   376us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:19:46.357864 (+    80us) write_op.cc:312] APPLY: finished
0709 12:19:46.358191 (+   327us) log.cc:844] Serialized 33 byte log entry
0709 12:19:46.358441 (+   250us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:46.358542 (+   101us) write_op.cc:454] Released schema lock
0709 12:19:46.358607 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:46.370129 (+ 11522us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:46.370164 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":698331,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":1108,"apply.run_cpu_time_us":6160,"apply.run_wall_time_us":17137,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12507,"num_ops":2,"prepare.queue_time_us":10604,"prepare.run_cpu_time_us":58891,"prepare.run_wall_time_us":93575,"raft.queue_time_us":67997,"raft.run_cpu_time_us":1408,"raft.run_wall_time_us":1408,"replication_time_us":306905,"thread_start_us":168193,"threads_started":4,"wal-append.queue_time_us":133018}]]}
W20260709 12:19:46.811252 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 69213.9us
W20260709 12:19:46.820428 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 170798us
I20260709 12:19:46.821521 22298 catalog_manager.cc:5697] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:46.859050 22298 catalog_manager.cc:5697] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 12 to 18, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 18 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.860906 22298 catalog_manager.cc:5697] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 14 to 17, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1), VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2), VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3), VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 21 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.863263 22298 catalog_manager.cc:5697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:46.864645 22298 catalog_manager.cc:5697] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 18 to 19, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 19 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:46.866130 22298 catalog_manager.cc:5697] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 18 to 20, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 20 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.867841 22298 catalog_manager.cc:5697] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 21 to 23, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 23 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.872013 22293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32988 (request call id 189) took 5116 ms. Trace:
I20260709 12:19:46.872575 22293 rpcz_store.cc:276] 0709 12:19:41.755952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:41.759493 (+  3541us) service_pool.cc:224] Handling call
0709 12:19:46.871895 (+5112402us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:46.421510 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:46.422141 (+   631us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:46.422177 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:19:46.422195 (+    18us) tablet.cc:662] Decoding operations
0709 12:19:46.490436 (+ 68241us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:46.494951 (+  4515us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:46.497490 (+  2539us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:19:46.587858 (+ 90368us) tablet.cc:701] Row locks acquired
0709 12:19:46.587879 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:19:46.588040 (+   161us) write_op.cc:270] Start()
0709 12:19:46.588182 (+   142us) write_op.cc:276] Timestamp: P: 1783599586587993 usec, L: 0
0709 12:19:46.588208 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:19:46.588868 (+   660us) log.cc:844] Serialized 3945 byte log entry
0709 12:19:46.598335 (+  9467us) op_driver.cc:464] REPLICATION: finished
0709 12:19:46.598997 (+   662us) write_op.cc:301] APPLY: starting
0709 12:19:46.599083 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:46.713599 (+114516us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:46.713706 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:46.745163 (+ 31457us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:46.745386 (+   223us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0709 12:19:46.745429 (+    43us) write_op.cc:312] APPLY: finished
0709 12:19:46.745730 (+   301us) log.cc:844] Serialized 89 byte log entry
0709 12:19:46.757966 (+ 12236us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:46.758099 (+   133us) write_op.cc:454] Released schema lock
0709 12:19:46.758147 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:46.758532 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:46.758560 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1114598,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":390,"apply.run_cpu_time_us":15047,"apply.run_wall_time_us":159494,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37710,"num_ops":9,"prepare.queue_time_us":182,"prepare.run_cpu_time_us":5712,"prepare.run_wall_time_us":167715,"replication_time_us":9907}]]}
I20260709 12:19:46.869635 22298 catalog_manager.cc:5697] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 25 to 28, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 28 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:46.906667 22298 catalog_manager.cc:5697] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 17 to 20, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 20 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:46.908070 22298 catalog_manager.cc:5697] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.909454 22298 catalog_manager.cc:5697] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:46.910866 22298 catalog_manager.cc:5697] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 14 to 16, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 16 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:46.912765 22298 catalog_manager.cc:5697] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 15 to 17, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 17 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.926407 22298 catalog_manager.cc:5697] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 22 to 23, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 23 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.928053 22298 catalog_manager.cc:5697] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 19 to 20, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 20 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.930168 22298 catalog_manager.cc:5697] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 18 to 19, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 19 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:46.931821 22298 catalog_manager.cc:5697] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 15 to 17, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 17 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.933329 22298 catalog_manager.cc:5697] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 17 to 20, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 20 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:46.937459 22298 catalog_manager.cc:5697] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 17 to 18, leader changed from 65951063312d4a1e9123f92354101c71 (127.20.191.4) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 18 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.939438 22298 catalog_manager.cc:5697] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.941202 22298 catalog_manager.cc:5697] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 12 to 14, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 14 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.954259 22298 catalog_manager.cc:5697] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 17 to 18, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 18 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.956012 22298 catalog_manager.cc:5697] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:46.957342 22298 catalog_manager.cc:5697] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 9 to 10, term changed from 14 to 15, leader changed from 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) to 65951063312d4a1e9123f92354101c71 (127.20.191.4), 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:47.053524 22297 catalog_manager.cc:5697] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 14 to 17, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 17 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:47.062981 22297 catalog_manager.cc:5697] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 20 to 21, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 21 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } }
I20260709 12:19:47.076443 22297 catalog_manager.cc:5697] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:47.078727 22297 catalog_manager.cc:5697] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 12 to 16, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 16 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:47.084570 22297 catalog_manager.cc:5697] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:47.275846 23129 consensus_queue.cc:237] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:47.377888 22550 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:47.379985 29038 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:47.384326 22394 raft_consensus.cc:1275] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:47.386021 29516 consensus_queue.cc:1048] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:47.398559 22549 consensus_queue.cc:237] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:47.425611 23129 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:19:47.427845 22471 raft_consensus.cc:1275] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:19:47.429432 29452 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:47.431844 29452 consensus_queue.cc:1048] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:47.457244 29187 raft_consensus.cc:2955] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 12 to 14, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:47.460042 22475 raft_consensus.cc:2955] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 12 to 14, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:47.466518 29038 raft_consensus.cc:2955] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 10 to 12, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:47.470546 22549 raft_consensus.cc:2955] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 10 to 12, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:47.486881 22284 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff6628c2d6a44791975f2350758cb3db with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:47.488180 22401 raft_consensus.cc:2955] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 10 to 12, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:47.503579 29525 log.cc:927] Time spent T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71: Append to log took a long time: real 0.059s	user 0.002s	sys 0.002s
I20260709 12:19:47.496920 22296 catalog_manager.cc:5697] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index 12 to 14, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New cstate: current_term: 17 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:47.513016 22284 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cbdd827fb2d34627bbd307872debd3d3 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:47.521324 23129 raft_consensus.cc:2955] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 12 to 14, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:47.525512 22298 catalog_manager.cc:5697] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 10 to 12, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New cstate: current_term: 15 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:47.559405 22387 tablet_service.cc:1558] Processing DeleteTablet for tablet ff6628c2d6a44791975f2350758cb3db with delete_type TABLET_DATA_TOMBSTONED (TS b8621fa34be04d3fa2d68a300f858cd1 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:52914
I20260709 12:19:47.568480 22458 tablet_service.cc:1558] Processing DeleteTablet for tablet cbdd827fb2d34627bbd307872debd3d3 with delete_type TABLET_DATA_TOMBSTONED (TS 25ebf14868c042dca42f54b3e251e1b2 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:51846
I20260709 12:19:47.628273 29529 tablet_replica.cc:333] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:19:47.630514 29528 tablet_replica.cc:333] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:47.642318 29528 raft_consensus.cc:2243] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:47.643903 29528 raft_consensus.cc:2272] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:47.643101 29529 raft_consensus.cc:2243] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:47.645731 29529 raft_consensus.cc:2272] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:47.649858 29529 ts_tablet_manager.cc:1916] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:47.656237 29528 ts_tablet_manager.cc:1916] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:47.713366 29528 ts_tablet_manager.cc:1929] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 12:19:47.714851 29528 log.cc:1199] T ff6628c2d6a44791975f2350758cb3db P b8621fa34be04d3fa2d68a300f858cd1: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-0-root/wals/ff6628c2d6a44791975f2350758cb3db
I20260709 12:19:47.717067 22285 catalog_manager.cc:5028] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): tablet ff6628c2d6a44791975f2350758cb3db (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:19:47.744155 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:47.741461 29529 ts_tablet_manager.cc:1929] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 12:19:47.744937 29529 log.cc:1199] T cbdd827fb2d34627bbd307872debd3d3 P 25ebf14868c042dca42f54b3e251e1b2: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-1-root/wals/cbdd827fb2d34627bbd307872debd3d3
I20260709 12:19:47.747778 22285 catalog_manager.cc:5028] TS 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): tablet cbdd827fb2d34627bbd307872debd3d3 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:19:47.865984 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "277d262725804effb16ede64e81d19c8"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:47.866731 22475 raft_consensus.cc:606] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:47.872395 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3781b48054df42c08e2bf775312a3699"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:47.873028 22475 raft_consensus.cc:606] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:47.876233 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:47.876888 22475 raft_consensus.cc:606] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:47.886816 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:47.887516 22475 raft_consensus.cc:606] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Received request to transfer leadership to TS 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:47.895802 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:47.896435 22475 raft_consensus.cc:606] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:47.897939 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:47.902313 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:47.904690 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:47.967758 29520 raft_consensus.cc:993] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:47.968341 29520 raft_consensus.cc:1081] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:47.970122 22550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3781b48054df42c08e2bf775312a3699"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54498
I20260709 12:19:47.970775 22550 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:47.971117 22550 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:47.979050 22550 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:47.982090 22394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
I20260709 12:19:47.982908 22394 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:47.990526 22394 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
I20260709 12:19:47.992004 22516 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:47.992959 29187 raft_consensus.cc:2804] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:47.993510 29187 raft_consensus.cc:697] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:47.994477 29187 consensus_queue.cc:237] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:48.065420 22296 catalog_manager.cc:5697] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 18 to 19, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 19 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:48.081290 29520 raft_consensus.cc:993] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:48.081856 29520 raft_consensus.cc:1081] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:48.085527 22401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:19:48.086196 22401 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:48.086527 22401 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:48.085552 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:48.088529 22475 raft_consensus.cc:3055] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:48.088794 22475 raft_consensus.cc:740] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:48.089567 22475 consensus_queue.cc:260] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:48.090685 22475 raft_consensus.cc:3060] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:48.084626 22550 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:48.132253 22401 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:48.160737 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:48.161366 23128 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:48.162099 22401 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:48.163553 22475 raft_consensus.cc:2468] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
I20260709 12:19:48.167811 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:48.168413 22475 raft_consensus.cc:3055] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:48.168694 22475 raft_consensus.cc:740] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:48.169267 23128 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:48.172111 22366 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:48.174885 29302 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:48.175429 29302 raft_consensus.cc:697] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:48.176348 29122 raft_consensus.cc:993] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:48.176828 29122 raft_consensus.cc:1081] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:48.176311 29302 consensus_queue.cc:237] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:48.179467 22550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54498
I20260709 12:19:48.180145 22550 raft_consensus.cc:493] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:48.180842 22550 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:48.179394 22475 consensus_queue.cc:260] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:48.187577 22475 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:48.201561 22550 raft_consensus.cc:515] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:48.207828 22299 catalog_manager.cc:5697] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 13 to 14, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 14 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:48.209071 22475 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 14.
I20260709 12:19:48.215276 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:48.215885 22475 raft_consensus.cc:3055] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:48.216176 22475 raft_consensus.cc:740] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:48.218031 22550 leader_election.cc:290] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:48.218621 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98e38137cdf48ddae2d7d3311ccb425" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:48.219225 23128 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:48.229657 23128 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:48.229645 22475 consensus_queue.cc:260] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:48.231204 22475 raft_consensus.cc:3060] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:48.231334 22515 leader_election.cc:304] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:48.232443 29417 raft_consensus.cc:2804] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:48.232967 29417 raft_consensus.cc:697] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:48.233945 29417 consensus_queue.cc:237] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:48.269867 22475 raft_consensus.cc:2468] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
I20260709 12:19:48.288143 22299 catalog_manager.cc:5697] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 14 to 15, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 15 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:48.345669 29520 raft_consensus.cc:993] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:48.347743 29520 raft_consensus.cc:1081] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:48.360589 22401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "277d262725804effb16ede64e81d19c8"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:19:48.361214 22401 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:48.361788 22401 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:19:48.384749 22401 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:48.421883 22399 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:19:48.439805 29537 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:48.437553 29518 raft_consensus.cc:993] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:48.447881 29518 raft_consensus.cc:1081] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Signalling peer 8c3bcfa13ca74a24ab8999a408532932 to start an election
I20260709 12:19:48.450417 22550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65"
dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
 from {username='slave'} at 127.0.0.1:54498
I20260709 12:19:48.451076 22550 raft_consensus.cc:493] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:48.452477 22550 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:48.481313 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:48.481936 22475 raft_consensus.cc:3055] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:19:48.482252 22475 raft_consensus.cc:740] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:48.486043 22550 raft_consensus.cc:515] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:48.487975 22401 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 23 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:48.488998 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:48.489694 22549 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:19:48.491585 22475 consensus_queue.cc:260] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:48.495551 22475 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:19:48.500100 22549 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 23.
I20260709 12:19:48.506040 22550 leader_election.cc:290] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:48.507114 23128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:48.507804 23128 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:48.510354 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db333e4f6a9549d88edc232a61e2fc65" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:48.511013 22473 raft_consensus.cc:3055] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:48.511302 22473 raft_consensus.cc:740] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:48.515775 22475 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 23.
I20260709 12:19:48.514904 22366 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:48.519964 23128 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:19:48.524609 29302 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:19:48.525322 29302 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 23 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:48.527261 22471 raft_consensus.cc:1275] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:19:48.520812 22473 consensus_queue.cc:260] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:48.528385 22473 raft_consensus.cc:3060] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:48.529047 29537 consensus_queue.cc:1048] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:48.526531 29302 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:48.551137 22515 leader_election.cc:304] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:48.552495 29537 raft_consensus.cc:2804] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:48.553797 29537 raft_consensus.cc:697] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:48.555518 29537 consensus_queue.cc:237] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:48.572038 22473 raft_consensus.cc:2468] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 13.
I20260709 12:19:48.601001 22299 catalog_manager.cc:5697] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 12 to 13, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 13 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:48.603055 22296 catalog_manager.cc:5697] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 22 to 23, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 23 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:48.623974 23128 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:48.628974 29302 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:48.676930 22473 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:48.678512 29539 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:48.699576 22475 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:48.701138 29417 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:48.773591 23129 raft_consensus.cc:1275] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:48.787818 29537 consensus_queue.cc:1048] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:48.807647 22401 consensus_queue.cc:237] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:48.820574 22550 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:19:48.824770 29302 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:48.829113 22475 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:19:48.831159 29302 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:19:48.834652 22366 consensus_peers.cc:597] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9c37e03879a64c308ad32ed0e1da75e9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:48.853106 29541 raft_consensus.cc:2955] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:48.855974 22550 raft_consensus.cc:2955] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:48.872249 22475 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:48.889364 22299 catalog_manager.cc:5697] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index -1 to 14, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 20 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:48.905853 22471 raft_consensus.cc:2955] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
W20260709 12:19:48.920348 22441 consensus_peers.cc:597] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67ad5236324342d48e6d762f265e4a3a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:48.922118 22550 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:19:48.925360 29184 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:19:48.933305 22401 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:19:48.935974 29184 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:48.967106 29122 raft_consensus.cc:2955] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index -1 to 15, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:48.977367 22545 raft_consensus.cc:2955] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index -1 to 15, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:48.988518 22399 raft_consensus.cc:2955] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index -1 to 15, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:49.002509 22475 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:19:49.004400 29302 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:49.011116 23128 raft_consensus.cc:1275] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:49.013025 29553 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:49.018368 22471 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:49.026146 22476 raft_consensus.cc:1275] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:49.028493 29417 consensus_queue.cc:1048] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:49.043618 22299 catalog_manager.cc:5697] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index -1 to 15, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 20 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:49.071465 22550 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:19:49.076366 29302 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:49.122792 22401 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:19:49.130482 29518 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:49.143020 22547 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 12:19:49.144558 22441 consensus_peers.cc:597] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 31ce456c700b43db9bef6c8297fe973c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:49.148855 29122 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:49.222735 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:49.251255 29122 raft_consensus.cc:2955] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:49.279850 22399 consensus_queue.cc:237] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:49.293126 22547 raft_consensus.cc:2955] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:49.350564 22298 catalog_manager.cc:5697] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index -1 to 15, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 23 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.353207 22476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:49.354911 22476 raft_consensus.cc:606] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:49.366954 22394 raft_consensus.cc:2955] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:49.386919 22476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
new_leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:19:49.387662 22476 raft_consensus.cc:606] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Received request to transfer leadership to TS b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:49.390216 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:49.391970 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:49.392947 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:49.413142 29122 raft_consensus.cc:993] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:49.413679 29122 raft_consensus.cc:1081] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:49.425230 22400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:19:49.425858 22400 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:49.426218 22400 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:19:49.430264 22443 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.20.191.62:37293, user_credentials={real_user=slave}} blocked reactor thread for 45739.3us
I20260709 12:19:49.456394 22400 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:49.462991 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:49.463591 22476 raft_consensus.cc:3055] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:49.463857 22476 raft_consensus.cc:740] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
W20260709 12:19:49.464018 22366 consensus_peers.cc:597] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9c9c94c2c7014c7b97357727b65ecdcd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:49.464596 22476 consensus_queue.cc:260] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:49.465754 22476 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:49.475811 29577 ts_tablet_manager.cc:933] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:19:49.479586 22476 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:49.484433 22471 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:19:49.486595 22400 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:49.490144 22367 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:49.491412 29573 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:49.491935 29573 raft_consensus.cc:697] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:49.492368 22547 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:19:49.492170 29480 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:49.494222 29480 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:49.497403 29573 consensus_queue.cc:237] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:49.487141 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:49.501695 23127 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:49.488232 29576 ts_tablet_manager.cc:933] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:49.523576 29577 tablet_copy_client.cc:323] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.1:37927
I20260709 12:19:49.525756 22411 tablet_copy_service.cc:140] P b8621fa34be04d3fa2d68a300f858cd1: Received BeginTabletCopySession request for tablet 9c37e03879a64c308ad32ed0e1da75e9 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:58054)
I20260709 12:19:49.526409 22411 tablet_copy_service.cc:161] P b8621fa34be04d3fa2d68a300f858cd1: Beginning new tablet copy session on tablet 9c37e03879a64c308ad32ed0e1da75e9 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:58054: session id = 65951063312d4a1e9123f92354101c71-9c37e03879a64c308ad32ed0e1da75e9
I20260709 12:19:49.509608 23127 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:49.541325 22411 tablet_copy_source_session.cc:215] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:49.551357 29577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c37e03879a64c308ad32ed0e1da75e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.553665 29576 tablet_copy_client.cc:323] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.2:46187
I20260709 12:19:49.558128 29541 raft_consensus.cc:2955] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:49.562374 22298 catalog_manager.cc:5697] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 16 to 17, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 17 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.567363 22547 raft_consensus.cc:2955] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:49.569671 22486 tablet_copy_service.cc:140] P 25ebf14868c042dca42f54b3e251e1b2: Received BeginTabletCopySession request for tablet 67ad5236324342d48e6d762f265e4a3a from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:43060)
I20260709 12:19:49.570593 22486 tablet_copy_service.cc:161] P 25ebf14868c042dca42f54b3e251e1b2: Beginning new tablet copy session on tablet 67ad5236324342d48e6d762f265e4a3a from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:43060: session id = 65951063312d4a1e9123f92354101c71-67ad5236324342d48e6d762f265e4a3a
I20260709 12:19:49.580467 22486 tablet_copy_source_session.cc:215] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:49.584324 29576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ad5236324342d48e6d762f265e4a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.592763 22476 raft_consensus.cc:2955] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:19:49.618460 22298 catalog_manager.cc:5697] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index -1 to 12, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 19 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.634981 29583 ts_tablet_manager.cc:933] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:49.695791 29518 raft_consensus.cc:993] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:49.697840 29570 raft_consensus.cc:1081] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Signalling peer b8621fa34be04d3fa2d68a300f858cd1 to start an election
I20260709 12:19:49.700183 22401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e"
dest_uuid: "b8621fa34be04d3fa2d68a300f858cd1"
 from {username='slave'} at 127.0.0.1:48926
I20260709 12:19:49.700740 22401 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:49.701092 22401 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:49.706279 29583 tablet_copy_client.cc:323] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.2:46187
I20260709 12:19:49.708097 22486 tablet_copy_service.cc:140] P 25ebf14868c042dca42f54b3e251e1b2: Received BeginTabletCopySession request for tablet 31ce456c700b43db9bef6c8297fe973c from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:43060)
I20260709 12:19:49.708238 22401 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:49.709036 22486 tablet_copy_service.cc:161] P 25ebf14868c042dca42f54b3e251e1b2: Beginning new tablet copy session on tablet 31ce456c700b43db9bef6c8297fe973c from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:43060: session id = 65951063312d4a1e9123f92354101c71-31ce456c700b43db9bef6c8297fe973c
I20260709 12:19:49.726850 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:49.727905 22547 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:49.727167 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:49.727447 22401 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:49.728942 22476 raft_consensus.cc:3055] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:49.729287 22476 raft_consensus.cc:740] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:49.731109 22476 consensus_queue.cc:260] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:49.732445 22476 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:49.736697 29577 tablet_copy_client.cc:806] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:49.737485 29577 tablet_copy_client.cc:670] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:49.744107 22547 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:49.745410 22366 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 
I20260709 12:19:49.746405 29541 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:49.746898 29541 raft_consensus.cc:697] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Becoming Leader. State: Replica: b8621fa34be04d3fa2d68a300f858cd1, State: Running, Role: LEADER
I20260709 12:19:49.747803 29541 consensus_queue.cc:237] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:49.769883 29576 tablet_copy_client.cc:806] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:49.776881 29576 tablet_copy_client.cc:670] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:49.781184 22486 tablet_copy_source_session.cc:215] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:49.794828 22476 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 17.
I20260709 12:19:49.797302 29577 tablet_copy_client.cc:538] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:49.823117 29583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ce456c700b43db9bef6c8297fe973c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.834179 29576 tablet_copy_client.cc:538] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:49.834496 22298 catalog_manager.cc:5697] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: term changed from 16 to 17, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1). New cstate: current_term: 17 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.859524 29577 tablet_bootstrap.cc:492] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:19:49.874372 29583 tablet_copy_client.cc:806] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:49.878183 29583 tablet_copy_client.cc:670] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:49.882376 29583 tablet_copy_client.cc:538] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:49.893239 29590 ts_tablet_manager.cc:933] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:19:49.908207 29583 tablet_bootstrap.cc:492] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:19:49.909996 23127 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:19:49.915922 29576 tablet_bootstrap.cc:492] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:19:49.917858 29573 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:49.948108 29590 tablet_copy_client.cc:323] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.1:37927
I20260709 12:19:49.953962 22411 tablet_copy_service.cc:140] P b8621fa34be04d3fa2d68a300f858cd1: Received BeginTabletCopySession request for tablet 9c9c94c2c7014c7b97357727b65ecdcd from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:58054)
I20260709 12:19:49.954567 22411 tablet_copy_service.cc:161] P b8621fa34be04d3fa2d68a300f858cd1: Beginning new tablet copy session on tablet 9c9c94c2c7014c7b97357727b65ecdcd from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:58054: session id = 65951063312d4a1e9123f92354101c71-9c9c94c2c7014c7b97357727b65ecdcd
I20260709 12:19:49.974625 22476 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:19:49.977244 29541 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:50.042858 22411 tablet_copy_source_session.cc:215] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:50.055219 29590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9c94c2c7014c7b97357727b65ecdcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.141825 22549 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:19:50.144493 29573 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:50.204571 29576 tablet_bootstrap.cc:492] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:50.205613 29576 tablet_bootstrap.cc:492] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:19:50.206386 29576 ts_tablet_manager.cc:1403] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.291s	user 0.056s	sys 0.051s
I20260709 12:19:50.207176 29590 tablet_copy_client.cc:806] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:50.207762 29590 tablet_copy_client.cc:670] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
W20260709 12:19:50.225334 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 64605.8us
I20260709 12:19:50.242561 29576 raft_consensus.cc:359] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:50.243527 29576 raft_consensus.cc:740] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:19:50.249433 29576 consensus_queue.cc:260] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:50.256124 22473 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:19:50.266623 29541 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:19:50.277571 29590 tablet_copy_client.cc:538] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:50.309517 29577 tablet_bootstrap.cc:492] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:50.313629 29577 tablet_bootstrap.cc:492] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:19:50.319649 29576 ts_tablet_manager.cc:1434] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.001s
I20260709 12:19:50.323300 29577 ts_tablet_manager.cc:1403] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.464s	user 0.047s	sys 0.012s
I20260709 12:19:50.355378 29590 tablet_bootstrap.cc:492] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:19:50.397902 22487 tablet_copy_service.cc:342] P 25ebf14868c042dca42f54b3e251e1b2: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-67ad5236324342d48e6d762f265e4a3a received from {username='slave'} at 127.0.0.1:43060
I20260709 12:19:50.398720 22487 tablet_copy_service.cc:434] P 25ebf14868c042dca42f54b3e251e1b2: ending tablet copy session 65951063312d4a1e9123f92354101c71-67ad5236324342d48e6d762f265e4a3a on tablet 67ad5236324342d48e6d762f265e4a3a with peer 65951063312d4a1e9123f92354101c71
W20260709 12:19:50.416164 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 52598.7us
I20260709 12:19:50.450300 29577 raft_consensus.cc:359] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:50.451282 29577 raft_consensus.cc:740] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:19:50.451989 29577 consensus_queue.cc:260] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:50.466782 23127 raft_consensus.cc:1217] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.14->[20.15-20.15]   Dedup: 20.15->[]
I20260709 12:19:50.472766 29577 ts_tablet_manager.cc:1434] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.149s	user 0.007s	sys 0.002s
I20260709 12:19:50.504901 22411 tablet_copy_service.cc:342] P b8621fa34be04d3fa2d68a300f858cd1: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-9c37e03879a64c308ad32ed0e1da75e9 received from {username='slave'} at 127.0.0.1:58054
I20260709 12:19:50.505471 22411 tablet_copy_service.cc:434] P b8621fa34be04d3fa2d68a300f858cd1: ending tablet copy session 65951063312d4a1e9123f92354101c71-9c37e03879a64c308ad32ed0e1da75e9 on tablet 9c37e03879a64c308ad32ed0e1da75e9 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:19:50.547801 29583 tablet_bootstrap.cc:492] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=1 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:50.548815 29583 tablet_bootstrap.cc:492] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:19:50.549585 29583 ts_tablet_manager.cc:1403] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.642s	user 0.051s	sys 0.009s
I20260709 12:19:50.604056 29583 raft_consensus.cc:359] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:50.605077 29583 raft_consensus.cc:740] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:19:50.605887 29583 consensus_queue.cc:260] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:50.611982 29583 ts_tablet_manager.cc:1434] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 12:19:50.625737 22487 tablet_copy_service.cc:342] P 25ebf14868c042dca42f54b3e251e1b2: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-31ce456c700b43db9bef6c8297fe973c received from {username='slave'} at 127.0.0.1:43060
I20260709 12:19:50.626240 22487 tablet_copy_service.cc:434] P 25ebf14868c042dca42f54b3e251e1b2: ending tablet copy session 65951063312d4a1e9123f92354101c71-31ce456c700b43db9bef6c8297fe973c on tablet 31ce456c700b43db9bef6c8297fe973c with peer 65951063312d4a1e9123f92354101c71
I20260709 12:19:50.780004 29590 tablet_bootstrap.cc:492] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=2 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:50.795892 29590 tablet_bootstrap.cc:492] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:19:50.796751 29590 ts_tablet_manager.cc:1403] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.462s	user 0.045s	sys 0.019s
I20260709 12:19:50.809963 29590 raft_consensus.cc:359] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:50.811002 29590 raft_consensus.cc:740] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:19:50.812328 29590 consensus_queue.cc:260] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:19:50.826015 29590 ts_tablet_manager.cc:1434] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.002s
I20260709 12:19:50.835631 22411 tablet_copy_service.cc:342] P b8621fa34be04d3fa2d68a300f858cd1: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-9c9c94c2c7014c7b97357727b65ecdcd received from {username='slave'} at 127.0.0.1:58054
I20260709 12:19:50.836105 22411 tablet_copy_service.cc:434] P b8621fa34be04d3fa2d68a300f858cd1: ending tablet copy session 65951063312d4a1e9123f92354101c71-9c9c94c2c7014c7b97357727b65ecdcd on tablet 9c9c94c2c7014c7b97357727b65ecdcd with peer 65951063312d4a1e9123f92354101c71
I20260709 12:19:50.859658 29520 raft_consensus.cc:1064] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:19:50.856161 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:50.866240 29520 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:50.888324 23128 raft_consensus.cc:1217] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.13->[20.14-20.14]   Dedup: 20.14->[]
I20260709 12:19:50.906389 22545 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:19:50.908329 29520 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:19:50.910149 22399 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:19:50.911640 29520 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:19:50.931666 23127 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [term 20 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:19:50.936028 29520 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:19:50.954089 23127 raft_consensus.cc:1217] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.14->[23.15-23.15]   Dedup: 23.15->[]
I20260709 12:19:50.972608 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:50.973798 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:50.974417 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:51.012271 29520 raft_consensus.cc:2955] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 15 to 16, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:51.020713 23128 raft_consensus.cc:2955] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:51.128670 22297 catalog_manager.cc:5697] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 15 to 16, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:51.132522 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 96813.6us
I20260709 12:19:51.184809 22399 raft_consensus.cc:2955] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:51.252039 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 75949.6us
W20260709 12:19:51.285247 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 119809us
W20260709 12:19:51.313297 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 67815.9us
W20260709 12:19:51.331807 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 43540us
W20260709 12:19:51.431697 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 68050us
W20260709 12:19:51.440932 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 155619us
I20260709 12:19:51.478524 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:51.495772 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 174251us
I20260709 12:19:51.498381 22547 raft_consensus.cc:2955] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:51.503357 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 229205us
W20260709 12:19:51.565969 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 79502.7us
W20260709 12:19:51.571094 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 52974.7us
W20260709 12:19:51.659520 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 136505us
W20260709 12:19:51.702207 22367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 107940us
W20260709 12:19:51.717846 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 134172us
W20260709 12:19:51.720687 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 64114.7us
I20260709 12:19:51.748692 23122 raft_consensus.cc:1217] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.11->[19.12-19.12]   Dedup: 19.12->[]
I20260709 12:19:51.785393 29634 raft_consensus.cc:1064] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:19:51.838003 29634 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 13, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:51.851455 29643 raft_consensus.cc:1064] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
W20260709 12:19:51.856141 22366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 66464.5us
I20260709 12:19:51.883555 29643 consensus_queue.cc:237] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:51.888607 22365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:51.908401 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 61161.7us
I20260709 12:19:51.920853 23127 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 [term 23 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:19:51.924278 22400 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:19:51.926028 29635 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:19:51.930579 22473 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:51.931854 29634 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:19:51.940349 23122 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:19:51.940980 22551 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:19:51.943876 29622 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:19:51.945192 22551 raft_consensus.cc:1275] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:19:51.955090 23129 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [term 20 LEARNER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:19:51.957154 29643 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:51.957829 22551 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:19:51.958352 29635 raft_consensus.cc:2955] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Committing config change with OpId 20.17: config changed from index 16 to 17, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:51.966444 29660 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:19:51.975623 29622 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:19:51.982470 23129 raft_consensus.cc:2955] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Committing config change with OpId 20.17: config changed from index 16 to 17, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:52.002260 22476 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:19:52.012656 22299 catalog_manager.cc:5697] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 16 to 17, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New cstate: current_term: 20 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:52.002835 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 67ad5236324342d48e6d762f265e4a3a with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:52.017913 29570 consensus_queue.cc:1048] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:19:52.018610 29622 raft_consensus.cc:2955] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index 15 to 16, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:52.027890 29643 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:52.031466 23127 raft_consensus.cc:2955] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:52.039662 22545 raft_consensus.cc:2955] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Committing config change with OpId 20.17: config changed from index 16 to 17, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:52.042135 22400 raft_consensus.cc:2955] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:52.088018 21244 tablet_server.cc:179] TabletServer@127.20.191.1:0 shutting down...
I20260709 12:19:52.087706 22551 raft_consensus.cc:2955] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:52.100481 22516 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
I20260709 12:19:52.144752 29626 raft_consensus.cc:2955] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:52.160218 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 61583.9us
I20260709 12:19:52.161963 22547 raft_consensus.cc:2955] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:52.175976 29660 raft_consensus.cc:1064] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
W20260709 12:19:52.179628 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 51820.6us
W20260709 12:19:52.183210 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 53021.5us
I20260709 12:19:52.208047 29660 consensus_queue.cc:237] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:52.210139 22293 catalog_manager.cc:5697] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 15 to 16, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:52.254752 22442 consensus_peers.cc:597] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.255421 22442 consensus_peers.cc:597] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.255987 22442 consensus_peers.cc:597] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.259970 22442 consensus_peers.cc:597] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.264647 23095 consensus_peers.cc:597] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.270011 23095 consensus_peers.cc:597] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.264647 22516 consensus_peers.cc:597] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.283768 22516 consensus_peers.cc:597] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.284499 22516 consensus_peers.cc:597] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:52.291534 23127 raft_consensus.cc:2955] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:52.297866 22442 consensus_peers.cc:597] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.315246 22285 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 124425us
I20260709 12:19:52.323282 22473 consensus_queue.cc:237] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:52.317127 23095 consensus_peers.cc:597] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:52.336642 22296 catalog_manager.cc:5697] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 reported cstate change: config changed from index 14 to 15, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:52.340981 29672 log.cc:927] Time spent T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:19:52.363802 23122 raft_consensus.cc:1275] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 [term 23 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 12:19:52.358202 23095 consensus_peers.cc:597] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:52.369136 29520 consensus_queue.cc:1048] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:19:52.391769 23095 consensus_peers.cc:597] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.414722 22285 catalog_manager.cc:4755] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 67ad5236324342d48e6d762f265e4a3a: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 12:19:52.424686 23095 consensus_peers.cc:597] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.424448 22442 consensus_peers.cc:597] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:52.419950 29621 raft_consensus.cc:2955] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 23 LEADER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:52.439420 22516 consensus_peers.cc:597] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.439940 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 130208us
W20260709 12:19:52.449398 22516 consensus_peers.cc:597] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:52.462308 23127 raft_consensus.cc:2955] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:52.473215 23095 consensus_peers.cc:597] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:52.474254 22549 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:19:52.478929 29660 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:52.480666 22470 raft_consensus.cc:2955] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:52.482337 23122 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 19 LEARNER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:19:52.482491 22469 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Refusing update from remote peer b8621fa34be04d3fa2d68a300f858cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:19:52.487352 29662 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:19:52.490901 23095 consensus_peers.cc:597] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.491566 23095 consensus_peers.cc:597] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.492599 22442 consensus_peers.cc:597] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.493268 22442 consensus_peers.cc:597] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:52.489454 29662 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
W20260709 12:19:52.537590 22516 consensus_peers.cc:597] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.543356 22516 consensus_peers.cc:597] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.542642 23095 consensus_peers.cc:597] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.551810 22442 consensus_peers.cc:597] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:52.576992 22293 catalog_manager.cc:5697] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 16 to 17, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New cstate: current_term: 23 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:52.584523 22442 consensus_peers.cc:597] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.596562 22442 consensus_peers.cc:597] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.597008 23095 consensus_peers.cc:597] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:52.602873 22516 consensus_peers.cc:597] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:52.606400 22538 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ce456c700b43db9bef6c8297fe973c with delete_type TABLET_DATA_TOMBSTONED (TS 8c3bcfa13ca74a24ab8999a408532932 not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:54490
W20260709 12:19:52.610683 22442 consensus_peers.cc:597] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:52.670662 22285 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 31ce456c700b43db9bef6c8297fe973c with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:19:52.690724 23095 consensus_peers.cc:597] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:52.691673 29662 raft_consensus.cc:2955] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:52.694250 29682 tablet_replica.cc:333] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:19:52.697297 23122 raft_consensus.cc:2955] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:19:52.757869 29678 log.cc:927] Time spent T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:19:52.784848 22549 raft_consensus.cc:2955] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:52.803480 29682 raft_consensus.cc:2243] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:52.804453 29682 raft_consensus.cc:2272] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:52.828859 22473 raft_consensus.cc:2955] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:52.827889 22298 catalog_manager.cc:5697] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 12 to 13, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "b8621fa34be04d3fa2d68a300f858cd1" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:52.897835 29682 ts_tablet_manager.cc:1916] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:53.134486 29682 ts_tablet_manager.cc:1929] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 23.16
I20260709 12:19:53.135020 29682 log.cc:1199] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-2-root/wals/31ce456c700b43db9bef6c8297fe973c
I20260709 12:19:53.140506 22284 catalog_manager.cc:5028] TS 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): tablet 31ce456c700b43db9bef6c8297fe973c (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:19:53.144188 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:53.146153 21244 tablet_replica.cc:333] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.147281 21244 raft_consensus.cc:2243] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.161003 29662 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:53.161700 29662 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:53.163915 29662 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:53.165611 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.170647 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.174880 21244 raft_consensus.cc:2272] T d7dee89f230e46e8a6f8e492cd0ca0d4 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.178628 22366 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.179467 29662 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:53.198951 21244 tablet_replica.cc:333] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.200018 21244 raft_consensus.cc:2243] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.201108 21244 raft_consensus.cc:2272] T 5f6bd9e32472432889b9795a2e3653d6 P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.204082 21244 tablet_replica.cc:333] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.210397 21244 raft_consensus.cc:2243] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.211238 21244 raft_consensus.cc:2272] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.226230 21244 tablet_replica.cc:333] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.227190 21244 raft_consensus.cc:2243] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.238183 21244 raft_consensus.cc:2272] T 2dae2730adf94f9da39f2dffbb692494 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.240375 29662 raft_consensus.cc:493] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:53.240947 29662 raft_consensus.cc:515] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:53.243072 29662 leader_election.cc:290] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:53.244058 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:53.244467 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4931c1eea6843949b1447b3e6106340" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.246609 22367 leader_election.cc:304] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:53.248098 29654 raft_consensus.cc:2749] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:53.248790 29654 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:53.249243 29654 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:53.251336 29654 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:53.252472 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.253197 29662 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:53.253750 29662 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:53.257515 29643 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:53.258149 29643 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:53.261749 29626 raft_consensus.cc:493] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:53.262364 29626 raft_consensus.cc:515] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:53.263578 29660 raft_consensus.cc:493] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:53.264181 29660 raft_consensus.cc:515] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:53.252831 29642 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:53.266458 29642 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:53.270046 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:53.274802 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.278702 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:53.280916 29660 leader_election.cc:290] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:53.281531 22366 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.281566 29660 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:53.284257 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.284152 29660 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:53.285758 29683 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:53.287045 29660 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:53.295192 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.295573 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.295040 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.296391 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.290580 29626 leader_election.cc:290] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:53.304180 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.305864 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.306203 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b016c5c65e474393776e2a5db3cfe2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.291395 29642 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:53.329873 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.330890 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3781b48054df42c08e2bf775312a3699" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.331116 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5498b1e8b04b8caba1d9a87889d60d" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.340035 29662 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:53.283109 29643 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:53.350235 29660 raft_consensus.cc:493] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:53.350854 29660 raft_consensus.cc:515] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:53.352937 29660 leader_election.cc:290] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:53.353992 29626 raft_consensus.cc:493] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:53.354565 29626 raft_consensus.cc:515] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:53.356778 29626 leader_election.cc:290] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:53.358286 29643 raft_consensus.cc:493] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:53.358973 29643 raft_consensus.cc:515] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:53.361406 29643 leader_election.cc:290] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:53.369441 22367 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:53.370080 29662 raft_consensus.cc:493] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:53.371690 29662 raft_consensus.cc:515] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:53.373998 29662 leader_election.cc:290] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:53.374869 29662 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:53.370973 29642 raft_consensus.cc:493] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:53.378827 29642 raft_consensus.cc:515] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:53.383800 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:53.385535 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.387081 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0723691b01e2413baf71cbc73a551fdc" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.390311 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:53.392105 29654 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:53.392743 29683 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:53.393152 29654 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:53.393589 22367 leader_election.cc:304] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.393735 29610 raft_consensus.cc:493] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:53.393461 29683 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:53.394309 29610 raft_consensus.cc:515] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:53.395361 29662 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:53.395686 29683 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:53.396181 29610 leader_election.cc:290] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:53.396669 29610 raft_consensus.cc:493] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:53.397151 29683 raft_consensus.cc:2749] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:53.397316 29662 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:53.397094 29610 raft_consensus.cc:515] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:53.398042 29654 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:53.398998 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:53.399971 29654 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:53.400847 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb931ddd9ec4606a06a5fd9dbc6322e" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.402482 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdd827fb2d34627bbd307872debd3d3" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.405923 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.380848 29642 leader_election.cc:290] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:53.409982 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23bd5666c81480f8ce12f767a245571" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:53.410540 21244 tablet_replica.cc:333] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.409021 29610 leader_election.cc:290] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:53.419591 21244 raft_consensus.cc:2243] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.420399 21244 raft_consensus.cc:2272] T 444001888258449e8c4f5fd4ad540389 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.406703 22367 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.423228 21244 tablet_replica.cc:333] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.423698 29642 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:53.424101 21244 raft_consensus.cc:2243] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.424901 22367 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.425374 21244 raft_consensus.cc:2272] T 9c37e03879a64c308ad32ed0e1da75e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.426265 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.426970 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad743163ad40dba602eb017e958a78" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:53.427253 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.429697 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:53.431706 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.432428 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:53.434592 29642 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:19:53.435951 22367 leader_election.cc:304] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.436951 21244 tablet_replica.cc:333] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.437942 21244 raft_consensus.cc:2243] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.439803 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d5063dbb1a45fdb6db1177b40d5c72" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.441100 29642 raft_consensus.cc:2749] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:53.441311 21244 raft_consensus.cc:2272] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.452064 21244 tablet_replica.cc:333] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.453015 21244 raft_consensus.cc:2243] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.454697 21244 raft_consensus.cc:2272] T b1433e47e33649a3a8e6313d2ec4e289 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.457603 21244 tablet_replica.cc:333] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.458510 21244 raft_consensus.cc:2243] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.442269 29643 raft_consensus.cc:493] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:53.459065 29643 raft_consensus.cc:515] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:53.461073 29643 leader_election.cc:290] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:53.445027 22366 leader_election.cc:304] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.442067 22367 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.462478 29643 raft_consensus.cc:2749] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:53.463701 22366 leader_election.cc:304] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.464270 29643 raft_consensus.cc:2749] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:19:53.475030 29626 raft_consensus.cc:493] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:53.475425 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a201b290044481b8c4e67ad9f11ed89" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.475595 29626 raft_consensus.cc:515] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:53.478392 29643 raft_consensus.cc:2749] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:53.478951 29626 leader_election.cc:290] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:53.480768 22366 leader_election.cc:304] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.481318 21244 raft_consensus.cc:2272] T 009e461415d44f48aed3f751e8855a5d P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.486159 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.485579 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff00cc49b3d446797f2e5ddc5bdfcdf" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.494355 29626 raft_consensus.cc:493] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:53.505226 29626 raft_consensus.cc:515] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:53.507517 29626 leader_election.cc:290] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:53.497314 29643 raft_consensus.cc:2749] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:53.498183 22366 leader_election.cc:304] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.498945 29642 raft_consensus.cc:493] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:53.504580 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.509572 29642 raft_consensus.cc:515] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:53.511818 29642 leader_election.cc:290] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:53.514307 29642 raft_consensus.cc:2749] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:53.515132 21244 tablet_replica.cc:333] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.515771 22366 leader_election.cc:304] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.516101 21244 raft_consensus.cc:2243] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.516835 21244 raft_consensus.cc:2272] T cc602501d91d4eff9464e488c0b6704d P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.517553 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.518896 29642 raft_consensus.cc:493] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:53.519685 29643 raft_consensus.cc:2749] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:53.519470 29642 raft_consensus.cc:515] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:53.521740 29642 leader_election.cc:290] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:53.525391 29642 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:53.526049 29642 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:53.528502 29642 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:53.529973 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.530779 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.531708 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5abbd8a2264ab6ac3b4face1caa842" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:53.534595 21244 tablet_replica.cc:333] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.535589 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b0076739944e0099d6937fbaa402f5" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.538089 21244 raft_consensus.cc:2243] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.541594 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c837f3ed639d47cc8258ce902cca0154" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:53.559815 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.562209 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fbfde86a044b028b2032a062d189e9" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:53.564185 29643 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:53.564496 29642 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:53.564824 29643 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:53.565670 29642 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:53.567750 29643 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:53.568408 29643 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:53.568511 29642 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:53.568903 29643 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:53.569463 21244 raft_consensus.cc:2272] T 9c9c94c2c7014c7b97357727b65ecdcd P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.574851 21244 tablet_replica.cc:333] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.576014 21244 raft_consensus.cc:2243] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.577438 21244 raft_consensus.cc:2272] T 277d262725804effb16ede64e81d19c8 P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.579952 29643 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:53.581287 22367 leader_election.cc:304] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.582861 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.580149 21244 tablet_replica.cc:333] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
W20260709 12:19:53.587473 22367 raft_consensus.cc:2686] T 1a201b290044481b8c4e67ad9f11ed89 P b8621fa34be04d3fa2d68a300f858cd1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:19:53.589228 22366 leader_election.cc:304] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.591739 22367 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.592501 29626 raft_consensus.cc:2749] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:53.587139 21244 raft_consensus.cc:2243] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.596976 21244 raft_consensus.cc:2272] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.598357 29642 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:53.599941 21244 tablet_replica.cc:333] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.600951 21244 raft_consensus.cc:2243] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.604028 21244 raft_consensus.cc:2272] T 67ad5236324342d48e6d762f265e4a3a P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.604560 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.610785 21244 tablet_replica.cc:333] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.611958 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.612396 21244 raft_consensus.cc:2243] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.602931 22367 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.614534 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:53.617554 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:53.618203 22551 raft_consensus.cc:1803] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: voting while tombstoned based on last-logged opid 23.16
I20260709 12:19:53.618570 22551 raft_consensus.cc:2468] T 31ce456c700b43db9bef6c8297fe973c P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8621fa34be04d3fa2d68a300f858cd1 in term 23.
I20260709 12:19:53.619722 29642 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:53.621079 22367 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:53.622545 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:53.624068 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:19:53.624861 22285 catalog_manager.cc:4755] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): ChangeConfig:REMOVE_PEER RPC failed for tablet 9c37e03879a64c308ad32ed0e1da75e9: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:53.630012 29642 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:53.631608 22367 leader_election.cc:304] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.632496 29642 raft_consensus.cc:493] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:53.635035 29642 raft_consensus.cc:515] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:53.637353 29642 leader_election.cc:290] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:53.638252 29642 raft_consensus.cc:2749] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:19:53.642342 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367745908a334997957e47f869d9fb14" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.643692 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71e68d38beb49d496914180d9606c26" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.645200 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.645231 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ce456c700b43db9bef6c8297fe973c" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.647696 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.648900 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:53.613138 21244 raft_consensus.cc:2272] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.634305 22366 leader_election.cc:304] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.652287 29642 raft_consensus.cc:2749] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:53.652660 21244 tablet_replica.cc:333] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.653529 21244 raft_consensus.cc:2243] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.654258 21244 raft_consensus.cc:2272] T beb931ddd9ec4606a06a5fd9dbc6322e P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.667985 21244 tablet_replica.cc:333] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.668829 21244 raft_consensus.cc:2243] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.669394 21244 raft_consensus.cc:2272] T b2b016c5c65e474393776e2a5db3cfe2 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.677717 21244 tablet_replica.cc:333] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.678511 21244 raft_consensus.cc:2243] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.653581 22366 leader_election.cc:304] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:53.679687 29642 raft_consensus.cc:2749] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:53.684338 22366 leader_election.cc:304] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.685521 29642 raft_consensus.cc:2749] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:53.689679 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453901cb626f4358bcfa980bf0d03ea4" candidate_uuid: "b8621fa34be04d3fa2d68a300f858cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:53.679759 21244 raft_consensus.cc:2272] T c3bf88f0980e49afb7b7f1dabfbb3815 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.700817 21244 tablet_replica.cc:333] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.701627 21244 raft_consensus.cc:2243] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.702785 21244 raft_consensus.cc:2272] T abad5d59b4bd455ab855711fa092b038 P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.705245 21244 tablet_replica.cc:333] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.706027 21244 raft_consensus.cc:2243] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.706560 21244 raft_consensus.cc:2272] T c837f3ed639d47cc8258ce902cca0154 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.709211 21244 tablet_replica.cc:333] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.710029 21244 raft_consensus.cc:2243] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.710654 22366 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.711002 21244 raft_consensus.cc:2272] T e8e9f45e270942459d8aa926ed037bec P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:53.722299 22366 raft_consensus.cc:2686] T 7f7fcc060e2443ad87cf29161f3ea079 P b8621fa34be04d3fa2d68a300f858cd1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:19:53.728870 21244 tablet_replica.cc:333] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.729821 21244 raft_consensus.cc:2243] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.716579 22367 leader_election.cc:304] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.732892 21244 raft_consensus.cc:2272] T eed3b8d7432b461c802823d02d952440 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.734181 29642 raft_consensus.cc:2749] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:19:53.735628 22367 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:53.738001 29626 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:53.737569 21244 tablet_replica.cc:333] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.744160 21244 raft_consensus.cc:2243] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.745986 21244 raft_consensus.cc:2272] T dd445b6ff12a48a9a51097b364e1da2e P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.753245 22367 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:53.753984 21244 tablet_replica.cc:333] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
W20260709 12:19:53.754160 22367 raft_consensus.cc:2686] T 31ce456c700b43db9bef6c8297fe973c P b8621fa34be04d3fa2d68a300f858cd1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:19:53.754853 21244 raft_consensus.cc:2243] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.764091 22367 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:53.764194 21244 raft_consensus.cc:2272] T ec9af5639dd5418baaabd871ac6515f0 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.765007 29642 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:53.766423 22367 leader_election.cc:304] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8621fa34be04d3fa2d68a300f858cd1; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:53.767215 29642 raft_consensus.cc:2749] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:53.767294 21244 tablet_replica.cc:333] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.768292 21244 raft_consensus.cc:2243] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.768991 21244 raft_consensus.cc:2272] T 367745908a334997957e47f869d9fb14 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.771552 21244 tablet_replica.cc:333] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.772306 21244 raft_consensus.cc:2243] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.772894 21244 raft_consensus.cc:2272] T 906ffc7e978c43a2841f212271a02a94 P b8621fa34be04d3fa2d68a300f858cd1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.775650 21244 tablet_replica.cc:333] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.776456 21244 raft_consensus.cc:2243] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.785445 21244 raft_consensus.cc:2272] T 5a1d549b197d46b29284e9fda8131aa2 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.788410 21244 tablet_replica.cc:333] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.789230 21244 raft_consensus.cc:2243] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.790359 21244 raft_consensus.cc:2272] T c7c8d517a42b486fab919998ad1e7e07 P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.804867 21244 tablet_replica.cc:333] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.805712 21244 raft_consensus.cc:2243] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.806437 21244 raft_consensus.cc:2272] T f1115558d9fe452f8e6c19d821f08bfd P b8621fa34be04d3fa2d68a300f858cd1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.809326 21244 tablet_replica.cc:333] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.810161 21244 raft_consensus.cc:2243] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.810835 21244 raft_consensus.cc:2272] T 2974af5009474d6590a8e35ea1dc6b83 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.823742 21244 tablet_replica.cc:333] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.824529 21244 raft_consensus.cc:2243] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.825464 21244 raft_consensus.cc:2272] T 272f66365eb84231bc71d7c51137bbfb P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.828145 21244 tablet_replica.cc:333] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.828864 21244 raft_consensus.cc:2243] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.829493 21244 raft_consensus.cc:2272] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P b8621fa34be04d3fa2d68a300f858cd1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.832113 21244 tablet_replica.cc:333] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.832968 21244 raft_consensus.cc:2243] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.838599 21244 raft_consensus.cc:2272] T 41ad743163ad40dba602eb017e958a78 P b8621fa34be04d3fa2d68a300f858cd1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.841328 21244 tablet_replica.cc:333] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.842509 21244 raft_consensus.cc:2243] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.843402 21244 raft_consensus.cc:2272] T cbdd827fb2d34627bbd307872debd3d3 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.846328 21244 tablet_replica.cc:333] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.847121 21244 raft_consensus.cc:2243] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.848035 21244 raft_consensus.cc:2272] T 2d5abbd8a2264ab6ac3b4face1caa842 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.860646 21244 tablet_replica.cc:333] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.861433 21244 raft_consensus.cc:2243] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.862028 21244 raft_consensus.cc:2272] T 3781b48054df42c08e2bf775312a3699 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.864745 21244 tablet_replica.cc:333] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.865494 21244 raft_consensus.cc:2243] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.866714 21244 raft_consensus.cc:2272] T 3b0059ced3574627a342d9de0f02a487 P b8621fa34be04d3fa2d68a300f858cd1 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.869351 21244 tablet_replica.cc:333] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.870079 21244 raft_consensus.cc:2243] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.870908 21244 raft_consensus.cc:2272] T 0723691b01e2413baf71cbc73a551fdc P b8621fa34be04d3fa2d68a300f858cd1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.873474 21244 tablet_replica.cc:333] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.874315 21244 raft_consensus.cc:2243] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.874867 21244 raft_consensus.cc:2272] T a0d5063dbb1a45fdb6db1177b40d5c72 P b8621fa34be04d3fa2d68a300f858cd1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.877418 21244 tablet_replica.cc:333] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.878206 21244 raft_consensus.cc:2243] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.878937 21244 raft_consensus.cc:2272] T 14fbfde86a044b028b2032a062d189e9 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.892877 21244 tablet_replica.cc:333] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.893652 21244 raft_consensus.cc:2243] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.894248 21244 raft_consensus.cc:2272] T d71e68d38beb49d496914180d9606c26 P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.896775 21244 tablet_replica.cc:333] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.897457 21244 raft_consensus.cc:2243] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.904524 21244 raft_consensus.cc:2272] T 3c5498b1e8b04b8caba1d9a87889d60d P b8621fa34be04d3fa2d68a300f858cd1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.928076 21244 tablet_replica.cc:333] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.930697 21244 raft_consensus.cc:2243] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.938684 21244 raft_consensus.cc:2272] T f8462358d27c41a9a8e75c2021a10a4a P b8621fa34be04d3fa2d68a300f858cd1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.948443 21244 tablet_replica.cc:333] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.954412 21244 raft_consensus.cc:2243] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.955226 21244 raft_consensus.cc:2272] T 453901cb626f4358bcfa980bf0d03ea4 P b8621fa34be04d3fa2d68a300f858cd1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.975433 21244 tablet_replica.cc:333] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.976404 21244 raft_consensus.cc:2243] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.977654 21244 raft_consensus.cc:2272] T a60334567abd4be7b4e9f6f2e754d015 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.980734 21244 tablet_replica.cc:333] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:53.990111 21244 raft_consensus.cc:2243] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.998212 21244 raft_consensus.cc:2272] T 12b0076739944e0099d6937fbaa402f5 P b8621fa34be04d3fa2d68a300f858cd1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.026734 21244 tablet_replica.cc:333] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:54.034390 21244 raft_consensus.cc:2243] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.048990 21244 raft_consensus.cc:2272] T e4931c1eea6843949b1447b3e6106340 P b8621fa34be04d3fa2d68a300f858cd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.052349 21244 tablet_replica.cc:333] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1: stopping tablet replica
I20260709 12:19:54.054486 21244 raft_consensus.cc:2243] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.056082 21244 raft_consensus.cc:2272] T c23bd5666c81480f8ce12f767a245571 P b8621fa34be04d3fa2d68a300f858cd1 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:54.305416 23095 consensus_peers.cc:597] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:54.342629 22516 consensus_peers.cc:597] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.512689 29685 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.513343 29685 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:54.515882 29685 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:54.519296 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:54.522181 22442 leader_election.cc:336] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:54.522722 22442 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:54.523563 29685 raft_consensus.cc:2749] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:54.570658 29685 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.571215 29685 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:54.574257 29685 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:54.574431 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:54.574261 22442 consensus_peers.cc:597] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:54.577939 22442 leader_election.cc:336] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:54.578408 22442 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:54.579257 29686 raft_consensus.cc:2749] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:54.585222 29686 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.585829 29686 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:54.590111 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:54.593740 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:54.595661 22441 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:54.596496 29607 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:54.597936 29686 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:54.600358 22442 leader_election.cc:336] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:54.606048 29687 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:19:54.606997 22442 consensus_peers.cc:597] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.606673 29687 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:54.609177 29687 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:54.611785 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:54.612489 22469 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 15.
W20260709 12:19:54.614784 22516 consensus_peers.cc:597] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.617987 22516 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:54.618813 29618 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:54.619271 29618 raft_consensus.cc:493] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.619673 29618 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:54.626304 22516 leader_election.cc:336] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:54.629343 23095 consensus_peers.cc:597] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.629164 29618 raft_consensus.cc:515] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:54.632524 22442 consensus_peers.cc:597] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.638316 29639 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.638972 29639 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:54.644428 22516 leader_election.cc:336] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:54.646091 29655 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
W20260709 12:19:54.646277 22442 consensus_peers.cc:597] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.646888 29655 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:54.648335 29639 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:54.648962 23095 consensus_peers.cc:597] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:54.649528 23095 consensus_peers.cc:597] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.653134 29618 leader_election.cc:290] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:54.654639 29655 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:54.655402 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1433e47e33649a3a8e6313d2ec4e289" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:54.655997 22469 raft_consensus.cc:3060] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:54.656564 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:54.658351 29655 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.658998 29655 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:54.662669 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:54.668164 22516 consensus_peers.cc:597] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.671113 29655 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:54.674010 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:54.675246 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:54.676105 23095 leader_election.cc:336] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:54.679952 22442 consensus_peers.cc:597] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.679620 23095 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:54.682654 29655 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:54.689262 29618 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.690351 22469 raft_consensus.cc:2468] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:54.689958 29618 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:54.692909 29607 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.693521 29607 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:54.697791 23129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:19:54.700654 22442 leader_election.cc:336] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:54.701635 29618 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:54.701817 29607 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:54.703088 23095 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:54.703884 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:54.704559 22475 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 20.
I20260709 12:19:54.706519 29655 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:19:54.709909 22516 consensus_peers.cc:597] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:54.710464 22516 consensus_peers.cc:597] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.711187 22516 leader_election.cc:304] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:54.716396 29618 raft_consensus.cc:2804] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:19:54.711241 23095 leader_election.cc:336] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:54.720096 29618 raft_consensus.cc:697] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:54.721159 29618 consensus_queue.cc:237] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:54.726352 22442 consensus_peers.cc:597] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.731102 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:54.733031 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:54.734236 29655 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:19:54.732441 22516 leader_election.cc:336] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:54.735898 23095 leader_election.cc:336] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:54.742861 22441 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:54.744204 29693 raft_consensus.cc:2749] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:19:54.754377 22442 consensus_peers.cc:597] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.734949 22516 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:54.756101 29687 raft_consensus.cc:2749] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:19:54.759641 23095 consensus_peers.cc:597] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:54.785923 23095 consensus_peers.cc:597] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.786841 22296 catalog_manager.cc:5697] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 15 to 16, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 16 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:54.807111 29618 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.807363 29687 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.807873 29687 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:54.807817 29618 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:54.810279 29687 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:54.814203 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:54.814944 22469 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:54.815918 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:54.816146 29639 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.816602 22475 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 23.
I20260709 12:19:54.816701 29639 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:54.818730 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:54.819590 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:54.810289 29618 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:54.822062 29618 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:54.822435 29618 raft_consensus.cc:493] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.822815 29618 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:19:54.822943 22285 catalog_manager.cc:4755] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 67ad5236324342d48e6d762f265e4a3a: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:54.825068 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:54.825809 22551 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 20.
I20260709 12:19:54.827148 29687 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:19:54.827626 29687 raft_consensus.cc:493] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.828044 29687 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:19:54.829862 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:54.830605 29639 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:54.830605 22475 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 20.
I20260709 12:19:54.835117 29607 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.835467 29693 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.835783 29607 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:54.836002 29693 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:54.837924 29686 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.838649 29686 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:54.843149 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:54.846868 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:54.847568 23122 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
I20260709 12:19:54.848883 29607 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:54.838039 29693 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:54.849164 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:19:54.849612 22442 leader_election.cc:336] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:54.849815 22551 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
W20260709 12:19:54.850159 22442 leader_election.cc:336] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:54.850533 22442 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:54.851392 22442 leader_election.cc:336] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:54.851999 22441 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:54.852195 29693 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:54.841517 29686 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:54.853108 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:54.854687 29607 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:54.855098 29607 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.855305 22441 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:54.855513 29607 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:54.856514 29686 raft_consensus.cc:2749] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:19:54.860603 23095 leader_election.cc:336] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:54.861994 23095 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:54.876401 29655 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:19:54.876230 29607 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:54.876823 29655 raft_consensus.cc:493] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.877259 29655 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:19:54.879752 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 60225.9us
W20260709 12:19:54.885366 22516 leader_election.cc:336] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:54.886171 22516 leader_election.cc:336] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:54.887578 29618 raft_consensus.cc:515] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:54.889982 29618 leader_election.cc:290] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:54.891273 29687 raft_consensus.cc:515] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:54.895634 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009e461415d44f48aed3f751e8855a5d" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:54.906287 22475 raft_consensus.cc:3060] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:54.930549 22475 raft_consensus.cc:2468] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
I20260709 12:19:54.885560 29655 raft_consensus.cc:515] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:54.934877 29655 leader_election.cc:290] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:54.935557 29655 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.936065 29655 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:54.942443 22516 leader_election.cc:304] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:54.955835 29655 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:54.970535 29700 raft_consensus.cc:2804] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:54.971165 29700 raft_consensus.cc:697] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:54.971990 29700 consensus_queue.cc:237] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:54.972697 29687 leader_election.cc:290] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 24 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:54.974185 29607 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:54.991387 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 99219.9us
W20260709 12:19:54.994395 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 52062.5us
W20260709 12:19:54.997071 22516 leader_election.cc:336] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:54.995718 23094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:38645, user_credentials={real_user=slave}} blocked reactor thread for 91803.9us
I20260709 12:19:54.999185 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:54.999821 22551 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:55.000976 29607 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.001538 29607 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:55.003484 29687 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.004319 29607 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:55.005347 22516 consensus_peers.cc:597] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:55.002108 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:55.007236 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277d262725804effb16ede64e81d19c8" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:55.007815 22475 raft_consensus.cc:3060] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:19:55.004036 29687 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:54.991703 29693 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:54.991544 29686 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.021584 29693 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:55.016037 29607 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.022854 29607 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:55.022272 29686 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:55.025128 29607 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:55.025583 29686 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:55.023774 29693 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:55.029673 22442 consensus_peers.cc:597] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:55.029793 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:55.034440 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:55.043148 22550 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:55.035751 22475 raft_consensus.cc:2468] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 24.
I20260709 12:19:55.038519 22551 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 21.
I20260709 12:19:55.021970 29687 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:55.011327 22516 leader_election.cc:336] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:55.049091 23095 consensus_peers.cc:597] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:55.048308 29699 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.053125 29699 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:55.055284 29699 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:55.057036 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:55.057686 22551 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 21.
W20260709 12:19:55.062152 23095 leader_election.cc:336] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:55.062772 23095 leader_election.cc:336] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:55.063151 23095 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:55.063925 29701 raft_consensus.cc:2749] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:19:55.064926 23095 consensus_peers.cc:597] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:55.065961 29707 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.071501 22550 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 20.
I20260709 12:19:55.074143 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37e03879a64c308ad32ed0e1da75e9" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:55.077284 22475 raft_consensus.cc:3060] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:55.077267 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:55.077962 23122 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:55.075644 22296 catalog_manager.cc:5697] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 18 to 19, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 19 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:55.081740 23095 consensus_peers.cc:597] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:55.082345 23095 consensus_peers.cc:597] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:55.066509 29707 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:55.075760 22442 leader_election.cc:336] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:55.085639 29707 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:55.086102 22442 consensus_peers.cc:597] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:55.086591 22442 leader_election.cc:336] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:55.093400 22516 leader_election.cc:304] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:55.093969 22441 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:19:55.095165 22442 consensus_peers.cc:597] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:55.095757 22442 leader_election.cc:336] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:55.096215 22442 consensus_peers.cc:597] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:55.096597 22442 leader_election.cc:336] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:55.102298 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:55.103011 22476 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 21.
I20260709 12:19:55.097288 22442 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:55.105198 22475 raft_consensus.cc:2468] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 21.
I20260709 12:19:55.106292 22515 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:19:55.117110 22442 leader_election.cc:336] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:55.107199 29706 raft_consensus.cc:2804] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:19:55.118288 29699 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:55.118651 29706 raft_consensus.cc:697] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 24 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:55.118765 29699 raft_consensus.cc:493] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.119218 29699 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:55.119639 29706 consensus_queue.cc:237] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:55.121151 29685 raft_consensus.cc:2749] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:55.107316 29607 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:19:55.123665 22442 leader_election.cc:336] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:55.123104 29607 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.128276 29708 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.128890 29708 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:55.125943 29607 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:55.140787 23095 leader_election.cc:304] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:55.140409 29639 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.144083 29639 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:55.146410 29639 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:55.147998 29708 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:55.151589 23095 leader_election.cc:336] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:55.151589 29701 raft_consensus.cc:2804] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:19:55.152036 29699 raft_consensus.cc:515] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:55.152936 29701 raft_consensus.cc:697] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [term 21 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:55.153426 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:55.154042 23122 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:55.153945 29701 consensus_queue.cc:237] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:55.152205 23095 leader_election.cc:336] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:55.141343 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:55.162113 23122 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 20.
I20260709 12:19:55.163744 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:55.167212 23122 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 17.
I20260709 12:19:55.180243 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:55.180966 22473 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 14.
I20260709 12:19:55.182161 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:55.183097 23122 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 14.
I20260709 12:19:55.189016 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:55.191113 29708 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:55.191540 29708 raft_consensus.cc:493] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.193199 29708 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:55.185108 29687 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:19:55.205096 29687 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.199884 29712 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.205555 29687 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:55.205991 29712 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:55.202253 29699 leader_election.cc:290] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:55.209739 29712 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:55.213373 22516 leader_election.cc:336] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:55.214530 22516 leader_election.cc:336] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:55.215240 22469 raft_consensus.cc:1275] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:19:55.216122 22516 consensus_peers.cc:597] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:55.226467 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:55.227203 23122 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 20.
I20260709 12:19:55.233480 29706 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.234222 29706 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:55.236373 29706 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:55.245177 23095 consensus_peers.cc:597] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:55.262933 29687 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:55.265244 29687 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:55.266638 29708 raft_consensus.cc:515] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:55.268858 29708 leader_election.cc:290] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:55.277946 29607 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:55.280579 29607 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:55.282668 29706 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.283249 29706 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:55.282692 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:55.284325 22476 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 28.
I20260709 12:19:55.285327 29706 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:55.288975 29706 consensus_queue.cc:1048] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:55.288494 22296 catalog_manager.cc:5697] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 20 to 21, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 21 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:55.294874 23095 consensus_peers.cc:597] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:55.295429 23095 leader_election.cc:336] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:55.268851 22515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 162633us
I20260709 12:19:55.300073 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed3b8d7432b461c802823d02d952440" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:55.300697 23127 raft_consensus.cc:3060] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:55.300669 29701 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.305060 29701 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:55.307755 29701 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927)
I20260709 12:19:55.310613 23127 raft_consensus.cc:2468] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
W20260709 12:19:55.313578 23095 leader_election.cc:336] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:55.307780 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
W20260709 12:19:55.315793 22516 leader_election.cc:336] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:55.319008 29713 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:19:55.319695 29713 raft_consensus.cc:493] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 28 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.320495 29713 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:19:55.317507 22296 catalog_manager.cc:5697] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 23 to 24, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 24 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:55.327276 22441 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:55.328033 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e9f45e270942459d8aa926ed037bec" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:55.333155 22475 raft_consensus.cc:3060] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:55.337126 22515 leader_election.cc:304] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:55.337574 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:55.328855 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:55.329898 22545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:55.338363 22469 raft_consensus.cc:2393] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c3bcfa13ca74a24ab8999a408532932 in current term 22: Already voted for candidate 25ebf14868c042dca42f54b3e251e1b2 in this term.
I20260709 12:19:55.339143 22546 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 17.
I20260709 12:19:55.339179 22470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:55.342213 22470 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 16.
I20260709 12:19:55.342314 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:55.343005 22550 raft_consensus.cc:2393] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 25ebf14868c042dca42f54b3e251e1b2 in current term 22: Already voted for candidate 8c3bcfa13ca74a24ab8999a408532932 in this term.
I20260709 12:19:55.343602 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:55.344254 22476 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:55.345382 22475 raft_consensus.cc:2468] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 15.
I20260709 12:19:55.350188 29607 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:19:55.350848 29607 raft_consensus.cc:697] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:55.351094 23094 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:55.351913 29607 consensus_queue.cc:237] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:55.337970 29706 raft_consensus.cc:2804] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:55.352873 29701 raft_consensus.cc:2749] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:55.353148 29706 raft_consensus.cc:697] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:55.352350 23094 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:55.350703 22441 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:55.332445 22442 leader_election.cc:336] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:55.354486 29701 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:55.354077 29706 consensus_queue.cc:237] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:55.355496 29715 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:55.356048 29715 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.356418 29715 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:55.360589 29701 raft_consensus.cc:493] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.361125 29701 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:55.364523 29715 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:55.366954 29715 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:55.368103 22441 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:55.372056 22442 consensus_peers.cc:597] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:55.373571 29711 raft_consensus.cc:2764] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 12:19:55.375130 21244 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22423)
I20260709 12:19:55.375216 22441 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:55.376780 29713 raft_consensus.cc:515] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:55.377974 29711 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:19:55.378409 29711 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.378770 29711 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:55.388737 29711 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:55.393738 22442 leader_election.cc:336] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:55.398960 29713 leader_election.cc:290] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 29 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:55.401571 22296 catalog_manager.cc:5697] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 18 to 19, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 19 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.403673 22293 catalog_manager.cc:5697] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 19 to 20, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 20 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:55.408812 22442 leader_election.cc:336] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:55.410962 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:55.411546 23127 raft_consensus.cc:3060] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:55.411625 23095 leader_election.cc:304] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:55.417611 29704 raft_consensus.cc:2804] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:55.418443 29704 raft_consensus.cc:697] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:55.419611 29704 consensus_queue.cc:237] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:55.419665 23127 raft_consensus.cc:2468] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 18.
I20260709 12:19:55.410729 29706 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.423180 29706 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:55.427703 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:55.427845 29706 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:55.429855 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:55.420691 29711 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:55.440876 23127 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 19.
I20260709 12:19:55.442200 22515 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:55.443053 29713 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:55.443454 29713 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.443826 29713 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:55.444422 22441 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:55.445225 29607 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:19:55.449327 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:55.450022 23127 raft_consensus.cc:3060] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:55.454161 29706 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:55.454665 29706 raft_consensus.cc:493] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.454986 22473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51846
I20260709 12:19:55.455597 22473 raft_consensus.cc:606] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Received request to transfer leadership
I20260709 12:19:55.459342 22441 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:55.460686 29713 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:55.462651 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:55.464439 29607 raft_consensus.cc:2804] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:55.465016 29607 raft_consensus.cc:697] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:55.465332 29687 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:55.465787 29687 raft_consensus.cc:493] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8621fa34be04d3fa2d68a300f858cd1)
I20260709 12:19:55.466648 29687 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:55.465756 29607 consensus_queue.cc:237] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:55.455061 29706 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:55.479877 22473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51846
I20260709 12:19:55.480520 22473 raft_consensus.cc:606] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Received request to transfer leadership
I20260709 12:19:55.484249 22473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd"
dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51846
I20260709 12:19:55.484936 22473 raft_consensus.cc:606] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Received request to transfer leadership
I20260709 12:19:55.485476 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0059ced3574627a342d9de0f02a487" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:55.486074 22475 raft_consensus.cc:3060] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:19:55.436092 29701 raft_consensus.cc:515] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:55.498073 23095 leader_election.cc:336] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:55.499565 22347 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:19:55.500007 22347 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 9c9c94c2c7014c7b97357727b65ecdcd already in progress
W20260709 12:19:55.500290 22347 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 9c9c94c2c7014c7b97357727b65ecdcd already in progress
W20260709 12:19:55.500479 22516 leader_election.cc:336] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:55.501158 22516 leader_election.cc:336] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:55.499619 22296 catalog_manager.cc:5697] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 14 to 15, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 15 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:55.504613 29687 raft_consensus.cc:515] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:55.506685 29687 leader_election.cc:290] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:55.499626 22293 catalog_manager.cc:5697] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 17 to 18, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 18 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.517149 29713 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:55.520885 29701 leader_election.cc:290] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:55.522135 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8462358d27c41a9a8e75c2021a10a4a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:55.522805 22546 raft_consensus.cc:3060] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:55.522946 23127 raft_consensus.cc:2468] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 21.
I20260709 12:19:55.501515 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:55.524112 22441 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:55.524655 22516 leader_election.cc:336] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:55.524901 29711 raft_consensus.cc:2804] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:19:55.525476 29711 raft_consensus.cc:697] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:55.527010 29713 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:19:55.526490 29711 consensus_queue.cc:237] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:55.532303 22475 raft_consensus.cc:2468] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 29.
W20260709 12:19:55.525605 22516 consensus_peers.cc:597] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:55.537575 29706 raft_consensus.cc:515] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:55.538019 22546 raft_consensus.cc:2468] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 18.
I20260709 12:19:55.546002 23094 leader_election.cc:304] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:55.547192 29701 raft_consensus.cc:2804] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:55.547938 29701 raft_consensus.cc:697] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 18 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
I20260709 12:19:55.548854 29701 consensus_queue.cc:237] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:55.552621 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60334567abd4be7b4e9f6f2e754d015" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:19:55.553354 23127 raft_consensus.cc:3060] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:19:55.543987 22516 consensus_peers.cc:597] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:55.557595 22516 leader_election.cc:336] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:55.564361 22473 raft_consensus.cc:1275] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:19:55.566959 23127 raft_consensus.cc:2468] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 20.
I20260709 12:19:55.568120 22515 leader_election.cc:304] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:55.573942 22473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd445b6ff12a48a9a51097b364e1da2e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:55.571967 29618 raft_consensus.cc:2804] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:19:55.581400 29618 raft_consensus.cc:697] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:55.582393 29618 consensus_queue.cc:237] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:55.586761 22473 raft_consensus.cc:3060] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:55.589157 22470 raft_consensus.cc:1275] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 24 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:19:55.573865 22516 leader_election.cc:304] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:55.588255 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abad5d59b4bd455ab855711fa092b038" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:55.595872 22476 raft_consensus.cc:3060] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:55.600625 22473 raft_consensus.cc:2468] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:55.601747 29687 raft_consensus.cc:2804] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:19:55.602366 29687 raft_consensus.cc:697] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 29 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:55.603238 29687 consensus_queue.cc:237] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:55.611563 22516 leader_election.cc:336] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:55.611270 22293 catalog_manager.cc:5697] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 20 to 21, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 21 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.606477 22476 raft_consensus.cc:2468] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 17.
I20260709 12:19:55.569514 29706 leader_election.cc:290] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:55.646647 29618 consensus_queue.cc:1048] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:55.629912 22296 catalog_manager.cc:5697] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 19 to 20, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 20 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.673457 22296 catalog_manager.cc:5697] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 28 to 29, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 29 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:55.686120 29699 consensus_queue.cc:1048] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:19:55.690409 22516 leader_election.cc:304] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:55.691466 22516 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:55.692891 29713 raft_consensus.cc:2804] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:55.702111 29705 raft_consensus.cc:2804] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:55.702880 29713 raft_consensus.cc:697] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:55.703095 29705 raft_consensus.cc:697] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Becoming Leader. State: Replica: 8c3bcfa13ca74a24ab8999a408532932, State: Running, Role: LEADER
I20260709 12:19:55.703893 29713 consensus_queue.cc:237] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:55.704003 29705 consensus_queue.cc:237] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:55.712934 22296 catalog_manager.cc:5697] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 17 to 18, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 18 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:55.714382 22516 leader_election.cc:336] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:55.715263 22516 leader_election.cc:336] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:55.716120 22516 leader_election.cc:336] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:55.720126 23095 consensus_peers.cc:597] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:55.750830 22516 leader_election.cc:336] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:55.751683 22516 consensus_peers.cc:597] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:55.765683 22475 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:19:55.789848 22296 catalog_manager.cc:5697] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 17 to 18, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 18 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:55.792407 22296 catalog_manager.cc:5697] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: term changed from 16 to 17, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3). New cstate: current_term: 17 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:55.776408 29701 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 12:19:55.811121 22550 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 12:19:55.811684 22516 consensus_peers.cc:597] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:55.823685 29639 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:19:55.834568 22442 consensus_peers.cc:597] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:55.887807 22516 consensus_peers.cc:597] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:55.893349 23127 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:19:55.895144 29711 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:55.959497 22546 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 12:19:55.960052 22442 consensus_peers.cc:597] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:55.964761 23095 consensus_peers.cc:597] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:55.966027 29733 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:55.959748 23129 raft_consensus.cc:1275] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:19:55.975204 29618 consensus_queue.cc:1048] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:55.976846 23129 raft_consensus.cc:1275] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:19:55.980304 29711 consensus_queue.cc:1048] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:19:55.990535 22476 raft_consensus.cc:1275] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:56.000977 29704 consensus_queue.cc:1048] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:56.004985 29711 raft_consensus.cc:993] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2: : Instructing follower 65951063312d4a1e9123f92354101c71 to start an election
I20260709 12:19:56.005560 29711 raft_consensus.cc:1081] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Signalling peer 65951063312d4a1e9123f92354101c71 to start an election
I20260709 12:19:56.009351 23127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd"
dest_uuid: "65951063312d4a1e9123f92354101c71"
 from {username='slave'} at 127.0.0.1:41012
I20260709 12:19:56.009990 23127 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:56.010357 23127 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:56.033332 23127 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:56.034590 23128 raft_consensus.cc:1240] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 20. Current term is 21. Ops: []
I20260709 12:19:56.039532 29607 consensus_queue.cc:1059] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:19:56.040985 22442 consensus_peers.cc:597] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:56.045481 29733 raft_consensus.cc:3055] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:19:56.045980 29733 raft_consensus.cc:740] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:56.046837 29733 consensus_queue.cc:260] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:56.048318 29733 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:56.060465 23128 raft_consensus.cc:1275] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 12:19:56.062188 29618 consensus_queue.cc:1048] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:19:56.098635 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:56.099279 22546 raft_consensus.cc:3060] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:56.105073 23127 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:56.126302 22546 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 21.
I20260709 12:19:56.223176 23130 raft_consensus.cc:1275] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:19:56.226275 29747 consensus_queue.cc:1048] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:19:56.255020 22516 consensus_peers.cc:597] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:56.255595 22516 consensus_peers.cc:597] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:56.256099 22516 consensus_peers.cc:597] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:56.258492 22516 consensus_peers.cc:597] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:56.291889 22550 raft_consensus.cc:1275] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:19:56.333525 29710 consensus_queue.cc:1048] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:19:56.345350 23095 leader_election.cc:336] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:56.357460 23095 consensus_peers.cc:597] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:56.387795 21244 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 22423)
I20260709 12:19:56.407486 22468 raft_consensus.cc:1275] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:19:56.415939 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:56.420378 22475 raft_consensus.cc:1275] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 29 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 12:19:56.424803 22477 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:56.448053 29618 consensus_queue.cc:1048] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:56.510118 29705 consensus_queue.cc:1048] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:19:56.511042 29712 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
W20260709 12:19:56.531092 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 170599us
I20260709 12:19:56.565202 22471 raft_consensus.cc:2468] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 21.
W20260709 12:19:56.681906 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 100304us
I20260709 12:19:56.728210 23095 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:56.733358 29639 raft_consensus.cc:2804] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:19:56.734159 29639 raft_consensus.cc:697] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 21 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:19:56.735198 23095 consensus_peers.cc:597] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:56.735522 29639 consensus_queue.cc:237] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:56.775693 22298 catalog_manager.cc:5697] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 20 to 21, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 21 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:56.924989 23095 consensus_peers.cc:597] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:56.965126 22285 catalog_manager.cc:4755] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 67ad5236324342d48e6d762f265e4a3a: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:56.996747 23095 consensus_peers.cc:597] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:57.033461 22516 consensus_peers.cc:597] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:57.070892 22442 consensus_peers.cc:597] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:57.082772 22516 consensus_peers.cc:597] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:57.113783 22442 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111) [suppressed 427 similar messages]
W20260709 12:19:57.124121 22516 consensus_peers.cc:597] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:57.175254 22471 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:19:57.177539 29639 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:19:57.207056 22442 consensus_peers.cc:597] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:57.388979 21244 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 22423)
I20260709 12:19:57.422256 23127 consensus_queue.cc:237] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:57.460577 23095 consensus_peers.cc:597] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:57.477180 23095 consensus_peers.cc:597] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:57.480543 23095 consensus_peers.cc:597] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:57.481052 23095 consensus_peers.cc:597] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:57.576774 23095 consensus_peers.cc:597] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:57.577522 23095 consensus_peers.cc:597] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:57.601701 22284 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9c9c94c2c7014c7b97357727b65ecdcd with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:19:57.758620 22472 raft_consensus.cc:1275] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:19:57.788609 29782 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.809196 29789 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.789319 29782 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
W20260709 12:19:57.882280 22441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:34357, user_credentials={real_user=slave}} blocked reactor thread for 71340.1us
I20260709 12:19:57.885593 29782 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:57.934666 29789 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:19:57.964809 23095 consensus_peers.cc:597] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:57.975600 29779 consensus_queue.cc:1048] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:19:57.977910 29789 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:57.993899 29793 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.994637 29793 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:58.028777 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:58.034271 22546 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:19:58.029865 22472 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 22.
I20260709 12:19:58.038309 29793 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:58.054075 22442 consensus_peers.cc:597] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:58.054991 22442 consensus_peers.cc:597] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:58.055516 22442 consensus_peers.cc:597] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:58.055927 22442 consensus_peers.cc:597] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:58.056304 22442 consensus_peers.cc:597] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:58.056854 22442 consensus_peers.cc:597] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:58.057277 22442 consensus_peers.cc:597] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:58.057679 22442 consensus_peers.cc:597] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:58.086527 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:58.092548 22442 leader_election.cc:336] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:58.094221 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:58.099224 29799 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:19:58.117853 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:58.118510 22550 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 22.
W20260709 12:19:58.156708 22442 consensus_peers.cc:597] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:58.179836 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 55025.6us
W20260709 12:19:58.182076 22516 consensus_peers.cc:597] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:58.194448 22516 leader_election.cc:336] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:58.195003 22516 consensus_peers.cc:597] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:58.195668 22516 consensus_peers.cc:597] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:58.196099 22516 leader_election.cc:336] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:58.196493 22516 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:58.191962 23095 consensus_peers.cc:597] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:58.203883 23095 consensus_peers.cc:597] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:58.197536 22516 consensus_peers.cc:597] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:58.215070 22441 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:58.214602 29618 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:19:58.216233 23095 consensus_peers.cc:597] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:58.218168 23095 consensus_peers.cc:597] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:58.226138 29792 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:19:58.229022 29792 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.229436 29792 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:19:58.239108 29792 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:58.241251 29792 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 election: Requested vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:19:58.217809 22516 consensus_peers.cc:597] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:58.243182 22516 consensus_peers.cc:597] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:58.246850 22442 leader_election.cc:336] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:58.261600 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:58.262372 22551 raft_consensus.cc:3060] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:19:58.281261 29756 raft_consensus.cc:2955] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [term 21 LEADER]: Committing config change with OpId 21.17: config changed from index 15 to 17, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:58.289952 22468 raft_consensus.cc:2955] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Committing config change with OpId 21.17: config changed from index 15 to 17, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:19:58.290832 22551 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 23.
I20260709 12:19:58.292634 22441 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:58.293738 29792 raft_consensus.cc:2804] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:19:58.295125 29792 raft_consensus.cc:697] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:58.296128 29792 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:58.297267 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932; no voters: b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:58.301498 29618 raft_consensus.cc:2764] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:19:58.314512 22284 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9c37e03879a64c308ad32ed0e1da75e9 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 12:19:58.375272 22298 catalog_manager.cc:5697] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 15 to 17, VOTER 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3) evicted. New cstate: current_term: 21 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:58.385422 22296 catalog_manager.cc:5697] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 21 to 23, leader changed from b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) to 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2). New cstate: current_term: 23 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:58.389495 21244 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 22423)
W20260709 12:19:58.504163 22442 consensus_peers.cc:597] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:58.536407 22516 consensus_peers.cc:597] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:58.537907 22538 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c37e03879a64c308ad32ed0e1da75e9 with delete_type TABLET_DATA_TOMBSTONED (TS 8c3bcfa13ca74a24ab8999a408532932 not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:54490
I20260709 12:19:58.553825 29813 tablet_replica.cc:333] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:19:58.555099 29813 raft_consensus.cc:2243] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:58.556509 29813 raft_consensus.cc:2272] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:58.560024 29813 ts_tablet_manager.cc:1916] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:58.579066 29813 ts_tablet_manager.cc:1929] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.16
I20260709 12:19:58.579677 29813 log.cc:1199] T 9c37e03879a64c308ad32ed0e1da75e9 P 8c3bcfa13ca74a24ab8999a408532932: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-2-root/wals/9c37e03879a64c308ad32ed0e1da75e9
I20260709 12:19:58.582434 22284 catalog_manager.cc:5028] TS 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): tablet 9c37e03879a64c308ad32ed0e1da75e9 (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
W20260709 12:19:58.606360 23095 consensus_peers.cc:597] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:58.633472 22516 consensus_peers.cc:597] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:58.721032 22572 debug-util.cc:398] Leaking SignalData structure 0x7b08002f61a0 after lost signal to thread 21247
W20260709 12:19:58.722494 22572 debug-util.cc:398] Leaking SignalData structure 0x7b080030ab80 after lost signal to thread 22333
W20260709 12:19:58.724023 22572 debug-util.cc:398] Leaking SignalData structure 0x7b080022ff20 after lost signal to thread 22501
W20260709 12:19:58.725373 22572 debug-util.cc:398] Leaking SignalData structure 0x7b0800138700 after lost signal to thread 22575
W20260709 12:19:58.792855 22572 debug-util.cc:398] Leaking SignalData structure 0x7b0800225200 after lost signal to thread 23155
W20260709 12:19:58.835240 22516 consensus_peers.cc:597] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:59.239262 22516 consensus_peers.cc:597] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:59.654498 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 415297us
W20260709 12:19:59.610402 21244 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 22423)
I20260709 12:19:59.626811 29618 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:59.658089 29618 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:59.630865 29817 raft_consensus.cc:493] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:19:59.659047 29817 raft_consensus.cc:515] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:59.661455 29817 leader_election.cc:290] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:59.668710 29618 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:59.718565 22442 leader_election.cc:336] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:59.719403 22442 consensus_peers.cc:597] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:59.723963 29823 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:59.724656 29823 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:59.729074 29823 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:19:59.757862 22442 consensus_peers.cc:597] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:59.761613 29819 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
W20260709 12:19:59.761466 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 865389us
I20260709 12:19:59.762230 29819 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:59.763460 29817 raft_consensus.cc:493] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:59.764003 29817 raft_consensus.cc:515] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:59.765156 29819 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:59.765383 29814 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:59.769169 29814 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:59.771339 29814 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:59.766624 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:59.767149 29817 leader_election.cc:290] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:59.773612 22442 leader_election.cc:336] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:59.781535 29814 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:59.784713 29814 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:59.786783 29814 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:59.799898 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1115558d9fe452f8e6c19d821f08bfd" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:59.806336 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d549b197d46b29284e9fda8131aa2" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:59.814456 29820 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:59.815196 29820 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:59.817308 29820 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:59.818656 29819 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:59.819160 29819 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:59.820461 29798 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:59.821069 29798 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:59.821539 29814 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:59.822104 29814 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:59.823321 29798 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:59.821173 29819 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:59.824115 29814 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:59.828122 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:59.828800 22551 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 18.
I20260709 12:19:59.834108 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:59.836273 23127 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 18.
I20260709 12:19:59.835435 23094 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:59.837232 29819 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:59.838794 29819 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:19:59.840778 29819 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:59.838068 22515 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:19:59.838251 29814 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:59.843117 29814 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:59.843546 29817 raft_consensus.cc:493] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65951063312d4a1e9123f92354101c71)
I20260709 12:19:59.844054 29817 raft_consensus.cc:515] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:59.845139 29814 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:19:59.837756 29798 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:59.847577 29798 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:59.847980 29798 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:59.848644 29817 leader_election.cc:290] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:59.851090 23095 consensus_peers.cc:597] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:59.852053 23095 leader_election.cc:336] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:19:59.852294 22442 consensus_peers.cc:597] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:59.852192 29820 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:59.855741 29820 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:59.856173 29820 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:59.863811 29820 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:59.868077 22546 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:19:59.871531 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc602501d91d4eff9464e488c0b6704d" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:59.875449 29819 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:19:59.877624 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272f66365eb84231bc71d7c51137bbfb" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:19:59.901852 29819 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:59.904064 29819 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
W20260709 12:19:59.905205 22442 leader_election.cc:336] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:59.880810 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:59.886472 22472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4dc17810b42c6bf0fc46fd69d0fd9" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:59.887329 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:59.888763 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444001888258449e8c4f5fd4ad540389" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:59.894098 23095 leader_election.cc:336] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:59.878266 29798 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:59.906720 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:19:59.907768 22516 consensus_peers.cc:597] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:59.910329 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
W20260709 12:19:59.915233 22516 leader_election.cc:336] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:59.915381 29798 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:19:59.917687 23127 raft_consensus.cc:1240] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Rejecting Update request from peer 25ebf14868c042dca42f54b3e251e1b2 for earlier term 18. Current term is 19. Ops: []
W20260709 12:19:59.917964 23095 leader_election.cc:336] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:59.918129 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:19:59.918509 23095 leader_election.cc:336] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:59.918718 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2974af5009474d6590a8e35ea1dc6b83" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
W20260709 12:19:59.919265 22516 consensus_peers.cc:597] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:59.919816 22516 leader_election.cc:336] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:59.920174 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:59.917833 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:19:59.922055 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c8d517a42b486fab919998ad1e7e07" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:59.922619 29618 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:59.923291 29618 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:59.926920 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:59.927553 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:59.928884 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906ffc7e978c43a2841f212271a02a94" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:59.929831 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:59.931411 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:59.932178 29819 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:59.934171 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:59.936444 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bf88f0980e49afb7b7f1dabfbb3815" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:19:59.938140 29819 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:59.939456 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:19:59.939604 22468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2"
I20260709 12:19:59.940199 29819 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:19:59.941951 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:19:59.942709 23127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9c94c2c7014c7b97357727b65ecdcd" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:19:59.943831 22516 leader_election.cc:336] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:59.917912 29820 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:19:59.947757 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:59.948534 29820 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:19:59.949544 22516 leader_election.cc:336] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:19:59.950048 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:59.950773 29820 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:59.950835 23095 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:59.951906 29814 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:59.953049 23095 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:59.954253 29798 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:19:59.957238 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:59.958173 29814 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:59.958853 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:59.959631 29814 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:59.960309 23095 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:19:59.966225 29814 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:19:59.969460 22441 leader_election.cc:304] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:59.970347 29817 raft_consensus.cc:2749] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:59.971838 29817 consensus_queue.cc:1059] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:19:59.972940 29818 raft_consensus.cc:3055] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:59.973330 29818 raft_consensus.cc:740] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:19:59.975888 29818 consensus_queue.cc:260] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:19:59.980288 29818 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:59.987998 22441 leader_election.cc:304] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 65951063312d4a1e9123f92354101c71, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:19:59.994190 29826 raft_consensus.cc:2749] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:00.006572 29826 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:00.008721 22441 leader_election.cc:304] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:20:00.009554 29826 raft_consensus.cc:2749] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:00.023797 22547 consensus_queue.cc:237] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:20:00.046279 22515 consensus_peers.cc:597] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d7dee89f230e46e8a6f8e492cd0ca0d4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:00.052536 22468 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:00.056156 29820 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:20:00.063247 22516 consensus_peers.cc:597] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:00.138391 23095 consensus_peers.cc:597] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:00.139935 29819 raft_consensus.cc:2955] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:20:00.154451 22468 raft_consensus.cc:2955] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:20:00.172928 22296 catalog_manager.cc:5697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index -1 to 13, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 18 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
W20260709 12:20:00.199795 23095 consensus_peers.cc:597] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:00.201978 23095 consensus_peers.cc:597] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:00.209959 22468 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:20:00.218515 22441 consensus_peers.cc:597] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec9af5639dd5418baaabd871ac6515f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:00.222194 22551 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:20:00.223718 29826 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:20:00.225701 22442 consensus_peers.cc:597] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:00.239311 29818 raft_consensus.cc:2955] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index -1 to 16, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:20:00.243805 22551 raft_consensus.cc:2955] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index -1 to 16, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:20:00.318804 22551 consensus_queue.cc:237] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:20:00.349990 22515 consensus_peers.cc:597] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: abad5d59b4bd455ab855711fa092b038. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:00.359575 22468 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:00.362077 22298 catalog_manager.cc:5697] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index -1 to 16, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 23 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:00.363922 29819 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:20:00.372639 22516 consensus_peers.cc:597] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:00.391041 22516 consensus_peers.cc:597] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:00.411967 29819 raft_consensus.cc:2955] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index -1 to 14, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:20:00.416100 22468 raft_consensus.cc:2955] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index -1 to 14, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
W20260709 12:20:00.432374 22442 consensus_peers.cc:597] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:00.460755 22296 catalog_manager.cc:5697] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index -1 to 14, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 17 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
W20260709 12:20:00.473315 23095 consensus_peers.cc:597] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:00.489992 29844 ts_tablet_manager.cc:933] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:20:00.500622 29844 tablet_copy_client.cc:323] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.3:38645
W20260709 12:20:00.504901 22516 consensus_peers.cc:597] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:00.512899 23095 consensus_peers.cc:597] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:00.518224 22442 consensus_peers.cc:597] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:00.519196 22560 tablet_copy_service.cc:140] P 8c3bcfa13ca74a24ab8999a408532932: Received BeginTabletCopySession request for tablet d7dee89f230e46e8a6f8e492cd0ca0d4 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:49290)
I20260709 12:20:00.519899 22560 tablet_copy_service.cc:161] P 8c3bcfa13ca74a24ab8999a408532932: Beginning new tablet copy session on tablet d7dee89f230e46e8a6f8e492cd0ca0d4 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:49290: session id = 65951063312d4a1e9123f92354101c71-d7dee89f230e46e8a6f8e492cd0ca0d4
I20260709 12:20:00.529946 22560 tablet_copy_source_session.cc:215] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:00.535928 29844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7dee89f230e46e8a6f8e492cd0ca0d4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:00.539348 23095 consensus_peers.cc:597] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:00.559051 23095 consensus_peers.cc:597] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:00.578318 22546 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:20:00.583029 29839 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.069s	user 0.007s	sys 0.007s
I20260709 12:20:00.601701 29844 tablet_copy_client.cc:806] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:00.610271 29844 tablet_copy_client.cc:670] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
W20260709 12:20:00.610585 23095 consensus_peers.cc:597] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:00.620074 29843 log.cc:927] Time spent T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:20:00.657876 21244 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 22423)
W20260709 12:20:00.679729 22515 consensus_peers.cc:597] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357): Couldn't send request to peer 65951063312d4a1e9123f92354101c71. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c5498b1e8b04b8caba1d9a87889d60d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:00.684660 22468 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 12:20:00.693653 23095 consensus_peers.cc:597] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:00.722671 23095 consensus_peers.cc:597] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:00.729890 29844 tablet_copy_client.cc:538] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:00.739223 29822 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:20:00.741739 23152 debug-util.cc:398] Leaking SignalData structure 0x7b08001cb300 after lost signal to thread 21247
W20260709 12:20:00.742949 23152 debug-util.cc:398] Leaking SignalData structure 0x7b08003723a0 after lost signal to thread 22333
W20260709 12:20:00.744104 22516 consensus_peers.cc:597] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:00.744342 23152 debug-util.cc:398] Leaking SignalData structure 0x7b08003899e0 after lost signal to thread 22501
W20260709 12:20:00.744783 22516 consensus_peers.cc:597] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:00.745623 23152 debug-util.cc:398] Leaking SignalData structure 0x7b080033eb40 after lost signal to thread 22575
W20260709 12:20:00.748399 23152 debug-util.cc:398] Leaking SignalData structure 0x7b0800387c00 after lost signal to thread 23155
I20260709 12:20:00.761699 29844 tablet_bootstrap.cc:492] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
W20260709 12:20:00.766762 22516 consensus_peers.cc:597] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:00.781136 29823 raft_consensus.cc:2955] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
W20260709 12:20:00.801165 22442 consensus_peers.cc:597] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:00.819474 23095 consensus_peers.cc:597] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:00.840389 22468 raft_consensus.cc:2955] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } } }
I20260709 12:20:00.863431 22296 catalog_manager.cc:5697] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index -1 to 14, NON_VOTER 65951063312d4a1e9123f92354101c71 (127.20.191.4) added. New cstate: current_term: 22 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:00.928752 22442 consensus_peers.cc:597] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:00.929637 29849 ts_tablet_manager.cc:933] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:20:00.966017 22516 consensus_peers.cc:597] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:00.972962 29844 tablet_bootstrap.cc:492] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:00.974212 29844 tablet_bootstrap.cc:492] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:20:00.974995 29844 ts_tablet_manager.cc:1403] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.214s	user 0.043s	sys 0.009s
W20260709 12:20:00.975553 22442 consensus_peers.cc:597] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:00.978210 29849 tablet_copy_client.cc:323] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.2:46187
I20260709 12:20:00.983738 29852 ts_tablet_manager.cc:933] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:20:00.984272 22487 tablet_copy_service.cc:140] P 25ebf14868c042dca42f54b3e251e1b2: Received BeginTabletCopySession request for tablet ec9af5639dd5418baaabd871ac6515f0 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:43060)
I20260709 12:20:00.984846 22487 tablet_copy_service.cc:161] P 25ebf14868c042dca42f54b3e251e1b2: Beginning new tablet copy session on tablet ec9af5639dd5418baaabd871ac6515f0 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:43060: session id = 65951063312d4a1e9123f92354101c71-ec9af5639dd5418baaabd871ac6515f0
I20260709 12:20:00.998207 22487 tablet_copy_source_session.cc:215] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:20:00.998694 23095 consensus_peers.cc:597] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:01.010174 22442 consensus_peers.cc:597] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:01.017563 23095 consensus_peers.cc:597] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:01.018172 22516 consensus_peers.cc:597] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:01.022408 29849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec9af5639dd5418baaabd871ac6515f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:01.009387 29844 raft_consensus.cc:359] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:20:01.023532 29844 raft_consensus.cc:740] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:20:01.024312 29844 consensus_queue.cc:260] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
W20260709 12:20:01.035386 22442 consensus_peers.cc:597] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:01.036623 29844 ts_tablet_manager.cc:1434] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.001s
I20260709 12:20:01.038600 22560 tablet_copy_service.cc:342] P 8c3bcfa13ca74a24ab8999a408532932: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-d7dee89f230e46e8a6f8e492cd0ca0d4 received from {username='slave'} at 127.0.0.1:49290
I20260709 12:20:01.039115 22560 tablet_copy_service.cc:434] P 8c3bcfa13ca74a24ab8999a408532932: ending tablet copy session 65951063312d4a1e9123f92354101c71-d7dee89f230e46e8a6f8e492cd0ca0d4 on tablet d7dee89f230e46e8a6f8e492cd0ca0d4 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:20:01.049176 29854 ts_tablet_manager.cc:933] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71: Initiating tablet copy from peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:20:01.051111 29852 tablet_copy_client.cc:323] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.3:38645
I20260709 12:20:01.053073 22560 tablet_copy_service.cc:140] P 8c3bcfa13ca74a24ab8999a408532932: Received BeginTabletCopySession request for tablet abad5d59b4bd455ab855711fa092b038 from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:49290)
I20260709 12:20:01.053704 22560 tablet_copy_service.cc:161] P 8c3bcfa13ca74a24ab8999a408532932: Beginning new tablet copy session on tablet abad5d59b4bd455ab855711fa092b038 from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:49290: session id = 65951063312d4a1e9123f92354101c71-abad5d59b4bd455ab855711fa092b038
W20260709 12:20:01.056962 22442 consensus_peers.cc:597] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:01.061496 22442 consensus_peers.cc:597] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:01.061815 22560 tablet_copy_source_session.cc:215] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:01.065340 29852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abad5d59b4bd455ab855711fa092b038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:01.070421 29854 tablet_copy_client.cc:323] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71: tablet copy: Beginning tablet copy session from remote peer at address 127.20.191.3:38645
I20260709 12:20:01.074244 22560 tablet_copy_service.cc:140] P 8c3bcfa13ca74a24ab8999a408532932: Received BeginTabletCopySession request for tablet 3c5498b1e8b04b8caba1d9a87889d60d from peer 65951063312d4a1e9123f92354101c71 ({username='slave'} at 127.0.0.1:49290)
I20260709 12:20:01.074713 22560 tablet_copy_service.cc:161] P 8c3bcfa13ca74a24ab8999a408532932: Beginning new tablet copy session on tablet 3c5498b1e8b04b8caba1d9a87889d60d from peer 65951063312d4a1e9123f92354101c71 at {username='slave'} at 127.0.0.1:49290: session id = 65951063312d4a1e9123f92354101c71-3c5498b1e8b04b8caba1d9a87889d60d
I20260709 12:20:01.080060 29849 tablet_copy_client.cc:806] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:01.080740 29849 tablet_copy_client.cc:670] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:01.086632 29849 tablet_copy_client.cc:538] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:01.118057 22560 tablet_copy_source_session.cc:215] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:20:01.119462 22285 catalog_manager.cc:4755] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 67ad5236324342d48e6d762f265e4a3a: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:20:01.122427 29849 tablet_bootstrap.cc:492] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:20:01.131884 29854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5498b1e8b04b8caba1d9a87889d60d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:01.149858 29852 tablet_copy_client.cc:806] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:01.150606 29852 tablet_copy_client.cc:670] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:01.150830 29827 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.151389 29827 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:01.154011 29827 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:20:01.186067 29852 tablet_copy_client.cc:538] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:20:01.194239 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 73671us
W20260709 12:20:01.194931 22516 consensus_peers.cc:597] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:01.210261 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:20:01.211392 23124 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 19.
W20260709 12:20:01.219316 22442 consensus_peers.cc:597] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:01.221865 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:20:01.223310 29827 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:01.223768 29827 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.224114 29827 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:01.235890 29827 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:01.240134 29827 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Requested vote from peers 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:20:01.242151 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71"
I20260709 12:20:01.242956 23124 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:01.250425 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:20:01.266004 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "25ebf14868c042dca42f54b3e251e1b2" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:20:01.269505 23124 raft_consensus.cc:2468] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ebf14868c042dca42f54b3e251e1b2 in term 20.
I20260709 12:20:01.266022 29852 tablet_bootstrap.cc:492] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
I20260709 12:20:01.279800 22441 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71; no voters: 
I20260709 12:20:01.280771 29826 raft_consensus.cc:2804] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:20:01.273208 23095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 58389.5us
I20260709 12:20:01.282266 29826 raft_consensus.cc:697] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Becoming Leader. State: Replica: 25ebf14868c042dca42f54b3e251e1b2, State: Running, Role: LEADER
I20260709 12:20:01.283175 29826 consensus_queue.cc:237] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:01.297142 29854 tablet_copy_client.cc:806] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:01.308418 29854 tablet_copy_client.cc:670] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:01.308681 29849 tablet_bootstrap.cc:492] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=1 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:01.317699 29849 tablet_bootstrap.cc:492] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:20:01.320467 29849 ts_tablet_manager.cc:1403] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.198s	user 0.053s	sys 0.013s
W20260709 12:20:01.309403 23095 consensus_peers.cc:597] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:01.325821 22442 consensus_peers.cc:597] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:01.336114 29854 tablet_copy_client.cc:538] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:01.346902 29849 raft_consensus.cc:359] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:20:01.347999 29849 raft_consensus.cc:740] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:20:01.348784 29849 consensus_queue.cc:260] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:20:01.350313 22296 catalog_manager.cc:5697] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:01.353559 29849 ts_tablet_manager.cc:1434] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:20:01.357995 29854 tablet_bootstrap.cc:492] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71: Bootstrap starting.
W20260709 12:20:01.354337 22516 consensus_peers.cc:597] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:01.365700 22487 tablet_copy_service.cc:342] P 25ebf14868c042dca42f54b3e251e1b2: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-ec9af5639dd5418baaabd871ac6515f0 received from {username='slave'} at 127.0.0.1:43060
I20260709 12:20:01.366194 22487 tablet_copy_service.cc:434] P 25ebf14868c042dca42f54b3e251e1b2: ending tablet copy session 65951063312d4a1e9123f92354101c71-ec9af5639dd5418baaabd871ac6515f0 on tablet ec9af5639dd5418baaabd871ac6515f0 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:20:01.403646 29852 tablet_bootstrap.cc:492] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:01.404033 23124 raft_consensus.cc:1217] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.15->[23.16-23.16]   Dedup: 23.16->[]
I20260709 12:20:01.404804 29852 tablet_bootstrap.cc:492] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:20:01.405674 29852 ts_tablet_manager.cc:1403] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.160s	user 0.042s	sys 0.013s
I20260709 12:20:01.418336 23127 raft_consensus.cc:1217] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.12->[18.13-18.13]   Dedup: 18.13->[]
W20260709 12:20:01.436414 22516 consensus_peers.cc:597] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:01.443310 29852 raft_consensus.cc:359] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:20:01.450038 29852 raft_consensus.cc:740] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:20:01.462046 29852 consensus_queue.cc:260] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:20:01.465184 29852 ts_tablet_manager.cc:1434] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 12:20:01.478776 22560 tablet_copy_service.cc:342] P 8c3bcfa13ca74a24ab8999a408532932: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-abad5d59b4bd455ab855711fa092b038 received from {username='slave'} at 127.0.0.1:49290
I20260709 12:20:01.479277 22560 tablet_copy_service.cc:434] P 8c3bcfa13ca74a24ab8999a408532932: ending tablet copy session 65951063312d4a1e9123f92354101c71-abad5d59b4bd455ab855711fa092b038 on tablet abad5d59b4bd455ab855711fa092b038 with peer 65951063312d4a1e9123f92354101c71
I20260709 12:20:01.498052 23124 raft_consensus.cc:1217] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.13->[17.14-17.14]   Dedup: 17.14->[]
W20260709 12:20:01.574780 22516 consensus_peers.cc:597] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:01.581329 23095 consensus_peers.cc:597] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:01.645634 29854 tablet_bootstrap.cc:492] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:01.655200 29854 tablet_bootstrap.cc:492] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71: Bootstrap complete.
I20260709 12:20:01.656200 29854 ts_tablet_manager.cc:1403] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71: Time spent bootstrapping tablet: real 0.298s	user 0.044s	sys 0.017s
W20260709 12:20:01.659078 21244 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 22423)
I20260709 12:20:01.659639 29854 raft_consensus.cc:359] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:20:01.660547 29854 raft_consensus.cc:740] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 65951063312d4a1e9123f92354101c71, State: Initialized, Role: LEARNER
I20260709 12:20:01.661521 29854 consensus_queue.cc:260] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: NON_VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: true } }
I20260709 12:20:01.684770 29854 ts_tablet_manager.cc:1434] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:20:01.688421 22560 tablet_copy_service.cc:342] P 8c3bcfa13ca74a24ab8999a408532932: Request end of tablet copy session 65951063312d4a1e9123f92354101c71-3c5498b1e8b04b8caba1d9a87889d60d received from {username='slave'} at 127.0.0.1:49290
I20260709 12:20:01.688916 22560 tablet_copy_service.cc:434] P 8c3bcfa13ca74a24ab8999a408532932: ending tablet copy session 65951063312d4a1e9123f92354101c71-3c5498b1e8b04b8caba1d9a87889d60d on tablet 3c5498b1e8b04b8caba1d9a87889d60d with peer 65951063312d4a1e9123f92354101c71
I20260709 12:20:01.750555 23127 consensus_queue.cc:237] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:01.777944 22546 raft_consensus.cc:1275] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Refusing update from remote peer 65951063312d4a1e9123f92354101c71: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 12:20:01.783515 23095 consensus_peers.cc:597] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:01.786924 29798 consensus_queue.cc:1048] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:20:01.833554 29860 raft_consensus.cc:2955] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 21 LEADER]: Committing config change with OpId 21.16: config changed from index 13 to 16, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:20:01.837486 22546 raft_consensus.cc:2955] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 13 to 16, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:20:01.848130 23127 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:01.900646 22550 raft_consensus.cc:3060] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:01.901544 22516 consensus_peers.cc:597] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:01.922094 29861 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:20:01.927827 22550 raft_consensus.cc:1275] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:01.939286 22284 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9c9c94c2c7014c7b97357727b65ecdcd with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
I20260709 12:20:01.956468 29863 consensus_queue.cc:1048] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:20:01.927683 23127 raft_consensus.cc:1217] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.13->[22.14-22.14]   Dedup: 22.14->[]
I20260709 12:20:01.967357 22293 catalog_manager.cc:5697] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 13 to 16, VOTER 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) evicted. New cstate: current_term: 21 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:01.974648 29823 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.975240 29823 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:01.979406 29823 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:20:01.981249 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:20:01.986809 29822 raft_consensus.cc:1064] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:20:01.989588 29822 consensus_queue.cc:237] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:20:02.003669 22442 consensus_peers.cc:597] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:02.016498 22469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "25ebf14868c042dca42f54b3e251e1b2" is_pre_election: true
I20260709 12:20:02.020514 29869 raft_consensus.cc:1064] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:20:02.025723 29819 raft_consensus.cc:1064] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:20:02.027355 29869 consensus_queue.cc:237] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 14, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:02.028309 29819 consensus_queue.cc:237] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 12, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:02.076277 23124 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71 [term 17 LEARNER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:20:02.083164 29823 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:02.083711 23127 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71 [term 18 LEARNER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:02.088275 22469 raft_consensus.cc:1275] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:20:02.101032 22469 raft_consensus.cc:1275] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:02.102730 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:20:02.109206 29819 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:20:02.110664 22442 consensus_peers.cc:597] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:02.116324 29823 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:02.127628 29822 consensus_queue.cc:1048] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:02.159250 29859 consensus_queue.cc:1048] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:02.132347 22458 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c9c94c2c7014c7b97357727b65ecdcd with delete_type TABLET_DATA_TOMBSTONED (TS 25ebf14868c042dca42f54b3e251e1b2 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:51846
W20260709 12:20:02.140095 22516 consensus_peers.cc:597] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:02.162678 22516 consensus_peers.cc:597] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:02.163193 22516 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111) [suppressed 393 similar messages]
I20260709 12:20:02.168298 29882 tablet_replica.cc:333] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:02.142154 22546 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:20:02.146512 23124 raft_consensus.cc:1275] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71 [term 23 LEARNER]: Refusing update from remote peer 25ebf14868c042dca42f54b3e251e1b2: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 12:20:02.168996 22516 consensus_peers.cc:597] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:02.172632 29826 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:20:02.182977 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 72370.9us
W20260709 12:20:02.183524 22516 consensus_peers.cc:597] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:02.184185 22516 consensus_peers.cc:597] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:02.182356 29826 consensus_queue.cc:1048] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.010s
I20260709 12:20:02.240089 29882 raft_consensus.cc:2243] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:02.284544 22516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:46187, user_credentials={real_user=slave}} blocked reactor thread for 44101.5us
I20260709 12:20:02.274068 29882 raft_consensus.cc:2272] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:02.310485 29882 ts_tablet_manager.cc:1916] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:20:02.317250 22442 consensus_peers.cc:597] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:02.338163 29823 raft_consensus.cc:2955] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Committing config change with OpId 17.15: config changed from index 14 to 15, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:20:02.349597 29822 raft_consensus.cc:1064] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932: attempting to promote NON_VOTER 65951063312d4a1e9123f92354101c71 to VOTER
I20260709 12:20:02.353034 29822 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 12, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:02.354228 29882 ts_tablet_manager.cc:1929] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.15
I20260709 12:20:02.354887 29882 log.cc:1199] T 9c9c94c2c7014c7b97357727b65ecdcd P 25ebf14868c042dca42f54b3e251e1b2: Deleting WAL directory at /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599324869158-21244-0/minicluster-data/ts-1-root/wals/9c9c94c2c7014c7b97357727b65ecdcd
I20260709 12:20:02.362097 22285 catalog_manager.cc:5028] TS 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): tablet 9c9c94c2c7014c7b97357727b65ecdcd (table test-workload [id=186854d74fe443938d812c3623d2cc63]) successfully deleted
I20260709 12:20:02.361578 29887 raft_consensus.cc:2955] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:20:02.374583 23124 raft_consensus.cc:2955] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:20:02.378062 23095 consensus_peers.cc:597] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:02.394307 22442 consensus_peers.cc:597] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:02.404989 23127 raft_consensus.cc:2955] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:20:02.406761 22468 raft_consensus.cc:2955] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:20:02.412249 22469 raft_consensus.cc:2955] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:20:02.415935 22296 catalog_manager.cc:5697] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71 reported cstate change: config changed from index 14 to 15, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:20:02.445809 29888 log.cc:927] Time spent T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.075s	user 0.004s	sys 0.000s
W20260709 12:20:02.449587 29874 log.cc:927] Time spent T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.072s	user 0.009s	sys 0.004s
I20260709 12:20:02.448522 29869 raft_consensus.cc:2955] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 LEADER]: Committing config change with OpId 23.17: config changed from index 16 to 17, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:20:02.452855 22550 raft_consensus.cc:2955] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:20:02.462289 22293 catalog_manager.cc:5697] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 13 to 14, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:20:02.504515 22298 catalog_manager.cc:5697] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index 16 to 17, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "25ebf14868c042dca42f54b3e251e1b2" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:20:02.507894 23124 raft_consensus.cc:2955] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:20:02.533587 23095 consensus_peers.cc:597] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:02.554230 23124 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71 [term 22 LEARNER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:20:02.557197 29835 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:02.575368 22468 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:20:02.609027 29822 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:20:02.614068 23095 consensus_peers.cc:597] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:02.618851 22516 consensus_peers.cc:597] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:02.659595 21244 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 22423)
I20260709 12:20:02.670058 29835 raft_consensus.cc:2955] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:20:02.677146 22469 raft_consensus.cc:2955] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:20:02.704632 23095 consensus_peers.cc:597] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:02.708103 22296 catalog_manager.cc:5697] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 reported cstate change: config changed from index 14 to 15, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
W20260709 12:20:02.712545 23095 consensus_peers.cc:597] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:02.721911 23124 raft_consensus.cc:2955] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 65951063312d4a1e9123f92354101c71 (127.20.191.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } attrs { replace: true } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:20:02.751441 22550 consensus_queue.cc:237] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:02.760377 22469 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:20:02.764698 29835 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:20:02.771744 23127 raft_consensus.cc:1275] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71 [term 22 FOLLOWER]: Refusing update from remote peer 8c3bcfa13ca74a24ab8999a408532932: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:20:02.774585 29835 raft_consensus.cc:2955] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 15 to 16, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:20:02.776746 22469 raft_consensus.cc:2955] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:20:02.779604 29822 consensus_queue.cc:1048] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:20:02.789153 23127 raft_consensus.cc:2955] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } } }
I20260709 12:20:02.800426 22284 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3c5498b1e8b04b8caba1d9a87889d60d with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:20:02.819732 22284 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 3c5498b1e8b04b8caba1d9a87889d60d with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER failed with leader 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 15 but the committed config has opid_index of 16
I20260709 12:20:02.823186 22293 catalog_manager.cc:5697] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 reported cstate change: config changed from index 15 to 16, VOTER b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1) evicted. New cstate: current_term: 22 leader_uuid: "8c3bcfa13ca74a24ab8999a408532932" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:02.880254 29839 log.cc:927] Time spent T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: Append to log took a long time: real 0.051s	user 0.004s	sys 0.015s
W20260709 12:20:02.914855 22285 catalog_manager.cc:4755] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3c5498b1e8b04b8caba1d9a87889d60d: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:20:02.940230 23095 consensus_peers.cc:597] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:02.979178 23095 consensus_peers.cc:597] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:02.984580 29892 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2: Append to log took a long time: real 0.161s	user 0.005s	sys 0.005s
W20260709 12:20:03.018513 23095 consensus_peers.cc:597] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.021986 29890 log.cc:927] Time spent T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932: Append to log took a long time: real 0.236s	user 0.004s	sys 0.009s
W20260709 12:20:03.024382 22516 consensus_peers.cc:597] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.083912 22516 consensus_peers.cc:597] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:03.128067 23095 consensus_peers.cc:597] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.172511 22442 consensus_peers.cc:597] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.195202 22442 consensus_peers.cc:597] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.202733 23095 consensus_peers.cc:597] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.258792 22442 consensus_peers.cc:597] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.267498 22516 consensus_peers.cc:597] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.265141 22442 consensus_peers.cc:597] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.323205 23095 consensus_peers.cc:597] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.402550 22516 consensus_peers.cc:597] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.491524 22442 consensus_peers.cc:597] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.492187 22442 consensus_peers.cc:597] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.552631 23095 consensus_peers.cc:597] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.563969 23095 consensus_peers.cc:597] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.604084 22516 consensus_peers.cc:597] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.608428 22442 consensus_peers.cc:597] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.660897 21244 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 22423)
W20260709 12:20:03.690495 22442 consensus_peers.cc:597] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.746488 23095 consensus_peers.cc:597] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.749641 22442 consensus_peers.cc:597] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.783772 22516 consensus_peers.cc:597] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:03.856132 22442 consensus_peers.cc:597] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:03.962034 23095 consensus_peers.cc:597] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:03.984031 22516 consensus_peers.cc:597] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:04.003472 22516 consensus_peers.cc:597] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:04.078706 22516 consensus_peers.cc:597] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:04.109110 22442 consensus_peers.cc:597] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:04.143976 22285 catalog_manager.cc:4755] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3c5498b1e8b04b8caba1d9a87889d60d: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:20:04.246466 23095 consensus_peers.cc:597] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:04.289947 22442 consensus_peers.cc:597] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:04.292471 22516 consensus_peers.cc:597] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:04.305892 22516 consensus_peers.cc:597] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:04.477258 22516 consensus_peers.cc:597] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:04.478996 22442 consensus_peers.cc:597] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:04.488723 23095 consensus_peers.cc:597] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:04.633164 22516 consensus_peers.cc:597] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:04.661397 21244 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 22423)
W20260709 12:20:04.780248 22442 consensus_peers.cc:597] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:04.784005 22516 consensus_peers.cc:597] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:04.802593 22516 consensus_peers.cc:597] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:04.935555 22442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 125480us
W20260709 12:20:04.945106 23095 consensus_peers.cc:597] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:05.008495 22442 consensus_peers.cc:597] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:05.126973 23095 consensus_peers.cc:597] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:05.192032 23095 consensus_peers.cc:597] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:05.205744 22285 catalog_manager.cc:4755] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3c5498b1e8b04b8caba1d9a87889d60d: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:20:05.224484 23095 consensus_peers.cc:597] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:05.248338 22516 consensus_peers.cc:597] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:05.377665 23095 consensus_peers.cc:597] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:05.452188 22516 consensus_peers.cc:597] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:05.477216 21244 tablet_server.cc:196] TabletServer@127.20.191.1:0 shutdown complete.
W20260709 12:20:05.478152 23095 consensus_peers.cc:597] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:05.571905 23095 consensus_peers.cc:597] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:05.628537 23095 consensus_peers.cc:597] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:05.658385 21244 tablet_server.cc:179] TabletServer@127.20.191.2:0 shutting down...
W20260709 12:20:05.670524 22516 consensus_peers.cc:597] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:05.681350 22442 consensus_peers.cc:597] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:05.685530 23095 consensus_peers.cc:597] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:05.689384 22516 consensus_peers.cc:597] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:05.691689 23095 consensus_peers.cc:597] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:05.690867 22516 consensus_peers.cc:597] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:05.695917 23095 consensus_peers.cc:597] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:05.703467 22516 consensus_peers.cc:597] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:05.730146 23095 consensus_peers.cc:597] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:05.746249 22516 consensus_peers.cc:597] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:05.762262 22442 consensus_peers.cc:597] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:05.762239 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:20:05.778846 22516 consensus_peers.cc:597] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:05.782413 21244 tablet_replica.cc:333] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.783345 21244 raft_consensus.cc:2243] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.784003 21244 raft_consensus.cc:2272] T c98e38137cdf48ddae2d7d3311ccb425 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:05.785324 23095 consensus_peers.cc:597] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:05.786928 21244 tablet_replica.cc:333] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.787804 21244 raft_consensus.cc:2243] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:20:05.788926 21244 raft_consensus.cc:2272] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.791585 21244 tablet_replica.cc:333] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.792498 21244 raft_consensus.cc:2243] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:20:05.793723 21244 raft_consensus.cc:2272] T 5f6bd9e32472432889b9795a2e3653d6 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:05.795282 22516 consensus_peers.cc:597] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:05.796334 21244 tablet_replica.cc:333] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.797274 21244 raft_consensus.cc:2243] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.798175 21244 raft_consensus.cc:2272] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:05.800096 22516 consensus_peers.cc:597] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:05.800835 21244 tablet_replica.cc:333] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.801782 21244 raft_consensus.cc:2243] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:20:05.802834 21244 raft_consensus.cc:2272] T 444001888258449e8c4f5fd4ad540389 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.805655 21244 tablet_replica.cc:333] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.806632 21244 raft_consensus.cc:2243] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.807358 21244 raft_consensus.cc:2272] T 277d262725804effb16ede64e81d19c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.811251 21244 tablet_replica.cc:333] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.812186 21244 raft_consensus.cc:2243] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:20:05.814060 21244 raft_consensus.cc:2272] T 31ce456c700b43db9bef6c8297fe973c P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.816855 21244 tablet_replica.cc:333] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.817757 21244 raft_consensus.cc:2243] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:20:05.820858 23095 consensus_peers.cc:597] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:05.822715 21244 raft_consensus.cc:2272] T 67ad5236324342d48e6d762f265e4a3a P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.825414 21244 tablet_replica.cc:333] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.826242 21244 raft_consensus.cc:2243] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.827102 21244 raft_consensus.cc:2272] T 9c37e03879a64c308ad32ed0e1da75e9 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.829581 21244 tablet_replica.cc:333] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.830399 21244 raft_consensus.cc:2243] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.831004 21244 raft_consensus.cc:2272] T 1a201b290044481b8c4e67ad9f11ed89 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.833556 21244 tablet_replica.cc:333] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.834391 21244 raft_consensus.cc:2243] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:20:05.835661 21244 raft_consensus.cc:2272] T 7f7fcc060e2443ad87cf29161f3ea079 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.838186 21244 tablet_replica.cc:333] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.839026 21244 raft_consensus.cc:2243] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.839629 21244 raft_consensus.cc:2272] T cc602501d91d4eff9464e488c0b6704d P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.842111 21244 tablet_replica.cc:333] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.842903 21244 raft_consensus.cc:2243] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:20:05.844007 21244 raft_consensus.cc:2272] T c3bf88f0980e49afb7b7f1dabfbb3815 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.846531 21244 tablet_replica.cc:333] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.847307 21244 raft_consensus.cc:2243] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.848060 21244 raft_consensus.cc:2272] T abad5d59b4bd455ab855711fa092b038 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.850497 21244 tablet_replica.cc:333] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.851341 21244 raft_consensus.cc:2243] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.851975 21244 raft_consensus.cc:2272] T c837f3ed639d47cc8258ce902cca0154 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.854588 21244 tablet_replica.cc:333] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
W20260709 12:20:05.854796 22516 consensus_peers.cc:597] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:05.855489 21244 raft_consensus.cc:2243] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:20:05.856783 21244 raft_consensus.cc:2272] T f1115558d9fe452f8e6c19d821f08bfd P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:05.857621 22516 consensus_peers.cc:597] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:05.859544 21244 tablet_replica.cc:333] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
W20260709 12:20:05.859534 23095 consensus_peers.cc:597] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:05.860625 21244 raft_consensus.cc:2243] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.861272 21244 raft_consensus.cc:2272] T b42c69680a57493c942307ff09185b72 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.863857 21244 tablet_replica.cc:333] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.864728 21244 raft_consensus.cc:2243] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:20:05.865945 21244 raft_consensus.cc:2272] T 2974af5009474d6590a8e35ea1dc6b83 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.868624 21244 tablet_replica.cc:333] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.869532 21244 raft_consensus.cc:2243] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.870210 21244 raft_consensus.cc:2272] T 272f66365eb84231bc71d7c51137bbfb P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.872954 21244 tablet_replica.cc:333] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.873870 21244 raft_consensus.cc:2243] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:20:05.875200 21244 raft_consensus.cc:2272] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.877867 21244 tablet_replica.cc:333] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.878628 21244 raft_consensus.cc:2243] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.879235 21244 raft_consensus.cc:2272] T 009e461415d44f48aed3f751e8855a5d P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.881682 21244 tablet_replica.cc:333] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.882509 21244 raft_consensus.cc:2243] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.883140 21244 raft_consensus.cc:2272] T b1433e47e33649a3a8e6313d2ec4e289 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.885861 21244 tablet_replica.cc:333] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.886654 21244 raft_consensus.cc:2243] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:20:05.887821 21244 raft_consensus.cc:2272] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.890425 21244 tablet_replica.cc:333] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.891271 21244 raft_consensus.cc:2243] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.891904 21244 raft_consensus.cc:2272] T 3b0059ced3574627a342d9de0f02a487 P 25ebf14868c042dca42f54b3e251e1b2 [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:05.895541 22516 consensus_peers.cc:597] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:05.896588 21244 tablet_replica.cc:333] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.897446 21244 raft_consensus.cc:2243] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.898093 21244 raft_consensus.cc:2272] T 5b2850432f3942ddadf16c096755b5b5 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:05.900095 22516 consensus_peers.cc:597] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:05.900719 21244 tablet_replica.cc:333] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.901628 21244 raft_consensus.cc:2243] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.903788 21244 raft_consensus.cc:2272] T ff6628c2d6a44791975f2350758cb3db P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.910835 21244 tablet_replica.cc:333] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.912071 21244 raft_consensus.cc:2243] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.912849 21244 raft_consensus.cc:2272] T e8e9f45e270942459d8aa926ed037bec P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.917413 21244 tablet_replica.cc:333] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.918380 21244 raft_consensus.cc:2243] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.919399 21244 raft_consensus.cc:2272] T 367745908a334997957e47f869d9fb14 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:05.920674 22516 consensus_peers.cc:597] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:05.924806 21244 tablet_replica.cc:333] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.925922 21244 raft_consensus.cc:2243] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:20:05.927086 21244 raft_consensus.cc:2272] T 906ffc7e978c43a2841f212271a02a94 P 25ebf14868c042dca42f54b3e251e1b2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.929836 21244 tablet_replica.cc:333] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.930608 21244 raft_consensus.cc:2243] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:20:05.931775 21244 raft_consensus.cc:2272] T 5a1d549b197d46b29284e9fda8131aa2 P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.934562 21244 tablet_replica.cc:333] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.935446 21244 raft_consensus.cc:2243] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.936726 21244 raft_consensus.cc:2272] T 3781b48054df42c08e2bf775312a3699 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.939962 21244 tablet_replica.cc:333] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.940989 21244 raft_consensus.cc:2243] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:20:05.942026 21244 raft_consensus.cc:2272] T 3367203e404b4201ac57986dc36a032e P 25ebf14868c042dca42f54b3e251e1b2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.944635 21244 tablet_replica.cc:333] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.945363 21244 raft_consensus.cc:2243] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.945951 21244 raft_consensus.cc:2272] T 9a6a426ef4624f2cb84081714ee42138 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.948411 21244 tablet_replica.cc:333] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.949204 21244 raft_consensus.cc:2243] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.949887 21244 raft_consensus.cc:2272] T b2b016c5c65e474393776e2a5db3cfe2 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.952775 21244 tablet_replica.cc:333] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.953563 21244 raft_consensus.cc:2243] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.954195 21244 raft_consensus.cc:2272] T db333e4f6a9549d88edc232a61e2fc65 P 25ebf14868c042dca42f54b3e251e1b2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.956898 21244 tablet_replica.cc:333] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.957614 21244 raft_consensus.cc:2243] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.958320 21244 raft_consensus.cc:2272] T dd445b6ff12a48a9a51097b364e1da2e P 25ebf14868c042dca42f54b3e251e1b2 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:05.960281 23095 consensus_peers.cc:597] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:05.961977 21244 tablet_replica.cc:333] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.962786 21244 raft_consensus.cc:2243] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.963330 21244 raft_consensus.cc:2272] T f65bed92f9e64bb9955b9ba82a1645c8 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.966180 21244 tablet_replica.cc:333] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.966922 21244 raft_consensus.cc:2243] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.967944 21244 raft_consensus.cc:2272] T c4e53d64761746008e02335e67f74c08 P 25ebf14868c042dca42f54b3e251e1b2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.970564 21244 tablet_replica.cc:333] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.971285 21244 raft_consensus.cc:2243] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:20:05.972797 21244 raft_consensus.cc:2272] T ec9af5639dd5418baaabd871ac6515f0 P 25ebf14868c042dca42f54b3e251e1b2 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.975577 21244 tablet_replica.cc:333] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.976329 21244 raft_consensus.cc:2243] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.976877 21244 raft_consensus.cc:2272] T 12b0076739944e0099d6937fbaa402f5 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.979465 21244 tablet_replica.cc:333] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.980187 21244 raft_consensus.cc:2243] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:20:05.981232 21244 raft_consensus.cc:2272] T 2dae2730adf94f9da39f2dffbb692494 P 25ebf14868c042dca42f54b3e251e1b2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.983843 21244 tablet_replica.cc:333] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.984544 21244 raft_consensus.cc:2243] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.985139 21244 raft_consensus.cc:2272] T 453901cb626f4358bcfa980bf0d03ea4 P 25ebf14868c042dca42f54b3e251e1b2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.987712 21244 tablet_replica.cc:333] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.988376 21244 raft_consensus.cc:2243] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:20:05.989481 21244 raft_consensus.cc:2272] T d71e68d38beb49d496914180d9606c26 P 25ebf14868c042dca42f54b3e251e1b2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.992998 21244 tablet_replica.cc:333] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:05.993757 21244 raft_consensus.cc:2243] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.994592 21244 raft_consensus.cc:2272] T 3c5498b1e8b04b8caba1d9a87889d60d P 25ebf14868c042dca42f54b3e251e1b2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:06.000313 21244 tablet_replica.cc:333] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:06.001034 21244 raft_consensus.cc:2243] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:06.001662 21244 raft_consensus.cc:2272] T e4931c1eea6843949b1447b3e6106340 P 25ebf14868c042dca42f54b3e251e1b2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:06.004261 21244 tablet_replica.cc:333] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:06.004911 21244 raft_consensus.cc:2243] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:20:06.006088 21244 raft_consensus.cc:2272] T c7c8d517a42b486fab919998ad1e7e07 P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:06.008994 21244 tablet_replica.cc:333] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2: stopping tablet replica
I20260709 12:20:06.009655 21244 raft_consensus.cc:2243] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:06.010293 21244 raft_consensus.cc:2272] T b59a53e40d134aaa9cfbc682ee81be3e P 25ebf14868c042dca42f54b3e251e1b2 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:06.033286 23095 consensus_peers.cc:597] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:06.078007 23095 consensus_peers.cc:597] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:06.141516 22516 connection.cc:769] client connection to 127.20.191.2:46187 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:20:06.157832 22516 consensus_peers.cc:597] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:06.159914 22516 consensus_peers.cc:597] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:06.160656 22516 consensus_peers.cc:597] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:06.161105 22516 consensus_peers.cc:597] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:06.161507 22516 consensus_peers.cc:597] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:06.169656 23095 consensus_peers.cc:597] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:06.196611 22516 consensus_peers.cc:597] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:06.197647 22516 consensus_peers.cc:597] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:06.198321 22516 consensus_peers.cc:597] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:06.213858 22516 consensus_peers.cc:597] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:06.229405 22516 consensus_peers.cc:597] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:06.229929 22516 consensus_peers.cc:597] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:06.240770 22516 consensus_peers.cc:597] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:06.242414 22516 consensus_peers.cc:597] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:06.295902 23095 consensus_peers.cc:597] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:06.309012 23095 consensus_peers.cc:597] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:06.514711 23095 consensus_peers.cc:597] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:06.649474 22516 consensus_peers.cc:597] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:06.686079 22516 consensus_peers.cc:597] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:06.696365 22516 consensus_peers.cc:597] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:06.715694 22516 consensus_peers.cc:597] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:06.811488 22516 consensus_peers.cc:597] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:06.951200 29922 raft_consensus.cc:493] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:06.952009 29922 raft_consensus.cc:515] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:20:06.954780 29922 leader_election.cc:290] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:20:06.960053 22516 leader_election.cc:336] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:20:06.960983 22516 leader_election.cc:336] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
I20260709 12:20:06.961503 22516 leader_election.cc:304] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:20:06.962455 29922 raft_consensus.cc:2749] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:06.971288 23095 consensus_peers.cc:597] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:06.998440 29922 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:06.999142 29922 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:07.003153 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:20:07.014740 29922 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:20:07.019979 29860 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.021075 29860 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:07.027595 21244 tablet_server.cc:196] TabletServer@127.20.191.2:0 shutdown complete.
I20260709 12:20:07.029911 29860 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:20:07.031059 22516 leader_election.cc:336] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
I20260709 12:20:07.031579 22516 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:20:07.034567 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
W20260709 12:20:07.034606 23095 leader_election.cc:336] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:20:07.037606 23094 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:20:07.038851 29860 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:07.034824 29922 raft_consensus.cc:2749] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:20:07.040403 23095 leader_election.cc:336] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
I20260709 12:20:07.045948 29922 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.047603 29896 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.047796 29910 raft_consensus.cc:493] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.048616 29896 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:07.048827 29910 raft_consensus.cc:515] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:20:07.053594 29896 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:20:07.046782 29922 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:07.054776 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3367203e404b4201ac57986dc36a032e" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:20:07.055584 29860 raft_consensus.cc:493] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.057869 29860 raft_consensus.cc:515] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:07.056444 29910 leader_election.cc:290] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:20:07.063774 29860 leader_election.cc:290] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:20:07.066466 29910 raft_consensus.cc:493] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.067232 29910 raft_consensus.cc:515] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:20:07.068199 29912 raft_consensus.cc:493] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.068938 29912 raft_consensus.cc:515] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:20:07.070860 29922 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:20:07.071568 29912 leader_election.cc:290] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:20:07.074407 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621dbb467a3b47c7b0f2d1e85c7eba84" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
W20260709 12:20:07.076088 23095 leader_election.cc:336] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:20:07.076459 29910 leader_election.cc:290] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
W20260709 12:20:07.076841 23095 leader_election.cc:336] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
I20260709 12:20:07.081528 23095 leader_election.cc:304] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:20:07.082486 29860 raft_consensus.cc:2749] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:20:07.083848 22516 leader_election.cc:336] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
I20260709 12:20:07.084436 22516 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:20:07.085319 29910 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:20:07.087428 22516 leader_election.cc:336] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
W20260709 12:20:07.091988 22516 leader_election.cc:336] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:20:07.092492 22516 leader_election.cc:304] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:20:07.093485 29910 raft_consensus.cc:2749] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:07.104053 22516 leader_election.cc:336] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
I20260709 12:20:07.104589 22516 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, 65951063312d4a1e9123f92354101c71
I20260709 12:20:07.105396 29912 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:07.106914 29860 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.107708 29860 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:20:07.109730 22516 leader_election.cc:336] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
W20260709 12:20:07.110409 22516 leader_election.cc:336] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
W20260709 12:20:07.111177 22516 leader_election.cc:336] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:20:07.111579 22516 leader_election.cc:304] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:20:07.114136 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:20:07.112196 29860 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:20:07.115207 22516 leader_election.cc:336] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:20:07.117897 22516 leader_election.cc:304] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:20:07.118784 29912 raft_consensus.cc:2749] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:07.114809 29910 raft_consensus.cc:2749] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:20:07.121608 29920 raft_consensus.cc:493] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.122433 29920 raft_consensus.cc:515] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:07.125211 29920 leader_election.cc:290] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:20:07.133611 29910 raft_consensus.cc:493] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.134585 29910 raft_consensus.cc:515] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:20:07.140280 29910 leader_election.cc:290] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:20:07.146229 29860 raft_consensus.cc:493] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.152565 29860 raft_consensus.cc:515] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:07.154829 29860 leader_election.cc:290] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:20:07.156723 29860 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.157459 29860 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:07.159708 29860 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:20:07.159726 22516 leader_election.cc:336] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:20:07.161069 22516 leader_election.cc:336] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
I20260709 12:20:07.161259 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932" is_pre_election: true
I20260709 12:20:07.161648 22516 leader_election.cc:304] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:20:07.162050 22546 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 20.
I20260709 12:20:07.163642 23094 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:20:07.163673 29922 raft_consensus.cc:2749] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:07.164966 29860 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:07.165405 29860 raft_consensus.cc:493] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.165822 29860 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:07.175364 22516 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111) [suppressed 537 similar messages]
I20260709 12:20:07.178819 29920 raft_consensus.cc:493] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.179621 29920 raft_consensus.cc:515] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:20:07.181228 23095 leader_election.cc:336] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:20:07.181851 23095 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 8c3bcfa13ca74a24ab8999a408532932, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:20:07.182679 29920 leader_election.cc:290] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:20:07.183473 29920 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:20:07.194866 23095 leader_election.cc:336] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:20:07.200002 23095 leader_election.cc:336] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
W20260709 12:20:07.201117 23095 leader_election.cc:336] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
I20260709 12:20:07.201982 23095 leader_election.cc:304] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:20:07.207211 29860 raft_consensus.cc:515] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:07.211171 29920 raft_consensus.cc:493] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.212116 29920 raft_consensus.cc:515] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:07.214123 29923 raft_consensus.cc:2749] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:07.215766 29910 raft_consensus.cc:493] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.218199 29910 raft_consensus.cc:515] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:20:07.227010 29910 leader_election.cc:290] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:20:07.231524 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ad5236324342d48e6d762f265e4a3a" candidate_uuid: "65951063312d4a1e9123f92354101c71" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8c3bcfa13ca74a24ab8999a408532932"
I20260709 12:20:07.232239 22546 raft_consensus.cc:3060] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:07.232746 29920 leader_election.cc:290] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:20:07.233364 29920 raft_consensus.cc:493] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.234040 29920 raft_consensus.cc:515] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:07.209491 29860 leader_election.cc:290] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 election: Requested vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:20:07.242111 29922 raft_consensus.cc:493] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.242754 29922 raft_consensus.cc:515] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:07.244403 22546 raft_consensus.cc:2468] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65951063312d4a1e9123f92354101c71 in term 21.
I20260709 12:20:07.245379 29922 leader_election.cc:290] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:20:07.246053 29920 leader_election.cc:290] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:20:07.247107 23095 leader_election.cc:336] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:20:07.250594 21244 tablet_server.cc:179] TabletServer@127.20.191.3:0 shutting down...
W20260709 12:20:07.256758 22516 leader_election.cc:336] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:20:07.257411 23095 leader_election.cc:336] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
I20260709 12:20:07.258137 23095 leader_election.cc:304] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:20:07.260324 29923 raft_consensus.cc:2749] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:07.261899 23095 leader_election.cc:336] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
W20260709 12:20:07.266214 23095 consensus_peers.cc:597] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:07.266862 23095 leader_election.cc:336] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:20:07.259341 22516 consensus_peers.cc:597] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:07.272296 23094 leader_election.cc:304] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 
I20260709 12:20:07.273650 29923 raft_consensus.cc:2804] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:07.274201 29923 raft_consensus.cc:697] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [term 21 LEADER]: Becoming Leader. State: Replica: 65951063312d4a1e9123f92354101c71, State: Running, Role: LEADER
W20260709 12:20:07.274518 23095 leader_election.cc:336] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
I20260709 12:20:07.274977 23095 leader_election.cc:304] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:20:07.275245 29923 consensus_queue.cc:237] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:20:07.280375 22516 leader_election.cc:336] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
I20260709 12:20:07.280898 22516 leader_election.cc:304] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:20:07.281997 29926 raft_consensus.cc:2749] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:20:07.282454 23095 leader_election.cc:336] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
W20260709 12:20:07.283178 23095 leader_election.cc:336] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
W20260709 12:20:07.283630 23095 leader_election.cc:336] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
I20260709 12:20:07.284446 29896 raft_consensus.cc:2749] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:07.285632 22516 leader_election.cc:336] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
W20260709 12:20:07.286365 22516 leader_election.cc:336] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:20:07.286479 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7fcc060e2443ad87cf29161f3ea079" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:20:07.287189 23124 raft_consensus.cc:2468] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 21.
W20260709 12:20:07.291720 23095 consensus_peers.cc:597] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:07.292503 23095 leader_election.cc:336] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:20:07.292989 23095 leader_election.cc:304] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:20:07.293666 22516 leader_election.cc:304] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:20:07.294425 29896 raft_consensus.cc:2749] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:07.304515 29926 raft_consensus.cc:2749] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:20:07.316471 23094 leader_election.cc:336] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:07.317082 23094 leader_election.cc:304] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
W20260709 12:20:07.319609 22516 consensus_peers.cc:597] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:07.320210 29926 raft_consensus.cc:493] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.321024 29860 raft_consensus.cc:2749] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:07.321925 29920 raft_consensus.cc:493] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.323276 29920 raft_consensus.cc:515] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:07.326481 29920 leader_election.cc:290] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:20:07.322664 29926 raft_consensus.cc:515] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
W20260709 12:20:07.327867 23094 consensus_peers.cc:597] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:07.330166 29926 leader_election.cc:290] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
W20260709 12:20:07.329028 23094 consensus_peers.cc:597] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:07.341244 23094 consensus_peers.cc:597] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:07.343956 23094 leader_election.cc:336] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:07.351130 23095 leader_election.cc:336] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:20:07.360194 23095 leader_election.cc:336] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
I20260709 12:20:07.363464 23095 leader_election.cc:304] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
W20260709 12:20:07.364612 23095 leader_election.cc:336] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
I20260709 12:20:07.364982 29923 raft_consensus.cc:2749] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:07.365159 23095 leader_election.cc:304] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:20:07.366163 29923 raft_consensus.cc:2749] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:07.373348 29910 raft_consensus.cc:493] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.374717 29910 raft_consensus.cc:515] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:07.375285 22298 catalog_manager.cc:5697] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 reported cstate change: term changed from 20 to 21, leader changed from 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2) to 65951063312d4a1e9123f92354101c71 (127.20.191.4). New cstate: current_term: 21 leader_uuid: "65951063312d4a1e9123f92354101c71" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:07.373255 22285 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.191.1:37927, user_credentials={real_user=slave}} blocked reactor thread for 50740.4us
I20260709 12:20:07.379004 29910 leader_election.cc:290] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 65951063312d4a1e9123f92354101c71 (127.20.191.4:34357)
I20260709 12:20:07.379362 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9af5639dd5418baaabd871ac6515f0" candidate_uuid: "8c3bcfa13ca74a24ab8999a408532932" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "65951063312d4a1e9123f92354101c71" is_pre_election: true
I20260709 12:20:07.380014 23124 raft_consensus.cc:2468] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3bcfa13ca74a24ab8999a408532932 in term 23.
W20260709 12:20:07.382634 22285 catalog_manager.cc:4755] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3c5498b1e8b04b8caba1d9a87889d60d: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:20:07.384984 23094 consensus_peers.cc:597] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:07.389353 22516 consensus_peers.cc:597] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:07.400171 22516 leader_election.cc:336] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:20:07.401554 22516 leader_election.cc:336] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
I20260709 12:20:07.402040 22516 leader_election.cc:304] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71, 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:20:07.404475 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:07.405859 29910 raft_consensus.cc:2749] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:20:07.407944 21244 tablet_replica.cc:333] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.407872 29910 raft_consensus.cc:493] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25ebf14868c042dca42f54b3e251e1b2)
I20260709 12:20:07.408726 29910 raft_consensus.cc:515] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } }
I20260709 12:20:07.409219 21244 raft_consensus.cc:2243] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.410036 21244 raft_consensus.cc:2272] T fcf4dc17810b42c6bf0fc46fd69d0fd9 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:07.411315 23094 consensus_peers.cc:597] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:07.411384 29910 leader_election.cc:290] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187)
I20260709 12:20:07.413403 21244 tablet_replica.cc:333] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.414546 21244 raft_consensus.cc:2243] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.415920 21244 raft_consensus.cc:2272] T c98e38137cdf48ddae2d7d3311ccb425 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.418795 21244 tablet_replica.cc:333] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.419827 21244 raft_consensus.cc:2243] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.420914 21244 raft_consensus.cc:2272] T 5f6bd9e32472432889b9795a2e3653d6 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.424080 21244 tablet_replica.cc:333] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
W20260709 12:20:07.424958 23094 consensus_peers.cc:597] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:07.425388 22516 leader_election.cc:336] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
I20260709 12:20:07.425015 21244 raft_consensus.cc:2243] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:20:07.426687 22516 leader_election.cc:336] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:20:07.427088 22516 leader_election.cc:304] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c3bcfa13ca74a24ab8999a408532932; no voters: 25ebf14868c042dca42f54b3e251e1b2, b8621fa34be04d3fa2d68a300f858cd1
I20260709 12:20:07.427821 29896 raft_consensus.cc:2749] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:07.427300 21244 raft_consensus.cc:2272] T 1a201b290044481b8c4e67ad9f11ed89 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.432466 21244 tablet_replica.cc:333] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.433354 21244 raft_consensus.cc:2243] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:20:07.433672 23094 consensus_peers.cc:597] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:07.434653 21244 raft_consensus.cc:2272] T b1433e47e33649a3a8e6313d2ec4e289 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.437857 21244 tablet_replica.cc:333] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.438494 21244 raft_consensus.cc:2243] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.439742 21244 raft_consensus.cc:2272] T 009e461415d44f48aed3f751e8855a5d P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.441897 21244 tablet_replica.cc:333] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.442570 21244 raft_consensus.cc:2243] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.443130 21244 raft_consensus.cc:2272] T 444001888258449e8c4f5fd4ad540389 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.445787 21244 tablet_replica.cc:333] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.446475 21244 raft_consensus.cc:2243] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.447809 21244 raft_consensus.cc:2272] T 9c9c94c2c7014c7b97357727b65ecdcd P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.450059 21244 tablet_replica.cc:333] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.450636 21244 raft_consensus.cc:2243] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.451959 21244 raft_consensus.cc:2272] T 277d262725804effb16ede64e81d19c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.454242 21244 tablet_replica.cc:333] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.454840 21244 raft_consensus.cc:2243] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.455631 21244 raft_consensus.cc:2272] T 67ad5236324342d48e6d762f265e4a3a P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.457893 21244 tablet_replica.cc:333] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.458449 21244 raft_consensus.cc:2243] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.459520 21244 raft_consensus.cc:2272] T 7f7fcc060e2443ad87cf29161f3ea079 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.462399 21244 tablet_replica.cc:333] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.463253 21244 raft_consensus.cc:2243] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.464504 21244 raft_consensus.cc:2272] T cc602501d91d4eff9464e488c0b6704d P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:07.464660 23094 consensus_peers.cc:597] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:07.467335 21244 tablet_replica.cc:333] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.468206 21244 raft_consensus.cc:2243] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.469966 21244 raft_consensus.cc:2272] T abad5d59b4bd455ab855711fa092b038 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.472841 21244 tablet_replica.cc:333] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.473701 21244 raft_consensus.cc:2243] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.474610 21244 raft_consensus.cc:2272] T 0723691b01e2413baf71cbc73a551fdc P 8c3bcfa13ca74a24ab8999a408532932 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.477401 21244 tablet_replica.cc:333] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.478258 21244 raft_consensus.cc:2243] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.478912 21244 raft_consensus.cc:2272] T a0d5063dbb1a45fdb6db1177b40d5c72 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.481753 21244 tablet_replica.cc:333] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.482668 21244 raft_consensus.cc:2243] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.483418 21244 raft_consensus.cc:2272] T f1115558d9fe452f8e6c19d821f08bfd P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.485807 21244 tablet_replica.cc:333] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.486423 21244 raft_consensus.cc:2243] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.487380 21244 raft_consensus.cc:2272] T b42c69680a57493c942307ff09185b72 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.489598 21244 tablet_replica.cc:333] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.490221 21244 raft_consensus.cc:2243] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.490753 21244 raft_consensus.cc:2272] T beb931ddd9ec4606a06a5fd9dbc6322e P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.492949 21244 tablet_replica.cc:333] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.493695 21244 raft_consensus.cc:2243] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.494246 21244 raft_consensus.cc:2272] T 5a1d549b197d46b29284e9fda8131aa2 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.496976 21244 tablet_replica.cc:333] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.497601 21244 raft_consensus.cc:2243] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.498768 21244 raft_consensus.cc:2272] T 3781b48054df42c08e2bf775312a3699 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.501199 21244 tablet_replica.cc:333] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.502023 21244 raft_consensus.cc:2243] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.503321 21244 raft_consensus.cc:2272] T ff6628c2d6a44791975f2350758cb3db P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.505975 21244 tablet_replica.cc:333] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.506731 21244 raft_consensus.cc:2243] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.508006 21244 raft_consensus.cc:2272] T 5b2850432f3942ddadf16c096755b5b5 P 8c3bcfa13ca74a24ab8999a408532932 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.510788 21244 tablet_replica.cc:333] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.511404 21244 raft_consensus.cc:2243] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.512328 21244 raft_consensus.cc:2272] T eed3b8d7432b461c802823d02d952440 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.514644 21244 tablet_replica.cc:333] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.515195 21244 raft_consensus.cc:2243] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.516191 21244 raft_consensus.cc:2272] T 367745908a334997957e47f869d9fb14 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.518409 21244 tablet_replica.cc:333] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.519024 21244 raft_consensus.cc:2243] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.519554 21244 raft_consensus.cc:2272] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.521663 21244 tablet_replica.cc:333] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.522259 21244 raft_consensus.cc:2243] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.522789 21244 raft_consensus.cc:2272] T 8ff00cc49b3d446797f2e5ddc5bdfcdf P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.524755 21244 tablet_replica.cc:333] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.525266 21244 raft_consensus.cc:2243] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.526208 21244 raft_consensus.cc:2272] T 3b0059ced3574627a342d9de0f02a487 P 8c3bcfa13ca74a24ab8999a408532932 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.528215 21244 tablet_replica.cc:333] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.528738 21244 raft_consensus.cc:2243] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.529610 21244 raft_consensus.cc:2272] T 9a6a426ef4624f2cb84081714ee42138 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.531759 21244 tablet_replica.cc:333] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.532578 21244 raft_consensus.cc:2243] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.533748 21244 raft_consensus.cc:2272] T db333e4f6a9549d88edc232a61e2fc65 P 8c3bcfa13ca74a24ab8999a408532932 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:07.536744 23094 consensus_peers.cc:597] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:07.537024 21244 tablet_replica.cc:333] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.537694 21244 raft_consensus.cc:2243] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.538775 21244 raft_consensus.cc:2272] T b2b016c5c65e474393776e2a5db3cfe2 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.540896 21244 tablet_replica.cc:333] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.541502 21244 raft_consensus.cc:2243] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.542459 21244 raft_consensus.cc:2272] T f8462358d27c41a9a8e75c2021a10a4a P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.545019 21244 tablet_replica.cc:333] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.545656 21244 raft_consensus.cc:2243] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.546331 21244 raft_consensus.cc:2272] T d71e68d38beb49d496914180d9606c26 P 8c3bcfa13ca74a24ab8999a408532932 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.548957 21244 tablet_replica.cc:333] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.549597 21244 raft_consensus.cc:2243] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.551025 21244 raft_consensus.cc:2272] T 3c5498b1e8b04b8caba1d9a87889d60d P 8c3bcfa13ca74a24ab8999a408532932 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:07.550374 23094 consensus_peers.cc:597] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:07.554193 21244 tablet_replica.cc:333] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.555007 21244 raft_consensus.cc:2243] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.555970 21244 raft_consensus.cc:2272] T 14fbfde86a044b028b2032a062d189e9 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.558149 21244 tablet_replica.cc:333] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.558768 21244 raft_consensus.cc:2243] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.559744 21244 raft_consensus.cc:2272] T a60334567abd4be7b4e9f6f2e754d015 P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.561955 21244 tablet_replica.cc:333] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.562492 21244 raft_consensus.cc:2243] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.563385 21244 raft_consensus.cc:2272] T 12b0076739944e0099d6937fbaa402f5 P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.565681 21244 tablet_replica.cc:333] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.566296 21244 raft_consensus.cc:2243] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.566937 21244 raft_consensus.cc:2272] T 3367203e404b4201ac57986dc36a032e P 8c3bcfa13ca74a24ab8999a408532932 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.568914 21244 tablet_replica.cc:333] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.569428 21244 raft_consensus.cc:2243] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.570637 21244 raft_consensus.cc:2272] T dd445b6ff12a48a9a51097b364e1da2e P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.572781 21244 tablet_replica.cc:333] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.573316 21244 raft_consensus.cc:2243] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.574612 21244 raft_consensus.cc:2272] T f65bed92f9e64bb9955b9ba82a1645c8 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.576875 21244 tablet_replica.cc:333] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.577433 21244 raft_consensus.cc:2243] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:20:07.578433 21244 raft_consensus.cc:2272] T c4e53d64761746008e02335e67f74c08 P 8c3bcfa13ca74a24ab8999a408532932 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.580389 21244 tablet_replica.cc:333] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.581029 21244 raft_consensus.cc:2243] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.582026 21244 raft_consensus.cc:2272] T ec9af5639dd5418baaabd871ac6515f0 P 8c3bcfa13ca74a24ab8999a408532932 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.584878 21244 tablet_replica.cc:333] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.585638 21244 raft_consensus.cc:2243] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 LEADER]: Raft consensus shutting down.
W20260709 12:20:07.587283 23094 consensus_peers.cc:597] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:07.588650 21244 raft_consensus.cc:2272] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.591533 21244 tablet_replica.cc:333] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.592181 21244 raft_consensus.cc:2243] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.592929 21244 raft_consensus.cc:2272] T 41ad743163ad40dba602eb017e958a78 P 8c3bcfa13ca74a24ab8999a408532932 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.595021 21244 tablet_replica.cc:333] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.595580 21244 raft_consensus.cc:2243] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.596213 21244 raft_consensus.cc:2272] T cbdd827fb2d34627bbd307872debd3d3 P 8c3bcfa13ca74a24ab8999a408532932 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.598539 21244 tablet_replica.cc:333] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.599064 21244 raft_consensus.cc:2243] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.599612 21244 raft_consensus.cc:2272] T 2d5abbd8a2264ab6ac3b4face1caa842 P 8c3bcfa13ca74a24ab8999a408532932 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.601909 21244 tablet_replica.cc:333] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.602414 21244 raft_consensus.cc:2243] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.603088 21244 raft_consensus.cc:2272] T c23bd5666c81480f8ce12f767a245571 P 8c3bcfa13ca74a24ab8999a408532932 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:07.605408 21244 tablet_replica.cc:333] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932: stopping tablet replica
I20260709 12:20:07.605921 21244 raft_consensus.cc:2243] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:07.606483 21244 raft_consensus.cc:2272] T b59a53e40d134aaa9cfbc682ee81be3e P 8c3bcfa13ca74a24ab8999a408532932 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:07.626310 23095 consensus_peers.cc:597] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:07.720988 23094 consensus_peers.cc:597] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.3:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:07.774978 23095 consensus_peers.cc:597] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:07.782296 23095 consensus_peers.cc:597] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:07.862978 23095 consensus_peers.cc:597] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:07.872037 23094 consensus_peers.cc:597] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 -> Peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Couldn't send request to peer 8c3bcfa13ca74a24ab8999a408532932. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.3:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:07.999557 23095 consensus_peers.cc:597] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:08.013943 23095 consensus_peers.cc:597] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:08.034339 23095 consensus_peers.cc:597] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:08.040720 23095 consensus_peers.cc:597] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:08.163156 23095 consensus_peers.cc:597] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:08.250933 23095 consensus_peers.cc:597] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:08.252311 21244 tablet_server.cc:196] TabletServer@127.20.191.3:0 shutdown complete.
W20260709 12:20:08.256299 23095 consensus_peers.cc:597] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 -> Peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Couldn't send request to peer b8621fa34be04d3fa2d68a300f858cd1. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:08.280725 23095 consensus_peers.cc:597] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:08.316902 23095 consensus_peers.cc:597] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:08.317514 23095 consensus_peers.cc:597] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:08.329306 23095 consensus_peers.cc:597] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:08.379439 21244 tablet_server.cc:179] TabletServer@127.20.191.4:0 shutting down...
I20260709 12:20:08.429378 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:08.430394 21244 tablet_replica.cc:333] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.431603 21244 raft_consensus.cc:2243] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.432524 21244 raft_consensus.cc:2272] T 31ce456c700b43db9bef6c8297fe973c P 65951063312d4a1e9123f92354101c71 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.436033 21244 tablet_replica.cc:333] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.436920 21244 raft_consensus.cc:2243] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.438330 21244 raft_consensus.cc:2272] T 9c37e03879a64c308ad32ed0e1da75e9 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.441851 21244 tablet_replica.cc:333] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.442883 21244 raft_consensus.cc:2243] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.443959 21244 pending_rounds.cc:70] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71: Trying to abort 1 pending ops.
I20260709 12:20:08.444232 21244 pending_rounds.cc:77] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71: Aborting op as it isn't in flight: id { term: 21 index: 18 } timestamp: 7305623991424434176 op_type: NO_OP noop_request { }
I20260709 12:20:08.444680 21244 raft_consensus.cc:2889] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [term 21 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:08.445014 21244 raft_consensus.cc:2272] T 67ad5236324342d48e6d762f265e4a3a P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.448132 21244 tablet_replica.cc:333] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.449045 21244 raft_consensus.cc:2243] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.450182 21244 raft_consensus.cc:2272] T cbdd827fb2d34627bbd307872debd3d3 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.453469 21244 tablet_replica.cc:333] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.454361 21244 raft_consensus.cc:2243] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.455183 21244 raft_consensus.cc:2272] T 7f7fcc060e2443ad87cf29161f3ea079 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.458618 21244 tablet_replica.cc:333] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.459578 21244 raft_consensus.cc:2243] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.460426 21244 raft_consensus.cc:2272] T ff6628c2d6a44791975f2350758cb3db P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.463508 21244 tablet_replica.cc:333] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.464304 21244 raft_consensus.cc:2243] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.464937 21244 raft_consensus.cc:2272] T 621dbb467a3b47c7b0f2d1e85c7eba84 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.464959 29923 raft_consensus.cc:493] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:20:08.465538 29923 raft_consensus.cc:515] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b8621fa34be04d3fa2d68a300f858cd1" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 37927 } } peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } attrs { replace: true } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:08.468261 29923 leader_election.cc:290] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927), 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:20:08.468526 21244 tablet_replica.cc:333] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.469518 21244 raft_consensus.cc:2243] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.470584 21244 raft_consensus.cc:2272] T 272f66365eb84231bc71d7c51137bbfb P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.474123 21244 tablet_replica.cc:333] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.475069 21244 raft_consensus.cc:2243] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.475836 21244 raft_consensus.cc:2272] T d7dee89f230e46e8a6f8e492cd0ca0d4 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:08.476462 23094 leader_election.cc:336] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Network error: Client connection negotiation failed: client connection to 127.20.191.3:38645: connect: Connection refused (error 111)
W20260709 12:20:08.477945 23095 leader_election.cc:336] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
I20260709 12:20:08.478281 23095 leader_election.cc:304] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:20:08.478899 29923 raft_consensus.cc:2749] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:08.479156 21244 tablet_replica.cc:333] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.480196 21244 raft_consensus.cc:2243] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.481556 21244 raft_consensus.cc:2272] T 9c9c94c2c7014c7b97357727b65ecdcd P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.485160 21244 tablet_replica.cc:333] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.486126 21244 raft_consensus.cc:2243] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.487283 21244 raft_consensus.cc:2272] T 2d5abbd8a2264ab6ac3b4face1caa842 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.490439 21244 tablet_replica.cc:333] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.491273 21244 raft_consensus.cc:2243] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.491973 21244 raft_consensus.cc:2272] T c7c8d517a42b486fab919998ad1e7e07 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.495117 21244 tablet_replica.cc:333] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.495965 21244 raft_consensus.cc:2243] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.497227 21244 raft_consensus.cc:2272] T f8462358d27c41a9a8e75c2021a10a4a P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.500595 21244 tablet_replica.cc:333] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.501443 21244 raft_consensus.cc:2243] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.502157 21244 raft_consensus.cc:2272] T 5b2850432f3942ddadf16c096755b5b5 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.505308 21244 tablet_replica.cc:333] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.506218 21244 raft_consensus.cc:2243] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.507282 21244 raft_consensus.cc:2272] T beb931ddd9ec4606a06a5fd9dbc6322e P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.510411 21244 tablet_replica.cc:333] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.511229 21244 raft_consensus.cc:2243] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.512015 21244 raft_consensus.cc:2272] T b42c69680a57493c942307ff09185b72 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.515254 21244 tablet_replica.cc:333] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.516184 21244 raft_consensus.cc:2243] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.517144 21244 raft_consensus.cc:2272] T a0d5063dbb1a45fdb6db1177b40d5c72 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.519898 21244 tablet_replica.cc:333] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.520666 21244 raft_consensus.cc:2243] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.521365 21244 raft_consensus.cc:2272] T c3bf88f0980e49afb7b7f1dabfbb3815 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.524132 21244 tablet_replica.cc:333] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.524932 21244 raft_consensus.cc:2243] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.525889 21244 raft_consensus.cc:2272] T 0723691b01e2413baf71cbc73a551fdc P 65951063312d4a1e9123f92354101c71 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.528678 21244 tablet_replica.cc:333] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.529529 21244 raft_consensus.cc:2243] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.530237 21244 raft_consensus.cc:2272] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.533265 21244 tablet_replica.cc:333] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.534137 21244 raft_consensus.cc:2243] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.535337 21244 raft_consensus.cc:2272] T c837f3ed639d47cc8258ce902cca0154 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.538640 21244 tablet_replica.cc:333] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.539420 21244 raft_consensus.cc:2243] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.540038 21244 raft_consensus.cc:2272] T c98e38137cdf48ddae2d7d3311ccb425 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:08.540851 23095 consensus_peers.cc:597] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 -> Peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Couldn't send request to peer 25ebf14868c042dca42f54b3e251e1b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:08.542975 21244 tablet_replica.cc:333] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.543874 21244 raft_consensus.cc:2243] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.544494 21244 raft_consensus.cc:2272] T 3367203e404b4201ac57986dc36a032e P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.547294 21244 tablet_replica.cc:333] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.548117 21244 raft_consensus.cc:2243] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.549196 21244 raft_consensus.cc:2272] T 41ad743163ad40dba602eb017e958a78 P 65951063312d4a1e9123f92354101c71 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.552204 21244 tablet_replica.cc:333] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.553038 21244 raft_consensus.cc:2243] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.553804 21244 raft_consensus.cc:2272] T 2974af5009474d6590a8e35ea1dc6b83 P 65951063312d4a1e9123f92354101c71 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.556553 21244 tablet_replica.cc:333] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.557437 21244 raft_consensus.cc:2243] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.558216 21244 raft_consensus.cc:2272] T ec9af5639dd5418baaabd871ac6515f0 P 65951063312d4a1e9123f92354101c71 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.561277 21244 tablet_replica.cc:333] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.562140 21244 raft_consensus.cc:2243] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.563254 21244 raft_consensus.cc:2272] T f65bed92f9e64bb9955b9ba82a1645c8 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.566485 21244 tablet_replica.cc:333] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.567298 21244 raft_consensus.cc:2243] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.568058 21244 raft_consensus.cc:2272] T c4e53d64761746008e02335e67f74c08 P 65951063312d4a1e9123f92354101c71 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.570886 21244 tablet_replica.cc:333] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.571755 21244 raft_consensus.cc:2243] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.572489 21244 raft_consensus.cc:2272] T db333e4f6a9549d88edc232a61e2fc65 P 65951063312d4a1e9123f92354101c71 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.575543 21244 tablet_replica.cc:333] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.576279 21244 raft_consensus.cc:2243] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.577453 21244 raft_consensus.cc:2272] T e8e9f45e270942459d8aa926ed037bec P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.580184 21244 tablet_replica.cc:333] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.580945 21244 raft_consensus.cc:2243] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.581964 21244 raft_consensus.cc:2272] T a60334567abd4be7b4e9f6f2e754d015 P 65951063312d4a1e9123f92354101c71 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.584858 21244 tablet_replica.cc:333] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.585618 21244 raft_consensus.cc:2243] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.586725 21244 raft_consensus.cc:2272] T e4931c1eea6843949b1447b3e6106340 P 65951063312d4a1e9123f92354101c71 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.589808 21244 tablet_replica.cc:333] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.590633 21244 raft_consensus.cc:2243] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.591724 21244 raft_consensus.cc:2272] T c23bd5666c81480f8ce12f767a245571 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.594547 21244 tablet_replica.cc:333] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.595294 21244 raft_consensus.cc:2243] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.595944 21244 raft_consensus.cc:2272] T 9a6a426ef4624f2cb84081714ee42138 P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.598532 21244 tablet_replica.cc:333] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.599284 21244 raft_consensus.cc:2243] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.600430 21244 raft_consensus.cc:2272] T 453901cb626f4358bcfa980bf0d03ea4 P 65951063312d4a1e9123f92354101c71 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.603511 21244 tablet_replica.cc:333] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.603941 29923 raft_consensus.cc:493] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8c3bcfa13ca74a24ab8999a408532932)
I20260709 12:20:08.604429 29923 raft_consensus.cc:515] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "25ebf14868c042dca42f54b3e251e1b2" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 46187 } } peers { permanent_uuid: "8c3bcfa13ca74a24ab8999a408532932" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 38645 } } peers { permanent_uuid: "65951063312d4a1e9123f92354101c71" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 34357 } attrs { promote: false } }
I20260709 12:20:08.605140 21244 raft_consensus.cc:2243] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.606050 21244 raft_consensus.cc:2272] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.606361 29923 leader_election.cc:290] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187), 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645)
I20260709 12:20:08.610848 21244 tablet_replica.cc:333] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
W20260709 12:20:08.611012 23094 leader_election.cc:336] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8c3bcfa13ca74a24ab8999a408532932 (127.20.191.3:38645): Network error: Client connection negotiation failed: client connection to 127.20.191.3:38645: connect: Connection refused (error 111)
I20260709 12:20:08.611763 21244 raft_consensus.cc:2243] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 19 LEADER]: Raft consensus shutting down.
W20260709 12:20:08.611720 23095 leader_election.cc:336] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 25ebf14868c042dca42f54b3e251e1b2 (127.20.191.2:46187): Network error: Client connection negotiation failed: client connection to 127.20.191.2:46187: connect: Connection refused (error 111)
I20260709 12:20:08.612325 23095 leader_election.cc:304] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65951063312d4a1e9123f92354101c71; no voters: 25ebf14868c042dca42f54b3e251e1b2, 8c3bcfa13ca74a24ab8999a408532932
I20260709 12:20:08.612825 21244 raft_consensus.cc:2272] T 14fbfde86a044b028b2032a062d189e9 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:08.612964 23095 raft_consensus.cc:2686] T 3c5498b1e8b04b8caba1d9a87889d60d P 65951063312d4a1e9123f92354101c71: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:20:08.615151 21244 tablet_replica.cc:333] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.615692 21244 raft_consensus.cc:2243] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.616484 21244 raft_consensus.cc:2272] T b59a53e40d134aaa9cfbc682ee81be3e P 65951063312d4a1e9123f92354101c71 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.618680 21244 tablet_replica.cc:333] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.619205 21244 raft_consensus.cc:2243] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.619752 21244 raft_consensus.cc:2272] T 906ffc7e978c43a2841f212271a02a94 P 65951063312d4a1e9123f92354101c71 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.621693 21244 tablet_replica.cc:333] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.622217 21244 raft_consensus.cc:2243] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.622686 21244 raft_consensus.cc:2272] T 2dae2730adf94f9da39f2dffbb692494 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.624732 21244 tablet_replica.cc:333] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71: stopping tablet replica
I20260709 12:20:08.625200 21244 raft_consensus.cc:2243] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.625666 21244 raft_consensus.cc:2272] T eed3b8d7432b461c802823d02d952440 P 65951063312d4a1e9123f92354101c71 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:08.903422 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:08.942242 23093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:08.992273 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:09.030639 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:09.145860 23096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:09.327309 22285 catalog_manager.cc:4755] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 67ad5236324342d48e6d762f265e4a3a: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:20:09.329190 23094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:09.420141 23095 leader_election.cc:336] T abad5d59b4bd455ab855711fa092b038 P 65951063312d4a1e9123f92354101c71 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): Service unavailable: Unable to start connection negotiation thread: The pool has been shut down.
I20260709 12:20:09.837333 21244 tablet_server.cc:196] TabletServer@127.20.191.4:0 shutdown complete.
I20260709 12:20:09.915055 21244 master.cc:562] Master@127.20.191.62:37293 shutting down...
W20260709 12:20:09.949528 22347 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:20:09.949826 22347 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:20:09.950053 22347 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:20:11.526274 22285 catalog_manager.cc:4755] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3c5498b1e8b04b8caba1d9a87889d60d: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
W20260709 12:20:25.736863 22285 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111) [suppressed 156 similar messages]
W20260709 12:20:25.740425 22285 catalog_manager.cc:4755] TS b8621fa34be04d3fa2d68a300f858cd1 (127.20.191.1:37927): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 67ad5236324342d48e6d762f265e4a3a: Network error: Client connection negotiation failed: client connection to 127.20.191.1:37927: connect: Connection refused (error 111)
I20260709 12:20:26.960305 21244 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:26.961426 21244 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:26.961843 21244 tablet_replica.cc:333] T 00000000000000000000000000000000 P fd30aaad5b9140cf904466d9eb78783a: stopping tablet replica
I20260709 12:20:27.179881 21244 master.cc:584] Master@127.20.191.62:37293 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (242312 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:20:27.287040 21244 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.191.62:36647
I20260709 12:20:27.288177 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:27.294373 29947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:27.294384 29948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:27.295284 29950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:27.295542 21244 server_base.cc:1061] running on GCE node
I20260709 12:20:27.298645 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:27.298844 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:27.298957 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599627298946 us; error 0 us; skew 500 ppm
I20260709 12:20:27.299398 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:27.302105 21244 webserver.cc:533] Webserver started at http://127.20.191.62:44885/ using document root <none> and password file <none>
I20260709 12:20:27.302608 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:27.302760 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:27.302984 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:27.304250 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/master-0-root/instance:
uuid: "e66f7e986b194f1888b8f70b2912b109"
format_stamp: "Formatted at 2026-07-09 12:20:27 on dist-test-slave-7c1h"
I20260709 12:20:27.308853 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:20:27.312516 29955 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:27.313313 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:20:27.313606 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/master-0-root
uuid: "e66f7e986b194f1888b8f70b2912b109"
format_stamp: "Formatted at 2026-07-09 12:20:27 on dist-test-slave-7c1h"
I20260709 12:20:27.313938 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:27.326310 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:27.327531 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:27.367304 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.62:36647
I20260709 12:20:27.367409 30006 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.62:36647 every 8 connection(s)
I20260709 12:20:27.371390 30007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:27.382581 30007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109: Bootstrap starting.
I20260709 12:20:27.388180 30007 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.392804 30007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109: No bootstrap required, opened a new log
I20260709 12:20:27.395416 30007 raft_consensus.cc:359] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e66f7e986b194f1888b8f70b2912b109" member_type: VOTER }
I20260709 12:20:27.395967 30007 raft_consensus.cc:385] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:27.396384 30007 raft_consensus.cc:740] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e66f7e986b194f1888b8f70b2912b109, State: Initialized, Role: FOLLOWER
I20260709 12:20:27.397130 30007 consensus_queue.cc:260] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e66f7e986b194f1888b8f70b2912b109" member_type: VOTER }
I20260709 12:20:27.397704 30007 raft_consensus.cc:399] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:20:27.397984 30007 raft_consensus.cc:493] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:20:27.398267 30007 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:27.404505 30007 raft_consensus.cc:515] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e66f7e986b194f1888b8f70b2912b109" member_type: VOTER }
I20260709 12:20:27.405208 30007 leader_election.cc:304] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e66f7e986b194f1888b8f70b2912b109; no voters: 
I20260709 12:20:27.406632 30007 leader_election.cc:290] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:20:27.407153 30010 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:27.408679 30010 raft_consensus.cc:697] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [term 1 LEADER]: Becoming Leader. State: Replica: e66f7e986b194f1888b8f70b2912b109, State: Running, Role: LEADER
I20260709 12:20:27.409454 30010 consensus_queue.cc:237] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e66f7e986b194f1888b8f70b2912b109" member_type: VOTER }
I20260709 12:20:27.410074 30007 sys_catalog.cc:565] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:20:27.416265 30011 sys_catalog.cc:455] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e66f7e986b194f1888b8f70b2912b109" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e66f7e986b194f1888b8f70b2912b109" member_type: VOTER } }
I20260709 12:20:27.416258 30012 sys_catalog.cc:455] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e66f7e986b194f1888b8f70b2912b109. Latest consensus state: current_term: 1 leader_uuid: "e66f7e986b194f1888b8f70b2912b109" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e66f7e986b194f1888b8f70b2912b109" member_type: VOTER } }
I20260709 12:20:27.417258 30012 sys_catalog.cc:458] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:27.417909 30011 sys_catalog.cc:458] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:27.419266 30018 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:20:27.429287 30018 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:20:27.430295 21244 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:20:27.438529 30018 catalog_manager.cc:1383] Generated new cluster ID: 15517765ecd1444a874a5567bcc5d908
I20260709 12:20:27.438844 30018 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:20:27.467574 30018 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:20:27.468884 30018 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:20:27.485554 30018 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109: Generated new TSK 0
I20260709 12:20:27.486172 30018 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:20:27.497107 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:27.504160 30028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:27.505007 30029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:27.506116 30031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:27.507426 21244 server_base.cc:1061] running on GCE node
I20260709 12:20:27.509748 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:27.509976 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:27.510151 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599627510131 us; error 0 us; skew 500 ppm
I20260709 12:20:27.510687 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:27.513007 21244 webserver.cc:533] Webserver started at http://127.20.191.1:39373/ using document root <none> and password file <none>
I20260709 12:20:27.513518 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:27.513690 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:27.514012 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:27.515240 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-0-root/instance:
uuid: "22a1255131174934a6bca3c0bf000026"
format_stamp: "Formatted at 2026-07-09 12:20:27 on dist-test-slave-7c1h"
I20260709 12:20:27.519842 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:20:27.523466 30036 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:27.524248 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:20:27.524521 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-0-root
uuid: "22a1255131174934a6bca3c0bf000026"
format_stamp: "Formatted at 2026-07-09 12:20:27 on dist-test-slave-7c1h"
I20260709 12:20:27.524798 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:27.555425 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:27.556617 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:27.558104 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:27.560525 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:27.560709 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:27.560947 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:27.561105 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:27.602018 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.1:43571
I20260709 12:20:27.602108 30098 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.1:43571 every 8 connection(s)
I20260709 12:20:27.606962 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:27.614367 30103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:27.615963 30104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:27.620745 21244 server_base.cc:1061] running on GCE node
I20260709 12:20:27.621115 30099 heartbeater.cc:344] Connected to a master server at 127.20.191.62:36647
I20260709 12:20:27.621584 30099 heartbeater.cc:461] Registering TS with master...
W20260709 12:20:27.621531 30106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:27.623350 30099 heartbeater.cc:507] Master 127.20.191.62:36647 requested a full tablet report, sending...
I20260709 12:20:27.623548 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:27.623842 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:27.624003 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599627623987 us; error 0 us; skew 500 ppm
I20260709 12:20:27.624698 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:27.625665 29972 ts_manager.cc:194] Registered new tserver with Master: 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:27.627610 21244 webserver.cc:533] Webserver started at http://127.20.191.2:38485/ using document root <none> and password file <none>
I20260709 12:20:27.627935 29972 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49632
I20260709 12:20:27.628180 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:27.629096 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:27.629634 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:27.631096 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-1-root/instance:
uuid: "b0439d4e94904196847cd825fcc8ebd7"
format_stamp: "Formatted at 2026-07-09 12:20:27 on dist-test-slave-7c1h"
I20260709 12:20:27.635718 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:20:27.639256 30111 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:27.640112 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:20:27.640412 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-1-root
uuid: "b0439d4e94904196847cd825fcc8ebd7"
format_stamp: "Formatted at 2026-07-09 12:20:27 on dist-test-slave-7c1h"
I20260709 12:20:27.640692 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:27.655109 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:27.656379 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:27.658000 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:27.660447 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:27.660661 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:27.661311 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:27.661726 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:27.709980 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.2:40479
I20260709 12:20:27.710075 30173 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.2:40479 every 8 connection(s)
I20260709 12:20:27.714982 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:27.723191 30177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:27.724609 30178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:27.728436 21244 server_base.cc:1061] running on GCE node
I20260709 12:20:27.728849 30174 heartbeater.cc:344] Connected to a master server at 127.20.191.62:36647
I20260709 12:20:27.729310 30174 heartbeater.cc:461] Registering TS with master...
W20260709 12:20:27.729655 30181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:27.730186 30174 heartbeater.cc:507] Master 127.20.191.62:36647 requested a full tablet report, sending...
I20260709 12:20:27.730815 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:27.731122 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:27.731333 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599627731314 us; error 0 us; skew 500 ppm
I20260709 12:20:27.731942 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:27.732506 29972 ts_manager.cc:194] Registered new tserver with Master: b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:27.734157 29972 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49638
I20260709 12:20:27.734684 21244 webserver.cc:533] Webserver started at http://127.20.191.3:35945/ using document root <none> and password file <none>
I20260709 12:20:27.735292 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:27.735533 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:27.735795 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:27.737092 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-2-root/instance:
uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
format_stamp: "Formatted at 2026-07-09 12:20:27 on dist-test-slave-7c1h"
I20260709 12:20:27.741993 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:20:27.745563 30185 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:27.746326 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:20:27.746625 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-2-root
uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
format_stamp: "Formatted at 2026-07-09 12:20:27 on dist-test-slave-7c1h"
I20260709 12:20:27.746894 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:27.772079 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:27.773603 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:27.775267 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:27.777689 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:27.777954 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:27.778191 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:27.778340 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:27.820858 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.3:44035
I20260709 12:20:27.820974 30247 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.3:44035 every 8 connection(s)
I20260709 12:20:27.826088 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:27.834445 30251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:27.835516 30252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:27.837666 30248 heartbeater.cc:344] Connected to a master server at 127.20.191.62:36647
I20260709 12:20:27.837843 21244 server_base.cc:1061] running on GCE node
I20260709 12:20:27.838255 30248 heartbeater.cc:461] Registering TS with master...
W20260709 12:20:27.838239 30255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:27.839354 30248 heartbeater.cc:507] Master 127.20.191.62:36647 requested a full tablet report, sending...
I20260709 12:20:27.839404 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:27.839764 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:27.839936 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599627839919 us; error 0 us; skew 500 ppm
I20260709 12:20:27.840734 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:27.841575 29972 ts_manager.cc:194] Registered new tserver with Master: f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:27.843616 21244 webserver.cc:533] Webserver started at http://127.20.191.4:37209/ using document root <none> and password file <none>
I20260709 12:20:27.843632 29972 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49640
I20260709 12:20:27.844430 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:27.844712 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:27.845027 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:27.846614 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-3-root/instance:
uuid: "f6c1f7275e654f49abaf1c80ed662511"
format_stamp: "Formatted at 2026-07-09 12:20:27 on dist-test-slave-7c1h"
I20260709 12:20:27.851032 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:20:27.854400 30259 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:27.855127 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:20:27.855418 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-3-root
uuid: "f6c1f7275e654f49abaf1c80ed662511"
format_stamp: "Formatted at 2026-07-09 12:20:27 on dist-test-slave-7c1h"
I20260709 12:20:27.855726 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:27.882025 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:27.883289 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:27.884706 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:27.887048 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:27.887252 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:27.887488 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:27.887639 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:27.930101 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.4:33729
I20260709 12:20:27.930186 30321 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.4:33729 every 8 connection(s)
I20260709 12:20:27.944192 30322 heartbeater.cc:344] Connected to a master server at 127.20.191.62:36647
I20260709 12:20:27.944586 30322 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:27.945364 30322 heartbeater.cc:507] Master 127.20.191.62:36647 requested a full tablet report, sending...
I20260709 12:20:27.947526 29972 ts_manager.cc:194] Registered new tserver with Master: f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:27.948330 21244 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015061623s
I20260709 12:20:27.949028 29972 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49656
I20260709 12:20:27.976114 29972 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49672:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:20:28.221637 30213 tablet_service.cc:1511] Processing CreateTablet for tablet 7423bc8fd1a54058b083a1c5affa2440 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:20:28.223248 30213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7423bc8fd1a54058b083a1c5affa2440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.224720 30212 tablet_service.cc:1511] Processing CreateTablet for tablet 5d01a3a6c7f24268a9c505f7d2f0efcd (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:20:28.226302 30212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d01a3a6c7f24268a9c505f7d2f0efcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.235549 30287 tablet_service.cc:1511] Processing CreateTablet for tablet 7423bc8fd1a54058b083a1c5affa2440 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:20:28.237093 30287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7423bc8fd1a54058b083a1c5affa2440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.235596 30286 tablet_service.cc:1511] Processing CreateTablet for tablet 27678468a40344eca39b8bab02b0b368 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:20:28.241297 30286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27678468a40344eca39b8bab02b0b368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.240904 30211 tablet_service.cc:1511] Processing CreateTablet for tablet 68f77894695f4690bea31f432539542e (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:20:28.242404 30211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68f77894695f4690bea31f432539542e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.244143 30139 tablet_service.cc:1511] Processing CreateTablet for tablet 5d01a3a6c7f24268a9c505f7d2f0efcd (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:20:28.244995 30138 tablet_service.cc:1511] Processing CreateTablet for tablet 27678468a40344eca39b8bab02b0b368 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:20:28.245640 30139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d01a3a6c7f24268a9c505f7d2f0efcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.252696 30138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27678468a40344eca39b8bab02b0b368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.254372 30136 tablet_service.cc:1511] Processing CreateTablet for tablet a6fb12e58a824780acab66b641b29009 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:20:28.255995 30136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6fb12e58a824780acab66b641b29009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.248816 30285 tablet_service.cc:1511] Processing CreateTablet for tablet 68f77894695f4690bea31f432539542e (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:20:28.263350 30285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68f77894695f4690bea31f432539542e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.246908 30137 tablet_service.cc:1511] Processing CreateTablet for tablet 68f77894695f4690bea31f432539542e (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:20:28.268328 30137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68f77894695f4690bea31f432539542e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.271696 30064 tablet_service.cc:1511] Processing CreateTablet for tablet 7423bc8fd1a54058b083a1c5affa2440 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:20:28.273168 30064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7423bc8fd1a54058b083a1c5affa2440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.276288 30063 tablet_service.cc:1511] Processing CreateTablet for tablet 5d01a3a6c7f24268a9c505f7d2f0efcd (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:20:28.278198 30063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d01a3a6c7f24268a9c505f7d2f0efcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.284176 30062 tablet_service.cc:1511] Processing CreateTablet for tablet 27678468a40344eca39b8bab02b0b368 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:20:28.286051 30062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27678468a40344eca39b8bab02b0b368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.291329 30061 tablet_service.cc:1511] Processing CreateTablet for tablet a6fb12e58a824780acab66b641b29009 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:20:28.293076 30061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6fb12e58a824780acab66b641b29009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.307132 30211 tablet_service.cc:1511] Processing CreateTablet for tablet a6fb12e58a824780acab66b641b29009 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:20:28.308866 30211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6fb12e58a824780acab66b641b29009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.316056 30284 tablet_service.cc:1511] Processing CreateTablet for tablet 4f18dd45e30e4e3aafdc917396dc2181 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:20:28.318184 30284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f18dd45e30e4e3aafdc917396dc2181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.341892 30060 tablet_service.cc:1511] Processing CreateTablet for tablet 4f18dd45e30e4e3aafdc917396dc2181 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:20:28.343626 30060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f18dd45e30e4e3aafdc917396dc2181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.372943 30343 tablet_bootstrap.cc:492] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:28.375255 30135 tablet_service.cc:1511] Processing CreateTablet for tablet 4f18dd45e30e4e3aafdc917396dc2181 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:20:28.376866 30135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f18dd45e30e4e3aafdc917396dc2181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.377101 30342 tablet_bootstrap.cc:492] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:28.380618 30212 tablet_service.cc:1511] Processing CreateTablet for tablet a6bfe6b1a3764834aa3501ebdf533ddf (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:20:28.386790 30342 tablet_bootstrap.cc:654] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:28.388062 30059 tablet_service.cc:1511] Processing CreateTablet for tablet a6bfe6b1a3764834aa3501ebdf533ddf (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:20:28.389550 30213 tablet_service.cc:1511] Processing CreateTablet for tablet bd0710767a1a447f9670e840fb1e68a4 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:20:28.391043 30213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0710767a1a447f9670e840fb1e68a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.390884 30283 tablet_service.cc:1511] Processing CreateTablet for tablet a6bfe6b1a3764834aa3501ebdf533ddf (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:20:28.391728 30138 tablet_service.cc:1511] Processing CreateTablet for tablet bd0710767a1a447f9670e840fb1e68a4 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:20:28.392331 30283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6bfe6b1a3764834aa3501ebdf533ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.393034 30138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0710767a1a447f9670e840fb1e68a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.389643 30059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6bfe6b1a3764834aa3501ebdf533ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.403641 30285 tablet_service.cc:1511] Processing CreateTablet for tablet bd0710767a1a447f9670e840fb1e68a4 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:20:28.411134 30285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0710767a1a447f9670e840fb1e68a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.409025 30212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6bfe6b1a3764834aa3501ebdf533ddf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:28.422343 30020 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:28.424649 30058 tablet_service.cc:1511] Processing CreateTablet for tablet e5da70c81d654d3e9e50fa2778189857 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:20:28.427008 30210 tablet_service.cc:1511] Processing CreateTablet for tablet e5da70c81d654d3e9e50fa2778189857 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:20:28.428489 30210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5da70c81d654d3e9e50fa2778189857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.431092 30282 tablet_service.cc:1511] Processing CreateTablet for tablet 67a9ecec74344c1693efb9acb6e38e26 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:20:28.432646 30282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a9ecec74344c1693efb9acb6e38e26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.436973 30058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5da70c81d654d3e9e50fa2778189857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.436847 30134 tablet_service.cc:1511] Processing CreateTablet for tablet e5da70c81d654d3e9e50fa2778189857 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:20:28.437863 30342 tablet_bootstrap.cc:492] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:28.438452 30342 ts_tablet_manager.cc:1403] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.010s
I20260709 12:20:28.438570 30134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5da70c81d654d3e9e50fa2778189857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.440171 30209 tablet_service.cc:1511] Processing CreateTablet for tablet ca034599de8146968cc8adcb232a2ca4 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:20:28.441744 30209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca034599de8146968cc8adcb232a2ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.445536 30342 raft_consensus.cc:359] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:28.446406 30342 raft_consensus.cc:385] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:28.446920 30342 raft_consensus.cc:740] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:28.446555 30133 tablet_service.cc:1511] Processing CreateTablet for tablet 67a9ecec74344c1693efb9acb6e38e26 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:20:28.448040 30133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a9ecec74344c1693efb9acb6e38e26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.452227 30286 tablet_service.cc:1511] Processing CreateTablet for tablet ca034599de8146968cc8adcb232a2ca4 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:20:28.453728 30286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca034599de8146968cc8adcb232a2ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.454066 30057 tablet_service.cc:1511] Processing CreateTablet for tablet ca034599de8146968cc8adcb232a2ca4 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:20:28.455786 30057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca034599de8146968cc8adcb232a2ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.461117 30213 tablet_service.cc:1511] Processing CreateTablet for tablet 0e9a81d1a7404da0aac49a76cb38f0de (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:20:28.462512 30213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e9a81d1a7404da0aac49a76cb38f0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.435392 30344 tablet_bootstrap.cc:492] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:28.465598 30138 tablet_service.cc:1511] Processing CreateTablet for tablet 0e9a81d1a7404da0aac49a76cb38f0de (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:20:28.467435 30138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e9a81d1a7404da0aac49a76cb38f0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.468576 30064 tablet_service.cc:1511] Processing CreateTablet for tablet 67a9ecec74344c1693efb9acb6e38e26 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:20:28.477299 30281 tablet_service.cc:1511] Processing CreateTablet for tablet 0e9a81d1a7404da0aac49a76cb38f0de (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:20:28.498790 30281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e9a81d1a7404da0aac49a76cb38f0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.478425 30056 tablet_service.cc:1511] Processing CreateTablet for tablet 27c8763c7b2b4fb891cbebff4035dbe6 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:20:28.502836 30056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c8763c7b2b4fb891cbebff4035dbe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.507066 30138 tablet_service.cc:1511] Processing CreateTablet for tablet 1aca82ece24244f792b8e4d302f4f4f9 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:20:28.508435 30138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aca82ece24244f792b8e4d302f4f4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.518633 30064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a9ecec74344c1693efb9acb6e38e26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.481969 30342 consensus_queue.cc:260] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:28.485539 30132 tablet_service.cc:1511] Processing CreateTablet for tablet 27c8763c7b2b4fb891cbebff4035dbe6 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:20:28.521946 30132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c8763c7b2b4fb891cbebff4035dbe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.527701 30280 tablet_service.cc:1511] Processing CreateTablet for tablet 975b191d2b5544a6838af42f2be670c9 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:20:28.527885 30211 tablet_service.cc:1511] Processing CreateTablet for tablet 975b191d2b5544a6838af42f2be670c9 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:20:28.529381 30211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 975b191d2b5544a6838af42f2be670c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.488634 30344 tablet_bootstrap.cc:654] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:28.488862 30208 tablet_service.cc:1511] Processing CreateTablet for tablet 27c8763c7b2b4fb891cbebff4035dbe6 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:20:28.532142 30208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c8763c7b2b4fb891cbebff4035dbe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.494822 30286 tablet_service.cc:1511] Processing CreateTablet for tablet 1aca82ece24244f792b8e4d302f4f4f9 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:20:28.496098 30055 tablet_service.cc:1511] Processing CreateTablet for tablet 1aca82ece24244f792b8e4d302f4f4f9 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:20:28.534276 30055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aca82ece24244f792b8e4d302f4f4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.538686 30062 tablet_service.cc:1511] Processing CreateTablet for tablet 975b191d2b5544a6838af42f2be670c9 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:20:28.540256 30062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 975b191d2b5544a6838af42f2be670c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.551596 30136 tablet_service.cc:1511] Processing CreateTablet for tablet 438c3adce9a646b8944ac27608e94314 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:20:28.553323 30136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438c3adce9a646b8944ac27608e94314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.559655 30207 tablet_service.cc:1511] Processing CreateTablet for tablet 438c3adce9a646b8944ac27608e94314 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:20:28.561343 30207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438c3adce9a646b8944ac27608e94314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.566167 30287 tablet_service.cc:1511] Processing CreateTablet for tablet 438c3adce9a646b8944ac27608e94314 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:20:28.575281 30280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 975b191d2b5544a6838af42f2be670c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.578817 30286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aca82ece24244f792b8e4d302f4f4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.586943 30346 tablet_bootstrap.cc:492] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:28.588405 30060 tablet_service.cc:1511] Processing CreateTablet for tablet 1e48bba41f0240ac820f0e23f6067b67 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:20:28.589803 30060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e48bba41f0240ac820f0e23f6067b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.473536 30343 tablet_bootstrap.cc:654] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:28.602702 30287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438c3adce9a646b8944ac27608e94314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.616704 30343 tablet_bootstrap.cc:492] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:28.622557 30343 ts_tablet_manager.cc:1403] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.250s	user 0.013s	sys 0.000s
I20260709 12:20:28.624579 30212 tablet_service.cc:1511] Processing CreateTablet for tablet 1e48bba41f0240ac820f0e23f6067b67 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:20:28.624759 30284 tablet_service.cc:1511] Processing CreateTablet for tablet 22caa8a59f42477199989f2612bb7136 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:20:28.622443 30133 tablet_service.cc:1511] Processing CreateTablet for tablet 1e48bba41f0240ac820f0e23f6067b67 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:20:28.626780 30133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e48bba41f0240ac820f0e23f6067b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.626041 30343 raft_consensus.cc:359] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:28.629586 30343 raft_consensus.cc:385] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:28.629997 30343 raft_consensus.cc:740] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:28.630777 30343 consensus_queue.cc:260] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:28.631412 30099 heartbeater.cc:499] Master 127.20.191.62:36647 was elected leader, sending a full tablet report...
I20260709 12:20:28.634581 30212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e48bba41f0240ac820f0e23f6067b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.636438 30344 tablet_bootstrap.cc:492] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:28.637080 30344 ts_tablet_manager.cc:1403] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.204s	user 0.010s	sys 0.007s
I20260709 12:20:28.645684 30284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22caa8a59f42477199989f2612bb7136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.674851 30248 heartbeater.cc:499] Master 127.20.191.62:36647 was elected leader, sending a full tablet report...
I20260709 12:20:28.682763 30342 ts_tablet_manager.cc:1434] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.244s	user 0.030s	sys 0.025s
I20260709 12:20:28.682909 30344 raft_consensus.cc:359] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:28.683907 30344 raft_consensus.cc:385] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:28.684293 30344 raft_consensus.cc:740] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:28.685269 30344 consensus_queue.cc:260] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:28.683921 30342 tablet_bootstrap.cc:492] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:28.690630 30346 tablet_bootstrap.cc:654] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:28.702579 30063 tablet_service.cc:1511] Processing CreateTablet for tablet 22caa8a59f42477199989f2612bb7136 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:20:28.704960 30137 tablet_service.cc:1511] Processing CreateTablet for tablet 22caa8a59f42477199989f2612bb7136 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:20:28.706923 30213 tablet_service.cc:1511] Processing CreateTablet for tablet 5b17f97873bb48ca864a13321c11f401 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:20:28.724946 30174 heartbeater.cc:499] Master 127.20.191.62:36647 was elected leader, sending a full tablet report...
I20260709 12:20:28.727540 30137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22caa8a59f42477199989f2612bb7136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.727865 30343 ts_tablet_manager.cc:1434] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.105s	user 0.035s	sys 0.061s
I20260709 12:20:28.728428 30213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b17f97873bb48ca864a13321c11f401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.727869 30322 heartbeater.cc:499] Master 127.20.191.62:36647 was elected leader, sending a full tablet report...
I20260709 12:20:28.730873 30063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22caa8a59f42477199989f2612bb7136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.731006 30344 ts_tablet_manager.cc:1434] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.094s	user 0.002s	sys 0.011s
I20260709 12:20:28.745343 30343 tablet_bootstrap.cc:492] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:28.753477 30343 tablet_bootstrap.cc:654] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:28.757790 30344 tablet_bootstrap.cc:492] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:28.761188 30059 tablet_service.cc:1511] Processing CreateTablet for tablet 5b17f97873bb48ca864a13321c11f401 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:20:28.762909 30059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b17f97873bb48ca864a13321c11f401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.763331 30138 tablet_service.cc:1511] Processing CreateTablet for tablet 3a289b0636994e34965a2dc0137e5b94 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:20:28.764688 30138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a289b0636994e34965a2dc0137e5b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.753021 30342 tablet_bootstrap.cc:654] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:28.787539 30344 tablet_bootstrap.cc:654] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:28.797561 30064 tablet_service.cc:1511] Processing CreateTablet for tablet 8f47831b773245faa71c01cb8c967a7a (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:20:28.799197 30064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f47831b773245faa71c01cb8c967a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.800439 30133 tablet_service.cc:1511] Processing CreateTablet for tablet 8f47831b773245faa71c01cb8c967a7a (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:20:28.801847 30133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f47831b773245faa71c01cb8c967a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.801653 30282 tablet_service.cc:1511] Processing CreateTablet for tablet 3a289b0636994e34965a2dc0137e5b94 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:20:28.806754 30209 tablet_service.cc:1511] Processing CreateTablet for tablet 3a289b0636994e34965a2dc0137e5b94 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:20:28.808107 30209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a289b0636994e34965a2dc0137e5b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.807121 30282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a289b0636994e34965a2dc0137e5b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.812973 30208 tablet_service.cc:1511] Processing CreateTablet for tablet 8f47831b773245faa71c01cb8c967a7a (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:20:28.814586 30208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f47831b773245faa71c01cb8c967a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.824944 30285 tablet_service.cc:1511] Processing CreateTablet for tablet 9c98f7fba9544225a8c7e515247ec5c9 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
W20260709 12:20:28.826803 30249 tablet.cc:2406] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:20:28.850391 30285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c98f7fba9544225a8c7e515247ec5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.852618 30062 tablet_service.cc:1511] Processing CreateTablet for tablet 9c98f7fba9544225a8c7e515247ec5c9 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:20:28.854121 30062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c98f7fba9544225a8c7e515247ec5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.854604 30343 tablet_bootstrap.cc:492] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:28.855180 30343 ts_tablet_manager.cc:1403] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.115s	user 0.019s	sys 0.019s
I20260709 12:20:28.858613 30343 raft_consensus.cc:359] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:28.861574 30346 tablet_bootstrap.cc:492] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:28.862255 30346 ts_tablet_manager.cc:1403] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.276s	user 0.016s	sys 0.012s
I20260709 12:20:28.864110 30207 tablet_service.cc:1511] Processing CreateTablet for tablet 1efc41cad99a42d5a67d2db6d27a9061 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:20:28.866065 30283 tablet_service.cc:1511] Processing CreateTablet for tablet 1efc41cad99a42d5a67d2db6d27a9061 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:20:28.867406 30283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1efc41cad99a42d5a67d2db6d27a9061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.859375 30343 raft_consensus.cc:385] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:28.867615 30133 tablet_service.cc:1511] Processing CreateTablet for tablet 9c98f7fba9544225a8c7e515247ec5c9 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:20:28.868254 30343 raft_consensus.cc:740] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:28.868889 30133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c98f7fba9544225a8c7e515247ec5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.872750 30058 tablet_service.cc:1511] Processing CreateTablet for tablet 1efc41cad99a42d5a67d2db6d27a9061 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:20:28.869246 30343 consensus_queue.cc:260] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:28.874176 30058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1efc41cad99a42d5a67d2db6d27a9061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.875525 30343 ts_tablet_manager.cc:1434] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:20:28.879021 30344 tablet_bootstrap.cc:492] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:28.879935 30344 ts_tablet_manager.cc:1403] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.136s	user 0.034s	sys 0.014s
I20260709 12:20:28.880611 30343 tablet_bootstrap.cc:492] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:28.880751 30136 tablet_service.cc:1511] Processing CreateTablet for tablet 1c55d09601aa4eceaf3916006afcc93a (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:20:28.882109 30136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c55d09601aa4eceaf3916006afcc93a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.883143 30344 raft_consensus.cc:359] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:28.883914 30344 raft_consensus.cc:385] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:28.884198 30344 raft_consensus.cc:740] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:28.866145 30286 tablet_service.cc:1511] Processing CreateTablet for tablet 5b17f97873bb48ca864a13321c11f401 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:20:28.886445 30286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b17f97873bb48ca864a13321c11f401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.865422 30346 raft_consensus.cc:359] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:28.889454 30346 raft_consensus.cc:385] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:28.889848 30346 raft_consensus.cc:740] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:28.890691 30346 consensus_queue.cc:260] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:28.891916 30342 tablet_bootstrap.cc:492] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:28.892482 30342 ts_tablet_manager.cc:1403] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.209s	user 0.014s	sys 0.009s
I20260709 12:20:28.894318 30344 consensus_queue.cc:260] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:28.895643 30342 raft_consensus.cc:359] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:28.896404 30342 raft_consensus.cc:385] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:28.896701 30342 raft_consensus.cc:740] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:28.898788 30280 tablet_service.cc:1511] Processing CreateTablet for tablet 1c55d09601aa4eceaf3916006afcc93a (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:20:28.899540 30351 raft_consensus.cc:493] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.900127 30280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c55d09601aa4eceaf3916006afcc93a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.900058 30351 raft_consensus.cc:515] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:28.901712 30347 raft_consensus.cc:493] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.902215 30347 raft_consensus.cc:515] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:28.866532 30207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1efc41cad99a42d5a67d2db6d27a9061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.911351 30350 raft_consensus.cc:493] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.912066 30350 raft_consensus.cc:515] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:28.914476 30211 tablet_service.cc:1511] Processing CreateTablet for tablet 1c55d09601aa4eceaf3916006afcc93a (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:20:28.933722 30346 ts_tablet_manager.cc:1434] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.071s	user 0.012s	sys 0.012s
I20260709 12:20:28.949920 30059 tablet_service.cc:1511] Processing CreateTablet for tablet ea68554f4650455e9aa55638ed533430 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:20:28.951290 30059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea68554f4650455e9aa55638ed533430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.921164 30342 consensus_queue.cc:260] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:28.938202 30211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c55d09601aa4eceaf3916006afcc93a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.921130 30350 leader_election.cc:290] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:28.920795 30351 leader_election.cc:290] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:28.945919 30344 ts_tablet_manager.cc:1434] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.001s
I20260709 12:20:28.965736 30347 leader_election.cc:290] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:28.966408 30347 raft_consensus.cc:493] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.977547 30344 tablet_bootstrap.cc:492] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:28.978631 30138 tablet_service.cc:1511] Processing CreateTablet for tablet ea68554f4650455e9aa55638ed533430 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:20:28.980002 30138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea68554f4650455e9aa55638ed533430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.975765 30346 tablet_bootstrap.cc:492] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:28.982709 30213 tablet_service.cc:1511] Processing CreateTablet for tablet ea68554f4650455e9aa55638ed533430 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:20:28.984015 30213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea68554f4650455e9aa55638ed533430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.984093 30209 tablet_service.cc:1511] Processing CreateTablet for tablet 0d0b7d6a4d5d4eb1a1c115b60981d41c (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:20:29.000437 30209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d0b7d6a4d5d4eb1a1c115b60981d41c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.001485 30343 tablet_bootstrap.cc:654] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:28.975379 30347 raft_consensus.cc:515] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:29.042095 30356 raft_consensus.cc:493] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.043598 30356 raft_consensus.cc:515] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:29.049746 30287 tablet_service.cc:1511] Processing CreateTablet for tablet 0d0b7d6a4d5d4eb1a1c115b60981d41c (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:20:29.051451 30287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d0b7d6a4d5d4eb1a1c115b60981d41c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.067482 30135 tablet_service.cc:1511] Processing CreateTablet for tablet 64c571ad30094eb3ac0b270c6a3c6a28 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:20:29.067888 30063 tablet_service.cc:1511] Processing CreateTablet for tablet 3b981cc4916444c0a31e5fd3b14aaa67 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:20:29.069027 30135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c571ad30094eb3ac0b270c6a3c6a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.074477 30342 ts_tablet_manager.cc:1434] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.182s	user 0.013s	sys 0.010s
I20260709 12:20:29.082414 30350 raft_consensus.cc:493] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.083197 30350 raft_consensus.cc:515] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:29.083809 30132 tablet_service.cc:1511] Processing CreateTablet for tablet 4ad560d215f8475ab9f93ff568eef9f9 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:20:29.085407 30132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad560d215f8475ab9f93ff568eef9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.087414 30347 leader_election.cc:290] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:29.053311 30284 tablet_service.cc:1511] Processing CreateTablet for tablet 3b981cc4916444c0a31e5fd3b14aaa67 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:20:29.069729 30063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b981cc4916444c0a31e5fd3b14aaa67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.098184 30208 tablet_service.cc:1511] Processing CreateTablet for tablet 64c571ad30094eb3ac0b270c6a3c6a28 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:20:29.090237 30137 tablet_service.cc:1511] Processing CreateTablet for tablet 3b981cc4916444c0a31e5fd3b14aaa67 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:20:29.099620 30208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c571ad30094eb3ac0b270c6a3c6a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.102087 30350 leader_election.cc:290] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:29.100553 30137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b981cc4916444c0a31e5fd3b14aaa67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.112650 30284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b981cc4916444c0a31e5fd3b14aaa67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.057657 30064 tablet_service.cc:1511] Processing CreateTablet for tablet 0d0b7d6a4d5d4eb1a1c115b60981d41c (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:20:29.134480 30351 raft_consensus.cc:493] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.135118 30351 raft_consensus.cc:515] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:29.137594 30356 leader_election.cc:290] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:29.134598 30064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d0b7d6a4d5d4eb1a1c115b60981d41c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.132164 30346 tablet_bootstrap.cc:654] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.139021 30351 leader_election.cc:290] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:29.128901 30344 tablet_bootstrap.cc:654] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.149066 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f77894695f4690bea31f432539542e" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:29.141425 30133 tablet_service.cc:1511] Processing CreateTablet for tablet 15f28aae897045be9eed015c98ba6908 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:20:29.150851 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27678468a40344eca39b8bab02b0b368" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:29.151683 30148 raft_consensus.cc:2468] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:29.151659 30133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f28aae897045be9eed015c98ba6908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.166438 30212 tablet_service.cc:1511] Processing CreateTablet for tablet 4ad560d215f8475ab9f93ff568eef9f9 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:20:29.166602 30210 tablet_service.cc:1511] Processing CreateTablet for tablet 3664ea9a740d4d4eaa2ba8371126d21b (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:20:29.168210 30212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad560d215f8475ab9f93ff568eef9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.171173 30210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3664ea9a740d4d4eaa2ba8371126d21b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:29.155503 30260 leader_election.cc:343] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.173367 30260 leader_election.cc:304] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:29.183346 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27678468a40344eca39b8bab02b0b368" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:29.199127 30136 tablet_service.cc:1511] Processing CreateTablet for tablet d0c2af5bb5b548d8855b05242cb9d33c (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:20:29.200555 30136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0c2af5bb5b548d8855b05242cb9d33c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.200644 30285 tablet_service.cc:1511] Processing CreateTablet for tablet 64c571ad30094eb3ac0b270c6a3c6a28 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:20:29.201936 30206 tablet_service.cc:1511] Processing CreateTablet for tablet d0c2af5bb5b548d8855b05242cb9d33c (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:20:29.203261 30206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0c2af5bb5b548d8855b05242cb9d33c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.203293 30286 tablet_service.cc:1511] Processing CreateTablet for tablet 15f28aae897045be9eed015c98ba6908 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:20:29.201982 30285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c571ad30094eb3ac0b270c6a3c6a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.206209 30282 tablet_service.cc:1511] Processing CreateTablet for tablet 3664ea9a740d4d4eaa2ba8371126d21b (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:20:29.209074 30205 tablet_service.cc:1511] Processing CreateTablet for tablet 41c11e80998149a79fca99acf176427e (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:20:29.209517 30282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3664ea9a740d4d4eaa2ba8371126d21b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.210461 30205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c11e80998149a79fca99acf176427e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.206127 30139 tablet_service.cc:1511] Processing CreateTablet for tablet 41c11e80998149a79fca99acf176427e (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:20:29.213374 30139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c11e80998149a79fca99acf176427e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.214630 30297 raft_consensus.cc:2468] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:29.215230 30351 raft_consensus.cc:2804] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:29.216991 30286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f28aae897045be9eed015c98ba6908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.221477 30351 raft_consensus.cc:493] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.222033 30351 raft_consensus.cc:3060] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.223851 30062 tablet_service.cc:1511] Processing CreateTablet for tablet 4ad560d215f8475ab9f93ff568eef9f9 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:20:29.224088 30058 tablet_service.cc:1511] Processing CreateTablet for tablet 15f28aae897045be9eed015c98ba6908 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:20:29.225265 30062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad560d215f8475ab9f93ff568eef9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.225971 30057 tablet_service.cc:1511] Processing CreateTablet for tablet 41c11e80998149a79fca99acf176427e (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:20:29.227088 30058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f28aae897045be9eed015c98ba6908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.234858 30057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c11e80998149a79fca99acf176427e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.238246 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb12e58a824780acab66b641b29009" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:29.240716 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27678468a40344eca39b8bab02b0b368" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:29.224337 30055 tablet_service.cc:1511] Processing CreateTablet for tablet 3664ea9a740d4d4eaa2ba8371126d21b (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:20:29.243057 30055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3664ea9a740d4d4eaa2ba8371126d21b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:29.243866 30114 leader_election.cc:343] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.263880 30343 tablet_bootstrap.cc:492] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
W20260709 12:20:29.264210 30114 leader_election.cc:343] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.264532 30343 ts_tablet_manager.cc:1403] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.384s	user 0.020s	sys 0.004s
I20260709 12:20:29.264979 30115 leader_election.cc:304] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:29.274078 30350 raft_consensus.cc:2804] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:29.274546 30350 raft_consensus.cc:493] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.274901 30350 raft_consensus.cc:3060] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:29.281919 30115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:33729, user_credentials={real_user=slave}} blocked reactor thread for 48252.3us
I20260709 12:20:29.284149 30350 raft_consensus.cc:515] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:29.285060 30343 raft_consensus.cc:359] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:29.289166 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27678468a40344eca39b8bab02b0b368" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:29.286545 30350 leader_election.cc:290] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
W20260709 12:20:29.326833 30114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:43571, user_credentials={real_user=slave}} blocked reactor thread for 82239us
I20260709 12:20:29.329924 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27678468a40344eca39b8bab02b0b368" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:29.314484 30343 raft_consensus.cc:385] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.334163 30343 raft_consensus.cc:740] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
W20260709 12:20:29.334367 30114 leader_election.cc:343] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.340693 30285 tablet_service.cc:1511] Processing CreateTablet for tablet d0c2af5bb5b548d8855b05242cb9d33c (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:20:29.342142 30285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0c2af5bb5b548d8855b05242cb9d33c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.336143 30342 tablet_bootstrap.cc:492] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:29.372295 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f77894695f4690bea31f432539542e" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:29.373281 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27678468a40344eca39b8bab02b0b368" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
W20260709 12:20:29.378687 30262 leader_election.cc:343] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.378971 30223 raft_consensus.cc:2468] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:29.379908 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb12e58a824780acab66b641b29009" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:29.380093 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f77894695f4690bea31f432539542e" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
W20260709 12:20:29.381809 30186 leader_election.cc:343] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:29.383098 30113 leader_election.cc:343] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.383644 30113 leader_election.cc:304] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7; no voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:29.384330 30350 raft_consensus.cc:2749] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:29.381836 30280 tablet_service.cc:1511] Processing CreateTablet for tablet 581f9562c91e46eea64ec770bcb8671b (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:20:29.385733 30280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 581f9562c91e46eea64ec770bcb8671b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.396071 30343 consensus_queue.cc:260] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:29.402035 30136 tablet_service.cc:1511] Processing CreateTablet for tablet 581f9562c91e46eea64ec770bcb8671b (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:20:29.403659 30136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 581f9562c91e46eea64ec770bcb8671b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.412189 30212 tablet_service.cc:1511] Processing CreateTablet for tablet d8157cddb556437c85c52ceb0ec7b614 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:20:29.413836 30212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8157cddb556437c85c52ceb0ec7b614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.415064 30064 tablet_service.cc:1511] Processing CreateTablet for tablet 581f9562c91e46eea64ec770bcb8671b (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:20:29.416456 30064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 581f9562c91e46eea64ec770bcb8671b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.416718 30296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f18dd45e30e4e3aafdc917396dc2181" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:29.418581 30282 tablet_service.cc:1511] Processing CreateTablet for tablet d8157cddb556437c85c52ceb0ec7b614 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:20:29.419991 30282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8157cddb556437c85c52ceb0ec7b614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.422226 30344 tablet_bootstrap.cc:492] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:29.422770 30344 ts_tablet_manager.cc:1403] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.445s	user 0.035s	sys 0.004s
W20260709 12:20:29.424978 30020 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:29.426071 30344 raft_consensus.cc:359] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:29.426880 30344 raft_consensus.cc:385] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.427237 30344 raft_consensus.cc:740] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.428028 30344 consensus_queue.cc:260] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:29.428666 30137 tablet_service.cc:1511] Processing CreateTablet for tablet 5bd853575cf54f3f91608d485c3d16ca (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:20:29.436107 30137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bd853575cf54f3f91608d485c3d16ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.416368 30063 tablet_service.cc:1511] Processing CreateTablet for tablet d8157cddb556437c85c52ceb0ec7b614 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:20:29.437484 30063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8157cddb556437c85c52ceb0ec7b614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.438946 30346 tablet_bootstrap.cc:492] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:29.431730 30295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f77894695f4690bea31f432539542e" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:29.442212 30295 raft_consensus.cc:2468] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 0.
I20260709 12:20:29.432580 30296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7423bc8fd1a54058b083a1c5affa2440" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:29.433095 30205 tablet_service.cc:1511] Processing CreateTablet for tablet 5bd853575cf54f3f91608d485c3d16ca (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:20:29.445436 30205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bd853575cf54f3f91608d485c3d16ca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:29.448074 30189 leader_election.cc:343] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.440212 30346 ts_tablet_manager.cc:1403] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.473s	user 0.027s	sys 0.012s
I20260709 12:20:29.454268 30189 leader_election.cc:304] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:29.455451 30366 raft_consensus.cc:2804] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:29.455902 30366 raft_consensus.cc:493] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.456306 30366 raft_consensus.cc:3060] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.456022 30283 tablet_service.cc:1511] Processing CreateTablet for tablet 5bd853575cf54f3f91608d485c3d16ca (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:20:29.457564 30283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bd853575cf54f3f91608d485c3d16ca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:29.462092 30040 leader_election.cc:343] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.463413 30346 raft_consensus.cc:359] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:29.464217 30346 raft_consensus.cc:385] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.464519 30346 raft_consensus.cc:740] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.465740 30346 consensus_queue.cc:260] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:29.466822 30135 tablet_service.cc:1511] Processing CreateTablet for tablet 3111cf2203d14eb8a006d35fee44552e (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:20:29.468226 30135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3111cf2203d14eb8a006d35fee44552e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.470177 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f18dd45e30e4e3aafdc917396dc2181" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:29.471232 30346 ts_tablet_manager.cc:1434] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 12:20:29.472345 30346 tablet_bootstrap.cc:492] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:29.473093 30206 tablet_service.cc:1511] Processing CreateTablet for tablet 3111cf2203d14eb8a006d35fee44552e (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:20:29.474502 30206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3111cf2203d14eb8a006d35fee44552e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.440562 30261 leader_election.cc:304] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: b0439d4e94904196847cd825fcc8ebd7
W20260709 12:20:29.479231 30037 leader_election.cc:343] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.479753 30037 leader_election.cc:304] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:29.480273 30366 raft_consensus.cc:515] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:29.481171 30356 raft_consensus.cc:2749] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:29.485913 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f77894695f4690bea31f432539542e" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
W20260709 12:20:29.487349 30186 leader_election.cc:343] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.488734 30342 tablet_bootstrap.cc:654] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.490764 30287 tablet_service.cc:1511] Processing CreateTablet for tablet f58b35cd70b1481993195f5bdd8ad3fe (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:20:29.492095 30287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58b35cd70b1481993195f5bdd8ad3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.493330 30351 raft_consensus.cc:515] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:29.494585 30297 raft_consensus.cc:2393] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b0439d4e94904196847cd825fcc8ebd7 in current term 1: Already voted for candidate f6c1f7275e654f49abaf1c80ed662511 in this term.
I20260709 12:20:29.496318 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27678468a40344eca39b8bab02b0b368" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:29.497224 30148 raft_consensus.cc:2393] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f6c1f7275e654f49abaf1c80ed662511 in current term 1: Already voted for candidate b0439d4e94904196847cd825fcc8ebd7 in this term.
I20260709 12:20:29.497735 30115 leader_election.cc:304] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7; no voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:29.498184 30133 tablet_service.cc:1511] Processing CreateTablet for tablet f58b35cd70b1481993195f5bdd8ad3fe (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:20:29.499099 30350 raft_consensus.cc:2749] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:29.499578 30133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58b35cd70b1481993195f5bdd8ad3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.501518 30344 ts_tablet_manager.cc:1434] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.016s
I20260709 12:20:29.504110 30055 tablet_service.cc:1511] Processing CreateTablet for tablet 3111cf2203d14eb8a006d35fee44552e (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:20:29.505496 30343 ts_tablet_manager.cc:1434] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.241s	user 0.008s	sys 0.012s
I20260709 12:20:29.506382 30059 tablet_service.cc:1511] Processing CreateTablet for tablet f58b35cd70b1481993195f5bdd8ad3fe (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:20:29.508518 30343 tablet_bootstrap.cc:492] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:29.516149 30351 leader_election.cc:290] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:29.517573 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f77894695f4690bea31f432539542e" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:29.518301 30297 raft_consensus.cc:3060] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.520215 30344 tablet_bootstrap.cc:492] T 7423bc8fd1a54058b083a1c5affa2440 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:29.531643 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7423bc8fd1a54058b083a1c5affa2440" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:29.531788 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27678468a40344eca39b8bab02b0b368" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:29.532399 30074 raft_consensus.cc:2468] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 0.
I20260709 12:20:29.530529 30366 leader_election.cc:290] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:29.535625 30188 leader_election.cc:304] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:29.536532 30366 raft_consensus.cc:2804] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:29.536816 30055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3111cf2203d14eb8a006d35fee44552e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.537195 30366 raft_consensus.cc:493] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.537842 30366 raft_consensus.cc:3060] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:29.537830 30262 leader_election.cc:343] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.539757 30262 leader_election.cc:304] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:29.539958 30059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58b35cd70b1481993195f5bdd8ad3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.557096 30380 raft_consensus.cc:493] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.557756 30380 raft_consensus.cc:515] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:29.561066 30380 leader_election.cc:290] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:29.558884 30381 raft_consensus.cc:2749] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:29.561934 30379 raft_consensus.cc:493] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.562343 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca034599de8146968cc8adcb232a2ca4" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
W20260709 12:20:29.566227 30261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:44035, user_credentials={real_user=slave}} blocked reactor thread for 125904us
I20260709 12:20:29.567625 30344 tablet_bootstrap.cc:654] T 7423bc8fd1a54058b083a1c5affa2440 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.569134 30343 tablet_bootstrap.cc:654] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.562106 30297 raft_consensus.cc:2468] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
W20260709 12:20:29.582739 30262 leader_election.cc:343] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.583118 30280 tablet_service.cc:1511] Processing CreateTablet for tablet 9aaa1e367a834921bed89b00cf7b2487 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:20:29.585250 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca034599de8146968cc8adcb232a2ca4" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:29.591003 30280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aaa1e367a834921bed89b00cf7b2487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.585973 30189 leader_election.cc:304] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:29.589726 30351 raft_consensus.cc:2764] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:20:29.584761 30212 tablet_service.cc:1511] Processing CreateTablet for tablet 9aaa1e367a834921bed89b00cf7b2487 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:20:29.597688 30366 raft_consensus.cc:515] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:29.602835 30366 leader_election.cc:290] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:29.603371 30133 tablet_service.cc:1511] Processing CreateTablet for tablet 2982be43a6544a2cbf3fbddd81601115 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:20:29.604069 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7423bc8fd1a54058b083a1c5affa2440" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:29.584968 30379 raft_consensus.cc:515] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:29.605476 30282 tablet_service.cc:1511] Processing CreateTablet for tablet 2982be43a6544a2cbf3fbddd81601115 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:20:29.604218 30059 tablet_service.cc:1511] Processing CreateTablet for tablet 9aaa1e367a834921bed89b00cf7b2487 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:20:29.611363 30282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2982be43a6544a2cbf3fbddd81601115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.611868 30059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aaa1e367a834921bed89b00cf7b2487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.606932 30206 tablet_service.cc:1511] Processing CreateTablet for tablet 2982be43a6544a2cbf3fbddd81601115 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:20:29.607970 30342 tablet_bootstrap.cc:492] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:29.613857 30342 ts_tablet_manager.cc:1403] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.379s	user 0.037s	sys 0.011s
W20260709 12:20:29.608453 30261 leader_election.cc:343] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.608754 30212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aaa1e367a834921bed89b00cf7b2487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.610754 30073 raft_consensus.cc:3060] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.614051 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0710767a1a447f9670e840fb1e68a4" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:29.610803 30366 raft_consensus.cc:2804] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:29.615051 30261 leader_election.cc:304] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:29.623555 30366 raft_consensus.cc:697] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
W20260709 12:20:29.624611 30113 leader_election.cc:343] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.627087 30206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2982be43a6544a2cbf3fbddd81601115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.627580 30055 tablet_service.cc:1511] Processing CreateTablet for tablet 0696a915ada148cca9600585d0152f86 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:20:29.628839 30055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0696a915ada148cca9600585d0152f86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.629065 30379 leader_election.cc:290] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:29.630492 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0710767a1a447f9670e840fb1e68a4" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:29.611363 30133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2982be43a6544a2cbf3fbddd81601115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.632341 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7423bc8fd1a54058b083a1c5affa2440" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:29.624516 30366 consensus_queue.cc:237] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
W20260709 12:20:29.634182 30115 leader_election.cc:343] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.634735 30115 leader_election.cc:304] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7; no voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:29.636117 30379 raft_consensus.cc:2749] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:29.637600 30189 leader_election.cc:343] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.638979 30346 tablet_bootstrap.cc:654] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.618454 30342 raft_consensus.cc:359] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:29.643003 30351 raft_consensus.cc:2749] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:29.643345 30342 raft_consensus.cc:385] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.643725 30342 raft_consensus.cc:740] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.644484 30342 consensus_queue.cc:260] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:29.646087 30137 tablet_service.cc:1511] Processing CreateTablet for tablet 0696a915ada148cca9600585d0152f86 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:20:29.647416 30137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0696a915ada148cca9600585d0152f86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.647867 30342 ts_tablet_manager.cc:1434] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:20:29.648901 30342 tablet_bootstrap.cc:492] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:29.650153 30205 tablet_service.cc:1511] Processing CreateTablet for tablet 0696a915ada148cca9600585d0152f86 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:20:29.651485 30205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0696a915ada148cca9600585d0152f86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.653877 30344 tablet_bootstrap.cc:492] T 7423bc8fd1a54058b083a1c5affa2440 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:29.654428 30344 ts_tablet_manager.cc:1403] T 7423bc8fd1a54058b083a1c5affa2440 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.134s	user 0.011s	sys 0.012s
I20260709 12:20:29.659644 30057 tablet_service.cc:1511] Processing CreateTablet for tablet 961df2c56aac4887bbb0971fd85cd3b0 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:20:29.661028 30057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 961df2c56aac4887bbb0971fd85cd3b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.660665 30135 tablet_service.cc:1511] Processing CreateTablet for tablet 961df2c56aac4887bbb0971fd85cd3b0 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:20:29.661993 30135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 961df2c56aac4887bbb0971fd85cd3b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.657459 30344 raft_consensus.cc:359] T 7423bc8fd1a54058b083a1c5affa2440 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:29.664338 30344 raft_consensus.cc:385] T 7423bc8fd1a54058b083a1c5affa2440 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.664639 30344 raft_consensus.cc:740] T 7423bc8fd1a54058b083a1c5affa2440 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.665419 30344 consensus_queue.cc:260] T 7423bc8fd1a54058b083a1c5affa2440 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:29.668310 30344 ts_tablet_manager.cc:1434] T 7423bc8fd1a54058b083a1c5affa2440 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:20:29.669364 30344 tablet_bootstrap.cc:492] T 0e9a81d1a7404da0aac49a76cb38f0de P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:29.642381 30073 raft_consensus.cc:2468] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
I20260709 12:20:29.686475 30282 tablet_service.cc:1511] Processing CreateTablet for tablet 961df2c56aac4887bbb0971fd85cd3b0 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:20:29.698901 30188 leader_election.cc:304] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:29.711709 30351 raft_consensus.cc:493] T 7423bc8fd1a54058b083a1c5affa2440 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.712309 30351 raft_consensus.cc:515] T 7423bc8fd1a54058b083a1c5affa2440 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:29.714497 30351 leader_election.cc:290] T 7423bc8fd1a54058b083a1c5affa2440 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:29.717501 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7423bc8fd1a54058b083a1c5affa2440" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:29.718494 29971 catalog_manager.cc:5697] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:29.719188 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7423bc8fd1a54058b083a1c5affa2440" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:29.720108 30073 raft_consensus.cc:2393] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6c1f7275e654f49abaf1c80ed662511 in current term 1: Already voted for candidate f3ef588fc4b54ec09355022d7a5a5e86 in this term.
I20260709 12:20:29.716053 30213 tablet_service.cc:1511] Processing CreateTablet for tablet cdeb0fe4f15c4ea9893bae143fa20651 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:20:29.721886 30213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdeb0fe4f15c4ea9893bae143fa20651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.728616 30287 tablet_service.cc:1511] Processing CreateTablet for tablet cdeb0fe4f15c4ea9893bae143fa20651 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:20:29.729957 30064 tablet_service.cc:1511] Processing CreateTablet for tablet cdeb0fe4f15c4ea9893bae143fa20651 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:20:29.731419 30136 tablet_service.cc:1511] Processing CreateTablet for tablet 03f2f494c25b47459faf1d6e4a245f08 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:20:29.732787 30136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f2f494c25b47459faf1d6e4a245f08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.731412 30064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdeb0fe4f15c4ea9893bae143fa20651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.737006 30366 raft_consensus.cc:2804] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:29.737715 30366 raft_consensus.cc:697] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:29.745806 30342 tablet_bootstrap.cc:654] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.738659 30366 consensus_queue.cc:237] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:29.748588 30282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 961df2c56aac4887bbb0971fd85cd3b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.749913 30283 tablet_service.cc:1511] Processing CreateTablet for tablet 03f2f494c25b47459faf1d6e4a245f08 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:20:29.751287 30283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f2f494c25b47459faf1d6e4a245f08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.758798 30059 tablet_service.cc:1511] Processing CreateTablet for tablet a5f5109a89314f8bbf67848895ef8918 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:20:29.759567 30132 tablet_service.cc:1511] Processing CreateTablet for tablet a5f5109a89314f8bbf67848895ef8918 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:20:29.760215 30059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5f5109a89314f8bbf67848895ef8918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.760843 30132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5f5109a89314f8bbf67848895ef8918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.764914 30063 tablet_service.cc:1511] Processing CreateTablet for tablet 6c8f2fbe93624983bd807e8ac2f76aff (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:20:29.766414 30063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c8f2fbe93624983bd807e8ac2f76aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.767899 30285 tablet_service.cc:1511] Processing CreateTablet for tablet 6c8f2fbe93624983bd807e8ac2f76aff (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:20:29.770131 30286 tablet_service.cc:1511] Processing CreateTablet for tablet 8364709c0e424d6791fed2d28528c655 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:20:29.770789 30139 tablet_service.cc:1511] Processing CreateTablet for tablet 6c8f2fbe93624983bd807e8ac2f76aff (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:20:29.772178 30139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c8f2fbe93624983bd807e8ac2f76aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.766345 30287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdeb0fe4f15c4ea9893bae143fa20651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.774577 30285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c8f2fbe93624983bd807e8ac2f76aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.775545 30210 tablet_service.cc:1511] Processing CreateTablet for tablet 8364709c0e424d6791fed2d28528c655 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:20:29.777093 30210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8364709c0e424d6791fed2d28528c655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.801038 30207 tablet_service.cc:1511] Processing CreateTablet for tablet d782d59119bc45d08292b0b77cabedc9 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:20:29.804911 30207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d782d59119bc45d08292b0b77cabedc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.807762 30211 tablet_service.cc:1511] Processing CreateTablet for tablet 1c80cf731d884ab6bcb89a294b8b905c (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:20:29.807972 30135 tablet_service.cc:1511] Processing CreateTablet for tablet d782d59119bc45d08292b0b77cabedc9 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:20:29.808348 30138 tablet_service.cc:1511] Processing CreateTablet for tablet 1c80cf731d884ab6bcb89a294b8b905c (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:20:29.809190 30211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c80cf731d884ab6bcb89a294b8b905c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.810006 30135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d782d59119bc45d08292b0b77cabedc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.811779 30138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c80cf731d884ab6bcb89a294b8b905c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.816831 30058 tablet_service.cc:1511] Processing CreateTablet for tablet 8364709c0e424d6791fed2d28528c655 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:20:29.817252 30062 tablet_service.cc:1511] Processing CreateTablet for tablet 1c80cf731d884ab6bcb89a294b8b905c (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:20:29.818271 30058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8364709c0e424d6791fed2d28528c655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.819037 30062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c80cf731d884ab6bcb89a294b8b905c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.803331 30346 tablet_bootstrap.cc:492] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:29.803637 30280 tablet_service.cc:1511] Processing CreateTablet for tablet d782d59119bc45d08292b0b77cabedc9 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:20:29.801882 30286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8364709c0e424d6791fed2d28528c655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.829609 30280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d782d59119bc45d08292b0b77cabedc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.838187 30346 ts_tablet_manager.cc:1403] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.366s	user 0.015s	sys 0.030s
I20260709 12:20:29.851781 30284 tablet_service.cc:1511] Processing CreateTablet for tablet b5692f07fd174dbfa06976e17c1c6b00 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:20:29.852859 30343 tablet_bootstrap.cc:492] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:29.853178 30284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5692f07fd174dbfa06976e17c1c6b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.853446 30343 ts_tablet_manager.cc:1403] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.345s	user 0.018s	sys 0.015s
I20260709 12:20:29.856845 30343 raft_consensus.cc:359] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:29.857992 30343 raft_consensus.cc:385] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.858345 30343 raft_consensus.cc:740] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.858860 30261 leader_election.cc:304] T 7423bc8fd1a54058b083a1c5affa2440 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:29.860416 30351 raft_consensus.cc:3060] T 7423bc8fd1a54058b083a1c5affa2440 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.860630 30206 tablet_service.cc:1511] Processing CreateTablet for tablet a5f5109a89314f8bbf67848895ef8918 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:20:29.861847 30342 tablet_bootstrap.cc:492] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:29.862457 30342 ts_tablet_manager.cc:1403] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.214s	user 0.018s	sys 0.002s
I20260709 12:20:29.862041 30205 tablet_service.cc:1511] Processing CreateTablet for tablet 03f2f494c25b47459faf1d6e4a245f08 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:20:29.876209 30205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f2f494c25b47459faf1d6e4a245f08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.878983 30206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5f5109a89314f8bbf67848895ef8918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.849274 30344 tablet_bootstrap.cc:654] T 0e9a81d1a7404da0aac49a76cb38f0de P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.865681 30342 raft_consensus.cc:359] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:29.881301 30342 raft_consensus.cc:385] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.881650 30342 raft_consensus.cc:740] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
W20260709 12:20:29.887657 30386 log.cc:927] Time spent T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:20:29.888104 30060 tablet_service.cc:1511] Processing CreateTablet for tablet b5692f07fd174dbfa06976e17c1c6b00 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:20:29.859532 30343 consensus_queue.cc:260] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:29.889755 30060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5692f07fd174dbfa06976e17c1c6b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.908900 30342 consensus_queue.cc:260] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
W20260709 12:20:29.926926 29956 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.191.2:40479, user_credentials={real_user=slave}} blocked reactor thread for 46155us
I20260709 12:20:29.946800 30281 tablet_service.cc:1511] Processing CreateTablet for tablet f159a8c7a6304cfc9a399f5c37fe3e1b (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:20:29.948199 30281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f159a8c7a6304cfc9a399f5c37fe3e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.950644 30351 raft_consensus.cc:2749] T 7423bc8fd1a54058b083a1c5affa2440 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:29.946800 30209 tablet_service.cc:1511] Processing CreateTablet for tablet f159a8c7a6304cfc9a399f5c37fe3e1b (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:20:29.953099 30137 tablet_service.cc:1511] Processing CreateTablet for tablet b5692f07fd174dbfa06976e17c1c6b00 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:20:29.953747 30209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f159a8c7a6304cfc9a399f5c37fe3e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.954453 30137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5692f07fd174dbfa06976e17c1c6b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.942884 30343 ts_tablet_manager.cc:1434] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.089s	user 0.009s	sys 0.000s
I20260709 12:20:29.957711 30343 tablet_bootstrap.cc:492] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:29.967250 30346 raft_consensus.cc:359] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:29.968155 30346 raft_consensus.cc:385] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.968501 30346 raft_consensus.cc:740] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.969435 30346 consensus_queue.cc:260] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:29.974733 30346 ts_tablet_manager.cc:1434] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.129s	user 0.005s	sys 0.004s
I20260709 12:20:29.986892 30064 tablet_service.cc:1511] Processing CreateTablet for tablet f159a8c7a6304cfc9a399f5c37fe3e1b (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:20:30.001058 30210 tablet_service.cc:1511] Processing CreateTablet for tablet c32f11599774407e9de2e65083c53e17 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:20:30.001998 30137 tablet_service.cc:1511] Processing CreateTablet for tablet c32f11599774407e9de2e65083c53e17 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:20:30.002681 30210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32f11599774407e9de2e65083c53e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.005352 30137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32f11599774407e9de2e65083c53e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.007923 30342 ts_tablet_manager.cc:1434] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.145s	user 0.010s	sys 0.000s
I20260709 12:20:30.009117 30342 tablet_bootstrap.cc:492] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:30.010337 30346 tablet_bootstrap.cc:492] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:30.012181 30064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f159a8c7a6304cfc9a399f5c37fe3e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.016585 30346 tablet_bootstrap.cc:654] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.020272 30343 tablet_bootstrap.cc:654] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.025529 30366 raft_consensus.cc:493] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.028812 30283 tablet_service.cc:1511] Processing CreateTablet for tablet c32f11599774407e9de2e65083c53e17 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:20:30.030346 30283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32f11599774407e9de2e65083c53e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.031090 30366 raft_consensus.cc:515] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.033731 30366 leader_election.cc:290] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:30.034575 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d01a3a6c7f24268a9c505f7d2f0efcd" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
W20260709 12:20:30.036499 30186 leader_election.cc:343] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.034961 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d01a3a6c7f24268a9c505f7d2f0efcd" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
W20260709 12:20:30.038569 30188 leader_election.cc:343] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.039027 30188 leader_election.cc:304] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:30.039141 30063 tablet_service.cc:1511] Processing CreateTablet for tablet 55101a88e97746d0bc20a0bc0ed8989c (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:20:30.040026 30342 tablet_bootstrap.cc:654] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.040586 30063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55101a88e97746d0bc20a0bc0ed8989c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.043946 30344 tablet_bootstrap.cc:492] T 0e9a81d1a7404da0aac49a76cb38f0de P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:30.044510 30344 ts_tablet_manager.cc:1403] T 0e9a81d1a7404da0aac49a76cb38f0de P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.375s	user 0.023s	sys 0.007s
I20260709 12:20:30.047134 30366 raft_consensus.cc:2749] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:30.047793 30344 raft_consensus.cc:359] T 0e9a81d1a7404da0aac49a76cb38f0de P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:30.048601 30344 raft_consensus.cc:385] T 0e9a81d1a7404da0aac49a76cb38f0de P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.048897 30344 raft_consensus.cc:740] T 0e9a81d1a7404da0aac49a76cb38f0de P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.044445 30138 tablet_service.cc:1511] Processing CreateTablet for tablet 55101a88e97746d0bc20a0bc0ed8989c (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:20:30.050005 30286 tablet_service.cc:1511] Processing CreateTablet for tablet f01efd7c139e45c3809ed6a668f1faca (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:20:30.051172 30286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f01efd7c139e45c3809ed6a668f1faca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.051167 30138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55101a88e97746d0bc20a0bc0ed8989c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.049649 30344 consensus_queue.cc:260] T 0e9a81d1a7404da0aac49a76cb38f0de P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:30.057145 30059 tablet_service.cc:1511] Processing CreateTablet for tablet f01efd7c139e45c3809ed6a668f1faca (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:20:30.058698 30059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f01efd7c139e45c3809ed6a668f1faca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.058941 30132 tablet_service.cc:1511] Processing CreateTablet for tablet f01efd7c139e45c3809ed6a668f1faca (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:20:30.060238 30132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f01efd7c139e45c3809ed6a668f1faca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.067505 30344 ts_tablet_manager.cc:1434] T 0e9a81d1a7404da0aac49a76cb38f0de P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:20:30.068761 30344 tablet_bootstrap.cc:492] T bd0710767a1a447f9670e840fb1e68a4 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:30.054244 30211 tablet_service.cc:1511] Processing CreateTablet for tablet 55101a88e97746d0bc20a0bc0ed8989c (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:20:30.075338 30211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55101a88e97746d0bc20a0bc0ed8989c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.076653 30346 tablet_bootstrap.cc:492] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:30.077294 30346 ts_tablet_manager.cc:1403] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.067s	user 0.005s	sys 0.005s
I20260709 12:20:30.084082 30207 tablet_service.cc:1511] Processing CreateTablet for tablet 60e61e6fb8fe4b2ba4edb9d057c98d4c (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:20:30.085593 30207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60e61e6fb8fe4b2ba4edb9d057c98d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.086370 30379 raft_consensus.cc:493] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.086882 30379 raft_consensus.cc:515] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:30.089054 30379 leader_election.cc:290] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:30.090939 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9a81d1a7404da0aac49a76cb38f0de" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:30.091631 30297 raft_consensus.cc:2468] T 0e9a81d1a7404da0aac49a76cb38f0de P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:30.093094 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9a81d1a7404da0aac49a76cb38f0de" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:30.094609 30115 leader_election.cc:304] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:30.095861 30343 tablet_bootstrap.cc:492] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:30.096443 30343 ts_tablet_manager.cc:1403] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.139s	user 0.013s	sys 0.004s
I20260709 12:20:30.097127 30379 raft_consensus.cc:2804] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:30.097577 30379 raft_consensus.cc:493] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.097967 30379 raft_consensus.cc:3060] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.101542 30342 tablet_bootstrap.cc:492] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:30.102169 30342 ts_tablet_manager.cc:1403] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.002s
W20260709 12:20:30.102746 30113 leader_election.cc:343] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.105311 30287 tablet_service.cc:1511] Processing CreateTablet for tablet 60e61e6fb8fe4b2ba4edb9d057c98d4c (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:20:30.105908 30058 tablet_service.cc:1511] Processing CreateTablet for tablet 60e61e6fb8fe4b2ba4edb9d057c98d4c (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:20:30.107699 30058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60e61e6fb8fe4b2ba4edb9d057c98d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.112839 30209 tablet_service.cc:1511] Processing CreateTablet for tablet 97c5550b956c4f36af10de2db7490b8b (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:20:30.114270 30356 raft_consensus.cc:493] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.114895 30209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c5550b956c4f36af10de2db7490b8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.114831 30356 raft_consensus.cc:515] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:30.117110 30356 leader_election.cc:290] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:30.119385 30344 tablet_bootstrap.cc:654] T bd0710767a1a447f9670e840fb1e68a4 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.119681 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27678468a40344eca39b8bab02b0b368" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:30.120522 30149 raft_consensus.cc:2393] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a1255131174934a6bca3c0bf000026 in current term 1: Already voted for candidate b0439d4e94904196847cd825fcc8ebd7 in this term.
I20260709 12:20:30.121647 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27678468a40344eca39b8bab02b0b368" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:30.122473 30297 raft_consensus.cc:2393] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a1255131174934a6bca3c0bf000026 in current term 1: Already voted for candidate f6c1f7275e654f49abaf1c80ed662511 in this term.
I20260709 12:20:30.122140 30346 raft_consensus.cc:359] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.122853 30346 raft_consensus.cc:385] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.123152 30346 raft_consensus.cc:740] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.124719 30037 leader_election.cc:304] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:30.106833 30287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60e61e6fb8fe4b2ba4edb9d057c98d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.126143 30356 raft_consensus.cc:3060] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.126858 30366 raft_consensus.cc:493] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.127408 30366 raft_consensus.cc:515] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:30.130239 30346 consensus_queue.cc:260] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.131359 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0710767a1a447f9670e840fb1e68a4" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:30.132063 30149 raft_consensus.cc:2468] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 0.
I20260709 12:20:30.133638 30186 leader_election.cc:304] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:30.134703 30383 raft_consensus.cc:2804] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:30.135116 30383 raft_consensus.cc:493] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.135483 30383 raft_consensus.cc:3060] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:30.136889 30186 consensus_peers.cc:597] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:30.144707 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0710767a1a447f9670e840fb1e68a4" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
W20260709 12:20:30.146564 30189 leader_election.cc:343] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.149302 30342 raft_consensus.cc:359] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.146564 30343 raft_consensus.cc:359] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:30.149628 30366 leader_election.cc:290] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:30.152765 30343 raft_consensus.cc:385] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.144629 30356 raft_consensus.cc:2749] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:30.154134 30383 raft_consensus.cc:515] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:30.155637 30283 tablet_service.cc:1511] Processing CreateTablet for tablet 97c5550b956c4f36af10de2db7490b8b (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:20:30.157114 30283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c5550b956c4f36af10de2db7490b8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.158020 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0710767a1a447f9670e840fb1e68a4" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:30.158733 30148 raft_consensus.cc:3060] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.179807 29970 catalog_manager.cc:5697] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.177696 30148 raft_consensus.cc:2468] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
I20260709 12:20:30.122676 30139 tablet_service.cc:1511] Processing CreateTablet for tablet 97c5550b956c4f36af10de2db7490b8b (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:20:30.187275 30139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c5550b956c4f36af10de2db7490b8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.188560 30062 tablet_service.cc:1511] Processing CreateTablet for tablet d094cffecb264ab689cd0baf985837d8 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:20:30.196141 30064 tablet_service.cc:1511] Processing CreateTablet for tablet af7b5f5579594d8381af5f96a15e24d9 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:20:30.196031 30062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d094cffecb264ab689cd0baf985837d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.199442 30137 tablet_service.cc:1511] Processing CreateTablet for tablet af7b5f5579594d8381af5f96a15e24d9 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:20:30.201494 30137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af7b5f5579594d8381af5f96a15e24d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.120231 30379 raft_consensus.cc:515] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:30.152488 30342 raft_consensus.cc:385] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.204530 30342 raft_consensus.cc:740] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.153412 30343 raft_consensus.cc:740] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.205847 30343 consensus_queue.cc:260] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:30.206678 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9a81d1a7404da0aac49a76cb38f0de" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
W20260709 12:20:30.208592 30113 leader_election.cc:343] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.209015 30342 consensus_queue.cc:260] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.214257 30211 tablet_service.cc:1511] Processing CreateTablet for tablet d094cffecb264ab689cd0baf985837d8 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:20:30.194368 30281 tablet_service.cc:1511] Processing CreateTablet for tablet af7b5f5579594d8381af5f96a15e24d9 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:20:30.217290 30211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d094cffecb264ab689cd0baf985837d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.211171 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9a81d1a7404da0aac49a76cb38f0de" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:30.217986 30297 raft_consensus.cc:3060] T 0e9a81d1a7404da0aac49a76cb38f0de P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.217523 30058 tablet_service.cc:1511] Processing CreateTablet for tablet e6b12541deba40218ef3f8c40f40312a (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:20:30.219174 30058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b12541deba40218ef3f8c40f40312a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.195341 30366 consensus_queue.cc:1048] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:20:30.225442 30064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af7b5f5579594d8381af5f96a15e24d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.189628 30138 tablet_service.cc:1511] Processing CreateTablet for tablet d094cffecb264ab689cd0baf985837d8 (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:20:30.215893 30207 tablet_service.cc:1511] Processing CreateTablet for tablet e6b12541deba40218ef3f8c40f40312a (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:20:30.217290 30281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af7b5f5579594d8381af5f96a15e24d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.227972 30138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d094cffecb264ab689cd0baf985837d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.191560 30346 ts_tablet_manager.cc:1434] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.114s	user 0.000s	sys 0.017s
I20260709 12:20:30.215704 30282 tablet_service.cc:1511] Processing CreateTablet for tablet e6b12541deba40218ef3f8c40f40312a (DEFAULT_TABLE table=test-workload [id=9b6576bd3d7644858e01c4a587233a7c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:20:30.209971 30379 leader_election.cc:290] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:30.261077 30186 leader_election.cc:304] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
W20260709 12:20:30.261890 30186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:40479, user_credentials={real_user=slave}} blocked reactor thread for 48315.8us
I20260709 12:20:30.264961 30383 leader_election.cc:290] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:30.265589 30383 raft_consensus.cc:2804] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:30.266044 30383 raft_consensus.cc:697] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:30.266175 30207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b12541deba40218ef3f8c40f40312a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.266903 30383 consensus_queue.cc:237] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:30.276189 30282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b12541deba40218ef3f8c40f40312a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:30.295815 30297 raft_consensus.cc:2468] T 0e9a81d1a7404da0aac49a76cb38f0de P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:30.297539 30115 leader_election.cc:304] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:30.298403 30379 raft_consensus.cc:2804] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:30.298868 30379 raft_consensus.cc:697] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:30.299690 30379 consensus_queue.cc:237] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:30.322503 30343 ts_tablet_manager.cc:1434] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.226s	user 0.014s	sys 0.005s
I20260709 12:20:30.342769 30344 tablet_bootstrap.cc:492] T bd0710767a1a447f9670e840fb1e68a4 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:30.343386 30344 ts_tablet_manager.cc:1403] T bd0710767a1a447f9670e840fb1e68a4 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.275s	user 0.042s	sys 0.082s
I20260709 12:20:30.346647 30344 raft_consensus.cc:359] T bd0710767a1a447f9670e840fb1e68a4 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:30.347455 30344 raft_consensus.cc:385] T bd0710767a1a447f9670e840fb1e68a4 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.347774 30344 raft_consensus.cc:740] T bd0710767a1a447f9670e840fb1e68a4 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.353799 30342 ts_tablet_manager.cc:1434] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.251s	user 0.030s	sys 0.060s
I20260709 12:20:30.354153 30400 raft_consensus.cc:493] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.354722 30400 raft_consensus.cc:515] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:30.355144 30342 tablet_bootstrap.cc:492] T 0e9a81d1a7404da0aac49a76cb38f0de P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:30.358088 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f77894695f4690bea31f432539542e" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:30.358218 30400 leader_election.cc:290] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:30.359207 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f77894695f4690bea31f432539542e" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:30.364212 30115 leader_election.cc:304] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7; no voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:30.365914 30400 raft_consensus.cc:2749] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:30.352685 30295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0710767a1a447f9670e840fb1e68a4" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:30.372413 30401 consensus_queue.cc:1048] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:30.372792 30346 tablet_bootstrap.cc:492] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:30.378003 30343 tablet_bootstrap.cc:492] T e5da70c81d654d3e9e50fa2778189857 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:30.378677 30344 consensus_queue.cc:260] T bd0710767a1a447f9670e840fb1e68a4 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:30.385986 30295 raft_consensus.cc:3060] T bd0710767a1a447f9670e840fb1e68a4 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.381639 30344 ts_tablet_manager.cc:1434] T bd0710767a1a447f9670e840fb1e68a4 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:20:30.396726 30383 consensus_queue.cc:1048] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.401446 30295 raft_consensus.cc:2468] T bd0710767a1a447f9670e840fb1e68a4 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
I20260709 12:20:30.408680 30344 tablet_bootstrap.cc:492] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:30.409941 30343 tablet_bootstrap.cc:654] T e5da70c81d654d3e9e50fa2778189857 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.412299 29971 catalog_manager.cc:5697] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.405566 29970 catalog_manager.cc:5697] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.416505 30342 tablet_bootstrap.cc:654] T 0e9a81d1a7404da0aac49a76cb38f0de P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.423066 30344 tablet_bootstrap.cc:654] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.412407 30346 tablet_bootstrap.cc:654] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:30.435600 30020 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:30.451539 30342 tablet_bootstrap.cc:492] T 0e9a81d1a7404da0aac49a76cb38f0de P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:30.452280 30342 ts_tablet_manager.cc:1403] T 0e9a81d1a7404da0aac49a76cb38f0de P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.097s	user 0.021s	sys 0.008s
I20260709 12:20:30.456144 30342 raft_consensus.cc:359] T 0e9a81d1a7404da0aac49a76cb38f0de P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:30.457062 30342 raft_consensus.cc:385] T 0e9a81d1a7404da0aac49a76cb38f0de P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.457420 30342 raft_consensus.cc:740] T 0e9a81d1a7404da0aac49a76cb38f0de P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.458498 30342 consensus_queue.cc:260] T 0e9a81d1a7404da0aac49a76cb38f0de P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:30.461561 30342 ts_tablet_manager.cc:1434] T 0e9a81d1a7404da0aac49a76cb38f0de P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 12:20:30.462842 30342 tablet_bootstrap.cc:492] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:30.470469 30342 tablet_bootstrap.cc:654] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.473732 30344 tablet_bootstrap.cc:492] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:30.474537 30344 ts_tablet_manager.cc:1403] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.005s
I20260709 12:20:30.477620 30344 raft_consensus.cc:359] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:30.478435 30344 raft_consensus.cc:385] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.478727 30344 raft_consensus.cc:740] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.479423 30344 consensus_queue.cc:260] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:30.486296 30344 ts_tablet_manager.cc:1434] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:20:30.487428 30344 tablet_bootstrap.cc:492] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:30.487881 30343 tablet_bootstrap.cc:492] T e5da70c81d654d3e9e50fa2778189857 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:30.488428 30343 ts_tablet_manager.cc:1403] T e5da70c81d654d3e9e50fa2778189857 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.128s	user 0.007s	sys 0.005s
I20260709 12:20:30.492298 30343 raft_consensus.cc:359] T e5da70c81d654d3e9e50fa2778189857 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.493122 30343 raft_consensus.cc:385] T e5da70c81d654d3e9e50fa2778189857 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.493445 30343 raft_consensus.cc:740] T e5da70c81d654d3e9e50fa2778189857 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.494403 30344 tablet_bootstrap.cc:654] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.494352 30343 consensus_queue.cc:260] T e5da70c81d654d3e9e50fa2778189857 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.496843 30343 ts_tablet_manager.cc:1434] T e5da70c81d654d3e9e50fa2778189857 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:20:30.500089 30342 tablet_bootstrap.cc:492] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:30.500728 30342 ts_tablet_manager.cc:1403] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.013s
I20260709 12:20:30.503562 30346 tablet_bootstrap.cc:492] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:30.504148 30346 ts_tablet_manager.cc:1403] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.152s	user 0.006s	sys 0.016s
I20260709 12:20:30.503950 30342 raft_consensus.cc:359] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:30.504721 30342 raft_consensus.cc:385] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.504935 30343 tablet_bootstrap.cc:492] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:30.505056 30342 raft_consensus.cc:740] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.506170 30342 consensus_queue.cc:260] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:30.508539 30342 ts_tablet_manager.cc:1434] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:30.509882 30342 tablet_bootstrap.cc:492] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:30.512554 30346 raft_consensus.cc:359] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.513149 30343 tablet_bootstrap.cc:654] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.513437 30346 raft_consensus.cc:385] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.513885 30346 raft_consensus.cc:740] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.516330 30346 consensus_queue.cc:260] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.516968 30342 tablet_bootstrap.cc:654] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.525985 30343 tablet_bootstrap.cc:492] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:30.526616 30343 ts_tablet_manager.cc:1403] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.013s
I20260709 12:20:30.528327 30342 tablet_bootstrap.cc:492] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:30.528715 30346 ts_tablet_manager.cc:1434] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:20:30.529050 30342 ts_tablet_manager.cc:1403] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.007s
I20260709 12:20:30.529937 30346 tablet_bootstrap.cc:492] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:30.529868 30343 raft_consensus.cc:359] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.530894 30343 raft_consensus.cc:385] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.531275 30343 raft_consensus.cc:740] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.532078 30343 consensus_queue.cc:260] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.532605 30342 raft_consensus.cc:359] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.533532 30342 raft_consensus.cc:385] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.533890 30342 raft_consensus.cc:740] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.534430 30343 ts_tablet_manager.cc:1434] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.007s
I20260709 12:20:30.534788 30342 consensus_queue.cc:260] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.537052 30342 ts_tablet_manager.cc:1434] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
I20260709 12:20:30.538228 30342 tablet_bootstrap.cc:492] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:30.538555 30343 tablet_bootstrap.cc:492] T 67a9ecec74344c1693efb9acb6e38e26 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:30.544382 30342 tablet_bootstrap.cc:654] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.545532 30343 tablet_bootstrap.cc:654] T 67a9ecec74344c1693efb9acb6e38e26 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.548437 30344 tablet_bootstrap.cc:492] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:30.549065 30344 ts_tablet_manager.cc:1403] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.005s
I20260709 12:20:30.549721 30398 raft_consensus.cc:493] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.550352 30398 raft_consensus.cc:515] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.548345 30346 tablet_bootstrap.cc:654] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.552305 30344 raft_consensus.cc:359] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:30.553409 30344 raft_consensus.cc:385] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.553757 30344 raft_consensus.cc:740] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.554738 30344 consensus_queue.cc:260] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:30.555999 30398 leader_election.cc:290] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:30.557583 30344 ts_tablet_manager.cc:1434] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:30.559600 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb12e58a824780acab66b641b29009" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:30.560408 30148 raft_consensus.cc:2468] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 0.
I20260709 12:20:30.561998 30351 raft_consensus.cc:493] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.562582 30351 raft_consensus.cc:515] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:30.565078 30351 leader_election.cc:290] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:30.568065 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f18dd45e30e4e3aafdc917396dc2181" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:30.570236 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f18dd45e30e4e3aafdc917396dc2181" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
W20260709 12:20:30.570784 30260 leader_election.cc:343] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.569085 30037 leader_election.cc:304] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:30.571058 30073 raft_consensus.cc:2468] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:30.573014 30262 leader_election.cc:304] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511; no voters: b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:30.575083 30351 raft_consensus.cc:2804] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:30.575551 30351 raft_consensus.cc:493] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.575919 30351 raft_consensus.cc:3060] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.577991 30398 raft_consensus.cc:2804] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:30.578485 30398 raft_consensus.cc:493] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.578850 30398 raft_consensus.cc:3060] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.598169 30344 tablet_bootstrap.cc:492] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:30.603818 30343 tablet_bootstrap.cc:492] T 67a9ecec74344c1693efb9acb6e38e26 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:30.604408 30343 ts_tablet_manager.cc:1403] T 67a9ecec74344c1693efb9acb6e38e26 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.066s	user 0.022s	sys 0.010s
I20260709 12:20:30.607372 30343 raft_consensus.cc:359] T 67a9ecec74344c1693efb9acb6e38e26 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:30.608081 30343 raft_consensus.cc:385] T 67a9ecec74344c1693efb9acb6e38e26 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.608351 30343 raft_consensus.cc:740] T 67a9ecec74344c1693efb9acb6e38e26 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.611465 30343 consensus_queue.cc:260] T 67a9ecec74344c1693efb9acb6e38e26 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:30.614138 30356 raft_consensus.cc:493] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.614292 30398 raft_consensus.cc:515] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.614684 30356 raft_consensus.cc:515] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.615995 30351 raft_consensus.cc:515] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:30.616823 30356 leader_election.cc:290] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:30.614081 30346 tablet_bootstrap.cc:492] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:30.617658 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c8763c7b2b4fb891cbebff4035dbe6" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:30.617934 30346 ts_tablet_manager.cc:1403] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.088s	user 0.020s	sys 0.019s
I20260709 12:20:30.619051 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb12e58a824780acab66b641b29009" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
W20260709 12:20:30.619194 30037 leader_election.cc:343] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.619285 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f18dd45e30e4e3aafdc917396dc2181" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:30.620210 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c8763c7b2b4fb891cbebff4035dbe6" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
W20260709 12:20:30.620743 30260 leader_election.cc:343] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.621585 30342 tablet_bootstrap.cc:492] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:30.622102 30342 ts_tablet_manager.cc:1403] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.084s	user 0.031s	sys 0.048s
I20260709 12:20:30.622664 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f18dd45e30e4e3aafdc917396dc2181" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:30.621471 30346 raft_consensus.cc:359] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.619766 30222 raft_consensus.cc:2468] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 0.
I20260709 12:20:30.623335 30073 raft_consensus.cc:3060] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.623350 30343 ts_tablet_manager.cc:1434] T 67a9ecec74344c1693efb9acb6e38e26 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:20:30.625206 30343 tablet_bootstrap.cc:492] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:30.624920 30342 raft_consensus.cc:359] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.625658 30342 raft_consensus.cc:385] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.626088 30342 raft_consensus.cc:740] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.626899 30342 consensus_queue.cc:260] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.628971 30342 ts_tablet_manager.cc:1434] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
W20260709 12:20:30.629894 30038 leader_election.cc:343] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.630666 30038 leader_election.cc:304] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:30.632517 30424 raft_consensus.cc:493] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.623974 30346 raft_consensus.cc:385] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.633200 30342 tablet_bootstrap.cc:492] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:30.633292 30346 raft_consensus.cc:740] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.634794 30344 tablet_bootstrap.cc:654] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.634542 30346 consensus_queue.cc:260] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.635768 30424 raft_consensus.cc:515] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:30.637917 30343 tablet_bootstrap.cc:654] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.639880 30342 tablet_bootstrap.cc:654] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.640046 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb12e58a824780acab66b641b29009" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:30.640697 30148 raft_consensus.cc:3060] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.641912 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a9ecec74344c1693efb9acb6e38e26" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:30.642616 30149 raft_consensus.cc:2468] T 67a9ecec74344c1693efb9acb6e38e26 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:30.642998 30356 raft_consensus.cc:2749] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:30.644003 30260 leader_election.cc:304] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:30.647298 30346 ts_tablet_manager.cc:1434] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:20:30.649339 30148 raft_consensus.cc:2468] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 1.
I20260709 12:20:30.639504 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a9ecec74344c1693efb9acb6e38e26" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:30.650185 30346 tablet_bootstrap.cc:492] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:30.651785 30342 tablet_bootstrap.cc:492] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:30.658597 30342 ts_tablet_manager.cc:1403] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.005s
W20260709 12:20:30.659613 30262 leader_election.cc:343] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.659857 30037 leader_election.cc:304] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:30.660967 30356 raft_consensus.cc:2804] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:30.661417 30342 raft_consensus.cc:359] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:30.659852 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb12e58a824780acab66b641b29009" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:30.662169 30342 raft_consensus.cc:385] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.662405 30222 raft_consensus.cc:3060] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.662596 30342 raft_consensus.cc:740] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.663477 30342 consensus_queue.cc:260] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:30.664734 30356 raft_consensus.cc:697] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:30.665634 30342 ts_tablet_manager.cc:1434] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:20:30.666693 30342 tablet_bootstrap.cc:492] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:30.667554 30427 raft_consensus.cc:2804] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:30.668134 30427 raft_consensus.cc:493] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.665839 30356 consensus_queue.cc:237] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.637789 30351 leader_election.cc:290] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:30.655839 30424 leader_election.cc:290] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:30.657611 30398 leader_election.cc:290] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:30.668561 30427 raft_consensus.cc:3060] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.669494 30346 tablet_bootstrap.cc:654] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.662154 30344 tablet_bootstrap.cc:492] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:30.672827 30344 ts_tablet_manager.cc:1403] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.114s	user 0.011s	sys 0.000s
I20260709 12:20:30.667213 30343 tablet_bootstrap.cc:492] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:30.674471 30343 ts_tablet_manager.cc:1403] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.005s
I20260709 12:20:30.677322 30343 raft_consensus.cc:359] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:30.677911 30342 tablet_bootstrap.cc:654] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.678077 30343 raft_consensus.cc:385] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.678416 30343 raft_consensus.cc:740] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.679243 30343 consensus_queue.cc:260] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:30.653451 30073 raft_consensus.cc:2468] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:30.680974 30343 ts_tablet_manager.cc:1434] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:20:30.683769 30148 raft_consensus.cc:3060] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.686894 30343 tablet_bootstrap.cc:492] T 4f18dd45e30e4e3aafdc917396dc2181 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:30.681604 30427 raft_consensus.cc:515] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:30.692704 30344 raft_consensus.cc:359] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:30.694362 30344 raft_consensus.cc:385] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.694694 30344 raft_consensus.cc:740] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.695497 30344 consensus_queue.cc:260] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:30.703299 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a9ecec74344c1693efb9acb6e38e26" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
W20260709 12:20:30.705576 30262 leader_election.cc:343] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.706434 30262 leader_election.cc:304] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511; no voters: b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:30.708613 30424 raft_consensus.cc:2804] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:30.697657 30344 ts_tablet_manager.cc:1434] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:20:30.716172 30343 tablet_bootstrap.cc:654] T 4f18dd45e30e4e3aafdc917396dc2181 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.724088 30407 consensus_queue.cc:1048] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:30.708269 30427 leader_election.cc:290] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:30.713032 30346 tablet_bootstrap.cc:492] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:30.708212 29972 catalog_manager.cc:5697] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.728123 30342 tablet_bootstrap.cc:492] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:30.746419 30342 ts_tablet_manager.cc:1403] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.009s
I20260709 12:20:30.709268 30424 raft_consensus.cc:697] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:30.712512 30222 raft_consensus.cc:2468] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 1.
I20260709 12:20:30.709498 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a9ecec74344c1693efb9acb6e38e26" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:30.750056 30149 raft_consensus.cc:3060] T 67a9ecec74344c1693efb9acb6e38e26 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.750643 30346 ts_tablet_manager.cc:1403] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.101s	user 0.029s	sys 0.016s
I20260709 12:20:30.754810 30346 raft_consensus.cc:359] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.755673 30407 raft_consensus.cc:493] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.744144 30344 tablet_bootstrap.cc:492] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:30.756311 30407 raft_consensus.cc:515] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.757025 30222 raft_consensus.cc:3060] T 0e9a81d1a7404da0aac49a76cb38f0de P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.757333 30342 raft_consensus.cc:359] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:30.758044 30342 raft_consensus.cc:385] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.758313 30342 raft_consensus.cc:740] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.758841 30407 leader_election.cc:290] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:30.750204 30424 consensus_queue.cc:237] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:30.759706 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5da70c81d654d3e9e50fa2778189857" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
W20260709 12:20:30.761528 30188 leader_election.cc:343] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.760020 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5da70c81d654d3e9e50fa2778189857" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:30.762791 30148 raft_consensus.cc:2468] T e5da70c81d654d3e9e50fa2778189857 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 0.
I20260709 12:20:30.763077 30342 consensus_queue.cc:260] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:30.765503 30342 ts_tablet_manager.cc:1434] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 12:20:30.766964 30342 tablet_bootstrap.cc:492] T 975b191d2b5544a6838af42f2be670c9 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:30.755672 30346 raft_consensus.cc:385] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.770833 30346 raft_consensus.cc:740] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.772188 30407 raft_consensus.cc:493] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.772742 30407 raft_consensus.cc:515] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.772881 30346 consensus_queue.cc:260] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.775303 30346 ts_tablet_manager.cc:1434] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:20:30.776134 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c8763c7b2b4fb891cbebff4035dbe6" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:30.776403 30346 tablet_bootstrap.cc:492] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:30.776856 30073 raft_consensus.cc:2468] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 0.
I20260709 12:20:30.777962 30383 consensus_queue.cc:1048] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.778349 30188 leader_election.cc:304] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:30.779314 30401 raft_consensus.cc:2804] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:30.779685 30401 raft_consensus.cc:493] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.780020 30401 raft_consensus.cc:3060] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.784812 30186 leader_election.cc:304] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:30.786188 30383 raft_consensus.cc:2804] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:30.786614 30383 raft_consensus.cc:493] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.788067 30344 tablet_bootstrap.cc:654] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.797144 30149 raft_consensus.cc:2468] T 67a9ecec74344c1693efb9acb6e38e26 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:30.798815 30260 leader_election.cc:304] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:30.791819 30383 raft_consensus.cc:3060] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.802019 30427 raft_consensus.cc:2804] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:30.802562 30427 raft_consensus.cc:697] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:30.803467 30427 consensus_queue.cc:237] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:30.815013 30342 tablet_bootstrap.cc:654] T 975b191d2b5544a6838af42f2be670c9 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.816388 30401 raft_consensus.cc:515] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.818389 30343 tablet_bootstrap.cc:492] T 4f18dd45e30e4e3aafdc917396dc2181 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:30.818958 30343 ts_tablet_manager.cc:1403] T 4f18dd45e30e4e3aafdc917396dc2181 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.134s	user 0.027s	sys 0.015s
I20260709 12:20:30.820235 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c8763c7b2b4fb891cbebff4035dbe6" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
W20260709 12:20:30.823040 30186 leader_election.cc:343] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.820891 30407 leader_election.cc:290] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:30.826867 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c8763c7b2b4fb891cbebff4035dbe6" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:30.827570 30073 raft_consensus.cc:3060] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.828593 30344 tablet_bootstrap.cc:492] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:30.829159 30344 ts_tablet_manager.cc:1403] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.016s
I20260709 12:20:30.834525 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c8763c7b2b4fb891cbebff4035dbe6" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:30.833666 30343 raft_consensus.cc:359] T 4f18dd45e30e4e3aafdc917396dc2181 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:30.835764 30343 raft_consensus.cc:385] T 4f18dd45e30e4e3aafdc917396dc2181 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.836084 30343 raft_consensus.cc:740] T 4f18dd45e30e4e3aafdc917396dc2181 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.836795 30343 consensus_queue.cc:260] T 4f18dd45e30e4e3aafdc917396dc2181 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
W20260709 12:20:30.836817 30186 leader_election.cc:343] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.838532 30343 ts_tablet_manager.cc:1434] T 4f18dd45e30e4e3aafdc917396dc2181 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.003s
I20260709 12:20:30.839390 30343 tablet_bootstrap.cc:492] T 27c8763c7b2b4fb891cbebff4035dbe6 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:30.833999 30400 consensus_queue.cc:1048] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:20:30.845498 30343 tablet_bootstrap.cc:654] T 27c8763c7b2b4fb891cbebff4035dbe6 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.846874 29972 catalog_manager.cc:5697] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 1 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.850044 30073 raft_consensus.cc:2468] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
I20260709 12:20:30.851523 30188 leader_election.cc:304] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:30.854100 30407 raft_consensus.cc:2804] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:30.854698 30407 raft_consensus.cc:697] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:30.855638 30407 consensus_queue.cc:237] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.858233 30346 tablet_bootstrap.cc:654] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.859092 30438 raft_consensus.cc:493] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.859745 30438 raft_consensus.cc:515] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:30.862033 30383 raft_consensus.cc:515] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.824317 30401 leader_election.cc:290] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:30.866207 30344 raft_consensus.cc:359] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:30.868963 30344 raft_consensus.cc:385] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.869207 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5da70c81d654d3e9e50fa2778189857" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:30.881378 30344 raft_consensus.cc:740] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.876626 30438 leader_election.cc:290] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:30.879046 30400 consensus_queue.cc:1048] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:30.880609 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca034599de8146968cc8adcb232a2ca4" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:30.879913 30379 raft_consensus.cc:493] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.886505 30344 consensus_queue.cc:260] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:30.884788 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca034599de8146968cc8adcb232a2ca4" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:30.895994 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5da70c81d654d3e9e50fa2778189857" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:30.896780 30149 raft_consensus.cc:3060] T e5da70c81d654d3e9e50fa2778189857 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.897862 30356 raft_consensus.cc:493] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.898401 30356 raft_consensus.cc:515] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.885912 30379 raft_consensus.cc:515] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.903070 30379 leader_election.cc:290] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:30.904220 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d01a3a6c7f24268a9c505f7d2f0efcd" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:30.905149 30074 raft_consensus.cc:2468] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:30.906615 30114 leader_election.cc:304] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:30.907670 30344 ts_tablet_manager.cc:1434] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.000s
I20260709 12:20:30.909171 30342 tablet_bootstrap.cc:492] T 975b191d2b5544a6838af42f2be670c9 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:30.909845 30342 ts_tablet_manager.cc:1403] T 975b191d2b5544a6838af42f2be670c9 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.143s	user 0.031s	sys 0.031s
I20260709 12:20:30.910825 30356 leader_election.cc:290] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:30.912730 30400 raft_consensus.cc:2804] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:20:30.885547 30188 leader_election.cc:343] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.885888 30297 raft_consensus.cc:2468] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 0.
I20260709 12:20:30.914669 30342 raft_consensus.cc:359] T 975b191d2b5544a6838af42f2be670c9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:30.884630 30383 leader_election.cc:290] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:30.923697 29972 catalog_manager.cc:5697] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 1 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.926160 30342 raft_consensus.cc:385] T 975b191d2b5544a6838af42f2be670c9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.926581 30342 raft_consensus.cc:740] T 975b191d2b5544a6838af42f2be670c9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.915151 30400 raft_consensus.cc:493] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.930403 30342 consensus_queue.cc:260] T 975b191d2b5544a6838af42f2be670c9 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:30.937217 30342 ts_tablet_manager.cc:1434] T 975b191d2b5544a6838af42f2be670c9 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:20:30.942940 30379 raft_consensus.cc:493] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.943174 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d01a3a6c7f24268a9c505f7d2f0efcd" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:30.925243 30356 raft_consensus.cc:493] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.944918 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d01a3a6c7f24268a9c505f7d2f0efcd" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:30.934825 30400 raft_consensus.cc:3060] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:30.944752 30188 leader_election.cc:343] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.953491 30222 raft_consensus.cc:2468] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 0.
I20260709 12:20:30.952807 30356 raft_consensus.cc:515] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.955255 30038 leader_election.cc:304] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:30.955772 30356 leader_election.cc:290] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:30.956372 30356 raft_consensus.cc:2804] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:30.956739 30356 raft_consensus.cc:493] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.957056 30356 raft_consensus.cc:3060] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.957481 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e48bba41f0240ac820f0e23f6067b67" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:30.951674 30379 raft_consensus.cc:515] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:30.958470 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e48bba41f0240ac820f0e23f6067b67" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
W20260709 12:20:30.959194 30038 leader_election.cc:343] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:30.960157 30037 leader_election.cc:343] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.960671 30037 leader_election.cc:304] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:30.961795 30398 raft_consensus.cc:2749] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:30.960180 30379 leader_election.cc:290] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:30.964514 30149 raft_consensus.cc:2468] T e5da70c81d654d3e9e50fa2778189857 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
I20260709 12:20:30.962517 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aca82ece24244f792b8e4d302f4f4f9" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:30.966027 30186 leader_election.cc:304] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:30.966367 30297 raft_consensus.cc:2468] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:30.962007 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aca82ece24244f792b8e4d302f4f4f9" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:30.968901 30438 raft_consensus.cc:2804] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:30.969431 30438 raft_consensus.cc:697] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:30.970323 30438 consensus_queue.cc:237] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
W20260709 12:20:30.938127 30113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:44035, user_credentials={real_user=slave}} blocked reactor thread for 49473.1us
I20260709 12:20:30.977973 30115 leader_election.cc:304] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:30.978747 30400 raft_consensus.cc:515] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:30.979693 30342 tablet_bootstrap.cc:492] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:30.980029 30147 raft_consensus.cc:2393] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a1255131174934a6bca3c0bf000026 in current term 1: Already voted for candidate b0439d4e94904196847cd825fcc8ebd7 in this term.
I20260709 12:20:30.980471 30379 raft_consensus.cc:2804] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:30.981240 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d01a3a6c7f24268a9c505f7d2f0efcd" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:30.981222 30379 raft_consensus.cc:493] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.995155 30379 raft_consensus.cc:3060] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.988314 30189 leader_election.cc:304] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
W20260709 12:20:30.984247 30114 leader_election.cc:343] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.992863 30342 tablet_bootstrap.cc:654] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.998322 30344 tablet_bootstrap.cc:492] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:30.998095 30222 raft_consensus.cc:2468] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:31.003466 30401 raft_consensus.cc:2804] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:31.007366 30401 raft_consensus.cc:493] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.007764 30401 raft_consensus.cc:3060] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:31.005195 30189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:33729, user_credentials={real_user=slave}} blocked reactor thread for 56152.8us
I20260709 12:20:31.010044 30343 tablet_bootstrap.cc:492] T 27c8763c7b2b4fb891cbebff4035dbe6 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:31.011924 30383 raft_consensus.cc:493] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.012209 30343 ts_tablet_manager.cc:1403] T 27c8763c7b2b4fb891cbebff4035dbe6 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.173s	user 0.026s	sys 0.053s
I20260709 12:20:31.012404 30383 raft_consensus.cc:515] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.014714 30383 leader_election.cc:290] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:31.006469 30407 raft_consensus.cc:493] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.016105 30407 raft_consensus.cc:515] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.017443 30343 raft_consensus.cc:359] T 27c8763c7b2b4fb891cbebff4035dbe6 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:31.018199 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d01a3a6c7f24268a9c505f7d2f0efcd" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:31.018420 30407 leader_election.cc:290] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:30.998747 30356 raft_consensus.cc:515] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:31.019392 30074 raft_consensus.cc:2393] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b0439d4e94904196847cd825fcc8ebd7 in current term 1: Already voted for candidate 22a1255131174934a6bca3c0bf000026 in this term.
I20260709 12:20:31.020165 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bfe6b1a3764834aa3501ebdf533ddf" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
W20260709 12:20:31.021791 30188 leader_election.cc:343] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.022421 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a289b0636994e34965a2dc0137e5b94" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:31.018239 30343 raft_consensus.cc:385] T 27c8763c7b2b4fb891cbebff4035dbe6 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.023226 30343 raft_consensus.cc:740] T 27c8763c7b2b4fb891cbebff4035dbe6 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
W20260709 12:20:31.023831 30186 leader_election.cc:343] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.024240 30295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a289b0636994e34965a2dc0137e5b94" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:31.018563 29972 catalog_manager.cc:5697] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:31.023588 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d01a3a6c7f24268a9c505f7d2f0efcd" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:31.025485 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bfe6b1a3764834aa3501ebdf533ddf" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:31.025882 30222 raft_consensus.cc:3060] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.023924 30343 consensus_queue.cc:260] T 27c8763c7b2b4fb891cbebff4035dbe6 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:31.022348 30400 leader_election.cc:290] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:31.032989 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d01a3a6c7f24268a9c505f7d2f0efcd" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
W20260709 12:20:31.031560 30189 leader_election.cc:343] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.027868 30401 raft_consensus.cc:515] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.036369 30189 leader_election.cc:304] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
W20260709 12:20:31.039999 30189 leader_election.cc:343] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.041059 30189 leader_election.cc:304] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:31.031332 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d01a3a6c7f24268a9c505f7d2f0efcd" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:31.042269 30343 ts_tablet_manager.cc:1434] T 27c8763c7b2b4fb891cbebff4035dbe6 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:20:31.042445 30149 raft_consensus.cc:2393] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 22a1255131174934a6bca3c0bf000026 in current term 1: Already voted for candidate b0439d4e94904196847cd825fcc8ebd7 in this term.
I20260709 12:20:31.042410 30438 raft_consensus.cc:2749] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:31.036490 30379 raft_consensus.cc:515] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:31.044265 30342 tablet_bootstrap.cc:492] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:31.044471 30222 raft_consensus.cc:2468] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:31.045790 30113 leader_election.cc:304] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:31.045957 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aca82ece24244f792b8e4d302f4f4f9" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:31.045957 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aca82ece24244f792b8e4d302f4f4f9" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:31.046868 30401 leader_election.cc:290] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:31.048545 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca034599de8146968cc8adcb232a2ca4" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:31.048504 30342 ts_tablet_manager.cc:1403] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.001s
W20260709 12:20:31.048702 30114 leader_election.cc:343] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.049305 30297 raft_consensus.cc:3060] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:31.050652 30188 leader_election.cc:343] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.051545 30295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca034599de8146968cc8adcb232a2ca4" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:31.052261 30295 raft_consensus.cc:3060] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.038703 30346 tablet_bootstrap.cc:492] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:31.040565 30407 raft_consensus.cc:2749] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:31.030005 30356 leader_election.cc:290] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:31.053364 30346 ts_tablet_manager.cc:1403] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.277s	user 0.017s	sys 0.025s
I20260709 12:20:31.053495 30343 tablet_bootstrap.cc:492] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:31.052356 30342 raft_consensus.cc:359] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.055652 30342 raft_consensus.cc:385] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.055948 30342 raft_consensus.cc:740] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.056876 30342 consensus_queue.cc:260] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.059015 30346 raft_consensus.cc:359] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.059710 30342 ts_tablet_manager.cc:1434] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:20:31.059924 30346 raft_consensus.cc:385] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.060423 30346 raft_consensus.cc:740] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.060866 30342 tablet_bootstrap.cc:492] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:31.061381 30346 consensus_queue.cc:260] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.059880 30445 raft_consensus.cc:2804] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:31.066360 30445 raft_consensus.cc:697] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:31.067245 30445 consensus_queue.cc:237] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:31.069715 30346 ts_tablet_manager.cc:1434] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:20:31.070436 30356 consensus_queue.cc:1048] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:31.054740 30379 leader_election.cc:290] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:31.070727 30037 leader_election.cc:304] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:31.073350 30342 tablet_bootstrap.cc:654] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.073971 30356 raft_consensus.cc:2749] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:31.076807 30297 raft_consensus.cc:2468] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:31.078181 30115 leader_election.cc:304] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:31.078961 30346 tablet_bootstrap.cc:492] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:31.079836 30400 raft_consensus.cc:2804] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:31.080452 30400 raft_consensus.cc:697] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:31.080260 29971 catalog_manager.cc:5697] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:31.081480 30400 consensus_queue.cc:237] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:31.083156 30344 tablet_bootstrap.cc:654] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.088948 30295 raft_consensus.cc:2468] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
I20260709 12:20:31.091668 30447 raft_consensus.cc:493] T 4f18dd45e30e4e3aafdc917396dc2181 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.091881 30346 tablet_bootstrap.cc:654] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.096742 30379 raft_consensus.cc:493] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.096663 30189 leader_election.cc:304] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:31.094002 30447 raft_consensus.cc:515] T 4f18dd45e30e4e3aafdc917396dc2181 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:31.097728 30407 raft_consensus.cc:2804] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:31.098296 30407 raft_consensus.cc:697] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:31.098131 30379 raft_consensus.cc:515] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.099220 30407 consensus_queue.cc:237] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.100696 30447 leader_election.cc:290] T 4f18dd45e30e4e3aafdc917396dc2181 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:31.102578 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f18dd45e30e4e3aafdc917396dc2181" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:31.103590 30073 raft_consensus.cc:2393] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0439d4e94904196847cd825fcc8ebd7 in current term 1: Already voted for candidate f6c1f7275e654f49abaf1c80ed662511 in this term.
I20260709 12:20:31.104489 30424 raft_consensus.cc:493] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.105028 30424 raft_consensus.cc:515] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.107064 30356 consensus_queue.cc:1048] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:31.133133 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "975b191d2b5544a6838af42f2be670c9" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:31.135879 30223 raft_consensus.cc:2468] T 975b191d2b5544a6838af42f2be670c9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:31.140202 30379 leader_election.cc:290] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:31.143232 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f18dd45e30e4e3aafdc917396dc2181" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:31.143114 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27678468a40344eca39b8bab02b0b368" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:31.144151 30073 raft_consensus.cc:2468] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:31.145426 30114 leader_election.cc:304] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:31.146257 30379 raft_consensus.cc:2804] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:31.146732 30379 raft_consensus.cc:493] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.146951 30261 leader_election.cc:304] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:31.147327 30379 raft_consensus.cc:3060] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:31.147946 30427 raft_consensus.cc:2804] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:31.148334 30427 raft_consensus.cc:493] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.148689 30427 raft_consensus.cc:3060] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.149044 30424 leader_election.cc:290] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:31.149974 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "975b191d2b5544a6838af42f2be670c9" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
W20260709 12:20:31.151412 30262 leader_election.cc:343] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.136899 30295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27678468a40344eca39b8bab02b0b368" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:31.159101 30344 tablet_bootstrap.cc:492] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:31.159632 30344 ts_tablet_manager.cc:1403] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.175s	user 0.025s	sys 0.019s
I20260709 12:20:31.163873 30342 tablet_bootstrap.cc:492] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:31.164549 30342 ts_tablet_manager.cc:1403] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.104s	user 0.014s	sys 0.002s
I20260709 12:20:31.156185 30295 raft_consensus.cc:2468] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:31.152295 29969 catalog_manager.cc:5697] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:31.176285 30115 leader_election.cc:304] T 4f18dd45e30e4e3aafdc917396dc2181 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7; no voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:31.176445 30344 raft_consensus.cc:359] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.177363 30344 raft_consensus.cc:385] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.177702 30344 raft_consensus.cc:740] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.175172 30427 raft_consensus.cc:515] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.178594 30344 consensus_queue.cc:260] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.180925 30427 leader_election.cc:290] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:31.178598 30445 raft_consensus.cc:3060] T 4f18dd45e30e4e3aafdc917396dc2181 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.184811 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "975b191d2b5544a6838af42f2be670c9" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:31.186141 30344 ts_tablet_manager.cc:1434] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.002s
I20260709 12:20:31.183329 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "975b191d2b5544a6838af42f2be670c9" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:31.188102 30344 tablet_bootstrap.cc:492] T 438c3adce9a646b8944ac27608e94314 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
W20260709 12:20:31.188534 30262 leader_election.cc:343] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.188874 30379 raft_consensus.cc:515] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.190135 30343 tablet_bootstrap.cc:654] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.187922 30223 raft_consensus.cc:3060] T 975b191d2b5544a6838af42f2be670c9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.198243 30346 tablet_bootstrap.cc:492] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:31.198928 30346 ts_tablet_manager.cc:1403] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.120s	user 0.019s	sys 0.001s
I20260709 12:20:31.202894 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27678468a40344eca39b8bab02b0b368" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:31.203680 30297 raft_consensus.cc:3060] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:31.207293 29971 catalog_manager.cc:5697] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:31.211580 30342 raft_consensus.cc:359] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.215237 30342 raft_consensus.cc:385] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.215610 30346 raft_consensus.cc:359] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.216542 30346 raft_consensus.cc:385] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.216851 30346 raft_consensus.cc:740] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.217839 30346 consensus_queue.cc:260] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.215348 30297 raft_consensus.cc:2468] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 2.
I20260709 12:20:31.220347 30115 leader_election.cc:304] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:31.221272 30400 raft_consensus.cc:2804] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:31.221813 30400 raft_consensus.cc:697] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:31.222018 30346 ts_tablet_manager.cc:1434] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:20:31.223019 30346 tablet_bootstrap.cc:492] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:31.222891 30400 consensus_queue.cc:237] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.223563 30424 consensus_queue.cc:1048] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:31.215590 30342 raft_consensus.cc:740] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.228488 30342 consensus_queue.cc:260] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.238034 30223 raft_consensus.cc:2468] T 975b191d2b5544a6838af42f2be670c9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:31.241940 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27678468a40344eca39b8bab02b0b368" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:31.242329 30343 tablet_bootstrap.cc:492] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:31.242662 30074 raft_consensus.cc:3060] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:31.242934 30343 ts_tablet_manager.cc:1403] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.190s	user 0.023s	sys 0.014s
I20260709 12:20:31.241596 30261 leader_election.cc:304] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
W20260709 12:20:31.244602 30262 consensus_peers.cc:597] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:31.245278 30427 raft_consensus.cc:2804] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:31.245842 30427 raft_consensus.cc:697] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:31.246701 30427 consensus_queue.cc:237] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.239078 30342 ts_tablet_manager.cc:1434] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 12:20:31.250397 30343 raft_consensus.cc:359] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:31.251240 30343 raft_consensus.cc:385] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.250883 30342 tablet_bootstrap.cc:492] T 1e48bba41f0240ac820f0e23f6067b67 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:31.251539 30343 raft_consensus.cc:740] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.254946 30346 tablet_bootstrap.cc:654] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.254994 30343 consensus_queue.cc:260] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:31.258028 30344 tablet_bootstrap.cc:654] T 438c3adce9a646b8944ac27608e94314 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.238472 30379 leader_election.cc:290] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:31.260877 30343 ts_tablet_manager.cc:1434] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 12:20:31.256459 30445 raft_consensus.cc:2749] T 4f18dd45e30e4e3aafdc917396dc2181 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:31.262015 30343 tablet_bootstrap.cc:492] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:31.263870 30461 raft_consensus.cc:493] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.266721 30461 raft_consensus.cc:515] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.272323 30074 raft_consensus.cc:2468] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 2.
I20260709 12:20:31.272668 30342 tablet_bootstrap.cc:654] T 1e48bba41f0240ac820f0e23f6067b67 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.276470 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca034599de8146968cc8adcb232a2ca4" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:31.282274 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca034599de8146968cc8adcb232a2ca4" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:31.283524 30297 raft_consensus.cc:2393] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a1255131174934a6bca3c0bf000026 in current term 1: Already voted for candidate f3ef588fc4b54ec09355022d7a5a5e86 in this term.
I20260709 12:20:31.284175 30461 leader_election.cc:290] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:31.290050 30342 tablet_bootstrap.cc:492] T 1e48bba41f0240ac820f0e23f6067b67 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:31.290654 30342 ts_tablet_manager.cc:1403] T 1e48bba41f0240ac820f0e23f6067b67 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.001s
I20260709 12:20:31.291074 30038 leader_election.cc:304] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:31.292574 30461 raft_consensus.cc:3060] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.294090 30342 raft_consensus.cc:359] T 1e48bba41f0240ac820f0e23f6067b67 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:31.294992 30342 raft_consensus.cc:385] T 1e48bba41f0240ac820f0e23f6067b67 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.295308 30342 raft_consensus.cc:740] T 1e48bba41f0240ac820f0e23f6067b67 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.299538 30342 consensus_queue.cc:260] T 1e48bba41f0240ac820f0e23f6067b67 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:31.301983 30342 ts_tablet_manager.cc:1434] T 1e48bba41f0240ac820f0e23f6067b67 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 12:20:31.302501 30343 tablet_bootstrap.cc:654] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.302958 30342 tablet_bootstrap.cc:492] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:31.308060 30149 raft_consensus.cc:3060] T 27c8763c7b2b4fb891cbebff4035dbe6 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.310200 30427 raft_consensus.cc:493] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.317538 30346 tablet_bootstrap.cc:492] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:31.318264 30346 ts_tablet_manager.cc:1403] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.095s	user 0.013s	sys 0.012s
I20260709 12:20:31.323107 30427 raft_consensus.cc:515] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.325577 30342 tablet_bootstrap.cc:654] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.326901 30427 leader_election.cc:290] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:31.327210 30346 raft_consensus.cc:359] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.330782 30346 raft_consensus.cc:385] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.331125 30346 raft_consensus.cc:740] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.332854 30346 consensus_queue.cc:260] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.337994 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bfe6b1a3764834aa3501ebdf533ddf" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:31.339219 30383 raft_consensus.cc:493] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.339512 30073 raft_consensus.cc:2468] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:31.339986 30383 raft_consensus.cc:515] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.342921 30262 leader_election.cc:304] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:31.333675 30445 raft_consensus.cc:493] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.344456 30445 raft_consensus.cc:515] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:31.349092 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e48bba41f0240ac820f0e23f6067b67" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:31.351035 30346 ts_tablet_manager.cc:1434] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 12:20:31.352236 30346 tablet_bootstrap.cc:492] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:31.352967 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438c3adce9a646b8944ac27608e94314" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:31.354214 30344 tablet_bootstrap.cc:492] T 438c3adce9a646b8944ac27608e94314 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
W20260709 12:20:31.354620 30186 leader_election.cc:343] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.338086 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bfe6b1a3764834aa3501ebdf533ddf" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:31.355530 30223 raft_consensus.cc:2468] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:31.356400 30222 raft_consensus.cc:2468] T 1e48bba41f0240ac820f0e23f6067b67 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:31.357327 29972 catalog_manager.cc:5697] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 1 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:31.358281 30346 tablet_bootstrap.cc:654] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.360534 30383 leader_election.cc:290] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:31.354727 30344 ts_tablet_manager.cc:1403] T 438c3adce9a646b8944ac27608e94314 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.167s	user 0.019s	sys 0.010s
I20260709 12:20:31.362139 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e48bba41f0240ac820f0e23f6067b67" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:31.362471 30113 leader_election.cc:304] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:31.362879 30073 raft_consensus.cc:2468] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:31.363665 30424 raft_consensus.cc:2804] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:31.364089 30424 raft_consensus.cc:493] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.364446 30424 raft_consensus.cc:3060] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.351015 30445 leader_election.cc:290] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:31.335218 30461 raft_consensus.cc:2749] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:31.367657 30427 consensus_queue.cc:1048] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:31.376101 30344 raft_consensus.cc:359] T 438c3adce9a646b8944ac27608e94314 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.377030 30344 raft_consensus.cc:385] T 438c3adce9a646b8944ac27608e94314 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.377390 30344 raft_consensus.cc:740] T 438c3adce9a646b8944ac27608e94314 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.378698 30344 consensus_queue.cc:260] T 438c3adce9a646b8944ac27608e94314 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.367798 30445 raft_consensus.cc:2804] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:31.380218 30445 raft_consensus.cc:493] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.380708 30445 raft_consensus.cc:3060] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.393414 30344 ts_tablet_manager.cc:1434] T 438c3adce9a646b8944ac27608e94314 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 12:20:31.394876 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438c3adce9a646b8944ac27608e94314" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:31.395553 30297 raft_consensus.cc:2468] T 438c3adce9a646b8944ac27608e94314 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 0.
I20260709 12:20:31.398093 30407 consensus_queue.cc:1048] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:31.378146 30383 consensus_queue.cc:1048] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:20:31.400331 30189 leader_election.cc:304] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:31.402199 30407 raft_consensus.cc:2804] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:31.402597 30407 raft_consensus.cc:493] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.402952 30407 raft_consensus.cc:3060] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.405129 30379 raft_consensus.cc:493] T 27c8763c7b2b4fb891cbebff4035dbe6 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.405725 30379 raft_consensus.cc:515] T 27c8763c7b2b4fb891cbebff4035dbe6 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:31.406751 30445 raft_consensus.cc:515] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:31.408329 30401 consensus_queue.cc:1048] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:31.409143 30445 leader_election.cc:290] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:31.409339 30379 leader_election.cc:290] T 27c8763c7b2b4fb891cbebff4035dbe6 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:31.410554 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e48bba41f0240ac820f0e23f6067b67" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:31.410811 30072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c8763c7b2b4fb891cbebff4035dbe6" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:31.411352 30074 raft_consensus.cc:3060] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.407797 29969 catalog_manager.cc:5697] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:31.422942 30343 tablet_bootstrap.cc:492] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:31.423694 30343 ts_tablet_manager.cc:1403] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.162s	user 0.016s	sys 0.000s
I20260709 12:20:31.424455 30344 tablet_bootstrap.cc:492] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:31.426682 30343 raft_consensus.cc:359] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.427524 30343 raft_consensus.cc:385] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.427806 30343 raft_consensus.cc:740] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.428529 30343 consensus_queue.cc:260] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.429636 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c8763c7b2b4fb891cbebff4035dbe6" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:31.433511 29969 catalog_manager.cc:5697] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 2, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:31.435268 30424 raft_consensus.cc:515] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.443286 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bfe6b1a3764834aa3501ebdf533ddf" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
W20260709 12:20:31.443737 30020 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:31.445576 30074 raft_consensus.cc:2468] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:31.446321 30113 leader_election.cc:304] T 27c8763c7b2b4fb891cbebff4035dbe6 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7; no voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:31.446986 30223 raft_consensus.cc:3060] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.448755 30114 leader_election.cc:304] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:31.439216 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e48bba41f0240ac820f0e23f6067b67" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:31.452461 30445 raft_consensus.cc:2804] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:31.453020 30346 tablet_bootstrap.cc:492] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:31.453053 30445 raft_consensus.cc:697] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:31.453572 30346 ts_tablet_manager.cc:1403] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.102s	user 0.025s	sys 0.011s
I20260709 12:20:31.454262 30445 consensus_queue.cc:237] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:31.463541 30346 raft_consensus.cc:359] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:31.464428 30346 raft_consensus.cc:385] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.464752 30346 raft_consensus.cc:740] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.465646 30346 consensus_queue.cc:260] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:31.452611 30222 raft_consensus.cc:3060] T 1e48bba41f0240ac820f0e23f6067b67 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.474121 30343 ts_tablet_manager.cc:1434] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 12:20:31.476089 30343 tablet_bootstrap.cc:492] T 8f47831b773245faa71c01cb8c967a7a P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:31.479034 30346 ts_tablet_manager.cc:1434] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:20:31.480099 30346 tablet_bootstrap.cc:492] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:31.480522 30342 tablet_bootstrap.cc:492] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:31.481005 30342 ts_tablet_manager.cc:1403] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.178s	user 0.034s	sys 0.017s
W20260709 12:20:31.482460 30188 consensus_peers.cc:597] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:31.484323 30342 raft_consensus.cc:359] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:31.485162 30342 raft_consensus.cc:385] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.485555 30342 raft_consensus.cc:740] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.486243 30346 tablet_bootstrap.cc:654] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.486579 30342 consensus_queue.cc:260] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:31.489221 30424 leader_election.cc:290] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:31.473105 30398 raft_consensus.cc:493] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.462170 30351 consensus_queue.cc:1048] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:20:31.468286 30407 raft_consensus.cc:515] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.499157 30342 ts_tablet_manager.cc:1434] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 12:20:31.499040 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bfe6b1a3764834aa3501ebdf533ddf" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:31.502568 30379 raft_consensus.cc:2749] T 27c8763c7b2b4fb891cbebff4035dbe6 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:31.509047 30342 tablet_bootstrap.cc:492] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:31.494791 30398 raft_consensus.cc:515] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.502199 30074 raft_consensus.cc:3060] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.517180 30407 leader_election.cc:290] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:31.514465 30223 raft_consensus.cc:2468] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:31.519469 30343 tablet_bootstrap.cc:654] T 8f47831b773245faa71c01cb8c967a7a P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.520097 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438c3adce9a646b8944ac27608e94314" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:31.520787 30297 raft_consensus.cc:3060] T 438c3adce9a646b8944ac27608e94314 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.515421 30400 raft_consensus.cc:493] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.523273 30400 raft_consensus.cc:515] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.527108 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a289b0636994e34965a2dc0137e5b94" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:31.527932 30223 raft_consensus.cc:2468] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:31.529435 30113 leader_election.cc:304] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:31.519315 30261 leader_election.cc:304] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:31.530674 30398 leader_election.cc:290] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:31.531515 30447 raft_consensus.cc:2804] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:31.532037 30447 raft_consensus.cc:493] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.531383 30351 raft_consensus.cc:2804] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:31.525535 30400 leader_election.cc:290] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:31.546535 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "975b191d2b5544a6838af42f2be670c9" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:31.547581 30223 raft_consensus.cc:2393] T 975b191d2b5544a6838af42f2be670c9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a1255131174934a6bca3c0bf000026 in current term 1: Already voted for candidate f6c1f7275e654f49abaf1c80ed662511 in this term.
I20260709 12:20:31.552152 30297 raft_consensus.cc:2468] T 438c3adce9a646b8944ac27608e94314 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
I20260709 12:20:31.552551 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "975b191d2b5544a6838af42f2be670c9" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:31.554519 30040 leader_election.cc:304] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:31.556071 30398 raft_consensus.cc:3060] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.556524 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438c3adce9a646b8944ac27608e94314" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:31.556825 30383 raft_consensus.cc:493] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.557490 30383 raft_consensus.cc:515] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.560128 30383 leader_election.cc:290] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:31.563130 30072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17f97873bb48ca864a13321c11f401" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
W20260709 12:20:31.566154 30188 leader_election.cc:343] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.532430 30447 raft_consensus.cc:3060] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.539223 30351 raft_consensus.cc:697] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:31.534991 30295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a289b0636994e34965a2dc0137e5b94" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:31.585397 30351 consensus_queue.cc:237] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.540474 30379 consensus_queue.cc:1048] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 12:20:31.568938 30189 leader_election.cc:304] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 
W20260709 12:20:31.588212 30186 leader_election.cc:343] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.590268 30407 raft_consensus.cc:2804] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:31.590801 30407 raft_consensus.cc:697] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:31.591778 30222 raft_consensus.cc:2468] T 1e48bba41f0240ac820f0e23f6067b67 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:31.593621 30401 consensus_queue.cc:1048] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:20:31.594168 30475 log.cc:927] Time spent T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 12:20:31.595613 30115 leader_election.cc:343] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.596402 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17f97873bb48ca864a13321c11f401" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
W20260709 12:20:31.603622 30189 leader_election.cc:343] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.604151 30189 leader_election.cc:304] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:31.605855 30383 raft_consensus.cc:2749] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:31.606735 30074 raft_consensus.cc:2468] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:31.591688 30407 consensus_queue.cc:237] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.577576 30400 consensus_queue.cc:1048] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:31.584174 30344 tablet_bootstrap.cc:654] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.613469 30401 consensus_queue.cc:1048] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:31.579981 30342 tablet_bootstrap.cc:654] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.603214 30447 raft_consensus.cc:515] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.590425 30398 raft_consensus.cc:2749] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:31.652074 30343 tablet_bootstrap.cc:492] T 8f47831b773245faa71c01cb8c967a7a P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:31.651829 29972 catalog_manager.cc:5697] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 1 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:31.652653 30343 ts_tablet_manager.cc:1403] T 8f47831b773245faa71c01cb8c967a7a P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.177s	user 0.025s	sys 0.018s
I20260709 12:20:31.653110 30445 consensus_queue.cc:1048] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:31.660943 30344 tablet_bootstrap.cc:492] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:31.661420 30344 ts_tablet_manager.cc:1403] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.237s	user 0.009s	sys 0.006s
I20260709 12:20:31.656929 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a289b0636994e34965a2dc0137e5b94" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:31.664544 30073 raft_consensus.cc:3060] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.666204 30222 raft_consensus.cc:3060] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.668628 30343 raft_consensus.cc:359] T 8f47831b773245faa71c01cb8c967a7a P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
W20260709 12:20:31.678488 30114 consensus_peers.cc:597] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:31.680347 30343 raft_consensus.cc:385] T 8f47831b773245faa71c01cb8c967a7a P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.680630 30344 raft_consensus.cc:359] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:31.681087 30343 raft_consensus.cc:740] T 8f47831b773245faa71c01cb8c967a7a P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.681394 30344 raft_consensus.cc:385] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.681679 30344 raft_consensus.cc:740] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.662274 29969 catalog_manager.cc:5697] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:31.683158 30342 tablet_bootstrap.cc:492] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:31.681847 30343 consensus_queue.cc:260] T 8f47831b773245faa71c01cb8c967a7a P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:31.665937 30447 leader_election.cc:290] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:31.683771 30342 ts_tablet_manager.cc:1403] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.183s	user 0.014s	sys 0.000s
I20260709 12:20:31.688457 30344 consensus_queue.cc:260] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:31.692816 30295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a289b0636994e34965a2dc0137e5b94" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:31.693888 30297 raft_consensus.cc:1275] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Refusing update from remote peer b0439d4e94904196847cd825fcc8ebd7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:20:31.693949 30342 raft_consensus.cc:359] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.695298 30342 raft_consensus.cc:385] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:20:31.695528 30115 leader_election.cc:343] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.695565 30342 raft_consensus.cc:740] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.696623 30342 consensus_queue.cc:260] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.697574 30447 consensus_queue.cc:1048] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:31.702687 30342 ts_tablet_manager.cc:1434] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 12:20:31.704033 30342 tablet_bootstrap.cc:492] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:31.707226 30343 ts_tablet_manager.cc:1434] T 8f47831b773245faa71c01cb8c967a7a P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 12:20:31.708169 30343 tablet_bootstrap.cc:492] T 438c3adce9a646b8944ac27608e94314 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:31.712713 30222 raft_consensus.cc:2468] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:31.714287 30113 leader_election.cc:304] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:31.714957 30346 tablet_bootstrap.cc:492] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:31.715474 30346 ts_tablet_manager.cc:1403] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.236s	user 0.011s	sys 0.002s
I20260709 12:20:31.715474 30400 raft_consensus.cc:2804] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:31.718664 30400 raft_consensus.cc:697] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:31.719930 30344 ts_tablet_manager.cc:1434] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.001s
I20260709 12:20:31.719724 30400 consensus_queue.cc:237] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.720607 30346 raft_consensus.cc:359] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:31.721346 30346 raft_consensus.cc:385] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.721618 30346 raft_consensus.cc:740] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.722064 30344 tablet_bootstrap.cc:492] T 3a289b0636994e34965a2dc0137e5b94 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:31.722481 30346 consensus_queue.cc:260] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:31.724825 30346 ts_tablet_manager.cc:1434] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:20:31.733440 29971 catalog_manager.cc:5697] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:31.736032 30344 tablet_bootstrap.cc:654] T 3a289b0636994e34965a2dc0137e5b94 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.736963 30342 tablet_bootstrap.cc:654] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.747195 30346 tablet_bootstrap.cc:492] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:31.762382 30401 raft_consensus.cc:493] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.762989 30401 raft_consensus.cc:515] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.764312 30073 raft_consensus.cc:1275] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Refusing update from remote peer b0439d4e94904196847cd825fcc8ebd7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:20:31.765057 30401 leader_election.cc:290] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:31.766965 30447 consensus_queue.cc:1048] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:31.767264 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c571ad30094eb3ac0b270c6a3c6a28" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:31.767971 30295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c571ad30094eb3ac0b270c6a3c6a28" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:31.768639 30470 consensus_queue.cc:1048] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:20:31.769034 30186 leader_election.cc:343] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:31.769908 30189 leader_election.cc:343] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.770346 30189 leader_election.cc:304] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:31.772938 30401 raft_consensus.cc:2749] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:31.778600 30346 tablet_bootstrap.cc:654] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.787554 29971 catalog_manager.cc:5697] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:31.792423 30346 tablet_bootstrap.cc:492] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:31.793035 30346 ts_tablet_manager.cc:1403] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.005s
I20260709 12:20:31.795032 30343 tablet_bootstrap.cc:654] T 438c3adce9a646b8944ac27608e94314 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.795876 30346 raft_consensus.cc:359] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:31.796563 30346 raft_consensus.cc:385] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.796792 30346 raft_consensus.cc:740] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.798731 30346 consensus_queue.cc:260] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:31.802129 30346 ts_tablet_manager.cc:1434] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:20:31.803222 30346 tablet_bootstrap.cc:492] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:31.820158 30469 consensus_queue.cc:1048] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:31.830407 30346 tablet_bootstrap.cc:654] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.830744 30342 tablet_bootstrap.cc:492] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:31.831302 30342 ts_tablet_manager.cc:1403] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.128s	user 0.004s	sys 0.011s
I20260709 12:20:31.834904 30342 raft_consensus.cc:359] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.835650 30342 raft_consensus.cc:385] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.835944 30342 raft_consensus.cc:740] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.836632 30342 consensus_queue.cc:260] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.837414 30344 tablet_bootstrap.cc:492] T 3a289b0636994e34965a2dc0137e5b94 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:31.838107 30398 raft_consensus.cc:493] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.838431 30344 ts_tablet_manager.cc:1403] T 3a289b0636994e34965a2dc0137e5b94 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.118s	user 0.013s	sys 0.006s
I20260709 12:20:31.838876 30342 ts_tablet_manager.cc:1434] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:31.839730 30342 tablet_bootstrap.cc:492] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:31.841485 30398 raft_consensus.cc:515] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:31.845422 30344 raft_consensus.cc:359] T 3a289b0636994e34965a2dc0137e5b94 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.846248 30344 raft_consensus.cc:385] T 3a289b0636994e34965a2dc0137e5b94 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.846510 30344 raft_consensus.cc:740] T 3a289b0636994e34965a2dc0137e5b94 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.846657 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aca82ece24244f792b8e4d302f4f4f9" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:31.847208 30344 consensus_queue.cc:260] T 3a289b0636994e34965a2dc0137e5b94 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.848824 30344 ts_tablet_manager.cc:1434] T 3a289b0636994e34965a2dc0137e5b94 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:20:31.856230 30398 leader_election.cc:290] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:31.858474 30344 tablet_bootstrap.cc:492] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:31.860819 30342 tablet_bootstrap.cc:654] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.859969 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aca82ece24244f792b8e4d302f4f4f9" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:31.862741 30040 leader_election.cc:304] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:31.864019 30398 raft_consensus.cc:2749] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:31.869031 30344 tablet_bootstrap.cc:654] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.876477 30343 tablet_bootstrap.cc:492] T 438c3adce9a646b8944ac27608e94314 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:31.877065 30343 ts_tablet_manager.cc:1403] T 438c3adce9a646b8944ac27608e94314 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.169s	user 0.014s	sys 0.010s
I20260709 12:20:31.878111 30346 tablet_bootstrap.cc:492] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:31.878638 30346 ts_tablet_manager.cc:1403] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.076s	user 0.008s	sys 0.025s
I20260709 12:20:31.879895 30342 tablet_bootstrap.cc:492] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:31.880563 30342 ts_tablet_manager.cc:1403] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.008s
I20260709 12:20:31.881487 30346 raft_consensus.cc:359] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.882237 30346 raft_consensus.cc:385] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.882570 30346 raft_consensus.cc:740] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.882299 30343 raft_consensus.cc:359] T 438c3adce9a646b8944ac27608e94314 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.882988 30343 raft_consensus.cc:385] T 438c3adce9a646b8944ac27608e94314 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.883262 30343 raft_consensus.cc:740] T 438c3adce9a646b8944ac27608e94314 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.883493 30342 raft_consensus.cc:359] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.884258 30342 raft_consensus.cc:385] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.884534 30342 raft_consensus.cc:740] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.885388 30342 consensus_queue.cc:260] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.888165 30342 ts_tablet_manager.cc:1434] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:31.883440 30346 consensus_queue.cc:260] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.889565 30342 tablet_bootstrap.cc:492] T 1efc41cad99a42d5a67d2db6d27a9061 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:31.890511 30346 ts_tablet_manager.cc:1434] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:20:31.891516 30346 tablet_bootstrap.cc:492] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:31.892201 30343 consensus_queue.cc:260] T 438c3adce9a646b8944ac27608e94314 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.894537 30343 ts_tablet_manager.cc:1434] T 438c3adce9a646b8944ac27608e94314 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:20:31.894878 30342 tablet_bootstrap.cc:654] T 1efc41cad99a42d5a67d2db6d27a9061 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.895813 30401 raft_consensus.cc:493] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.896308 30401 raft_consensus.cc:515] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:31.897171 30346 tablet_bootstrap.cc:654] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.898380 30401 leader_election.cc:290] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:31.900074 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c55d09601aa4eceaf3916006afcc93a" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:31.900552 30343 tablet_bootstrap.cc:492] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:31.902187 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c55d09601aa4eceaf3916006afcc93a" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
W20260709 12:20:31.904026 30189 leader_election.cc:343] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:31.904834 30186 leader_election.cc:343] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.905284 30186 leader_election.cc:304] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:31.906476 30401 raft_consensus.cc:2749] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:31.916679 30344 tablet_bootstrap.cc:492] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:31.917322 30344 ts_tablet_manager.cc:1403] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.012s
I20260709 12:20:31.920491 30344 raft_consensus.cc:359] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.921231 30344 raft_consensus.cc:385] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.921499 30344 raft_consensus.cc:740] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.922178 30342 tablet_bootstrap.cc:492] T 1efc41cad99a42d5a67d2db6d27a9061 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:31.922688 30342 ts_tablet_manager.cc:1403] T 1efc41cad99a42d5a67d2db6d27a9061 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.005s
I20260709 12:20:31.923174 30343 tablet_bootstrap.cc:654] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.923774 30401 raft_consensus.cc:493] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.924245 30401 raft_consensus.cc:515] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.925315 30342 raft_consensus.cc:359] T 1efc41cad99a42d5a67d2db6d27a9061 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.926039 30344 consensus_queue.cc:260] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.926398 30401 leader_election.cc:290] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:31.926668 30342 raft_consensus.cc:385] T 1efc41cad99a42d5a67d2db6d27a9061 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.927062 30342 raft_consensus.cc:740] T 1efc41cad99a42d5a67d2db6d27a9061 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.927881 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0b7d6a4d5d4eb1a1c115b60981d41c" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:31.927735 30342 consensus_queue.cc:260] T 1efc41cad99a42d5a67d2db6d27a9061 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.928612 30344 ts_tablet_manager.cc:1434] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:20:31.929988 30342 ts_tablet_manager.cc:1434] T 1efc41cad99a42d5a67d2db6d27a9061 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:20:31.930975 30342 tablet_bootstrap.cc:492] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:31.927670 30400 consensus_queue.cc:1048] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:20:31.930564 30351 raft_consensus.cc:493] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.950206 30351 raft_consensus.cc:515] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.932221 30401 raft_consensus.cc:493] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.931259 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0b7d6a4d5d4eb1a1c115b60981d41c" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:31.951527 30401 raft_consensus.cc:515] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:31.957331 30342 tablet_bootstrap.cc:654] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:31.959553 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f47831b773245faa71c01cb8c967a7a" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:31.960109 30401 leader_election.cc:290] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:31.960251 30148 raft_consensus.cc:2468] T 8f47831b773245faa71c01cb8c967a7a P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 0.
W20260709 12:20:31.930851 30189 leader_election.cc:343] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:31.962639 30188 leader_election.cc:343] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.963888 30188 leader_election.cc:304] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:31.964685 30407 raft_consensus.cc:2749] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:31.965474 30186 leader_election.cc:304] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:31.966421 30407 raft_consensus.cc:2804] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:31.966789 30407 raft_consensus.cc:493] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.967114 30407 raft_consensus.cc:3060] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.968647 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f47831b773245faa71c01cb8c967a7a" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:31.969678 30072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efc41cad99a42d5a67d2db6d27a9061" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
W20260709 12:20:31.971271 30262 leader_election.cc:343] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.971669 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efc41cad99a42d5a67d2db6d27a9061" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:31.971894 30351 leader_election.cc:290] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:31.948436 30343 tablet_bootstrap.cc:492] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:31.972388 30222 raft_consensus.cc:2468] T 1efc41cad99a42d5a67d2db6d27a9061 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
W20260709 12:20:31.972524 30188 leader_election.cc:343] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.973486 30343 ts_tablet_manager.cc:1403] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.000s
I20260709 12:20:31.977643 30261 leader_election.cc:304] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:31.978576 30351 raft_consensus.cc:493] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.978948 30469 raft_consensus.cc:2804] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:31.930374 30344 tablet_bootstrap.cc:492] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:31.978253 30346 tablet_bootstrap.cc:492] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:31.979969 30346 ts_tablet_manager.cc:1403] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.089s	user 0.027s	sys 0.004s
I20260709 12:20:31.979415 30469 raft_consensus.cc:493] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.984422 30469 raft_consensus.cc:3060] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:31.979096 30351 raft_consensus.cc:515] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:31.988497 30351 leader_election.cc:290] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:31.992789 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caa8a59f42477199989f2612bb7136" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:31.993367 30379 consensus_queue.cc:1048] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:20:31.994316 30260 leader_election.cc:343] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:31.995396 30469 raft_consensus.cc:515] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:31.997258 30343 raft_consensus.cc:359] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:31.998010 30343 raft_consensus.cc:385] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:31.998380 30343 raft_consensus.cc:740] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:31.998973 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efc41cad99a42d5a67d2db6d27a9061" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:31.999039 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efc41cad99a42d5a67d2db6d27a9061" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:31.999917 30222 raft_consensus.cc:3060] T 1efc41cad99a42d5a67d2db6d27a9061 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:32.000669 30262 leader_election.cc:343] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:32.007606 30222 raft_consensus.cc:2468] T 1efc41cad99a42d5a67d2db6d27a9061 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:32.008167 30343 consensus_queue.cc:260] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.011746 30261 leader_election.cc:304] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:31.997944 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caa8a59f42477199989f2612bb7136" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:32.012694 30351 raft_consensus.cc:2804] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:32.013415 30351 raft_consensus.cc:697] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
W20260709 12:20:32.013455 30262 leader_election.cc:343] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:32.014045 30262 leader_election.cc:304] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:32.014729 30470 raft_consensus.cc:2749] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:32.014405 30351 consensus_queue.cc:237] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:32.016975 30343 ts_tablet_manager.cc:1434] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:20:32.018031 30343 tablet_bootstrap.cc:492] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:31.977697 30407 raft_consensus.cc:515] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.020042 30407 leader_election.cc:290] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:32.021975 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f47831b773245faa71c01cb8c967a7a" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:32.021883 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f47831b773245faa71c01cb8c967a7a" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:32.028432 30148 raft_consensus.cc:3060] T 8f47831b773245faa71c01cb8c967a7a P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:32.029129 30188 leader_election.cc:343] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:32.034921 30148 raft_consensus.cc:2468] T 8f47831b773245faa71c01cb8c967a7a P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
I20260709 12:20:32.036303 30186 leader_election.cc:304] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:32.024085 30344 tablet_bootstrap.cc:654] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.024794 30346 raft_consensus.cc:359] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.038020 30346 raft_consensus.cc:385] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.038254 30346 raft_consensus.cc:740] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.027678 30342 tablet_bootstrap.cc:492] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:32.038401 30470 consensus_queue.cc:1048] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:32.025887 30469 leader_election.cc:290] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:32.037513 30407 raft_consensus.cc:2804] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:32.039932 30346 consensus_queue.cc:260] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.041182 30407 raft_consensus.cc:697] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:32.042646 30407 consensus_queue.cc:237] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.045750 30346 ts_tablet_manager.cc:1434] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.001s
I20260709 12:20:32.046976 30346 tablet_bootstrap.cc:492] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:32.038887 30342 ts_tablet_manager.cc:1403] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.108s	user 0.018s	sys 0.017s
I20260709 12:20:32.047086 30398 raft_consensus.cc:493] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.048015 30398 raft_consensus.cc:515] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.050786 30342 raft_consensus.cc:359] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:32.051647 30342 raft_consensus.cc:385] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.051940 30342 raft_consensus.cc:740] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.053198 30398 leader_election.cc:290] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:32.054776 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5da70c81d654d3e9e50fa2778189857" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:32.052680 30342 consensus_queue.cc:260] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:32.059974 30342 ts_tablet_manager.cc:1434] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:20:32.062253 30342 tablet_bootstrap.cc:492] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:32.065780 30469 consensus_queue.cc:1048] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:32.067134 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5da70c81d654d3e9e50fa2778189857" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:32.068984 30038 leader_election.cc:304] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:32.070394 30346 tablet_bootstrap.cc:654] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.037671 30343 tablet_bootstrap.cc:654] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.070389 30398 raft_consensus.cc:2749] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:32.093720 30346 tablet_bootstrap.cc:492] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:32.094270 30346 ts_tablet_manager.cc:1403] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.002s
I20260709 12:20:32.095867 30149 raft_consensus.cc:3060] T 438c3adce9a646b8944ac27608e94314 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.096971 30074 raft_consensus.cc:3060] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.105423 29969 catalog_manager.cc:5697] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 1 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:32.107787 30342 tablet_bootstrap.cc:654] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.115943 30346 raft_consensus.cc:359] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.116699 30346 raft_consensus.cc:385] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.116945 30346 raft_consensus.cc:740] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.117692 30346 consensus_queue.cc:260] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.118489 29972 catalog_manager.cc:5697] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:32.120052 30346 ts_tablet_manager.cc:1434] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 12:20:32.120838 30297 raft_consensus.cc:3060] T 3a289b0636994e34965a2dc0137e5b94 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.121307 30346 tablet_bootstrap.cc:492] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:32.127997 30346 tablet_bootstrap.cc:654] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.132692 30407 raft_consensus.cc:493] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.133296 30407 raft_consensus.cc:515] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:32.135555 30445 consensus_queue.cc:1048] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:32.136304 30344 tablet_bootstrap.cc:492] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:32.136826 30344 ts_tablet_manager.cc:1403] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.207s	user 0.025s	sys 0.011s
I20260709 12:20:32.136994 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3664ea9a740d4d4eaa2ba8371126d21b" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:32.137554 30511 consensus_queue.cc:1048] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:20:32.141614 30188 leader_election.cc:343] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:32.135576 30407 leader_election.cc:290] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:32.158157 30398 raft_consensus.cc:493] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.158805 30398 raft_consensus.cc:515] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.161110 30398 leader_election.cc:290] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:32.141664 30295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3664ea9a740d4d4eaa2ba8371126d21b" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
W20260709 12:20:32.166231 30189 leader_election.cc:343] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:32.172631 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caa8a59f42477199989f2612bb7136" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:32.172816 30189 leader_election.cc:304] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:32.173403 30147 raft_consensus.cc:2468] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 0.
I20260709 12:20:32.174482 30407 raft_consensus.cc:2749] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:32.162755 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caa8a59f42477199989f2612bb7136" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:32.174512 30343 tablet_bootstrap.cc:492] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:32.176574 30343 ts_tablet_manager.cc:1403] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.159s	user 0.021s	sys 0.011s
I20260709 12:20:32.178233 30293 raft_consensus.cc:2468] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 0.
I20260709 12:20:32.178437 30344 raft_consensus.cc:359] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:32.179204 30344 raft_consensus.cc:385] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.179473 30344 raft_consensus.cc:740] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.175346 30037 leader_election.cc:304] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:32.180104 30344 consensus_queue.cc:260] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:32.180579 30461 raft_consensus.cc:2804] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:32.178966 30342 tablet_bootstrap.cc:492] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:32.181350 30342 ts_tablet_manager.cc:1403] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.119s	user 0.020s	sys 0.009s
I20260709 12:20:32.181648 30343 raft_consensus.cc:359] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:32.181026 30461 raft_consensus.cc:493] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.185108 30343 raft_consensus.cc:385] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.185554 30343 raft_consensus.cc:740] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.187626 30346 tablet_bootstrap.cc:492] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:32.188254 30346 ts_tablet_manager.cc:1403] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.017s
I20260709 12:20:32.189404 30343 consensus_queue.cc:260] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:32.193851 30344 ts_tablet_manager.cc:1434] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.002s
I20260709 12:20:32.196952 30344 tablet_bootstrap.cc:492] T 9c98f7fba9544225a8c7e515247ec5c9 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:32.192281 30407 consensus_queue.cc:1048] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:20:32.187278 30461 raft_consensus.cc:3060] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.201574 30342 raft_consensus.cc:359] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:32.191690 30398 raft_consensus.cc:493] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.226161 30398 raft_consensus.cc:515] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:32.228451 30398 leader_election.cc:290] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:32.205451 30346 raft_consensus.cc:359] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.229671 30346 raft_consensus.cc:385] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.230839 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17f97873bb48ca864a13321c11f401" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:32.231537 30297 raft_consensus.cc:2468] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 0.
I20260709 12:20:32.210345 30445 consensus_queue.cc:1048] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:32.232996 30040 leader_election.cc:304] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:32.233302 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17f97873bb48ca864a13321c11f401" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:32.234141 30222 raft_consensus.cc:2468] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 0.
I20260709 12:20:32.212441 30343 ts_tablet_manager.cc:1434] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:20:32.234323 30398 raft_consensus.cc:2804] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:32.230019 30346 raft_consensus.cc:740] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.238377 30342 raft_consensus.cc:385] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.244773 30343 tablet_bootstrap.cc:492] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:32.245000 30342 raft_consensus.cc:740] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.244823 30346 consensus_queue.cc:260] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.246088 30342 consensus_queue.cc:260] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:32.247284 30346 ts_tablet_manager.cc:1434] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 12:20:32.251397 30343 tablet_bootstrap.cc:654] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.251958 30344 tablet_bootstrap.cc:654] T 9c98f7fba9544225a8c7e515247ec5c9 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.248174 30342 ts_tablet_manager.cc:1434] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.000s
I20260709 12:20:32.245035 30398 raft_consensus.cc:493] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.254910 30398 raft_consensus.cc:3060] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.255234 30346 tablet_bootstrap.cc:492] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:32.254163 30342 tablet_bootstrap.cc:492] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:32.262171 30346 tablet_bootstrap.cc:654] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.271742 30461 raft_consensus.cc:515] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.279930 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caa8a59f42477199989f2612bb7136" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:32.280766 30149 raft_consensus.cc:3060] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.283293 30074 raft_consensus.cc:3060] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.285899 30447 raft_consensus.cc:493] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.286475 30447 raft_consensus.cc:515] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:32.289366 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c55d09601aa4eceaf3916006afcc93a" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:32.290115 30223 raft_consensus.cc:2468] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:32.296294 30398 raft_consensus.cc:515] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:32.298337 30342 tablet_bootstrap.cc:654] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.301316 30113 leader_election.cc:304] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:32.301893 30447 leader_election.cc:290] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:32.302310 30400 raft_consensus.cc:2804] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:32.302743 30400 raft_consensus.cc:493] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.303112 30400 raft_consensus.cc:3060] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.306623 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c55d09601aa4eceaf3916006afcc93a" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:32.289460 30149 raft_consensus.cc:2468] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 1.
W20260709 12:20:32.314239 30115 leader_election.cc:343] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:32.317003 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caa8a59f42477199989f2612bb7136" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:32.317749 30294 raft_consensus.cc:3060] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.321741 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17f97873bb48ca864a13321c11f401" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:32.322456 30223 raft_consensus.cc:3060] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.325058 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17f97873bb48ca864a13321c11f401" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:32.326094 30293 raft_consensus.cc:3060] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.332635 30400 raft_consensus.cc:515] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:32.336079 30293 raft_consensus.cc:2468] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 1.
I20260709 12:20:32.292333 30461 leader_election.cc:290] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:32.348526 30398 leader_election.cc:290] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:32.354833 30040 leader_election.cc:304] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:32.355768 30461 raft_consensus.cc:2804] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:32.356259 30461 raft_consensus.cc:697] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:32.357052 30461 consensus_queue.cc:237] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:32.360275 30344 tablet_bootstrap.cc:492] T 9c98f7fba9544225a8c7e515247ec5c9 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:32.361296 30344 ts_tablet_manager.cc:1403] T 9c98f7fba9544225a8c7e515247ec5c9 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.166s	user 0.023s	sys 0.007s
I20260709 12:20:32.362768 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c55d09601aa4eceaf3916006afcc93a" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:32.360672 30400 leader_election.cc:290] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:32.363436 30222 raft_consensus.cc:3060] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.366075 30037 leader_election.cc:304] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:32.370198 30343 tablet_bootstrap.cc:492] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:32.370814 30343 ts_tablet_manager.cc:1403] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.126s	user 0.037s	sys 0.042s
I20260709 12:20:32.373719 30343 raft_consensus.cc:359] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.374472 30343 raft_consensus.cc:385] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.374763 30343 raft_consensus.cc:740] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.370705 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c55d09601aa4eceaf3916006afcc93a" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:32.376713 30344 raft_consensus.cc:359] T 9c98f7fba9544225a8c7e515247ec5c9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.376924 30343 consensus_queue.cc:260] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.377748 30344 raft_consensus.cc:385] T 9c98f7fba9544225a8c7e515247ec5c9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.378068 30344 raft_consensus.cc:740] T 9c98f7fba9544225a8c7e515247ec5c9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.378881 30344 consensus_queue.cc:260] T 9c98f7fba9544225a8c7e515247ec5c9 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.375659 30398 raft_consensus.cc:2804] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:32.382866 30398 raft_consensus.cc:697] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
W20260709 12:20:32.383244 30115 leader_election.cc:343] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:32.387354 30343 ts_tablet_manager.cc:1434] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 12:20:32.388314 30343 tablet_bootstrap.cc:492] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:32.376407 30294 raft_consensus.cc:2468] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 1.
I20260709 12:20:32.398519 30344 ts_tablet_manager.cc:1434] T 9c98f7fba9544225a8c7e515247ec5c9 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.003s
I20260709 12:20:32.399384 30344 tablet_bootstrap.cc:492] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:32.401060 29970 catalog_manager.cc:5697] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:32.404726 30346 tablet_bootstrap.cc:492] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:32.405217 30346 ts_tablet_manager.cc:1403] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.150s	user 0.006s	sys 0.017s
I20260709 12:20:32.406811 30342 tablet_bootstrap.cc:492] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:32.407370 30342 ts_tablet_manager.cc:1403] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.153s	user 0.009s	sys 0.006s
I20260709 12:20:32.410311 30342 raft_consensus.cc:359] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.411005 30342 raft_consensus.cc:385] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.411285 30342 raft_consensus.cc:740] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.383755 30398 consensus_queue.cc:237] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.412096 30342 consensus_queue.cc:260] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.413542 30346 raft_consensus.cc:359] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:32.414287 30346 raft_consensus.cc:385] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.414539 30346 raft_consensus.cc:740] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.415306 30346 consensus_queue.cc:260] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:32.416143 30222 raft_consensus.cc:2468] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:32.417557 30346 ts_tablet_manager.cc:1434] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.006s
I20260709 12:20:32.417908 30113 leader_election.cc:304] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:32.418603 30346 tablet_bootstrap.cc:492] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:32.418628 30223 raft_consensus.cc:2468] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 1.
I20260709 12:20:32.411212 30344 tablet_bootstrap.cc:654] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.422581 30343 tablet_bootstrap.cc:654] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.426663 30445 raft_consensus.cc:2804] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:32.427321 30445 raft_consensus.cc:697] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:32.428185 30343 tablet_bootstrap.cc:492] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:32.428790 30343 ts_tablet_manager.cc:1403] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.001s
I20260709 12:20:32.432060 30343 raft_consensus.cc:359] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.433022 30343 raft_consensus.cc:385] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.433440 30343 raft_consensus.cc:740] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.428193 30445 consensus_queue.cc:237] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:32.433583 30346 tablet_bootstrap.cc:654] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.428678 30398 raft_consensus.cc:493] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.439713 30398 raft_consensus.cc:515] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.438828 30344 tablet_bootstrap.cc:492] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:32.442698 30344 ts_tablet_manager.cc:1403] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.005s
I20260709 12:20:32.444203 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f47831b773245faa71c01cb8c967a7a" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:32.445115 30149 raft_consensus.cc:2393] T 8f47831b773245faa71c01cb8c967a7a P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a1255131174934a6bca3c0bf000026 in current term 1: Already voted for candidate f3ef588fc4b54ec09355022d7a5a5e86 in this term.
I20260709 12:20:32.446010 30344 raft_consensus.cc:359] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:32.446871 30344 raft_consensus.cc:385] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.447191 30344 raft_consensus.cc:740] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.447805 30342 ts_tablet_manager.cc:1434] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.003s
I20260709 12:20:32.435093 30343 consensus_queue.cc:260] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.448051 30344 consensus_queue.cc:260] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:32.452630 30343 ts_tablet_manager.cc:1434] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 12:20:32.453027 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f47831b773245faa71c01cb8c967a7a" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:32.460704 30343 tablet_bootstrap.cc:492] T 41c11e80998149a79fca99acf176427e P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:32.461529 30038 leader_election.cc:304] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:32.462538 30461 raft_consensus.cc:3060] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.464325 30342 tablet_bootstrap.cc:492] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:32.467438 30343 tablet_bootstrap.cc:654] T 41c11e80998149a79fca99acf176427e P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.453118 30398 leader_election.cc:290] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
W20260709 12:20:32.465656 30020 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:32.473501 30461 raft_consensus.cc:2749] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:32.473721 30346 tablet_bootstrap.cc:492] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:32.474347 30346 ts_tablet_manager.cc:1403] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.004s
I20260709 12:20:32.470757 30342 tablet_bootstrap.cc:654] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.477411 30346 raft_consensus.cc:359] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.478335 30346 raft_consensus.cc:385] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.478739 30346 raft_consensus.cc:740] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.479699 30346 consensus_queue.cc:260] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.459367 30344 ts_tablet_manager.cc:1434] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:20:32.482041 30346 ts_tablet_manager.cc:1434] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:32.482924 30344 tablet_bootstrap.cc:492] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:32.484023 30346 tablet_bootstrap.cc:492] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:32.486698 29968 catalog_manager.cc:5697] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:32.488895 30344 tablet_bootstrap.cc:654] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.490998 30342 tablet_bootstrap.cc:492] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:32.491560 30342 ts_tablet_manager.cc:1403] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 12:20:32.492228 30346 tablet_bootstrap.cc:654] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.457432 29970 catalog_manager.cc:5697] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:32.494650 30342 raft_consensus.cc:359] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.495400 30342 raft_consensus.cc:385] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.494388 30343 tablet_bootstrap.cc:492] T 41c11e80998149a79fca99acf176427e P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:32.495671 30342 raft_consensus.cc:740] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.496578 30342 consensus_queue.cc:260] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.497442 30343 ts_tablet_manager.cc:1403] T 41c11e80998149a79fca99acf176427e P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.037s	user 0.021s	sys 0.003s
I20260709 12:20:32.500592 30343 raft_consensus.cc:359] T 41c11e80998149a79fca99acf176427e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.506012 30343 raft_consensus.cc:385] T 41c11e80998149a79fca99acf176427e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.502557 30342 ts_tablet_manager.cc:1434] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:20:32.503558 30346 tablet_bootstrap.cc:492] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:32.506358 30343 raft_consensus.cc:740] T 41c11e80998149a79fca99acf176427e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.507522 30344 tablet_bootstrap.cc:492] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:32.512351 30344 ts_tablet_manager.cc:1403] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.005s
I20260709 12:20:32.513257 30469 raft_consensus.cc:493] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.513823 30469 raft_consensus.cc:515] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:32.515843 30469 leader_election.cc:290] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:32.511899 30343 consensus_queue.cc:260] T 41c11e80998149a79fca99acf176427e P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.517248 30438 raft_consensus.cc:493] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.517491 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3664ea9a740d4d4eaa2ba8371126d21b" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:32.517849 30438 raft_consensus.cc:515] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.519120 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3664ea9a740d4d4eaa2ba8371126d21b" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
W20260709 12:20:32.519237 30262 leader_election.cc:343] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:32.520107 30438 leader_election.cc:290] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:32.520841 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c11e80998149a79fca99acf176427e" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:32.521665 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c11e80998149a79fca99acf176427e" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:32.523977 30149 raft_consensus.cc:2468] T 41c11e80998149a79fca99acf176427e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 0.
W20260709 12:20:32.524204 30188 leader_election.cc:343] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:32.523463 30343 ts_tablet_manager.cc:1434] T 41c11e80998149a79fca99acf176427e P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 12:20:32.525442 30186 leader_election.cc:304] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:32.526645 30343 tablet_bootstrap.cc:492] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:32.527365 30401 raft_consensus.cc:2804] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:32.508226 30346 ts_tablet_manager.cc:1403] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.005s
I20260709 12:20:32.511035 30342 tablet_bootstrap.cc:492] T ea68554f4650455e9aa55638ed533430 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:32.531263 30346 raft_consensus.cc:359] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.532017 30346 raft_consensus.cc:385] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.532292 30346 raft_consensus.cc:740] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.532683 30401 raft_consensus.cc:493] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.533121 30401 raft_consensus.cc:3060] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.535482 30342 tablet_bootstrap.cc:654] T ea68554f4650455e9aa55638ed533430 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.521449 30344 raft_consensus.cc:359] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:32.537184 30344 raft_consensus.cc:385] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.537714 30344 raft_consensus.cc:740] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.538645 30344 consensus_queue.cc:260] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:32.540508 30344 ts_tablet_manager.cc:1434] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.000s
I20260709 12:20:32.542074 30344 tablet_bootstrap.cc:492] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:32.522725 30222 raft_consensus.cc:2468] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:32.546581 30261 leader_election.cc:304] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:32.548038 30344 tablet_bootstrap.cc:654] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.547878 30424 raft_consensus.cc:2804] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:32.550766 30424 raft_consensus.cc:493] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.550917 30343 tablet_bootstrap.cc:654] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.551194 30424 raft_consensus.cc:3060] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.533130 30346 consensus_queue.cc:260] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.540946 30401 raft_consensus.cc:515] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.567855 30346 ts_tablet_manager.cc:1434] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:20:32.568933 30346 tablet_bootstrap.cc:492] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:32.573619 30424 raft_consensus.cc:515] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:32.578209 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c11e80998149a79fca99acf176427e" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
W20260709 12:20:32.579939 30188 leader_election.cc:343] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:32.581003 30074 raft_consensus.cc:3060] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.585811 30342 tablet_bootstrap.cc:492] T ea68554f4650455e9aa55638ed533430 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:32.588750 30342 ts_tablet_manager.cc:1403] T ea68554f4650455e9aa55638ed533430 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.000s
I20260709 12:20:32.588007 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3664ea9a740d4d4eaa2ba8371126d21b" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:32.587060 30400 raft_consensus.cc:493] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:32.590706 30262 leader_election.cc:343] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:32.589118 30424 leader_election.cc:290] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:32.591605 30400 raft_consensus.cc:515] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.594445 30342 raft_consensus.cc:359] T ea68554f4650455e9aa55638ed533430 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.594990 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c98f7fba9544225a8c7e515247ec5c9" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:32.595234 30342 raft_consensus.cc:385] T ea68554f4650455e9aa55638ed533430 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.595512 30342 raft_consensus.cc:740] T ea68554f4650455e9aa55638ed533430 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.595649 30294 raft_consensus.cc:2468] T 9c98f7fba9544225a8c7e515247ec5c9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:32.596568 30400 leader_election.cc:290] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:32.597129 30115 leader_election.cc:304] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:32.598057 30400 raft_consensus.cc:2804] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:32.598448 30400 raft_consensus.cc:493] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.598783 30344 tablet_bootstrap.cc:492] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:32.598382 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c98f7fba9544225a8c7e515247ec5c9" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:32.598999 30400 raft_consensus.cc:3060] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.590950 30438 consensus_queue.cc:1048] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:32.599830 30343 tablet_bootstrap.cc:492] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:32.599331 30073 raft_consensus.cc:2468] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:32.600353 30343 ts_tablet_manager.cc:1403] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.075s	user 0.016s	sys 0.025s
I20260709 12:20:32.598280 30342 consensus_queue.cc:260] T ea68554f4650455e9aa55638ed533430 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.602356 30342 ts_tablet_manager.cc:1434] T ea68554f4650455e9aa55638ed533430 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:20:32.599277 30344 ts_tablet_manager.cc:1403] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.057s	user 0.035s	sys 0.015s
I20260709 12:20:32.603150 30343 raft_consensus.cc:359] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.603868 30343 raft_consensus.cc:385] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.604122 30343 raft_consensus.cc:740] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.586177 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3664ea9a740d4d4eaa2ba8371126d21b" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:32.604773 30343 consensus_queue.cc:260] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.605247 30344 raft_consensus.cc:359] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:32.606079 30344 raft_consensus.cc:385] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.606388 30344 raft_consensus.cc:740] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.607236 30343 ts_tablet_manager.cc:1434] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:32.607120 30344 consensus_queue.cc:260] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:32.607327 30379 raft_consensus.cc:493] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.607981 30379 raft_consensus.cc:515] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.609361 30344 ts_tablet_manager.cc:1434] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:20:32.610160 30379 leader_election.cc:290] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:32.611007 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea68554f4650455e9aa55638ed533430" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:32.611778 30073 raft_consensus.cc:2468] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:32.613590 30114 leader_election.cc:304] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:32.605641 30222 raft_consensus.cc:3060] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.616353 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c11e80998149a79fca99acf176427e" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:32.617041 30148 raft_consensus.cc:3060] T 41c11e80998149a79fca99acf176427e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.618053 30400 raft_consensus.cc:515] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.614883 30401 leader_election.cc:290] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:32.615622 30344 tablet_bootstrap.cc:492] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:32.621316 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c98f7fba9544225a8c7e515247ec5c9" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:32.621999 30294 raft_consensus.cc:3060] T 9c98f7fba9544225a8c7e515247ec5c9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.623574 30424 consensus_queue.cc:1048] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:32.628463 30424 consensus_queue.cc:1048] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:32.630509 30469 raft_consensus.cc:493] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.631196 30469 raft_consensus.cc:515] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:32.633558 30469 leader_election.cc:290] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:32.638315 30343 tablet_bootstrap.cc:492] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:32.639004 30342 tablet_bootstrap.cc:492] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:32.631150 30401 raft_consensus.cc:493] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.620436 30400 leader_election.cc:290] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:32.662422 30511 consensus_queue.cc:1048] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:32.645921 30445 raft_consensus.cc:2804] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:32.650236 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea68554f4650455e9aa55638ed533430" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:32.667871 30445 raft_consensus.cc:493] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.654103 30401 raft_consensus.cc:515] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.669354 30438 raft_consensus.cc:493] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.668709 30220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c571ad30094eb3ac0b270c6a3c6a28" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:32.672550 30223 raft_consensus.cc:2468] T ea68554f4650455e9aa55638ed533430 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:32.683087 30220 raft_consensus.cc:2468] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:32.675966 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c98f7fba9544225a8c7e515247ec5c9" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:32.687579 30346 tablet_bootstrap.cc:654] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.678368 30445 raft_consensus.cc:3060] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.690038 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c571ad30094eb3ac0b270c6a3c6a28" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:32.690913 30073 raft_consensus.cc:3060] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.682188 30438 raft_consensus.cc:515] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
W20260709 12:20:32.701660 30260 leader_election.cc:343] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:32.713265 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad560d215f8475ab9f93ff568eef9f9" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
W20260709 12:20:32.715381 30186 leader_election.cc:343] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:32.716799 30261 leader_election.cc:304] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:32.718189 30424 raft_consensus.cc:2804] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:32.718596 30424 raft_consensus.cc:493] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.721385 30424 raft_consensus.cc:3060] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:32.723151 30438 leader_election.cc:290] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:32.701104 30148 raft_consensus.cc:2468] T 41c11e80998149a79fca99acf176427e P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
I20260709 12:20:32.739557 30071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad560d215f8475ab9f93ff568eef9f9" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:32.739287 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c2af5bb5b548d8855b05242cb9d33c" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:32.754665 30342 tablet_bootstrap.cc:654] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.728587 30294 raft_consensus.cc:2468] T 9c98f7fba9544225a8c7e515247ec5c9 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
W20260709 12:20:32.755913 30189 leader_election.cc:343] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:32.757445 30222 raft_consensus.cc:2468] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:32.761940 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c2af5bb5b548d8855b05242cb9d33c" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
W20260709 12:20:32.765849 30261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:44035, user_credentials={real_user=slave}} blocked reactor thread for 49159.8us
I20260709 12:20:32.769012 30186 leader_election.cc:304] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:32.788210 30344 tablet_bootstrap.cc:654] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:32.791778 30188 leader_election.cc:343] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:32.792337 30188 leader_election.cc:304] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:32.783560 30115 leader_election.cc:304] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:32.797356 30552 raft_consensus.cc:2804] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:32.798005 30552 raft_consensus.cc:697] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:32.798892 30552 consensus_queue.cc:237] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:32.798885 30511 raft_consensus.cc:2749] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:32.783968 30401 leader_election.cc:290] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:32.807431 30400 raft_consensus.cc:2804] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:32.809052 30400 raft_consensus.cc:697] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:32.812361 30398 consensus_queue.cc:1048] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:32.813896 30261 leader_election.cc:304] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:32.812764 30343 tablet_bootstrap.cc:654] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:32.818059 30186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:40479, user_credentials={real_user=slave}} blocked reactor thread for 52888.4us
I20260709 12:20:32.837574 30398 consensus_queue.cc:1048] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:32.841648 30551 raft_consensus.cc:2804] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:32.847407 30551 raft_consensus.cc:697] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:32.841574 30400 consensus_queue.cc:237] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
W20260709 12:20:32.857546 30186 leader_election.cc:343] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:32.858136 30186 leader_election.cc:304] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:32.869849 30342 tablet_bootstrap.cc:492] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:32.870401 30342 ts_tablet_manager.cc:1403] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.232s	user 0.017s	sys 0.007s
I20260709 12:20:32.866518 30073 raft_consensus.cc:2468] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:32.877867 30424 raft_consensus.cc:515] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:32.877995 30554 raft_consensus.cc:2749] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:32.922063 30398 raft_consensus.cc:493] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.922672 30398 raft_consensus.cc:515] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:32.924124 30342 raft_consensus.cc:359] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:32.924844 30342 raft_consensus.cc:385] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.925153 30342 raft_consensus.cc:740] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.930601 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b981cc4916444c0a31e5fd3b14aaa67" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:32.930970 30445 raft_consensus.cc:515] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
W20260709 12:20:32.932561 30559 log.cc:927] Time spent T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:20:32.937330 30040 leader_election.cc:343] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:32.938699 30342 consensus_queue.cc:260] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:32.942195 30342 ts_tablet_manager.cc:1434] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 12:20:32.924775 30398 leader_election.cc:290] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:32.945375 30344 tablet_bootstrap.cc:492] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:32.945986 30344 ts_tablet_manager.cc:1403] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.331s	user 0.023s	sys 0.005s
I20260709 12:20:32.950465 30344 raft_consensus.cc:359] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:32.951387 30344 raft_consensus.cc:385] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:32.951689 30344 raft_consensus.cc:740] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:32.952548 30344 consensus_queue.cc:260] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:32.955166 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b981cc4916444c0a31e5fd3b14aaa67" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:32.955428 30344 ts_tablet_manager.cc:1434] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:20:32.956709 30344 tablet_bootstrap.cc:492] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:32.871364 30551 consensus_queue.cc:237] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:32.964342 30344 tablet_bootstrap.cc:654] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:32.974548 30445 leader_election.cc:290] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:32.975397 30445 consensus_queue.cc:1048] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:32.982316 30561 raft_consensus.cc:493] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.982911 30561 raft_consensus.cc:515] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:32.985205 30561 leader_election.cc:290] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:32.951068 30461 consensus_queue.cc:1048] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 12:20:32.997732 30294 raft_consensus.cc:3060] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:33.005860 30114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:43571, user_credentials={real_user=slave}} blocked reactor thread for 71584.5us
I20260709 12:20:33.008648 30346 tablet_bootstrap.cc:492] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
W20260709 12:20:33.015406 30113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:44035, user_credentials={real_user=slave}} blocked reactor thread for 77477.4us
I20260709 12:20:33.016003 30346 ts_tablet_manager.cc:1403] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.447s	user 0.018s	sys 0.035s
I20260709 12:20:33.019186 30346 raft_consensus.cc:359] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:33.019445 30220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea68554f4650455e9aa55638ed533430" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:33.019932 30346 raft_consensus.cc:385] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.014672 30343 tablet_bootstrap.cc:492] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:33.020752 30220 raft_consensus.cc:3060] T ea68554f4650455e9aa55638ed533430 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.022661 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c55d09601aa4eceaf3916006afcc93a" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:33.023489 30223 raft_consensus.cc:2393] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6c1f7275e654f49abaf1c80ed662511 in current term 1: Already voted for candidate b0439d4e94904196847cd825fcc8ebd7 in this term.
I20260709 12:20:33.025840 30343 ts_tablet_manager.cc:1403] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.388s	user 0.014s	sys 0.010s
I20260709 12:20:33.021314 30346 raft_consensus.cc:740] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.027348 30346 consensus_queue.cc:260] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:33.028940 30342 tablet_bootstrap.cc:492] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:33.019411 30569 raft_consensus.cc:493] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.020833 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c55d09601aa4eceaf3916006afcc93a" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:33.043362 30351 raft_consensus.cc:493] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.044087 30351 raft_consensus.cc:515] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:33.063338 30346 ts_tablet_manager.cc:1434] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.047s	user 0.014s	sys 0.009s
I20260709 12:20:33.064327 30346 tablet_bootstrap.cc:492] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
W20260709 12:20:33.055233 30040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:33729, user_credentials={real_user=slave}} blocked reactor thread for 113356us
W20260709 12:20:33.053704 30037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:40479, user_credentials={real_user=slave}} blocked reactor thread for 89731us
I20260709 12:20:33.048034 30569 raft_consensus.cc:515] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.069077 30260 leader_election.cc:304] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c1f7275e654f49abaf1c80ed662511; no voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:33.069279 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0b7d6a4d5d4eb1a1c115b60981d41c" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:33.070055 30221 raft_consensus.cc:2468] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:33.074683 30220 raft_consensus.cc:2468] T ea68554f4650455e9aa55638ed533430 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:33.075805 30351 leader_election.cc:290] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:33.078681 30445 consensus_queue.cc:1048] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:33.077607 30351 raft_consensus.cc:2749] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:33.082170 30037 leader_election.cc:343] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:33.089293 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c571ad30094eb3ac0b270c6a3c6a28" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:33.094913 30261 leader_election.cc:304] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:33.094976 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea68554f4650455e9aa55638ed533430" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:33.095803 30074 raft_consensus.cc:3060] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.087775 30424 leader_election.cc:290] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:33.096757 30424 raft_consensus.cc:2804] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:33.097098 30424 raft_consensus.cc:493] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.097447 30424 raft_consensus.cc:3060] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.098969 29969 catalog_manager.cc:5697] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:33.094980 30220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c571ad30094eb3ac0b270c6a3c6a28" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:33.125304 30220 raft_consensus.cc:3060] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.100042 30037 leader_election.cc:304] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
W20260709 12:20:33.126371 30567 log.cc:927] Time spent T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:20:33.120254 30113 leader_election.cc:304] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:33.114517 29968 catalog_manager.cc:5697] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 1 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:33.134083 30574 raft_consensus.cc:2749] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:33.129581 30260 leader_election.cc:343] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:33.136071 30570 raft_consensus.cc:2804] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:20:33.133426 30037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:40479, user_credentials={real_user=slave}} blocked reactor thread for 59771.3us
I20260709 12:20:33.137096 30570 raft_consensus.cc:697] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:33.138036 30570 consensus_queue.cc:237] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:33.140890 30220 raft_consensus.cc:2468] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:33.147516 30344 tablet_bootstrap.cc:492] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:33.148272 30344 ts_tablet_manager.cc:1403] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.192s	user 0.009s	sys 0.008s
I20260709 12:20:33.157255 30342 tablet_bootstrap.cc:654] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.159137 30343 raft_consensus.cc:359] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:33.161449 30343 raft_consensus.cc:385] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.161707 30343 raft_consensus.cc:740] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.162395 30343 consensus_queue.cc:260] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:33.172348 30346 tablet_bootstrap.cc:654] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.154999 30424 raft_consensus.cc:515] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:33.176050 30343 ts_tablet_manager.cc:1434] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.147s	user 0.007s	sys 0.000s
I20260709 12:20:33.177865 30074 raft_consensus.cc:2468] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:33.179205 30343 tablet_bootstrap.cc:492] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:33.166006 30261 leader_election.cc:304] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:33.183728 30351 raft_consensus.cc:2804] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:33.184286 30351 raft_consensus.cc:697] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:33.185150 30351 consensus_queue.cc:237] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:33.194553 30569 leader_election.cc:290] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:33.195567 30343 tablet_bootstrap.cc:654] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.197888 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f28aae897045be9eed015c98ba6908" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:33.198058 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0b7d6a4d5d4eb1a1c115b60981d41c" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:33.198633 30073 raft_consensus.cc:2468] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:33.195004 30344 raft_consensus.cc:359] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.201046 30344 raft_consensus.cc:385] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.201381 30344 raft_consensus.cc:740] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.207053 30344 consensus_queue.cc:260] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.217396 30424 leader_election.cc:290] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:33.220712 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0b7d6a4d5d4eb1a1c115b60981d41c" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:33.221488 30074 raft_consensus.cc:3060] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:33.222970 30115 leader_election.cc:343] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:33.203394 30572 consensus_queue.cc:1048] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:20:33.229984 30344 ts_tablet_manager.cc:1434] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
I20260709 12:20:33.231448 30344 tablet_bootstrap.cc:492] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:33.236809 30220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0b7d6a4d5d4eb1a1c115b60981d41c" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:33.237582 30220 raft_consensus.cc:3060] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.244277 30344 tablet_bootstrap.cc:654] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.248634 30220 raft_consensus.cc:2468] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:33.250358 30261 leader_election.cc:304] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:33.251284 30424 raft_consensus.cc:2804] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:33.251760 30424 raft_consensus.cc:697] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:33.252568 30424 consensus_queue.cc:237] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:33.257500 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f28aae897045be9eed015c98ba6908" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:33.262576 29970 catalog_manager.cc:5697] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:33.273255 30342 tablet_bootstrap.cc:492] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:33.273878 30342 ts_tablet_manager.cc:1403] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.245s	user 0.020s	sys 0.015s
I20260709 12:20:33.276543 30342 raft_consensus.cc:359] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:33.277247 30342 raft_consensus.cc:385] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.277515 30342 raft_consensus.cc:740] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.279621 30344 tablet_bootstrap.cc:492] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:33.280311 30552 raft_consensus.cc:493] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.284013 30552 raft_consensus.cc:515] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:33.284135 30342 consensus_queue.cc:260] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
W20260709 12:20:33.285615 30114 leader_election.cc:343] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:33.286217 30114 leader_election.cc:304] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7; no voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:33.286437 30552 leader_election.cc:290] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:33.287513 30445 raft_consensus.cc:2749] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:33.289072 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd853575cf54f3f91608d485c3d16ca" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:33.290416 30342 ts_tablet_manager.cc:1434] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:20:33.290496 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd853575cf54f3f91608d485c3d16ca" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:33.291536 30342 tablet_bootstrap.cc:492] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
W20260709 12:20:33.292217 30189 leader_election.cc:343] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:33.280784 30188 consensus_peers.cc:597] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:33.293257 30186 leader_election.cc:343] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:33.293758 30344 ts_tablet_manager.cc:1403] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.063s	user 0.009s	sys 0.003s
I20260709 12:20:33.293732 30186 leader_election.cc:304] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:33.295521 30552 raft_consensus.cc:2749] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:33.306337 30445 consensus_queue.cc:1048] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:33.307529 30074 raft_consensus.cc:2468] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:33.308018 30400 consensus_queue.cc:1048] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:33.310622 30342 tablet_bootstrap.cc:654] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.327461 30343 tablet_bootstrap.cc:492] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:33.327999 30343 ts_tablet_manager.cc:1403] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.149s	user 0.014s	sys 0.006s
I20260709 12:20:33.328254 30344 raft_consensus.cc:359] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.330526 30344 raft_consensus.cc:385] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.330825 30344 raft_consensus.cc:740] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.333794 30344 consensus_queue.cc:260] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.337625 30344 ts_tablet_manager.cc:1434] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.043s	user 0.003s	sys 0.007s
I20260709 12:20:33.350752 30342 tablet_bootstrap.cc:492] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:33.349118 30343 raft_consensus.cc:359] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.351603 30342 ts_tablet_manager.cc:1403] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.013s
I20260709 12:20:33.352363 30343 raft_consensus.cc:385] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.353057 30343 raft_consensus.cc:740] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.354614 30343 consensus_queue.cc:260] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.355366 30342 raft_consensus.cc:359] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:33.356161 30342 raft_consensus.cc:385] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.356483 30342 raft_consensus.cc:740] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.356817 30343 ts_tablet_manager.cc:1434] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 12:20:33.357358 30342 consensus_queue.cc:260] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:33.358304 30401 consensus_queue.cc:1048] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:33.361286 30343 tablet_bootstrap.cc:492] T 64c571ad30094eb3ac0b270c6a3c6a28 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:33.367338 30346 tablet_bootstrap.cc:492] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:33.367929 30346 ts_tablet_manager.cc:1403] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.304s	user 0.022s	sys 0.022s
I20260709 12:20:33.376310 30344 tablet_bootstrap.cc:492] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:33.374514 30346 raft_consensus.cc:359] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:33.377547 30346 raft_consensus.cc:385] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.378196 30346 raft_consensus.cc:740] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.379132 30346 consensus_queue.cc:260] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:33.382056 30346 ts_tablet_manager.cc:1434] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:20:33.383121 30346 tablet_bootstrap.cc:492] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:33.368080 29968 catalog_manager.cc:5697] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:33.380162 30343 tablet_bootstrap.cc:654] T 64c571ad30094eb3ac0b270c6a3c6a28 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.394778 30342 ts_tablet_manager.cc:1434] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:20:33.398546 30342 tablet_bootstrap.cc:492] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:33.399657 30572 raft_consensus.cc:493] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.400213 30572 raft_consensus.cc:515] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:33.400851 30552 raft_consensus.cc:493] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.401432 30552 raft_consensus.cc:515] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:33.402626 30572 leader_election.cc:290] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:33.403753 30552 leader_election.cc:290] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:33.406033 30220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3664ea9a740d4d4eaa2ba8371126d21b" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:33.407006 30220 raft_consensus.cc:2393] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a1255131174934a6bca3c0bf000026 in current term 1: Already voted for candidate f6c1f7275e654f49abaf1c80ed662511 in this term.
I20260709 12:20:33.408399 30344 tablet_bootstrap.cc:654] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.410351 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3664ea9a740d4d4eaa2ba8371126d21b" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:33.411576 30346 tablet_bootstrap.cc:654] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.406105 30072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3111cf2203d14eb8a006d35fee44552e" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:33.415215 30342 tablet_bootstrap.cc:654] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.417152 30038 leader_election.cc:304] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:33.418673 30572 raft_consensus.cc:3060] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:33.420425 30188 leader_election.cc:343] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:33.423281 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3111cf2203d14eb8a006d35fee44552e" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:33.427974 30343 tablet_bootstrap.cc:492] T 64c571ad30094eb3ac0b270c6a3c6a28 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:33.428531 30343 ts_tablet_manager.cc:1403] T 64c571ad30094eb3ac0b270c6a3c6a28 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.004s
I20260709 12:20:33.431270 30343 raft_consensus.cc:359] T 64c571ad30094eb3ac0b270c6a3c6a28 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:33.431980 30343 raft_consensus.cc:385] T 64c571ad30094eb3ac0b270c6a3c6a28 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.432261 30343 raft_consensus.cc:740] T 64c571ad30094eb3ac0b270c6a3c6a28 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
W20260709 12:20:33.433059 30186 leader_election.cc:343] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:33.432896 30343 consensus_queue.cc:260] T 64c571ad30094eb3ac0b270c6a3c6a28 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:33.433578 30186 leader_election.cc:304] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:33.435046 30552 raft_consensus.cc:2749] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:33.436055 30346 tablet_bootstrap.cc:492] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:33.436600 30346 ts_tablet_manager.cc:1403] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.000s
I20260709 12:20:33.437695 30447 raft_consensus.cc:493] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.438287 30447 raft_consensus.cc:515] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:33.439347 30344 tablet_bootstrap.cc:492] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:33.439875 30344 ts_tablet_manager.cc:1403] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.000s
I20260709 12:20:33.440397 30447 leader_election.cc:290] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:33.441159 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad560d215f8475ab9f93ff568eef9f9" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:33.442021 30220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad560d215f8475ab9f93ff568eef9f9" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:33.442764 30220 raft_consensus.cc:2468] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:33.444156 30113 leader_election.cc:304] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:33.445122 30447 raft_consensus.cc:2804] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:33.445526 30447 raft_consensus.cc:493] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.445911 30447 raft_consensus.cc:3060] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.442121 30572 raft_consensus.cc:2749] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:33.448199 30557 raft_consensus.cc:493] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.448725 30557 raft_consensus.cc:515] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:33.447629 30344 raft_consensus.cc:359] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
W20260709 12:20:33.450434 30114 leader_election.cc:343] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:33.450857 30557 leader_election.cc:290] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:33.449890 30346 raft_consensus.cc:359] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:33.456286 30346 raft_consensus.cc:385] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.456661 30346 raft_consensus.cc:740] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.452498 30343 ts_tablet_manager.cc:1434] T 64c571ad30094eb3ac0b270c6a3c6a28 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:20:33.452620 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8157cddb556437c85c52ceb0ec7b614" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:33.457392 29970 catalog_manager.cc:5697] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 1 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:33.458670 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8157cddb556437c85c52ceb0ec7b614" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:33.458818 30346 consensus_queue.cc:260] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:33.459298 29970 catalog_manager.cc:5697] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 1 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:33.458315 30343 tablet_bootstrap.cc:492] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
W20260709 12:20:33.460109 30188 leader_election.cc:343] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:33.460251 30351 raft_consensus.cc:493] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.460820 30351 raft_consensus.cc:515] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.461498 30346 ts_tablet_manager.cc:1434] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:20:33.462572 30346 tablet_bootstrap.cc:492] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:33.463057 30351 leader_election.cc:290] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:33.451143 30344 raft_consensus.cc:385] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.468878 30344 raft_consensus.cc:740] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.469070 30343 tablet_bootstrap.cc:654] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.465422 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b981cc4916444c0a31e5fd3b14aaa67" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:33.469966 30074 raft_consensus.cc:2468] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:33.471261 30262 leader_election.cc:304] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:33.475360 30346 tablet_bootstrap.cc:654] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.477941 30351 raft_consensus.cc:2804] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:33.478413 30351 raft_consensus.cc:493] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.478780 30351 raft_consensus.cc:3060] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.481622 30343 tablet_bootstrap.cc:492] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:33.482386 30343 ts_tablet_manager.cc:1403] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 12:20:33.466223 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b981cc4916444c0a31e5fd3b14aaa67" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:33.466769 30447 raft_consensus.cc:515] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:33.485805 30343 raft_consensus.cc:359] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:33.486896 30343 raft_consensus.cc:385] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.487301 30343 raft_consensus.cc:740] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.487891 30447 leader_election.cc:290] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:33.488204 30343 consensus_queue.cc:260] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:33.489301 30220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad560d215f8475ab9f93ff568eef9f9" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:33.489967 30220 raft_consensus.cc:3060] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.491881 30343 ts_tablet_manager.cc:1434] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:20:33.493713 30343 tablet_bootstrap.cc:492] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:33.495015 30579 raft_consensus.cc:493] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.495551 30579 raft_consensus.cc:515] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:33.497394 30220 raft_consensus.cc:2468] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:33.497906 30560 raft_consensus.cc:493] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.498396 30560 raft_consensus.cc:515] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.498620 30113 leader_election.cc:304] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:33.498950 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad560d215f8475ab9f93ff568eef9f9" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:33.499402 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad560d215f8475ab9f93ff568eef9f9" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:33.500272 30219 raft_consensus.cc:2393] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a1255131174934a6bca3c0bf000026 in current term 1: Already voted for candidate b0439d4e94904196847cd825fcc8ebd7 in this term.
I20260709 12:20:33.501248 30560 leader_election.cc:290] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:33.501987 30343 tablet_bootstrap.cc:654] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.503074 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f28aae897045be9eed015c98ba6908" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:33.503196 30424 consensus_queue.cc:1048] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:33.503825 30149 raft_consensus.cc:2468] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:33.505192 30260 leader_election.cc:304] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:33.506171 30424 raft_consensus.cc:2804] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:33.506579 30424 raft_consensus.cc:493] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.506934 30424 raft_consensus.cc:3060] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.507128 30346 tablet_bootstrap.cc:492] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:33.507823 30346 ts_tablet_manager.cc:1403] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.005s
I20260709 12:20:33.509802 30570 raft_consensus.cc:493] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.510389 30570 raft_consensus.cc:515] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.512416 30346 raft_consensus.cc:359] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.513751 30071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b981cc4916444c0a31e5fd3b14aaa67" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:33.499749 30146 raft_consensus.cc:2393] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a1255131174934a6bca3c0bf000026 in current term 1: Already voted for candidate b0439d4e94904196847cd825fcc8ebd7 in this term.
I20260709 12:20:33.514595 30071 raft_consensus.cc:2468] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:33.515746 30037 leader_election.cc:304] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:33.516475 30447 raft_consensus.cc:2804] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:33.516939 30579 leader_election.cc:290] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:33.518102 30579 raft_consensus.cc:3060] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.512928 30072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f28aae897045be9eed015c98ba6908" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:33.517136 30114 leader_election.cc:304] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:33.523896 30493 raft_consensus.cc:2804] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:33.524314 30493 raft_consensus.cc:493] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.524683 30493 raft_consensus.cc:3060] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.512591 30570 leader_election.cc:290] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:33.513825 30346 raft_consensus.cc:385] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.527153 30346 raft_consensus.cc:740] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.526126 30424 raft_consensus.cc:515] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.531102 30071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f28aae897045be9eed015c98ba6908" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:33.533941 30346 consensus_queue.cc:260] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.535514 30072 raft_consensus.cc:2468] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:33.537550 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b981cc4916444c0a31e5fd3b14aaa67" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:33.535598 30579 raft_consensus.cc:2749] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:33.538491 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f28aae897045be9eed015c98ba6908" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:33.539269 30149 raft_consensus.cc:3060] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.516999 30447 raft_consensus.cc:697] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:33.540848 30447 consensus_queue.cc:237] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:33.554919 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad560d215f8475ab9f93ff568eef9f9" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:33.561264 30149 raft_consensus.cc:2468] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:33.562680 30260 leader_election.cc:304] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:33.563599 30560 raft_consensus.cc:2804] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:33.564087 30560 raft_consensus.cc:697] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:33.564168 29970 catalog_manager.cc:5697] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:33.565012 30560 consensus_queue.cc:237] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.567274 30493 raft_consensus.cc:515] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.568539 30148 raft_consensus.cc:2393] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6c1f7275e654f49abaf1c80ed662511 in current term 1: Already voted for candidate b0439d4e94904196847cd825fcc8ebd7 in this term.
I20260709 12:20:33.572415 30424 leader_election.cc:290] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:33.570976 30346 ts_tablet_manager.cc:1434] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 12:20:33.575505 30346 tablet_bootstrap.cc:492] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:33.576157 30343 tablet_bootstrap.cc:492] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:33.576656 30343 ts_tablet_manager.cc:1403] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.083s	user 0.033s	sys 0.026s
I20260709 12:20:33.579559 30343 raft_consensus.cc:359] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.580878 30343 raft_consensus.cc:385] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.580765 30551 consensus_queue.cc:1048] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:33.579344 30344 consensus_queue.cc:260] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:33.581383 30343 raft_consensus.cc:740] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.582293 30343 consensus_queue.cc:260] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.584323 30343 ts_tablet_manager.cc:1434] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:33.585294 30343 tablet_bootstrap.cc:492] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:33.585220 30346 tablet_bootstrap.cc:654] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.591413 30343 tablet_bootstrap.cc:654] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.596807 30346 tablet_bootstrap.cc:492] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:33.597311 30346 ts_tablet_manager.cc:1403] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.004s
I20260709 12:20:33.600026 30346 raft_consensus.cc:359] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:33.600678 30346 raft_consensus.cc:385] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.600956 30346 raft_consensus.cc:740] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.601562 30346 consensus_queue.cc:260] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:33.603966 30346 ts_tablet_manager.cc:1434] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:20:33.604967 30346 tablet_bootstrap.cc:492] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:33.606284 30400 consensus_queue.cc:1048] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:33.606734 30294 raft_consensus.cc:2468] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 0.
I20260709 12:20:33.607856 29970 catalog_manager.cc:5697] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 1 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:33.608707 30189 leader_election.cc:304] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:33.610354 30557 raft_consensus.cc:2804] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:33.611048 30557 raft_consensus.cc:493] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.611615 30557 raft_consensus.cc:3060] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.619844 30343 tablet_bootstrap.cc:492] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:33.620163 30424 raft_consensus.cc:493] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.620700 30424 raft_consensus.cc:515] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:33.621500 30343 ts_tablet_manager.cc:1403] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 12:20:33.623350 30342 tablet_bootstrap.cc:492] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:33.623862 30342 ts_tablet_manager.cc:1403] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.226s	user 0.017s	sys 0.002s
I20260709 12:20:33.627524 30557 raft_consensus.cc:515] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:33.629675 30557 leader_election.cc:290] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:33.630486 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8157cddb556437c85c52ceb0ec7b614" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:33.631022 30294 raft_consensus.cc:3060] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.633088 30072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8157cddb556437c85c52ceb0ec7b614" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:33.633862 30072 raft_consensus.cc:3060] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.635833 30343 raft_consensus.cc:359] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:33.636551 30343 raft_consensus.cc:385] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.636842 30343 raft_consensus.cc:740] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.636859 30400 consensus_queue.cc:1048] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:33.637874 30294 raft_consensus.cc:2468] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
I20260709 12:20:33.637605 30343 consensus_queue.cc:260] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:33.640131 30343 ts_tablet_manager.cc:1434] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:20:33.641131 30343 tablet_bootstrap.cc:492] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:33.643289 30346 tablet_bootstrap.cc:654] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.646984 30189 leader_election.cc:304] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:33.649782 30557 raft_consensus.cc:2804] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:33.650362 30557 raft_consensus.cc:697] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:33.653316 30343 tablet_bootstrap.cc:654] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.657202 30493 leader_election.cc:290] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:33.658099 30344 ts_tablet_manager.cc:1434] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.218s	user 0.006s	sys 0.001s
I20260709 12:20:33.659235 30344 tablet_bootstrap.cc:492] T 581f9562c91e46eea64ec770bcb8671b P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:33.661074 30071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b981cc4916444c0a31e5fd3b14aaa67" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:33.661726 30071 raft_consensus.cc:3060] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.665304 30569 raft_consensus.cc:493] T 64c571ad30094eb3ac0b270c6a3c6a28 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.665907 30569 raft_consensus.cc:515] T 64c571ad30094eb3ac0b270c6a3c6a28 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:33.668094 30569 leader_election.cc:290] T 64c571ad30094eb3ac0b270c6a3c6a28 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:33.670388 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c571ad30094eb3ac0b270c6a3c6a28" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:33.671379 30219 raft_consensus.cc:2393] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0439d4e94904196847cd825fcc8ebd7 in current term 1: Already voted for candidate f6c1f7275e654f49abaf1c80ed662511 in this term.
I20260709 12:20:33.651216 30557 consensus_queue.cc:237] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:33.675558 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c571ad30094eb3ac0b270c6a3c6a28" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:33.673892 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b981cc4916444c0a31e5fd3b14aaa67" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:33.678583 30351 raft_consensus.cc:515] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.680341 30115 leader_election.cc:304] T 64c571ad30094eb3ac0b270c6a3c6a28 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7; no voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:33.680819 30400 raft_consensus.cc:493] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.685420 30071 raft_consensus.cc:2468] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:33.690728 30343 tablet_bootstrap.cc:492] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:33.691789 30074 raft_consensus.cc:2468] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:33.693923 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8157cddb556437c85c52ceb0ec7b614" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:33.702782 30400 raft_consensus.cc:515] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:33.694064 30070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8157cddb556437c85c52ceb0ec7b614" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:33.705080 30400 leader_election.cc:290] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:33.705425 30569 raft_consensus.cc:3060] T 64c571ad30094eb3ac0b270c6a3c6a28 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.709134 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c2af5bb5b548d8855b05242cb9d33c" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:33.709758 30351 leader_election.cc:290] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:33.711037 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b981cc4916444c0a31e5fd3b14aaa67" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:33.711490 30293 raft_consensus.cc:2393] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0439d4e94904196847cd825fcc8ebd7 in current term 1: Already voted for candidate f6c1f7275e654f49abaf1c80ed662511 in this term.
I20260709 12:20:33.711885 30148 raft_consensus.cc:2393] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f6c1f7275e654f49abaf1c80ed662511 in current term 1: Already voted for candidate b0439d4e94904196847cd825fcc8ebd7 in this term.
I20260709 12:20:33.694994 30424 leader_election.cc:290] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:33.698381 30344 tablet_bootstrap.cc:654] T 581f9562c91e46eea64ec770bcb8671b P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.702188 30343 ts_tablet_manager.cc:1403] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.019s
I20260709 12:20:33.718364 30346 tablet_bootstrap.cc:492] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:33.718951 30346 ts_tablet_manager.cc:1403] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.114s	user 0.023s	sys 0.018s
I20260709 12:20:33.718953 30114 leader_election.cc:304] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: f6c1f7275e654f49abaf1c80ed662511
W20260709 12:20:33.721801 30115 leader_election.cc:343] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:33.722084 30346 raft_consensus.cc:359] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.722796 30346 raft_consensus.cc:385] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.723073 30346 raft_consensus.cc:740] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.723767 30346 consensus_queue.cc:260] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.724320 30071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b981cc4916444c0a31e5fd3b14aaa67" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:33.724704 30493 raft_consensus.cc:2804] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:33.724849 30261 leader_election.cc:304] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:33.725193 30071 raft_consensus.cc:2393] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f6c1f7275e654f49abaf1c80ed662511 in current term 1: Already voted for candidate b0439d4e94904196847cd825fcc8ebd7 in this term.
I20260709 12:20:33.725380 30493 raft_consensus.cc:697] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:33.727023 30262 leader_election.cc:304] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:33.726375 30343 raft_consensus.cc:359] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.727690 30343 raft_consensus.cc:385] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.727624 30560 consensus_queue.cc:1048] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:33.728214 30343 raft_consensus.cc:740] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.729212 30560 raft_consensus.cc:2749] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:33.728982 30343 consensus_queue.cc:260] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.726495 30493 consensus_queue.cc:237] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.731688 30343 ts_tablet_manager.cc:1434] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:20:33.732908 30343 tablet_bootstrap.cc:492] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:33.733196 30569 raft_consensus.cc:2749] T 64c571ad30094eb3ac0b270c6a3c6a28 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:33.734504 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c2af5bb5b548d8855b05242cb9d33c" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:33.735276 30219 raft_consensus.cc:2468] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:33.737404 30346 ts_tablet_manager.cc:1434] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:20:33.738492 30346 tablet_bootstrap.cc:492] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:33.740234 30342 raft_consensus.cc:359] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:33.740993 30342 raft_consensus.cc:385] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.741263 30342 raft_consensus.cc:740] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.741636 30561 consensus_queue.cc:1048] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:33.742264 30113 leader_election.cc:304] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:33.743539 30351 raft_consensus.cc:2749] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:33.747514 30400 raft_consensus.cc:2804] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:33.748064 30400 raft_consensus.cc:493] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.748426 30400 raft_consensus.cc:3060] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.749341 30342 consensus_queue.cc:260] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:33.760885 30342 ts_tablet_manager.cc:1434] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.137s	user 0.005s	sys 0.003s
I20260709 12:20:33.759153 30570 raft_consensus.cc:493] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.762225 30570 raft_consensus.cc:515] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.764374 30570 leader_election.cc:290] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:33.766382 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58b35cd70b1481993195f5bdd8ad3fe" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
W20260709 12:20:33.771724 30115 leader_election.cc:343] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:33.771957 30071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58b35cd70b1481993195f5bdd8ad3fe" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
W20260709 12:20:33.773958 30114 leader_election.cc:343] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:33.774590 30114 leader_election.cc:304] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7; no voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:33.775565 30570 raft_consensus.cc:2749] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:33.775837 30346 tablet_bootstrap.cc:654] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.785337 30342 tablet_bootstrap.cc:492] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:33.800067 30072 raft_consensus.cc:2468] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
I20260709 12:20:33.783721 30400 raft_consensus.cc:515] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:33.815299 30552 raft_consensus.cc:493] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.815907 30552 raft_consensus.cc:515] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
W20260709 12:20:33.818379 30020 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:33.820307 30400 leader_election.cc:290] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:33.830865 29968 catalog_manager.cc:5697] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:33.832981 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c2af5bb5b548d8855b05242cb9d33c" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:33.828843 29969 catalog_manager.cc:5697] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:33.835397 30115 leader_election.cc:343] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:33.834678 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0696a915ada148cca9600585d0152f86" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
W20260709 12:20:33.839159 30188 leader_election.cc:343] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:33.842201 30552 leader_election.cc:290] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:33.847952 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0696a915ada148cca9600585d0152f86" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
W20260709 12:20:33.849651 30186 leader_election.cc:343] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:33.850212 30186 leader_election.cc:304] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:33.853430 30220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c2af5bb5b548d8855b05242cb9d33c" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:33.854149 30220 raft_consensus.cc:3060] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.857033 30424 consensus_queue.cc:1048] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:33.857932 30401 raft_consensus.cc:2749] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:33.867800 30343 tablet_bootstrap.cc:654] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.868358 30351 consensus_queue.cc:1048] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:33.872174 30342 tablet_bootstrap.cc:654] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:33.897339 30344 tablet_bootstrap.cc:492] T 581f9562c91e46eea64ec770bcb8671b P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:33.897956 30344 ts_tablet_manager.cc:1403] T 581f9562c91e46eea64ec770bcb8671b P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.239s	user 0.029s	sys 0.012s
I20260709 12:20:33.900631 30344 raft_consensus.cc:359] T 581f9562c91e46eea64ec770bcb8671b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.901319 30344 raft_consensus.cc:385] T 581f9562c91e46eea64ec770bcb8671b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.905129 30220 raft_consensus.cc:2468] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:33.901571 30344 raft_consensus.cc:740] T 581f9562c91e46eea64ec770bcb8671b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.888523 30400 raft_consensus.cc:493] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.909947 30400 raft_consensus.cc:515] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.908499 30344 consensus_queue.cc:260] T 581f9562c91e46eea64ec770bcb8671b P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.914326 30346 tablet_bootstrap.cc:492] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:33.915072 30346 ts_tablet_manager.cc:1403] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.177s	user 0.011s	sys 0.007s
I20260709 12:20:33.923822 30344 ts_tablet_manager.cc:1434] T 581f9562c91e46eea64ec770bcb8671b P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:20:33.929913 30344 tablet_bootstrap.cc:492] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:33.929561 30113 leader_election.cc:304] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:33.939780 30493 raft_consensus.cc:2804] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:33.940798 30493 raft_consensus.cc:697] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:33.941601 30493 consensus_queue.cc:237] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:33.951098 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581f9562c91e46eea64ec770bcb8671b" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:33.951872 30297 raft_consensus.cc:2468] T 581f9562c91e46eea64ec770bcb8671b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:33.953913 30115 leader_election.cc:304] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:33.954823 30569 raft_consensus.cc:2804] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:33.955199 30569 raft_consensus.cc:493] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.955521 30569 raft_consensus.cc:3060] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.956600 30346 raft_consensus.cc:359] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.958017 30400 leader_election.cc:290] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:33.963174 30569 raft_consensus.cc:515] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.965615 30346 raft_consensus.cc:385] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:33.966064 30346 raft_consensus.cc:740] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:33.966463 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581f9562c91e46eea64ec770bcb8671b" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:33.967139 30297 raft_consensus.cc:3060] T 581f9562c91e46eea64ec770bcb8671b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:33.966763 30346 consensus_queue.cc:260] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:33.977880 30346 ts_tablet_manager.cc:1434] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 12:20:33.979022 30346 tablet_bootstrap.cc:492] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:33.998478 30297 raft_consensus.cc:2468] T 581f9562c91e46eea64ec770bcb8671b P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:34.001255 30115 leader_election.cc:304] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:34.003130 30570 raft_consensus.cc:2804] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:34.003681 30570 raft_consensus.cc:697] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:34.004588 30570 consensus_queue.cc:237] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:34.009279 30400 consensus_queue.cc:1048] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:33.963229 30344 tablet_bootstrap.cc:654] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.026185 30343 tablet_bootstrap.cc:492] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:34.026835 30342 tablet_bootstrap.cc:492] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:34.026917 30343 ts_tablet_manager.cc:1403] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.294s	user 0.009s	sys 0.017s
I20260709 12:20:34.027443 30342 ts_tablet_manager.cc:1403] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.242s	user 0.041s	sys 0.023s
I20260709 12:20:34.030241 30342 raft_consensus.cc:359] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.030936 30342 raft_consensus.cc:385] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.031215 30342 raft_consensus.cc:740] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.032016 30342 consensus_queue.cc:260] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.034427 30074 raft_consensus.cc:3060] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.035928 30072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581f9562c91e46eea64ec770bcb8671b" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:34.036652 30072 raft_consensus.cc:2468] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:34.034473 30342 ts_tablet_manager.cc:1434] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:20:34.038687 30342 tablet_bootstrap.cc:492] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:34.031260 30346 tablet_bootstrap.cc:654] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.044458 30342 tablet_bootstrap.cc:654] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.044883 30351 consensus_queue.cc:1048] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:34.059110 30346 tablet_bootstrap.cc:492] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:34.059607 30346 ts_tablet_manager.cc:1403] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.004s
I20260709 12:20:34.060585 30569 leader_election.cc:290] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:34.071696 30342 tablet_bootstrap.cc:492] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:34.072255 30342 ts_tablet_manager.cc:1403] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.022s
I20260709 12:20:34.074939 30342 raft_consensus.cc:359] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:34.075690 30342 raft_consensus.cc:385] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.075963 30342 raft_consensus.cc:740] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.076812 30493 consensus_queue.cc:1048] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:34.079435 30342 consensus_queue.cc:260] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:34.062412 30346 raft_consensus.cc:359] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:34.081599 30346 raft_consensus.cc:385] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.063941 30351 consensus_queue.cc:1048] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:34.064463 30071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581f9562c91e46eea64ec770bcb8671b" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:34.081665 30342 ts_tablet_manager.cc:1434] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:20:34.083564 30342 tablet_bootstrap.cc:492] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:34.063867 30343 raft_consensus.cc:359] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:34.084980 30343 raft_consensus.cc:385] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.085294 30343 raft_consensus.cc:740] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.085976 30343 consensus_queue.cc:260] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:34.088049 30343 ts_tablet_manager.cc:1434] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.061s	user 0.002s	sys 0.003s
I20260709 12:20:34.089046 30343 tablet_bootstrap.cc:492] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:34.081969 30346 raft_consensus.cc:740] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.082314 30071 raft_consensus.cc:3060] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.090682 30346 consensus_queue.cc:260] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:34.093389 30346 ts_tablet_manager.cc:1434] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.001s
I20260709 12:20:34.094429 30346 tablet_bootstrap.cc:492] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:34.100802 30342 tablet_bootstrap.cc:654] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.106707 30346 tablet_bootstrap.cc:654] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.106829 30552 consensus_queue.cc:1048] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:34.116693 30343 tablet_bootstrap.cc:654] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.113415 30071 raft_consensus.cc:2468] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:34.142658 30074 raft_consensus.cc:3060] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.141942 30346 tablet_bootstrap.cc:492] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:34.156682 30346 ts_tablet_manager.cc:1403] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.062s	user 0.024s	sys 0.002s
I20260709 12:20:34.137271 30570 raft_consensus.cc:493] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.158294 30570 raft_consensus.cc:515] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.160287 30344 tablet_bootstrap.cc:492] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:34.160854 30344 ts_tablet_manager.cc:1403] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.236s	user 0.010s	sys 0.001s
I20260709 12:20:34.160895 30346 raft_consensus.cc:359] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:34.161973 30346 raft_consensus.cc:385] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.162668 30346 raft_consensus.cc:740] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.162819 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd853575cf54f3f91608d485c3d16ca" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:34.163874 30346 consensus_queue.cc:260] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:34.164490 30219 raft_consensus.cc:2468] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:34.165921 30346 ts_tablet_manager.cc:1434] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:20:34.166046 30113 leader_election.cc:304] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:34.166321 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd853575cf54f3f91608d485c3d16ca" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:34.167024 30493 raft_consensus.cc:2804] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:34.167467 30493 raft_consensus.cc:493] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.167834 30493 raft_consensus.cc:3060] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.167049 30346 tablet_bootstrap.cc:492] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:34.183176 29970 catalog_manager.cc:5697] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:34.185400 30344 raft_consensus.cc:359] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.186147 30344 raft_consensus.cc:385] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.160465 30570 leader_election.cc:290] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:34.186821 30344 raft_consensus.cc:740] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.195936 30552 consensus_queue.cc:1048] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:20:34.182808 30115 leader_election.cc:343] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:34.192803 30344 consensus_queue.cc:260] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.220996 30569 raft_consensus.cc:493] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.221593 30569 raft_consensus.cc:515] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:34.223383 30344 ts_tablet_manager.cc:1434] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 12:20:34.224974 30344 tablet_bootstrap.cc:492] T d0c2af5bb5b548d8855b05242cb9d33c P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:34.227644 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3111cf2203d14eb8a006d35fee44552e" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:34.228323 30561 raft_consensus.cc:493] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.224828 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3111cf2203d14eb8a006d35fee44552e" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:34.229708 30073 raft_consensus.cc:2468] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:34.228881 30561 raft_consensus.cc:515] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.231482 30400 consensus_queue.cc:1048] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:34.224680 30569 leader_election.cc:290] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:34.228467 30219 raft_consensus.cc:2468] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:34.233177 30561 leader_election.cc:290] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:34.236660 30493 raft_consensus.cc:515] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.231945 30114 leader_election.cc:304] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:34.238152 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd853575cf54f3f91608d485c3d16ca" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:34.239106 30219 raft_consensus.cc:2468] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:34.240837 30261 leader_election.cc:304] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:34.241727 30561 raft_consensus.cc:2804] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:34.242177 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd853575cf54f3f91608d485c3d16ca" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:34.243047 30149 raft_consensus.cc:2393] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6c1f7275e654f49abaf1c80ed662511 in current term 1: Already voted for candidate b0439d4e94904196847cd825fcc8ebd7 in this term.
I20260709 12:20:34.242323 30400 raft_consensus.cc:2804] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:34.244783 30400 raft_consensus.cc:493] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.245198 30400 raft_consensus.cc:3060] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.248880 30344 tablet_bootstrap.cc:654] T d0c2af5bb5b548d8855b05242cb9d33c P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.255862 29970 catalog_manager.cc:5697] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:34.242152 30561 raft_consensus.cc:493] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.269186 30561 raft_consensus.cc:3060] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.284309 30342 tablet_bootstrap.cc:492] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:34.284799 30342 ts_tablet_manager.cc:1403] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.201s	user 0.019s	sys 0.042s
I20260709 12:20:34.287171 30400 raft_consensus.cc:515] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:34.289819 30400 leader_election.cc:290] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:34.290131 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3111cf2203d14eb8a006d35fee44552e" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:34.290768 30074 raft_consensus.cc:3060] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.292135 30342 raft_consensus.cc:359] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:34.292692 30342 raft_consensus.cc:385] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.292862 30342 raft_consensus.cc:740] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.298863 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3111cf2203d14eb8a006d35fee44552e" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:34.299602 30219 raft_consensus.cc:3060] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.299927 30493 leader_election.cc:290] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:34.301133 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd853575cf54f3f91608d485c3d16ca" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:34.303401 30220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd853575cf54f3f91608d485c3d16ca" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:34.304091 30220 raft_consensus.cc:3060] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.308812 30219 raft_consensus.cc:2468] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:34.293511 30342 consensus_queue.cc:260] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:34.299006 30346 tablet_bootstrap.cc:654] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.309139 30561 raft_consensus.cc:515] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.312770 30113 leader_election.cc:304] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:34.313282 30294 raft_consensus.cc:2393] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b0439d4e94904196847cd825fcc8ebd7 in current term 1: Already voted for candidate f6c1f7275e654f49abaf1c80ed662511 in this term.
I20260709 12:20:34.314394 30343 tablet_bootstrap.cc:492] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:34.314709 30074 raft_consensus.cc:2468] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:34.315032 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd853575cf54f3f91608d485c3d16ca" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:34.315865 30149 raft_consensus.cc:2393] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f6c1f7275e654f49abaf1c80ed662511 in current term 1: Already voted for candidate b0439d4e94904196847cd825fcc8ebd7 in this term.
I20260709 12:20:34.314888 30343 ts_tablet_manager.cc:1403] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.226s	user 0.030s	sys 0.030s
I20260709 12:20:34.320011 30400 raft_consensus.cc:2804] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:34.320591 30400 raft_consensus.cc:697] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:34.321452 30400 consensus_queue.cc:237] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:34.327574 30342 ts_tablet_manager.cc:1434] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.002s
I20260709 12:20:34.329735 30342 tablet_bootstrap.cc:492] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:34.331125 30573 raft_consensus.cc:493] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.331724 30573 raft_consensus.cc:515] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:34.333920 30619 raft_consensus.cc:493] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.334478 30619 raft_consensus.cc:515] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.336549 30619 leader_election.cc:290] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:34.339469 30343 raft_consensus.cc:359] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:34.340366 30343 raft_consensus.cc:385] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.340655 30343 raft_consensus.cc:740] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.341842 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2982be43a6544a2cbf3fbddd81601115" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
W20260709 12:20:34.343329 30186 leader_election.cc:343] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:34.340512 30493 consensus_queue.cc:1048] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:20:34.344818 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58b35cd70b1481993195f5bdd8ad3fe" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:34.346848 30573 leader_election.cc:290] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
W20260709 12:20:34.348219 30040 leader_election.cc:343] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:34.348162 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd853575cf54f3f91608d485c3d16ca" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:34.350060 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2982be43a6544a2cbf3fbddd81601115" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:34.352002 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58b35cd70b1481993195f5bdd8ad3fe" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:34.352645 30149 raft_consensus.cc:2468] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 0.
I20260709 12:20:34.353863 30037 leader_election.cc:304] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:34.344792 30344 tablet_bootstrap.cc:492] T d0c2af5bb5b548d8855b05242cb9d33c P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:34.356190 30344 ts_tablet_manager.cc:1403] T d0c2af5bb5b548d8855b05242cb9d33c P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.131s	user 0.024s	sys 0.012s
I20260709 12:20:34.358421 30261 leader_election.cc:304] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c1f7275e654f49abaf1c80ed662511; no voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:34.359390 30351 raft_consensus.cc:2749] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:34.360855 30344 raft_consensus.cc:359] T d0c2af5bb5b548d8855b05242cb9d33c P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.361568 30344 raft_consensus.cc:385] T d0c2af5bb5b548d8855b05242cb9d33c P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.319522 30561 leader_election.cc:290] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:34.361868 30344 raft_consensus.cc:740] T d0c2af5bb5b548d8855b05242cb9d33c P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.362700 30344 consensus_queue.cc:260] T d0c2af5bb5b548d8855b05242cb9d33c P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.357193 30343 consensus_queue.cc:260] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:34.370110 30344 ts_tablet_manager.cc:1434] T d0c2af5bb5b548d8855b05242cb9d33c P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 12:20:34.370575 30343 ts_tablet_manager.cc:1434] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.002s
I20260709 12:20:34.371757 30343 tablet_bootstrap.cc:492] T 2982be43a6544a2cbf3fbddd81601115 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:34.373258 30344 tablet_bootstrap.cc:492] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:34.363056 30573 raft_consensus.cc:2804] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:34.379868 29972 catalog_manager.cc:5697] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:34.381371 30346 tablet_bootstrap.cc:492] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:34.383069 30346 ts_tablet_manager.cc:1403] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.216s	user 0.012s	sys 0.006s
W20260709 12:20:34.376614 30189 leader_election.cc:343] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:34.385342 30189 leader_election.cc:304] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:34.382450 30573 raft_consensus.cc:493] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.386261 30573 raft_consensus.cc:3060] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.390709 30346 raft_consensus.cc:359] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:34.391472 30346 raft_consensus.cc:385] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.391752 30346 raft_consensus.cc:740] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.392431 30346 consensus_queue.cc:260] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:34.393960 30401 raft_consensus.cc:2749] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:34.343365 30220 raft_consensus.cc:2468] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:34.427763 30579 raft_consensus.cc:493] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.433297 30579 raft_consensus.cc:515] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:34.435494 30579 leader_election.cc:290] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:34.436267 30220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaa1e367a834921bed89b00cf7b2487" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:34.437028 30220 raft_consensus.cc:2468] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 0.
I20260709 12:20:34.438483 30038 leader_election.cc:304] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
W20260709 12:20:34.431610 30188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:43571, user_credentials={real_user=slave}} blocked reactor thread for 44128.7us
I20260709 12:20:34.441040 30569 consensus_queue.cc:1048] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:20:34.448428 30113 leader_election.cc:304] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:34.443233 30579 raft_consensus.cc:2804] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:34.449326 30579 raft_consensus.cc:493] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.449684 30579 raft_consensus.cc:3060] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.450738 30569 raft_consensus.cc:2804] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:34.451311 30569 raft_consensus.cc:697] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:34.452133 30569 consensus_queue.cc:237] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.454134 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaa1e367a834921bed89b00cf7b2487" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:34.455823 30342 tablet_bootstrap.cc:654] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:34.456516 30040 leader_election.cc:343] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:34.479043 30346 ts_tablet_manager.cc:1434] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.096s	user 0.020s	sys 0.027s
I20260709 12:20:34.479873 30346 tablet_bootstrap.cc:492] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:34.496965 30573 raft_consensus.cc:515] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:34.500587 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58b35cd70b1481993195f5bdd8ad3fe" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:34.501322 30343 tablet_bootstrap.cc:654] T 2982be43a6544a2cbf3fbddd81601115 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.503233 30579 raft_consensus.cc:515] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:34.501322 30149 raft_consensus.cc:3060] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.509635 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58b35cd70b1481993195f5bdd8ad3fe" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:34.510052 30344 tablet_bootstrap.cc:654] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.512965 29970 catalog_manager.cc:5697] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:34.515326 30346 tablet_bootstrap.cc:654] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.515933 30573 leader_election.cc:290] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:34.519666 30293 raft_consensus.cc:3060] T d0c2af5bb5b548d8855b05242cb9d33c P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.519627 30570 consensus_queue.cc:1048] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:34.527416 30579 leader_election.cc:290] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:34.528360 30220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaa1e367a834921bed89b00cf7b2487" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:34.529035 30220 raft_consensus.cc:3060] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.532830 30447 consensus_queue.cc:1048] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:34.559798 30149 raft_consensus.cc:2468] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 1.
I20260709 12:20:34.562543 30037 leader_election.cc:304] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:34.563647 30579 raft_consensus.cc:2804] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:34.563508 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaa1e367a834921bed89b00cf7b2487" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:34.565418 30579 raft_consensus.cc:697] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:34.566524 30579 consensus_queue.cc:237] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
W20260709 12:20:34.567611 30040 leader_election.cc:343] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:34.568639 30040 leader_election.cc:343] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:34.561188 30220 raft_consensus.cc:2468] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 1.
I20260709 12:20:34.578195 30038 leader_election.cc:304] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:34.570050 30570 consensus_queue.cc:1048] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:20:34.582440 30343 tablet_bootstrap.cc:492] T 2982be43a6544a2cbf3fbddd81601115 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:34.583114 30343 ts_tablet_manager.cc:1403] T 2982be43a6544a2cbf3fbddd81601115 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.212s	user 0.009s	sys 0.020s
I20260709 12:20:34.584674 30649 raft_consensus.cc:2804] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:34.590688 30342 tablet_bootstrap.cc:492] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:34.595608 30342 ts_tablet_manager.cc:1403] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.267s	user 0.010s	sys 0.013s
I20260709 12:20:34.598908 30342 raft_consensus.cc:359] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:34.599676 30342 raft_consensus.cc:385] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.599957 30342 raft_consensus.cc:740] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.590247 30649 raft_consensus.cc:697] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:34.602790 30649 consensus_queue.cc:237] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:34.605432 30346 tablet_bootstrap.cc:492] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:34.605983 30346 ts_tablet_manager.cc:1403] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.010s
I20260709 12:20:34.600684 30342 consensus_queue.cc:260] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:34.609359 30342 ts_tablet_manager.cc:1434] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:20:34.591363 30344 tablet_bootstrap.cc:492] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:34.610190 30344 ts_tablet_manager.cc:1403] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.239s	user 0.013s	sys 0.019s
I20260709 12:20:34.610410 30342 tablet_bootstrap.cc:492] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:34.613284 30344 raft_consensus.cc:359] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.614038 30344 raft_consensus.cc:385] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.614297 30344 raft_consensus.cc:740] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.616350 30344 consensus_queue.cc:260] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.588596 30343 raft_consensus.cc:359] T 2982be43a6544a2cbf3fbddd81601115 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.618172 30343 raft_consensus.cc:385] T 2982be43a6544a2cbf3fbddd81601115 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.618456 30343 raft_consensus.cc:740] T 2982be43a6544a2cbf3fbddd81601115 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.618877 30344 ts_tablet_manager.cc:1434] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:20:34.616535 29967 catalog_manager.cc:5697] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:34.619851 30344 tablet_bootstrap.cc:492] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:34.622181 30346 raft_consensus.cc:359] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:34.622992 30346 raft_consensus.cc:385] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.623283 30346 raft_consensus.cc:740] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.624148 30346 consensus_queue.cc:260] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:34.695711 30342 tablet_bootstrap.cc:654] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.687114 30344 tablet_bootstrap.cc:654] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.629191 30343 consensus_queue.cc:260] T 2982be43a6544a2cbf3fbddd81601115 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.716238 30343 ts_tablet_manager.cc:1434] T 2982be43a6544a2cbf3fbddd81601115 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.133s	user 0.025s	sys 0.013s
I20260709 12:20:34.718345 30343 tablet_bootstrap.cc:492] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:34.705066 30346 ts_tablet_manager.cc:1434] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.000s
I20260709 12:20:34.707190 30619 raft_consensus.cc:493] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.719144 30619 raft_consensus.cc:515] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:34.690553 30557 raft_consensus.cc:493] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.720232 30557 raft_consensus.cc:515] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:34.721380 30619 leader_election.cc:290] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:34.724025 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8364709c0e424d6791fed2d28528c655" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:34.723146 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8364709c0e424d6791fed2d28528c655" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
W20260709 12:20:34.726055 30188 leader_election.cc:343] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:34.726380 30346 tablet_bootstrap.cc:492] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:34.745002 30447 raft_consensus.cc:493] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.745616 30447 raft_consensus.cc:515] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:34.769335 30344 tablet_bootstrap.cc:492] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:34.769995 30344 ts_tablet_manager.cc:1403] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.150s	user 0.031s	sys 0.038s
I20260709 12:20:34.769845 29967 catalog_manager.cc:5697] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:34.774251 30342 tablet_bootstrap.cc:492] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:34.776535 30342 ts_tablet_manager.cc:1403] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.166s	user 0.043s	sys 0.044s
I20260709 12:20:34.776878 30447 leader_election.cc:290] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:34.779415 30342 raft_consensus.cc:359] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:34.780200 30342 raft_consensus.cc:385] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.780479 30342 raft_consensus.cc:740] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.774880 30344 raft_consensus.cc:359] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:34.775274 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961df2c56aac4887bbb0971fd85cd3b0" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:34.781090 30344 raft_consensus.cc:385] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.781328 30074 raft_consensus.cc:2468] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:34.785279 30072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cf731d884ab6bcb89a294b8b905c" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:34.783928 30557 leader_election.cc:290] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
W20260709 12:20:34.788372 30188 leader_election.cc:343] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:34.790050 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cf731d884ab6bcb89a294b8b905c" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:34.790467 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961df2c56aac4887bbb0971fd85cd3b0" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:34.791103 30569 consensus_queue.cc:1048] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:20:34.791469 30186 leader_election.cc:343] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:34.791987 30186 leader_election.cc:304] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7
W20260709 12:20:34.789976 30189 leader_election.cc:343] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:34.792253 30114 leader_election.cc:304] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:34.792748 30189 leader_election.cc:304] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:34.793339 30569 raft_consensus.cc:2804] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:34.793895 30569 raft_consensus.cc:493] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.794247 30569 raft_consensus.cc:3060] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.794474 30343 tablet_bootstrap.cc:654] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.793249 30557 raft_consensus.cc:2749] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:34.794623 30648 raft_consensus.cc:2749] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:34.781405 30344 raft_consensus.cc:740] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.785053 30342 consensus_queue.cc:260] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:34.800771 30344 consensus_queue.cc:260] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:34.810825 30342 ts_tablet_manager.cc:1434] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
W20260709 12:20:34.812950 30115 leader_election.cc:343] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:34.813263 30344 ts_tablet_manager.cc:1434] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:20:34.811937 30342 tablet_bootstrap.cc:492] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:34.820915 30344 tablet_bootstrap.cc:492] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:34.828656 30342 tablet_bootstrap.cc:654] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.833510 30344 tablet_bootstrap.cc:654] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.843679 30569 raft_consensus.cc:515] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:34.846757 30072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961df2c56aac4887bbb0971fd85cd3b0" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:34.846930 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961df2c56aac4887bbb0971fd85cd3b0" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:34.847606 30072 raft_consensus.cc:3060] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.849048 30346 tablet_bootstrap.cc:654] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:34.848819 30115 leader_election.cc:343] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:34.849963 30351 raft_consensus.cc:493] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.850782 30351 raft_consensus.cc:515] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.854501 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2982be43a6544a2cbf3fbddd81601115" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:34.855237 30148 raft_consensus.cc:2468] T 2982be43a6544a2cbf3fbddd81601115 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:34.856241 30072 raft_consensus.cc:2468] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:34.854502 30220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2982be43a6544a2cbf3fbddd81601115" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:34.857103 30220 raft_consensus.cc:2468] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:34.857178 30260 leader_election.cc:304] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:34.858104 30561 raft_consensus.cc:2804] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:34.858485 30561 raft_consensus.cc:493] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.858865 30561 raft_consensus.cc:3060] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.859917 30114 leader_election.cc:304] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:34.861081 30447 raft_consensus.cc:2804] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:34.861567 30447 raft_consensus.cc:697] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:34.863972 30447 consensus_queue.cc:237] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:34.864832 30569 leader_election.cc:290] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:34.866011 30343 tablet_bootstrap.cc:492] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:34.866550 30343 ts_tablet_manager.cc:1403] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.148s	user 0.025s	sys 0.013s
I20260709 12:20:34.854585 30351 leader_election.cc:290] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:34.869556 30343 raft_consensus.cc:359] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:34.870241 30343 raft_consensus.cc:385] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.870455 30343 raft_consensus.cc:740] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.871042 30343 consensus_queue.cc:260] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:34.875264 30561 raft_consensus.cc:515] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.877624 30561 leader_election.cc:290] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:34.879688 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2982be43a6544a2cbf3fbddd81601115" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:34.883088 30343 ts_tablet_manager.cc:1434] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:20:34.883958 30343 tablet_bootstrap.cc:492] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:34.879685 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2982be43a6544a2cbf3fbddd81601115" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:34.891090 30148 raft_consensus.cc:3060] T 2982be43a6544a2cbf3fbddd81601115 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.885272 30219 raft_consensus.cc:3060] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.895354 30342 tablet_bootstrap.cc:492] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:34.895941 30342 ts_tablet_manager.cc:1403] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.004s
I20260709 12:20:34.900472 29967 catalog_manager.cc:5697] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:34.908080 30342 raft_consensus.cc:359] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:34.908893 30342 raft_consensus.cc:385] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.909174 30342 raft_consensus.cc:740] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.911854 30343 tablet_bootstrap.cc:654] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.913201 30447 consensus_queue.cc:1048] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:34.919561 30447 consensus_queue.cc:1048] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:34.922644 30344 tablet_bootstrap.cc:492] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:34.923507 30344 ts_tablet_manager.cc:1403] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.103s	user 0.009s	sys 0.005s
I20260709 12:20:34.926666 30342 consensus_queue.cc:260] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:34.927944 30344 raft_consensus.cc:359] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:34.929833 30344 raft_consensus.cc:385] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.930126 30344 raft_consensus.cc:740] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.944571 30344 consensus_queue.cc:260] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:34.949565 30342 ts_tablet_manager.cc:1434] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:20:34.951692 30344 ts_tablet_manager.cc:1434] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:20:34.982861 30344 tablet_bootstrap.cc:492] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:34.983991 30342 tablet_bootstrap.cc:492] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:34.989225 30344 tablet_bootstrap.cc:654] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.947182 30148 raft_consensus.cc:2468] T 2982be43a6544a2cbf3fbddd81601115 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
W20260709 12:20:34.963629 30020 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:34.964107 30351 raft_consensus.cc:493] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.966145 30649 consensus_queue.cc:1048] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:34.991382 30351 raft_consensus.cc:515] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:34.991828 30260 leader_election.cc:304] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:34.974647 30346 tablet_bootstrap.cc:492] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:34.993422 30351 leader_election.cc:290] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:34.994143 30351 raft_consensus.cc:2804] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:34.994812 30351 raft_consensus.cc:697] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:34.995450 30072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaa1e367a834921bed89b00cf7b2487" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:34.993374 30346 ts_tablet_manager.cc:1403] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.267s	user 0.024s	sys 0.010s
I20260709 12:20:34.997758 30351 consensus_queue.cc:237] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:34.999933 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaa1e367a834921bed89b00cf7b2487" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:35.000133 30346 raft_consensus.cc:359] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:35.000905 30223 raft_consensus.cc:2393] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6c1f7275e654f49abaf1c80ed662511 in current term 1: Already voted for candidate 22a1255131174934a6bca3c0bf000026 in this term.
I20260709 12:20:35.002310 30261 leader_election.cc:304] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:35.003655 30560 raft_consensus.cc:3060] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.006037 30297 raft_consensus.cc:3060] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.012485 30560 raft_consensus.cc:2749] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:35.000993 30346 raft_consensus.cc:385] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.013264 30346 raft_consensus.cc:740] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.014125 30346 consensus_queue.cc:260] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:35.015717 30649 consensus_queue.cc:1048] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:35.019479 30346 ts_tablet_manager.cc:1434] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260709 12:20:35.020809 30346 tablet_bootstrap.cc:492] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:34.981345 30219 raft_consensus.cc:2468] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:34.981137 30447 consensus_queue.cc:1048] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:35.031724 30342 tablet_bootstrap.cc:654] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.037822 30346 tablet_bootstrap.cc:654] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.042363 30343 tablet_bootstrap.cc:492] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:35.042973 30343 ts_tablet_manager.cc:1403] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.159s	user 0.066s	sys 0.053s
I20260709 12:20:35.045691 30343 raft_consensus.cc:359] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.046429 30343 raft_consensus.cc:385] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.046737 30343 raft_consensus.cc:740] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.047713 30343 consensus_queue.cc:260] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.049979 30343 ts_tablet_manager.cc:1434] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:35.050989 30343 tablet_bootstrap.cc:492] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:35.051702 30346 tablet_bootstrap.cc:492] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:35.058169 30447 raft_consensus.cc:493] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.058406 30342 tablet_bootstrap.cc:492] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:35.058991 30342 ts_tablet_manager.cc:1403] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.004s
I20260709 12:20:35.058792 30447 raft_consensus.cc:515] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:35.060954 30447 leader_election.cc:290] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:35.064795 30343 tablet_bootstrap.cc:654] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.065047 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0696a915ada148cca9600585d0152f86" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:35.065784 30073 raft_consensus.cc:2468] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:35.072086 30114 leader_election.cc:304] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:35.073149 30447 raft_consensus.cc:2804] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:35.073596 30447 raft_consensus.cc:493] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.074609 30447 raft_consensus.cc:3060] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.075693 30346 ts_tablet_manager.cc:1403] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.001s
I20260709 12:20:35.092378 30342 raft_consensus.cc:359] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.092988 30342 raft_consensus.cc:385] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.093200 30342 raft_consensus.cc:740] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.097678 30346 raft_consensus.cc:359] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:35.098475 30346 raft_consensus.cc:385] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.098753 30346 raft_consensus.cc:740] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.100324 30579 consensus_queue.cc:1048] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:35.100678 30346 consensus_queue.cc:260] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:35.109380 30346 ts_tablet_manager.cc:1434] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.030s	user 0.002s	sys 0.004s
I20260709 12:20:35.110638 30346 tablet_bootstrap.cc:492] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:35.116463 30342 consensus_queue.cc:260] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.149175 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0696a915ada148cca9600585d0152f86" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:35.151013 30223 raft_consensus.cc:2468] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:35.094638 30557 raft_consensus.cc:493] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.151959 30342 ts_tablet_manager.cc:1434] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.093s	user 0.005s	sys 0.002s
I20260709 12:20:35.153164 30342 tablet_bootstrap.cc:492] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:35.152033 30557 raft_consensus.cc:515] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:35.156409 30557 leader_election.cc:290] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:35.158286 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdeb0fe4f15c4ea9893bae143fa20651" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
W20260709 12:20:35.166291 30189 leader_election.cc:343] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.069353 29967 catalog_manager.cc:5697] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 1 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:35.169476 30346 tablet_bootstrap.cc:654] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.175320 30342 tablet_bootstrap.cc:654] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.193239 30447 raft_consensus.cc:515] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:35.214166 30072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdeb0fe4f15c4ea9893bae143fa20651" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:35.214951 30072 raft_consensus.cc:2468] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 0.
I20260709 12:20:35.215996 30188 leader_election.cc:304] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:35.216984 30648 raft_consensus.cc:2804] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:35.217360 30648 raft_consensus.cc:493] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.217706 30648 raft_consensus.cc:3060] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.225350 30343 tablet_bootstrap.cc:492] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:35.225579 30344 tablet_bootstrap.cc:492] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:35.226091 30344 ts_tablet_manager.cc:1403] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.243s	user 0.026s	sys 0.060s
I20260709 12:20:35.226171 30343 ts_tablet_manager.cc:1403] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.175s	user 0.026s	sys 0.058s
I20260709 12:20:35.229117 30344 raft_consensus.cc:359] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:35.229858 30344 raft_consensus.cc:385] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.230134 30344 raft_consensus.cc:740] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.230979 30344 consensus_queue.cc:260] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:35.233072 30344 ts_tablet_manager.cc:1434] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:20:35.234143 30344 tablet_bootstrap.cc:492] T d782d59119bc45d08292b0b77cabedc9 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:35.242107 30072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0696a915ada148cca9600585d0152f86" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:35.242856 30072 raft_consensus.cc:3060] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.249624 30342 tablet_bootstrap.cc:492] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:35.250236 30342 ts_tablet_manager.cc:1403] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.005s
I20260709 12:20:35.252305 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0696a915ada148cca9600585d0152f86" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:35.252924 30219 raft_consensus.cc:3060] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.254390 30342 raft_consensus.cc:359] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.255125 30342 raft_consensus.cc:385] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.255486 30342 raft_consensus.cc:740] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.256160 30342 consensus_queue.cc:260] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.260476 30342 ts_tablet_manager.cc:1434] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 12:20:35.261541 30342 tablet_bootstrap.cc:492] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:35.264582 30343 raft_consensus.cc:359] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:35.258424 30072 raft_consensus.cc:2468] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:35.267102 30579 consensus_queue.cc:1048] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:35.275344 30344 tablet_bootstrap.cc:654] T d782d59119bc45d08292b0b77cabedc9 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.267745 30219 raft_consensus.cc:2468] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:35.277630 30114 leader_election.cc:304] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:35.268240 30447 leader_election.cc:290] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:35.278566 30447 raft_consensus.cc:2804] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:35.279304 30447 raft_consensus.cc:697] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:35.280920 30447 consensus_queue.cc:237] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:35.271363 30346 tablet_bootstrap.cc:492] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:35.283897 30346 ts_tablet_manager.cc:1403] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.174s	user 0.012s	sys 0.010s
I20260709 12:20:35.286782 30346 raft_consensus.cc:359] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:35.287504 30346 raft_consensus.cc:385] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.287809 30346 raft_consensus.cc:740] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.288519 30346 consensus_queue.cc:260] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:35.254974 30648 raft_consensus.cc:515] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:35.291373 30648 leader_election.cc:290] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:35.270351 30342 tablet_bootstrap.cc:654] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.293148 30072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdeb0fe4f15c4ea9893bae143fa20651" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:35.293848 30072 raft_consensus.cc:3060] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.298810 30346 ts_tablet_manager.cc:1434] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:20:35.299937 30346 tablet_bootstrap.cc:492] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:35.309490 30343 raft_consensus.cc:385] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.313299 30343 raft_consensus.cc:740] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.314246 30343 consensus_queue.cc:260] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:35.316614 30072 raft_consensus.cc:2468] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
I20260709 12:20:35.320513 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdeb0fe4f15c4ea9893bae143fa20651" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:35.321167 30188 leader_election.cc:304] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
W20260709 12:20:35.321979 30189 leader_election.cc:343] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.322069 30648 raft_consensus.cc:2804] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:35.323132 30648 raft_consensus.cc:697] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:35.324023 30648 consensus_queue.cc:237] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:35.328908 29972 catalog_manager.cc:5697] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:35.316651 30343 ts_tablet_manager.cc:1434] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.000s
I20260709 12:20:35.338393 30343 tablet_bootstrap.cc:492] T d782d59119bc45d08292b0b77cabedc9 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:35.344143 30344 tablet_bootstrap.cc:492] T d782d59119bc45d08292b0b77cabedc9 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:35.321209 30346 tablet_bootstrap.cc:654] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.344799 30344 ts_tablet_manager.cc:1403] T d782d59119bc45d08292b0b77cabedc9 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.111s	user 0.015s	sys 0.002s
I20260709 12:20:35.348081 30344 raft_consensus.cc:359] T d782d59119bc45d08292b0b77cabedc9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.349422 30344 raft_consensus.cc:385] T d782d59119bc45d08292b0b77cabedc9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.349985 30344 raft_consensus.cc:740] T d782d59119bc45d08292b0b77cabedc9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.350598 30342 tablet_bootstrap.cc:492] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:35.354072 30342 ts_tablet_manager.cc:1403] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.093s	user 0.015s	sys 0.002s
I20260709 12:20:35.353497 29972 catalog_manager.cc:5697] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:35.355526 30557 raft_consensus.cc:493] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.355955 30570 raft_consensus.cc:493] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.356289 30557 raft_consensus.cc:515] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:35.356730 30570 raft_consensus.cc:515] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.359088 30570 leader_election.cc:290] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:35.359903 30557 leader_election.cc:290] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:35.360577 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f159a8c7a6304cfc9a399f5c37fe3e1b" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:35.363456 30342 raft_consensus.cc:359] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:35.364495 30342 raft_consensus.cc:385] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.364795 30342 raft_consensus.cc:740] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.365533 30342 consensus_queue.cc:260] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:35.366703 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f2f494c25b47459faf1d6e4a245f08" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:35.367709 30342 ts_tablet_manager.cc:1434] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:20:35.368048 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f159a8c7a6304cfc9a399f5c37fe3e1b" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:35.368758 30342 tablet_bootstrap.cc:492] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
W20260709 12:20:35.369483 30115 leader_election.cc:343] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:35.364056 30188 leader_election.cc:343] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.370520 30343 tablet_bootstrap.cc:654] T d782d59119bc45d08292b0b77cabedc9 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.371025 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f2f494c25b47459faf1d6e4a245f08" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:35.371712 30219 raft_consensus.cc:2468] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:35.375864 30346 tablet_bootstrap.cc:492] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:35.376444 30346 ts_tablet_manager.cc:1403] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.003s
I20260709 12:20:35.378420 30343 tablet_bootstrap.cc:492] T d782d59119bc45d08292b0b77cabedc9 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:35.378947 30343 ts_tablet_manager.cc:1403] T d782d59119bc45d08292b0b77cabedc9 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.000s
I20260709 12:20:35.379218 30346 raft_consensus.cc:359] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:35.379936 30346 raft_consensus.cc:385] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.380223 30346 raft_consensus.cc:740] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.381016 30346 consensus_queue.cc:260] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
W20260709 12:20:35.382134 30189 leader_election.cc:343] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.382661 30189 leader_election.cc:304] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:35.383581 30346 ts_tablet_manager.cc:1434] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:35.383260 30343 raft_consensus.cc:359] T d782d59119bc45d08292b0b77cabedc9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.384042 30343 raft_consensus.cc:385] T d782d59119bc45d08292b0b77cabedc9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.384346 30343 raft_consensus.cc:740] T d782d59119bc45d08292b0b77cabedc9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.384701 30346 tablet_bootstrap.cc:492] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:35.384838 30113 leader_election.cc:304] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:35.385146 30343 consensus_queue.cc:260] T d782d59119bc45d08292b0b77cabedc9 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.386053 30570 raft_consensus.cc:2804] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:35.386442 30570 raft_consensus.cc:493] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.386806 30570 raft_consensus.cc:3060] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.388793 30342 tablet_bootstrap.cc:654] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.401392 30561 consensus_queue.cc:1048] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:35.383848 30401 raft_consensus.cc:2749] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:35.406002 30342 tablet_bootstrap.cc:492] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:35.406553 30342 ts_tablet_manager.cc:1403] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.002s
I20260709 12:20:35.407840 30493 raft_consensus.cc:493] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.408401 30493 raft_consensus.cc:515] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:35.410194 30570 raft_consensus.cc:515] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.410777 30493 leader_election.cc:290] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:35.350805 30344 consensus_queue.cc:260] T d782d59119bc45d08292b0b77cabedc9 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.412295 30072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5692f07fd174dbfa06976e17c1c6b00" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:35.413467 30346 tablet_bootstrap.cc:654] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:35.413805 30114 leader_election.cc:343] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.414430 30344 ts_tablet_manager.cc:1434] T d782d59119bc45d08292b0b77cabedc9 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.001s
I20260709 12:20:35.414925 30342 raft_consensus.cc:359] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.416222 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f2f494c25b47459faf1d6e4a245f08" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:35.433614 30219 raft_consensus.cc:3060] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.416361 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5692f07fd174dbfa06976e17c1c6b00" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
W20260709 12:20:35.436605 30115 leader_election.cc:343] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.437072 30115 leader_election.cc:304] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7; no voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:35.438231 30493 raft_consensus.cc:2749] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:35.419785 30343 ts_tablet_manager.cc:1434] T d782d59119bc45d08292b0b77cabedc9 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 12:20:35.438637 30561 consensus_queue.cc:1048] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:35.439781 30343 tablet_bootstrap.cc:492] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:35.441488 30219 raft_consensus.cc:2468] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:35.442025 30342 raft_consensus.cc:385] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.442950 30342 raft_consensus.cc:740] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.443274 30113 leader_election.cc:304] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:35.443812 30342 consensus_queue.cc:260] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.444103 30493 raft_consensus.cc:2804] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:35.446334 30493 raft_consensus.cc:697] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:35.447247 30493 consensus_queue.cc:237] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.449447 30344 tablet_bootstrap.cc:492] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:35.449970 30570 leader_election.cc:290] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:35.453678 30343 tablet_bootstrap.cc:654] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.451383 30342 ts_tablet_manager.cc:1434] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.002s
I20260709 12:20:35.452196 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f2f494c25b47459faf1d6e4a245f08" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:35.460837 30342 tablet_bootstrap.cc:492] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
W20260709 12:20:35.461128 30115 leader_election.cc:343] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.467728 30579 raft_consensus.cc:493] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.468456 30579 raft_consensus.cc:515] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:35.464465 30344 tablet_bootstrap.cc:654] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.481595 30220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f5109a89314f8bbf67848895ef8918" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:35.482524 30220 raft_consensus.cc:2468] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 0.
I20260709 12:20:35.476557 30579 leader_election.cc:290] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:35.487571 30342 tablet_bootstrap.cc:654] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.494352 30493 consensus_queue.cc:1048] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:35.496615 30038 leader_election.cc:304] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:35.497479 30573 raft_consensus.cc:2804] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:35.497897 30573 raft_consensus.cc:493] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.505561 29972 catalog_manager.cc:5697] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:35.498238 30573 raft_consensus.cc:3060] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:35.510704 30115 consensus_peers.cc:597] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 -> Peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Couldn't send request to peer f6c1f7275e654f49abaf1c80ed662511. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:35.493268 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f5109a89314f8bbf67848895ef8918" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
W20260709 12:20:35.513293 30037 leader_election.cc:343] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.528167 30573 raft_consensus.cc:515] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:35.534469 30351 raft_consensus.cc:493] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.538219 30351 raft_consensus.cc:515] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:35.541114 30343 tablet_bootstrap.cc:492] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:35.541564 30351 leader_election.cc:290] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:35.541673 30343 ts_tablet_manager.cc:1403] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.102s	user 0.035s	sys 0.020s
I20260709 12:20:35.547070 30573 leader_election.cc:290] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:35.544575 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c8f2fbe93624983bd807e8ac2f76aff" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:35.547998 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f5109a89314f8bbf67848895ef8918" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:35.548972 30220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f5109a89314f8bbf67848895ef8918" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
W20260709 12:20:35.549633 30260 leader_election.cc:343] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.549621 30220 raft_consensus.cc:3060] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.549515 30343 raft_consensus.cc:359] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:35.550884 30343 raft_consensus.cc:385] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.551106 30343 raft_consensus.cc:740] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.550097 30401 raft_consensus.cc:493] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.554057 30343 consensus_queue.cc:260] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:35.554224 30401 raft_consensus.cc:515] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.555881 30148 raft_consensus.cc:3060] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.556581 30343 ts_tablet_manager.cc:1434] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:20:35.557371 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32f11599774407e9de2e65083c53e17" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:35.557807 30343 tablet_bootstrap.cc:492] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:35.558070 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32f11599774407e9de2e65083c53e17" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
W20260709 12:20:35.558916 30186 leader_election.cc:343] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.560205 30346 tablet_bootstrap.cc:492] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:35.560635 30346 ts_tablet_manager.cc:1403] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.176s	user 0.020s	sys 0.016s
I20260709 12:20:35.556663 30401 leader_election.cc:290] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
W20260709 12:20:35.570822 30189 leader_election.cc:343] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.577268 30189 leader_election.cc:304] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:35.577828 30148 raft_consensus.cc:2468] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 1.
I20260709 12:20:35.581207 30037 leader_election.cc:304] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:35.582134 30579 raft_consensus.cc:2804] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:35.582409 30220 raft_consensus.cc:2468] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 1.
I20260709 12:20:35.582655 30579 raft_consensus.cc:697] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:35.583590 30579 consensus_queue.cc:237] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:35.587175 30648 raft_consensus.cc:2749] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:35.590135 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c8f2fbe93624983bd807e8ac2f76aff" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:35.591653 30074 raft_consensus.cc:2468] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:35.592728 30344 tablet_bootstrap.cc:492] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:35.593271 30344 ts_tablet_manager.cc:1403] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.144s	user 0.008s	sys 0.007s
I20260709 12:20:35.595531 30262 leader_election.cc:304] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511; no voters: b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:35.598779 30351 raft_consensus.cc:2804] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:35.599126 30351 raft_consensus.cc:493] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.599428 30351 raft_consensus.cc:3060] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.599923 30346 raft_consensus.cc:359] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:35.600720 30346 raft_consensus.cc:385] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.600713 30344 raft_consensus.cc:359] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.601787 30344 raft_consensus.cc:385] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.601019 30346 raft_consensus.cc:740] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.601996 30344 raft_consensus.cc:740] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.603071 30346 consensus_queue.cc:260] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:35.605911 30346 ts_tablet_manager.cc:1434] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 12:20:35.608968 30351 raft_consensus.cc:515] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:35.603040 30344 consensus_queue.cc:260] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.610874 30346 tablet_bootstrap.cc:492] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:35.611819 30351 leader_election.cc:290] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:35.614459 30344 ts_tablet_manager.cc:1434] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:20:35.616166 30344 tablet_bootstrap.cc:492] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:35.617136 30342 tablet_bootstrap.cc:492] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:35.617578 30342 ts_tablet_manager.cc:1403] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.157s	user 0.014s	sys 0.029s
I20260709 12:20:35.613224 30401 raft_consensus.cc:493] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.625540 30401 raft_consensus.cc:515] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.630791 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d782d59119bc45d08292b0b77cabedc9" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:35.631466 30149 raft_consensus.cc:2468] T d782d59119bc45d08292b0b77cabedc9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 0.
I20260709 12:20:35.632586 30343 tablet_bootstrap.cc:654] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.632745 30186 leader_election.cc:304] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:35.633244 30073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c8f2fbe93624983bd807e8ac2f76aff" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:35.633877 30073 raft_consensus.cc:3060] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.626681 30342 raft_consensus.cc:359] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.634584 30342 raft_consensus.cc:385] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.634881 30342 raft_consensus.cc:740] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.635622 30342 consensus_queue.cc:260] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.636538 30552 raft_consensus.cc:2804] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:35.626313 29972 catalog_manager.cc:5697] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:35.636957 30552 raft_consensus.cc:493] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.637523 30552 raft_consensus.cc:3060] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.640664 30342 ts_tablet_manager.cc:1434] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.001s
I20260709 12:20:35.620971 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c8f2fbe93624983bd807e8ac2f76aff" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:35.652809 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d782d59119bc45d08292b0b77cabedc9" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
W20260709 12:20:35.653509 30260 leader_election.cc:343] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.648238 30680 raft_consensus.cc:493] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.654363 30680 raft_consensus.cc:515] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.656646 30680 leader_election.cc:290] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:35.659487 30220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f2f494c25b47459faf1d6e4a245f08" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:35.660377 30220 raft_consensus.cc:2393] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6c1f7275e654f49abaf1c80ed662511 in current term 1: Already voted for candidate b0439d4e94904196847cd825fcc8ebd7 in this term.
I20260709 12:20:35.660881 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f2f494c25b47459faf1d6e4a245f08" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:35.662578 30260 leader_election.cc:304] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c1f7275e654f49abaf1c80ed662511; no voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:35.663851 30680 raft_consensus.cc:3060] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.664161 30346 tablet_bootstrap.cc:654] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.669389 30344 tablet_bootstrap.cc:654] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.673056 30680 raft_consensus.cc:2749] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:35.650002 30552 raft_consensus.cc:515] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.686777 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d782d59119bc45d08292b0b77cabedc9" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:35.687434 30149 raft_consensus.cc:3060] T d782d59119bc45d08292b0b77cabedc9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.652081 30401 leader_election.cc:290] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:35.653467 30297 raft_consensus.cc:2468] T d782d59119bc45d08292b0b77cabedc9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 0.
I20260709 12:20:35.695050 30149 raft_consensus.cc:2468] T d782d59119bc45d08292b0b77cabedc9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
I20260709 12:20:35.695772 30619 raft_consensus.cc:493] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.696231 30186 leader_election.cc:304] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:35.696311 30619 raft_consensus.cc:515] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.697801 30401 raft_consensus.cc:2804] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:35.698395 30401 raft_consensus.cc:697] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:35.699982 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c5550b956c4f36af10de2db7490b8b" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:35.701897 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c5550b956c4f36af10de2db7490b8b" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
W20260709 12:20:35.702363 30186 leader_election.cc:343] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.698602 30619 leader_election.cc:290] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
W20260709 12:20:35.704464 30189 leader_election.cc:343] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.641822 30342 tablet_bootstrap.cc:492] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:35.704980 30189 leader_election.cc:304] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:35.708086 30619 raft_consensus.cc:2749] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:35.713254 30619 consensus_queue.cc:1048] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:35.714434 30552 leader_election.cc:290] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:35.716142 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d782d59119bc45d08292b0b77cabedc9" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:35.716789 30297 raft_consensus.cc:3060] T d782d59119bc45d08292b0b77cabedc9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.719040 30073 raft_consensus.cc:2468] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:35.724468 30262 leader_election.cc:304] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511; no voters: b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:35.725699 30351 raft_consensus.cc:2804] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:35.729074 30297 raft_consensus.cc:2468] T d782d59119bc45d08292b0b77cabedc9 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
I20260709 12:20:35.729689 30351 raft_consensus.cc:697] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:35.733615 30351 consensus_queue.cc:237] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:35.740641 30346 tablet_bootstrap.cc:492] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
W20260709 12:20:35.750949 30189 consensus_peers.cc:597] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Couldn't send request to peer f6c1f7275e654f49abaf1c80ed662511. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:35.755548 30346 ts_tablet_manager.cc:1403] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.149s	user 0.010s	sys 0.015s
I20260709 12:20:35.759210 30344 tablet_bootstrap.cc:492] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:35.759928 30344 ts_tablet_manager.cc:1403] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.144s	user 0.021s	sys 0.003s
I20260709 12:20:35.762831 30344 raft_consensus.cc:359] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:35.763589 30344 raft_consensus.cc:385] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.763873 30344 raft_consensus.cc:740] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.764564 30344 consensus_queue.cc:260] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:35.765605 29972 catalog_manager.cc:5697] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 1 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:35.769603 30346 raft_consensus.cc:359] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:35.770532 30346 raft_consensus.cc:385] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.772384 30346 raft_consensus.cc:740] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.699496 30401 consensus_queue.cc:237] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:35.779459 30344 ts_tablet_manager.cc:1434] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 12:20:35.790580 30344 tablet_bootstrap.cc:492] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:35.793223 30346 consensus_queue.cc:260] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:35.795621 30346 ts_tablet_manager.cc:1434] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.003s
I20260709 12:20:35.799290 30346 tablet_bootstrap.cc:492] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:35.809161 30346 tablet_bootstrap.cc:654] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.811312 30344 tablet_bootstrap.cc:654] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.830802 30344 tablet_bootstrap.cc:492] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:35.831207 30346 tablet_bootstrap.cc:492] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:35.831329 30344 ts_tablet_manager.cc:1403] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.005s
I20260709 12:20:35.831770 30346 ts_tablet_manager.cc:1403] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.003s
I20260709 12:20:35.834388 30344 raft_consensus.cc:359] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:35.834537 30346 raft_consensus.cc:359] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:35.835377 30346 raft_consensus.cc:385] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.835377 30344 raft_consensus.cc:385] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.835876 30346 raft_consensus.cc:740] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.835947 30344 raft_consensus.cc:740] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.836848 30346 consensus_queue.cc:260] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:35.836891 30344 consensus_queue.cc:260] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:35.841454 30344 ts_tablet_manager.cc:1434] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:20:35.842693 30344 tablet_bootstrap.cc:492] T cdeb0fe4f15c4ea9893bae143fa20651 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:35.849210 30344 tablet_bootstrap.cc:654] T cdeb0fe4f15c4ea9893bae143fa20651 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.852344 30346 ts_tablet_manager.cc:1434] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:20:35.855067 30697 raft_consensus.cc:493] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.855840 30697 raft_consensus.cc:515] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:35.858237 30697 leader_election.cc:290] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:35.859946 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5692f07fd174dbfa06976e17c1c6b00" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:35.860669 30148 raft_consensus.cc:2468] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 0.
I20260709 12:20:35.862032 30346 tablet_bootstrap.cc:492] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:35.862270 30037 leader_election.cc:304] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:35.863559 30697 raft_consensus.cc:2804] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:35.863933 30697 raft_consensus.cc:493] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.864262 30697 raft_consensus.cc:3060] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.866850 30569 consensus_queue.cc:1048] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:35.874202 30346 tablet_bootstrap.cc:654] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.880580 30697 raft_consensus.cc:515] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:35.887632 30697 leader_election.cc:290] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:35.888932 30344 tablet_bootstrap.cc:492] T cdeb0fe4f15c4ea9893bae143fa20651 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:35.889428 30344 ts_tablet_manager.cc:1403] T cdeb0fe4f15c4ea9893bae143fa20651 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.002s
I20260709 12:20:35.890913 30346 tablet_bootstrap.cc:492] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:35.891456 30346 ts_tablet_manager.cc:1403] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.003s
I20260709 12:20:35.893600 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5692f07fd174dbfa06976e17c1c6b00" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:35.894299 30148 raft_consensus.cc:3060] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.897568 30346 raft_consensus.cc:359] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:35.898368 30346 raft_consensus.cc:385] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.892844 30344 raft_consensus.cc:359] T cdeb0fe4f15c4ea9893bae143fa20651 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:35.898638 30346 raft_consensus.cc:740] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.899036 30344 raft_consensus.cc:385] T cdeb0fe4f15c4ea9893bae143fa20651 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.899637 30493 consensus_queue.cc:1048] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:20:35.899518 30346 consensus_queue.cc:260] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:35.909504 30346 ts_tablet_manager.cc:1434] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.003s
I20260709 12:20:35.910533 30346 tablet_bootstrap.cc:492] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:35.911633 30697 raft_consensus.cc:493] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.912155 30697 raft_consensus.cc:515] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:35.915338 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f01efd7c139e45c3809ed6a668f1faca" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
W20260709 12:20:35.917284 30037 leader_election.cc:343] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.917973 30697 leader_election.cc:290] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:35.923565 30346 tablet_bootstrap.cc:654] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.926290 30342 tablet_bootstrap.cc:654] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.919543 29967 catalog_manager.cc:5697] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:35.899384 30344 raft_consensus.cc:740] T cdeb0fe4f15c4ea9893bae143fa20651 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.935581 30344 consensus_queue.cc:260] T cdeb0fe4f15c4ea9893bae143fa20651 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:35.949959 30344 ts_tablet_manager.cc:1434] T cdeb0fe4f15c4ea9893bae143fa20651 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.001s
I20260709 12:20:35.951088 30344 tablet_bootstrap.cc:492] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:35.953831 30148 raft_consensus.cc:2468] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 1.
I20260709 12:20:35.955281 30296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f01efd7c139e45c3809ed6a668f1faca" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:35.955628 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5692f07fd174dbfa06976e17c1c6b00" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:35.956192 30037 leader_election.cc:304] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:35.956490 30293 raft_consensus.cc:2468] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 0.
I20260709 12:20:35.957172 30579 raft_consensus.cc:2804] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:35.957675 30579 raft_consensus.cc:697] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:35.957945 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5692f07fd174dbfa06976e17c1c6b00" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:35.963794 30344 tablet_bootstrap.cc:654] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.958648 30294 raft_consensus.cc:3060] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.976291 30493 consensus_queue.cc:1048] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:20:35.988458 30040 leader_election.cc:343] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.988992 30040 leader_election.cc:304] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:35.989681 30573 raft_consensus.cc:2749] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:35.991129 30294 raft_consensus.cc:2468] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 1.
I20260709 12:20:35.993382 30569 consensus_queue.cc:1048] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:35.958523 30579 consensus_queue.cc:237] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:36.009739 30344 tablet_bootstrap.cc:492] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:36.010399 30344 ts_tablet_manager.cc:1403] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.060s	user 0.018s	sys 0.011s
I20260709 12:20:36.024782 30342 tablet_bootstrap.cc:492] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:36.024902 30344 raft_consensus.cc:359] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:36.025496 30342 ts_tablet_manager.cc:1403] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.384s	user 0.024s	sys 0.000s
I20260709 12:20:36.025701 30344 raft_consensus.cc:385] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:36.026049 30344 raft_consensus.cc:740] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:36.026301 30343 tablet_bootstrap.cc:492] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:36.026782 30343 ts_tablet_manager.cc:1403] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.469s	user 0.140s	sys 0.144s
I20260709 12:20:36.026660 30344 consensus_queue.cc:260] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:36.027137 30346 tablet_bootstrap.cc:492] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:36.028343 30346 ts_tablet_manager.cc:1403] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.012s
I20260709 12:20:36.029619 30342 raft_consensus.cc:359] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:36.030413 30342 raft_consensus.cc:385] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:36.030726 30342 raft_consensus.cc:740] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:36.036727 30342 consensus_queue.cc:260] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:36.041363 30343 raft_consensus.cc:359] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:36.042125 30343 raft_consensus.cc:385] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:36.042400 30343 raft_consensus.cc:740] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:36.049077 30344 ts_tablet_manager.cc:1434] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:20:36.042917 30343 consensus_queue.cc:260] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:36.055845 30344 tablet_bootstrap.cc:492] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:36.054636 30346 raft_consensus.cc:359] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:36.057264 30346 raft_consensus.cc:385] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:36.057574 30346 raft_consensus.cc:740] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:36.062409 30346 consensus_queue.cc:260] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:36.066495 30342 ts_tablet_manager.cc:1434] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260709 12:20:36.068187 30342 tablet_bootstrap.cc:492] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:36.080355 30346 ts_tablet_manager.cc:1434] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:20:36.082489 30346 tablet_bootstrap.cc:492] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:36.083509 30343 ts_tablet_manager.cc:1434] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.056s	user 0.004s	sys 0.003s
I20260709 12:20:36.084507 30343 tablet_bootstrap.cc:492] T 6c8f2fbe93624983bd807e8ac2f76aff P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:36.089820 30649 raft_consensus.cc:493] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.090422 30649 raft_consensus.cc:515] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:36.102017 30649 leader_election.cc:290] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:36.102582 30342 tablet_bootstrap.cc:654] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:36.104352 30344 tablet_bootstrap.cc:654] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:36.115899 29970 catalog_manager.cc:5697] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:36.121477 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8364709c0e424d6791fed2d28528c655" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:36.122349 30222 raft_consensus.cc:2468] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 0.
I20260709 12:20:36.123232 30343 tablet_bootstrap.cc:654] T 6c8f2fbe93624983bd807e8ac2f76aff P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:36.128130 30346 tablet_bootstrap.cc:654] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:36.135130 30020 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:36.145012 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8364709c0e424d6791fed2d28528c655" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:36.145951 30297 raft_consensus.cc:2468] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 0.
I20260709 12:20:36.161098 30038 leader_election.cc:304] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:36.199033 30351 raft_consensus.cc:493] T cdeb0fe4f15c4ea9893bae143fa20651 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.199991 30351 raft_consensus.cc:515] T cdeb0fe4f15c4ea9893bae143fa20651 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:36.205470 30342 tablet_bootstrap.cc:492] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:36.206050 30342 ts_tablet_manager.cc:1403] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.138s	user 0.030s	sys 0.031s
I20260709 12:20:36.208681 30342 raft_consensus.cc:359] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:36.209400 30342 raft_consensus.cc:385] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:36.209652 30342 raft_consensus.cc:740] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:36.218173 30351 leader_election.cc:290] T cdeb0fe4f15c4ea9893bae143fa20651 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:36.219298 30342 consensus_queue.cc:260] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:36.233276 30071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdeb0fe4f15c4ea9893bae143fa20651" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:36.227294 30573 raft_consensus.cc:2804] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:36.235508 30573 raft_consensus.cc:493] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.235908 30573 raft_consensus.cc:3060] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:36.236362 30038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:44035, user_credentials={real_user=slave}} blocked reactor thread for 89800.3us
I20260709 12:20:36.273118 30342 ts_tablet_manager.cc:1434] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 12:20:36.279281 30342 tablet_bootstrap.cc:492] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:36.268649 30557 raft_consensus.cc:493] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.282578 30344 tablet_bootstrap.cc:492] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:36.286158 30344 ts_tablet_manager.cc:1403] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.231s	user 0.021s	sys 0.012s
I20260709 12:20:36.296916 30343 tablet_bootstrap.cc:492] T 6c8f2fbe93624983bd807e8ac2f76aff P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:36.297474 30343 ts_tablet_manager.cc:1403] T 6c8f2fbe93624983bd807e8ac2f76aff P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.213s	user 0.019s	sys 0.011s
I20260709 12:20:36.301018 30220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdeb0fe4f15c4ea9893bae143fa20651" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:36.287225 30557 raft_consensus.cc:515] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
W20260709 12:20:36.302052 30260 consensus_peers.cc:597] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:36.303956 30557 leader_election.cc:290] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:36.319363 30649 consensus_queue.cc:1048] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:36.321331 30346 tablet_bootstrap.cc:492] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:36.321843 30346 ts_tablet_manager.cc:1403] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.240s	user 0.013s	sys 0.021s
I20260709 12:20:36.312000 30579 raft_consensus.cc:493] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.324210 30648 consensus_queue.cc:1048] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:36.325965 30261 leader_election.cc:304] T cdeb0fe4f15c4ea9893bae143fa20651 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:36.326386 30294 raft_consensus.cc:3060] T cdeb0fe4f15c4ea9893bae143fa20651 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:36.326690 30579 raft_consensus.cc:515] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:36.329701 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55101a88e97746d0bc20a0bc0ed8989c" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
W20260709 12:20:36.331351 30037 leader_election.cc:343] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:36.340236 30346 raft_consensus.cc:359] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:36.341732 30346 raft_consensus.cc:385] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:36.342199 30346 raft_consensus.cc:740] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:36.343631 30346 consensus_queue.cc:260] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:36.347571 30344 raft_consensus.cc:359] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:36.348361 30344 raft_consensus.cc:385] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:36.348624 30344 raft_consensus.cc:740] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:36.349344 30344 consensus_queue.cc:260] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:36.344794 30343 raft_consensus.cc:359] T 6c8f2fbe93624983bd807e8ac2f76aff P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:36.350684 30343 raft_consensus.cc:385] T 6c8f2fbe93624983bd807e8ac2f76aff P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:36.350988 30343 raft_consensus.cc:740] T 6c8f2fbe93624983bd807e8ac2f76aff P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:36.351539 30343 consensus_queue.cc:260] T 6c8f2fbe93624983bd807e8ac2f76aff P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:36.353572 30573 raft_consensus.cc:515] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:36.342814 30649 consensus_queue.cc:1048] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:20:36.358021 30344 ts_tablet_manager.cc:1434] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 12:20:36.359035 30343 ts_tablet_manager.cc:1434] T 6c8f2fbe93624983bd807e8ac2f76aff P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 12:20:36.359807 30343 tablet_bootstrap.cc:492] T c32f11599774407e9de2e65083c53e17 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:36.361140 30346 ts_tablet_manager.cc:1434] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.039s	user 0.002s	sys 0.004s
I20260709 12:20:36.361570 30344 tablet_bootstrap.cc:492] T 961df2c56aac4887bbb0971fd85cd3b0 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:36.377051 30342 tablet_bootstrap.cc:654] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:36.390115 30070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60e61e6fb8fe4b2ba4edb9d057c98d4c" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:36.390882 30070 raft_consensus.cc:2468] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 0.
I20260709 12:20:36.390934 30573 leader_election.cc:290] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:36.396648 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8364709c0e424d6791fed2d28528c655" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:36.397498 30219 raft_consensus.cc:3060] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:36.398402 30188 leader_election.cc:304] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:36.400454 30552 raft_consensus.cc:2804] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:36.400863 30552 raft_consensus.cc:493] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.401153 30342 tablet_bootstrap.cc:492] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:36.401721 30342 ts_tablet_manager.cc:1403] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.123s	user 0.011s	sys 0.005s
I20260709 12:20:36.388545 30579 leader_election.cc:290] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:36.389668 30344 tablet_bootstrap.cc:654] T 961df2c56aac4887bbb0971fd85cd3b0 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:36.401199 30552 raft_consensus.cc:3060] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:36.387096 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60e61e6fb8fe4b2ba4edb9d057c98d4c" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:36.377121 30346 tablet_bootstrap.cc:492] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:36.408915 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55101a88e97746d0bc20a0bc0ed8989c" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:36.423072 30222 raft_consensus.cc:2468] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 0.
I20260709 12:20:36.422940 30342 raft_consensus.cc:359] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:36.423764 30342 raft_consensus.cc:385] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:36.424060 30342 raft_consensus.cc:740] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
I20260709 12:20:36.424656 30038 leader_election.cc:304] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:36.425158 30343 tablet_bootstrap.cc:654] T c32f11599774407e9de2e65083c53e17 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:36.426121 30697 raft_consensus.cc:2804] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:36.426546 30697 raft_consensus.cc:493] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.426909 30697 raft_consensus.cc:3060] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:36.419260 30552 raft_consensus.cc:515] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:36.429845 30342 consensus_queue.cc:260] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
W20260709 12:20:36.442852 30040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:33729, user_credentials={real_user=slave}} blocked reactor thread for 73904.8us
I20260709 12:20:36.459386 30728 consensus_queue.cc:1048] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:36.450389 30493 raft_consensus.cc:493] T 6c8f2fbe93624983bd807e8ac2f76aff P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.464130 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8364709c0e424d6791fed2d28528c655" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:36.464646 30493 raft_consensus.cc:515] T 6c8f2fbe93624983bd807e8ac2f76aff P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:36.464874 30648 raft_consensus.cc:493] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.465548 30648 raft_consensus.cc:515] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:36.466989 30493 leader_election.cc:290] T 6c8f2fbe93624983bd807e8ac2f76aff P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:36.464850 30293 raft_consensus.cc:3060] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:36.468480 30068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cf731d884ab6bcb89a294b8b905c" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:36.469322 30068 raft_consensus.cc:2468] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 0.
I20260709 12:20:36.473448 30188 leader_election.cc:304] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:36.474047 30296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c8f2fbe93624983bd807e8ac2f76aff" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:36.474342 30557 raft_consensus.cc:2804] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:36.474745 30557 raft_consensus.cc:493] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.475087 30557 raft_consensus.cc:3060] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:36.474457 30342 ts_tablet_manager.cc:1434] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 12:20:36.479171 30342 tablet_bootstrap.cc:492] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86: Bootstrap starting.
I20260709 12:20:36.482863 30680 raft_consensus.cc:493] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.497421 30680 raft_consensus.cc:515] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:36.509393 30074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c8f2fbe93624983bd807e8ac2f76aff" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:36.512127 30400 raft_consensus.cc:493] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.513068 30074 raft_consensus.cc:2393] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0439d4e94904196847cd825fcc8ebd7 in current term 1: Already voted for candidate f6c1f7275e654f49abaf1c80ed662511 in this term.
I20260709 12:20:36.512674 30400 raft_consensus.cc:515] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:36.499684 30680 leader_election.cc:290] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:36.523038 30114 leader_election.cc:304] T 6c8f2fbe93624983bd807e8ac2f76aff P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7; no voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:36.527971 30072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f159a8c7a6304cfc9a399f5c37fe3e1b" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:36.540729 30400 leader_election.cc:290] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:36.544770 30346 tablet_bootstrap.cc:654] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:36.546348 30552 leader_election.cc:290] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:36.548795 30219 raft_consensus.cc:2468] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 1.
I20260709 12:20:36.542098 30648 leader_election.cc:290] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:36.536670 30569 raft_consensus.cc:3060] T 6c8f2fbe93624983bd807e8ac2f76aff P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:36.508096 30649 consensus_queue.cc:1048] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 12:20:36.555812 30068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60e61e6fb8fe4b2ba4edb9d057c98d4c" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:36.556588 30068 raft_consensus.cc:3060] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:36.557247 30561 raft_consensus.cc:2749] T cdeb0fe4f15c4ea9893bae143fa20651 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:36.549427 30697 raft_consensus.cc:515] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:36.565194 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55101a88e97746d0bc20a0bc0ed8989c" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:36.566033 30222 raft_consensus.cc:3060] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:36.565109 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cf731d884ab6bcb89a294b8b905c" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:36.571471 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55101a88e97746d0bc20a0bc0ed8989c" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:36.576994 30569 raft_consensus.cc:2749] T 6c8f2fbe93624983bd807e8ac2f76aff P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:36.582651 30037 leader_election.cc:343] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:36.567839 30293 raft_consensus.cc:2468] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 1.
I20260709 12:20:36.584352 30342 tablet_bootstrap.cc:654] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:36.589519 30115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:33729, user_credentials={real_user=slave}} blocked reactor thread for 45727us
W20260709 12:20:36.591697 30262 leader_election.cc:343] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:36.592444 30040 leader_election.cc:304] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:36.598642 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cf731d884ab6bcb89a294b8b905c" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:36.599392 30147 raft_consensus.cc:2468] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 0.
I20260709 12:20:36.603329 30344 tablet_bootstrap.cc:492] T 961df2c56aac4887bbb0971fd85cd3b0 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:36.603859 30344 ts_tablet_manager.cc:1403] T 961df2c56aac4887bbb0971fd85cd3b0 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.245s	user 0.012s	sys 0.012s
W20260709 12:20:36.606894 30189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:33729, user_credentials={real_user=slave}} blocked reactor thread for 119837us
I20260709 12:20:36.602506 30579 raft_consensus.cc:2804] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:20:36.607672 30189 leader_election.cc:343] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:36.590030 30697 leader_election.cc:290] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:36.594374 30557 raft_consensus.cc:515] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:36.601967 30067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cf731d884ab6bcb89a294b8b905c" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:36.629786 30344 raft_consensus.cc:359] T 961df2c56aac4887bbb0971fd85cd3b0 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:36.630568 30344 raft_consensus.cc:385] T 961df2c56aac4887bbb0971fd85cd3b0 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:36.630851 30344 raft_consensus.cc:740] T 961df2c56aac4887bbb0971fd85cd3b0 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:36.635535 30343 tablet_bootstrap.cc:492] T c32f11599774407e9de2e65083c53e17 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:36.636157 30343 ts_tablet_manager.cc:1403] T c32f11599774407e9de2e65083c53e17 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.276s	user 0.014s	sys 0.005s
I20260709 12:20:36.616777 30579 raft_consensus.cc:697] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:36.642418 30344 consensus_queue.cc:260] T 961df2c56aac4887bbb0971fd85cd3b0 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:36.643551 30728 raft_consensus.cc:493] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.622068 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f159a8c7a6304cfc9a399f5c37fe3e1b" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:36.645539 30351 raft_consensus.cc:493] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.646145 30351 raft_consensus.cc:515] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:36.650843 30068 raft_consensus.cc:2468] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
I20260709 12:20:36.652050 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60e61e6fb8fe4b2ba4edb9d057c98d4c" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:36.652438 30557 leader_election.cc:290] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:36.627141 30222 raft_consensus.cc:2468] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 1.
I20260709 12:20:36.654541 30343 raft_consensus.cc:359] T c32f11599774407e9de2e65083c53e17 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:36.655548 30343 raft_consensus.cc:385] T c32f11599774407e9de2e65083c53e17 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:36.655835 30343 raft_consensus.cc:740] T c32f11599774407e9de2e65083c53e17 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:36.656276 30188 leader_election.cc:304] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:36.654642 30072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cf731d884ab6bcb89a294b8b905c" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:36.659214 30619 raft_consensus.cc:2804] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:36.659729 30619 raft_consensus.cc:697] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:36.660619 30619 consensus_queue.cc:237] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:36.664179 30038 leader_election.cc:304] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:36.665751 30649 raft_consensus.cc:2804] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:36.624186 30573 consensus_queue.cc:1048] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:20:36.668509 30219 raft_consensus.cc:2468] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:36.671100 30223 raft_consensus.cc:2393] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0439d4e94904196847cd825fcc8ebd7 in current term 1: Already voted for candidate f3ef588fc4b54ec09355022d7a5a5e86 in this term.
I20260709 12:20:36.634049 30067 raft_consensus.cc:2468] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:36.675778 30579 consensus_queue.cc:237] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:36.677414 30649 raft_consensus.cc:697] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:36.657887 30351 leader_election.cc:290] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:36.656574 30343 consensus_queue.cc:260] T c32f11599774407e9de2e65083c53e17 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:36.688735 30114 leader_election.cc:304] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:36.689842 30400 raft_consensus.cc:2804] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:36.690291 30400 raft_consensus.cc:493] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.691293 30400 raft_consensus.cc:3060] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:36.690649 30115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.4:33729, user_credentials={real_user=slave}} blocked reactor thread for 60047.5us
I20260709 12:20:36.644134 30728 raft_consensus.cc:515] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
W20260709 12:20:36.693356 30189 leader_election.cc:343] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:36.713708 30728 leader_election.cc:290] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
W20260709 12:20:36.720522 30260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:40479, user_credentials={real_user=slave}} blocked reactor thread for 72927.8us
I20260709 12:20:36.722754 30070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094cffecb264ab689cd0baf985837d8" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:36.697381 30343 ts_tablet_manager.cc:1434] T c32f11599774407e9de2e65083c53e17 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.002s
I20260709 12:20:36.700028 30342 tablet_bootstrap.cc:492] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86: No bootstrap required, opened a new log
I20260709 12:20:36.728570 30342 ts_tablet_manager.cc:1403] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86: Time spent bootstrapping tablet: real 0.250s	user 0.011s	sys 0.006s
I20260709 12:20:36.707579 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cf731d884ab6bcb89a294b8b905c" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:36.710314 30726 consensus_queue.cc:1048] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.114s
I20260709 12:20:36.678440 30649 consensus_queue.cc:237] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:36.739717 30400 raft_consensus.cc:515] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:36.729171 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32f11599774407e9de2e65083c53e17" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:36.741405 30148 raft_consensus.cc:2468] T c32f11599774407e9de2e65083c53e17 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:36.748863 30343 tablet_bootstrap.cc:492] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:36.735467 30342 raft_consensus.cc:359] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:36.750141 30342 raft_consensus.cc:385] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:36.749882 30400 leader_election.cc:290] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:36.750655 30342 raft_consensus.cc:740] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Initialized, Role: FOLLOWER
W20260709 12:20:36.750192 30261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:44035, user_credentials={real_user=slave}} blocked reactor thread for 108294us
I20260709 12:20:36.767745 30071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cf731d884ab6bcb89a294b8b905c" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
W20260709 12:20:36.768067 30188 leader_election.cc:343] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:36.768548 30071 raft_consensus.cc:3060] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:36.788726 30146 raft_consensus.cc:2393] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f3ef588fc4b54ec09355022d7a5a5e86 in current term 1: Already voted for candidate b0439d4e94904196847cd825fcc8ebd7 in this term.
I20260709 12:20:36.786999 30342 consensus_queue.cc:260] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:36.789856 30145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094cffecb264ab689cd0baf985837d8" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:36.795508 30342 ts_tablet_manager.cc:1434] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.001s
I20260709 12:20:36.796188 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cf731d884ab6bcb89a294b8b905c" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
W20260709 12:20:36.799321 30186 leader_election.cc:343] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:36.799867 30186 leader_election.cc:304] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:36.812954 30223 raft_consensus.cc:2393] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b0439d4e94904196847cd825fcc8ebd7 in current term 1: Already voted for candidate f3ef588fc4b54ec09355022d7a5a5e86 in this term.
I20260709 12:20:36.823181 30744 raft_consensus.cc:2749] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:36.828917 30346 tablet_bootstrap.cc:492] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:36.831889 30346 ts_tablet_manager.cc:1403] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.455s	user 0.044s	sys 0.042s
I20260709 12:20:36.829252 30344 ts_tablet_manager.cc:1434] T 961df2c56aac4887bbb0971fd85cd3b0 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.225s	user 0.015s	sys 0.025s
I20260709 12:20:36.828958 30261 leader_election.cc:304] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:36.817641 30260 leader_election.cc:304] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:36.836948 30344 tablet_bootstrap.cc:492] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:36.840714 30343 tablet_bootstrap.cc:654] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:36.840929 30186 leader_election.cc:304] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:36.841547 30560 raft_consensus.cc:2804] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:36.841993 30560 raft_consensus.cc:493] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.842336 30560 raft_consensus.cc:3060] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:36.842406 30552 raft_consensus.cc:2749] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:36.843868 30346 raft_consensus.cc:359] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:36.844372 30346 raft_consensus.cc:385] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:36.844533 30346 raft_consensus.cc:740] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:36.845006 30346 consensus_queue.cc:260] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:36.847633 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32f11599774407e9de2e65083c53e17" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:36.848003 30747 raft_consensus.cc:2804] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:36.848439 30747 raft_consensus.cc:493] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.847110 30344 tablet_bootstrap.cc:654] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:36.848398 30222 raft_consensus.cc:2468] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:36.849043 30346 ts_tablet_manager.cc:1434] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:20:36.850056 30346 tablet_bootstrap.cc:492] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:36.850803 30747 raft_consensus.cc:3060] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:36.853889 30344 tablet_bootstrap.cc:492] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:36.854418 30344 ts_tablet_manager.cc:1403] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 12:20:36.855159 30346 tablet_bootstrap.cc:654] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:36.873541 30344 raft_consensus.cc:359] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:36.874445 30344 raft_consensus.cc:385] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:36.874747 30344 raft_consensus.cc:740] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:36.875476 30344 consensus_queue.cc:260] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:36.877996 30344 ts_tablet_manager.cc:1434] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.014s
I20260709 12:20:36.879019 30344 tablet_bootstrap.cc:492] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:36.882310 30747 raft_consensus.cc:515] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:36.884140 30560 raft_consensus.cc:515] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:36.884748 30344 tablet_bootstrap.cc:654] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:36.886806 30747 leader_election.cc:290] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:36.960085 30560 leader_election.cc:290] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:36.963598 30071 raft_consensus.cc:2468] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:36.976840 30070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f159a8c7a6304cfc9a399f5c37fe3e1b" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:36.992154 30296 raft_consensus.cc:3060] T 961df2c56aac4887bbb0971fd85cd3b0 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:36.964154 29970 catalog_manager.cc:5697] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:37.023845 30145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32f11599774407e9de2e65083c53e17" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:37.040066 30552 raft_consensus.cc:493] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.042771 30552 raft_consensus.cc:515] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:37.040432 30070 raft_consensus.cc:3060] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:37.050196 30145 raft_consensus.cc:3060] T c32f11599774407e9de2e65083c53e17 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:37.035092 29972 catalog_manager.cc:5697] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.052469 30114 leader_election.cc:304] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:37.085469 30743 raft_consensus.cc:2804] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:37.086681 30743 raft_consensus.cc:697] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:37.088232 30743 consensus_queue.cc:237] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
W20260709 12:20:37.067950 30261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:44035, user_credentials={real_user=slave}} blocked reactor thread for 90669.2us
I20260709 12:20:37.095202 30552 leader_election.cc:290] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:37.096655 30071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b12541deba40218ef3f8c40f40312a" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:37.110798 30295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b12541deba40218ef3f8c40f40312a" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:37.111924 30346 tablet_bootstrap.cc:492] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:37.112864 30346 ts_tablet_manager.cc:1403] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.263s	user 0.020s	sys 0.016s
I20260709 12:20:37.114319 30344 tablet_bootstrap.cc:492] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:37.115118 30344 ts_tablet_manager.cc:1403] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.236s	user 0.008s	sys 0.008s
I20260709 12:20:37.115860 30343 tablet_bootstrap.cc:492] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:37.116700 30343 ts_tablet_manager.cc:1403] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.372s	user 0.012s	sys 0.003s
I20260709 12:20:37.119868 30344 raft_consensus.cc:359] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:37.121227 30344 raft_consensus.cc:385] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.121587 30344 raft_consensus.cc:740] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.122351 30344 consensus_queue.cc:260] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
W20260709 12:20:37.122826 30188 leader_election.cc:343] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:37.123270 30346 raft_consensus.cc:359] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:37.124390 30346 raft_consensus.cc:385] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.124606 30346 raft_consensus.cc:740] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.128329 30145 raft_consensus.cc:2468] T c32f11599774407e9de2e65083c53e17 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:37.130920 30344 ts_tablet_manager.cc:1434] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:20:37.131881 30260 leader_election.cc:304] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:37.132614 30344 tablet_bootstrap.cc:492] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:37.148018 30343 raft_consensus.cc:359] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:37.148366 30619 consensus_queue.cc:1048] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:37.149032 30343 raft_consensus.cc:385] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.149421 30343 raft_consensus.cc:740] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.148597 30747 raft_consensus.cc:2804] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:37.150462 30343 consensus_queue.cc:260] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:37.151049 30747 raft_consensus.cc:697] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:37.153090 30747 consensus_queue.cc:237] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:37.155433 30731 consensus_queue.cc:1048] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:37.164690 30070 raft_consensus.cc:2468] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:37.170588 30262 leader_election.cc:304] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:37.172394 30346 consensus_queue.cc:260] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:37.177501 30343 ts_tablet_manager.cc:1434] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.061s	user 0.010s	sys 0.000s
I20260709 12:20:37.182343 30560 raft_consensus.cc:2804] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:37.185206 30731 consensus_queue.cc:1048] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:20:37.198500 30189 leader_election.cc:343] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:37.199038 30189 leader_election.cc:304] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511
W20260709 12:20:37.202386 30189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.4:33729, user_credentials={real_user=slave}} blocked reactor thread for 77083.1us
I20260709 12:20:37.201802 30680 raft_consensus.cc:493] T 961df2c56aac4887bbb0971fd85cd3b0 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0439d4e94904196847cd825fcc8ebd7)
I20260709 12:20:37.205067 30346 ts_tablet_manager.cc:1434] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.001s
I20260709 12:20:37.205866 30744 raft_consensus.cc:2749] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:37.215540 30346 tablet_bootstrap.cc:492] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:37.203467 30680 raft_consensus.cc:515] T 961df2c56aac4887bbb0971fd85cd3b0 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:37.200609 30560 raft_consensus.cc:697] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:37.226534 30560 consensus_queue.cc:237] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:37.223194 30731 consensus_queue.cc:1048] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:20:37.235558 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f159a8c7a6304cfc9a399f5c37fe3e1b" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:37.237150 30223 raft_consensus.cc:3060] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:37.248953 30344 tablet_bootstrap.cc:654] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.254383 30346 tablet_bootstrap.cc:654] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.270777 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32f11599774407e9de2e65083c53e17" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:37.271627 30221 raft_consensus.cc:3060] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:37.275415 30343 tablet_bootstrap.cc:492] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
W20260709 12:20:37.282356 30766 log.cc:927] Time spent T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:20:37.284505 30145 raft_consensus.cc:3060] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:37.297067 29967 catalog_manager.cc:5697] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:37.355549 30680 leader_election.cc:290] T 961df2c56aac4887bbb0971fd85cd3b0 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
W20260709 12:20:37.393278 30189 consensus_peers.cc:597] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Couldn't send request to peer f6c1f7275e654f49abaf1c80ed662511. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:37.396121 30223 raft_consensus.cc:2468] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:37.397425 30071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961df2c56aac4887bbb0971fd85cd3b0" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:37.387892 30221 raft_consensus.cc:2468] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
W20260709 12:20:37.417904 30768 log.cc:927] Time spent T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:20:37.406137 30680 raft_consensus.cc:493] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.427790 30346 tablet_bootstrap.cc:492] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:37.430101 30346 ts_tablet_manager.cc:1403] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.215s	user 0.018s	sys 0.001s
I20260709 12:20:37.432574 30649 raft_consensus.cc:493] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.430065 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961df2c56aac4887bbb0971fd85cd3b0" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:37.433132 30649 raft_consensus.cc:515] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:37.443668 30649 leader_election.cc:290] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:37.434410 30680 raft_consensus.cc:515] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:37.437597 30759 raft_consensus.cc:493] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.447893 30759 raft_consensus.cc:515] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:37.449383 30344 tablet_bootstrap.cc:492] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:37.449977 30344 ts_tablet_manager.cc:1403] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.318s	user 0.018s	sys 0.003s
I20260709 12:20:37.450749 30680 leader_election.cc:290] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:37.438987 30343 tablet_bootstrap.cc:654] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.453122 30344 raft_consensus.cc:359] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:37.453871 30344 raft_consensus.cc:385] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.454149 30344 raft_consensus.cc:740] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.454770 30344 consensus_queue.cc:260] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:37.438493 30579 consensus_queue.cc:1048] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:37.455430 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b12541deba40218ef3f8c40f40312a" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:37.456384 30221 raft_consensus.cc:2468] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 0.
I20260709 12:20:37.457126 30344 ts_tablet_manager.cc:1434] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:20:37.457638 30038 leader_election.cc:304] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:37.451851 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55101a88e97746d0bc20a0bc0ed8989c" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:37.451630 30759 leader_election.cc:290] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:37.470554 30344 tablet_bootstrap.cc:492] T af7b5f5579594d8381af5f96a15e24d9 P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:37.473706 30726 raft_consensus.cc:493] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.474419 30726 raft_consensus.cc:515] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:37.476460 30579 raft_consensus.cc:2804] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:37.477948 30071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55101a88e97746d0bc20a0bc0ed8989c" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:37.479553 30579 raft_consensus.cc:493] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.481953 30579 raft_consensus.cc:3060] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:37.483916 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c5550b956c4f36af10de2db7490b8b" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
W20260709 12:20:37.481122 30261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:44035, user_credentials={real_user=slave}} blocked reactor thread for 124930us
I20260709 12:20:37.496587 30726 leader_election.cc:290] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:37.498236 30114 leader_election.cc:304] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7; no voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:37.505309 30343 tablet_bootstrap.cc:492] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:37.507023 30343 ts_tablet_manager.cc:1403] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.232s	user 0.014s	sys 0.002s
I20260709 12:20:37.481369 30260 leader_election.cc:304] T 961df2c56aac4887bbb0971fd85cd3b0 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:37.504647 30346 raft_consensus.cc:359] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:37.510849 30346 raft_consensus.cc:385] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.511226 30346 raft_consensus.cc:740] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.512310 30071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f01efd7c139e45c3809ed6a668f1faca" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:37.513065 30071 raft_consensus.cc:2468] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:37.520982 30344 tablet_bootstrap.cc:654] T af7b5f5579594d8381af5f96a15e24d9 P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:37.525031 30260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.2:40479, user_credentials={real_user=slave}} blocked reactor thread for 48002.3us
I20260709 12:20:37.525959 30726 raft_consensus.cc:2749] T 961df2c56aac4887bbb0971fd85cd3b0 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:37.533406 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f01efd7c139e45c3809ed6a668f1faca" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
W20260709 12:20:37.528180 30260 leader_election.cc:343] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:37.547546 30260 leader_election.cc:343] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:37.548696 30346 consensus_queue.cc:260] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:37.550439 30346 ts_tablet_manager.cc:1434] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.120s	user 0.007s	sys 0.000s
I20260709 12:20:37.553627 30262 leader_election.cc:304] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511; no voters: b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:37.554834 30560 raft_consensus.cc:2804] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:37.555227 30560 raft_consensus.cc:493] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.555553 30560 raft_consensus.cc:3060] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:37.556083 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c5550b956c4f36af10de2db7490b8b" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:37.556568 30343 raft_consensus.cc:359] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:37.557313 30343 raft_consensus.cc:385] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.557581 30343 raft_consensus.cc:740] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.556874 30223 raft_consensus.cc:2468] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 0.
I20260709 12:20:37.558331 30343 consensus_queue.cc:260] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:37.553504 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b12541deba40218ef3f8c40f40312a" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:37.565092 30493 raft_consensus.cc:2749] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:37.565606 30261 leader_election.cc:304] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:37.566596 30346 tablet_bootstrap.cc:492] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:37.567364 30560 raft_consensus.cc:515] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:37.568176 30726 raft_consensus.cc:2804] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:37.568627 30726 raft_consensus.cc:493] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.568974 30726 raft_consensus.cc:3060] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:37.578325 30346 tablet_bootstrap.cc:654] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:37.582571 30040 leader_election.cc:343] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:37.582777 30070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f01efd7c139e45c3809ed6a668f1faca" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:37.583595 30070 raft_consensus.cc:3060] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:37.589159 30343 ts_tablet_manager.cc:1434] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.000s
I20260709 12:20:37.583746 30579 raft_consensus.cc:515] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:37.597450 30726 raft_consensus.cc:515] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:37.602489 30726 leader_election.cc:290] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:37.574651 30145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f01efd7c139e45c3809ed6a668f1faca" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:37.576792 30560 leader_election.cc:290] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:37.605479 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c5550b956c4f36af10de2db7490b8b" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:37.606235 30223 raft_consensus.cc:3060] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:37.607472 30579 leader_election.cc:290] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:37.608631 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b12541deba40218ef3f8c40f40312a" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:37.609176 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b12541deba40218ef3f8c40f40312a" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:37.612903 30221 raft_consensus.cc:3060] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:37.621727 29971 catalog_manager.cc:5697] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 1 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:37.606369 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c5550b956c4f36af10de2db7490b8b" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:37.627381 30221 raft_consensus.cc:2468] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 1.
I20260709 12:20:37.614426 30070 raft_consensus.cc:2468] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:37.630623 30038 leader_election.cc:304] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:37.632606 30579 raft_consensus.cc:2804] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:37.633157 30579 raft_consensus.cc:697] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:37.634014 30579 consensus_queue.cc:237] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
W20260709 12:20:37.633754 30020 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:37.631964 30344 tablet_bootstrap.cc:492] T af7b5f5579594d8381af5f96a15e24d9 P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
W20260709 12:20:37.638383 30260 leader_election.cc:343] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:37.644591 30344 ts_tablet_manager.cc:1403] T af7b5f5579594d8381af5f96a15e24d9 P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.177s	user 0.020s	sys 0.015s
I20260709 12:20:37.639010 30560 consensus_queue.cc:1048] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:37.641644 30262 leader_election.cc:304] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:37.641911 30569 consensus_queue.cc:1048] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 12:20:37.646082 30726 raft_consensus.cc:2804] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:37.646572 30726 raft_consensus.cc:697] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:37.647411 30726 consensus_queue.cc:237] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:37.643782 30343 tablet_bootstrap.cc:492] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:37.649494 30344 raft_consensus.cc:359] T af7b5f5579594d8381af5f96a15e24d9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:37.650396 30344 raft_consensus.cc:385] T af7b5f5579594d8381af5f96a15e24d9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.650735 30344 raft_consensus.cc:740] T af7b5f5579594d8381af5f96a15e24d9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.652225 30344 consensus_queue.cc:260] T af7b5f5579594d8381af5f96a15e24d9 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
W20260709 12:20:37.645534 30040 leader_election.cc:343] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:37.655561 30344 ts_tablet_manager.cc:1434] T af7b5f5579594d8381af5f96a15e24d9 P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:20:37.657414 30344 tablet_bootstrap.cc:492] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511: Bootstrap starting.
I20260709 12:20:37.624241 29971 catalog_manager.cc:5697] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 1 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.644400 30223 raft_consensus.cc:2468] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:37.613305 30145 raft_consensus.cc:3060] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:37.665866 30493 consensus_queue.cc:1048] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:37.666095 30261 leader_election.cc:304] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:37.668635 30343 tablet_bootstrap.cc:654] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.699429 30145 raft_consensus.cc:2468] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:37.699951 30560 raft_consensus.cc:2804] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:37.712196 30560 raft_consensus.cc:697] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:37.709672 29970 catalog_manager.cc:5697] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } }
I20260709 12:20:37.722054 30561 consensus_queue.cc:1048] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:37.724588 30293 raft_consensus.cc:3060] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:37.727352 30343 tablet_bootstrap.cc:492] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:37.727912 30343 ts_tablet_manager.cc:1403] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.002s
I20260709 12:20:37.713258 30560 consensus_queue.cc:237] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:37.744020 30561 consensus_queue.cc:1048] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:37.759101 30343 raft_consensus.cc:359] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:37.759923 30343 raft_consensus.cc:385] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.760226 30343 raft_consensus.cc:740] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.761004 30343 consensus_queue.cc:260] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:37.818532 30343 ts_tablet_manager.cc:1434] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.090s	user 0.017s	sys 0.000s
I20260709 12:20:37.819680 30447 raft_consensus.cc:493] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.820278 30447 raft_consensus.cc:515] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:37.838459 30344 tablet_bootstrap.cc:654] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.840369 30447 leader_election.cc:290] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
W20260709 12:20:37.840965 30114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:43571, user_credentials={real_user=slave}} blocked reactor thread for 67489.6us
I20260709 12:20:37.843700 30569 raft_consensus.cc:493] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.844173 30569 raft_consensus.cc:515] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:37.846282 30569 leader_election.cc:290] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:37.851600 30346 tablet_bootstrap.cc:492] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026: No bootstrap required, opened a new log
I20260709 12:20:37.853446 30346 ts_tablet_manager.cc:1403] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.287s	user 0.039s	sys 0.029s
I20260709 12:20:37.854095 30344 tablet_bootstrap.cc:492] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511: No bootstrap required, opened a new log
I20260709 12:20:37.855104 30344 ts_tablet_manager.cc:1403] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511: Time spent bootstrapping tablet: real 0.198s	user 0.014s	sys 0.005s
I20260709 12:20:37.856339 30346 raft_consensus.cc:359] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:37.860845 30346 raft_consensus.cc:385] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.861143 30346 raft_consensus.cc:740] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.819796 30343 tablet_bootstrap.cc:492] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:37.869445 30561 consensus_queue.cc:1048] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:37.870846 30346 consensus_queue.cc:260] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:37.878777 30346 ts_tablet_manager.cc:1434] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:20:37.883376 30067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7b5f5579594d8381af5f96a15e24d9" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:37.884160 30067 raft_consensus.cc:2468] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:37.884896 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f01efd7c139e45c3809ed6a668f1faca" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:37.887820 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7b5f5579594d8381af5f96a15e24d9" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:37.888741 30068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f01efd7c139e45c3809ed6a668f1faca" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:37.888607 30294 raft_consensus.cc:2468] T af7b5f5579594d8381af5f96a15e24d9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 0.
I20260709 12:20:37.889490 30068 raft_consensus.cc:2468] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:37.896308 30343 tablet_bootstrap.cc:654] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.884867 30344 raft_consensus.cc:359] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:37.898828 30344 raft_consensus.cc:385] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.899201 30344 raft_consensus.cc:740] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.900336 30115 leader_election.cc:304] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:37.901219 30344 consensus_queue.cc:260] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:37.904021 30344 ts_tablet_manager.cc:1434] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.001s
I20260709 12:20:37.903060 29967 catalog_manager.cc:5697] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.918776 30343 tablet_bootstrap.cc:492] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:37.919294 30343 ts_tablet_manager.cc:1403] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.100s	user 0.006s	sys 0.006s
I20260709 12:20:37.921430 30343 raft_consensus.cc:359] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:37.922024 30343 raft_consensus.cc:385] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.922392 30343 raft_consensus.cc:740] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.923208 30570 raft_consensus.cc:2804] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:37.923110 30343 consensus_queue.cc:260] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:37.923628 30570 raft_consensus.cc:493] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.923985 30570 raft_consensus.cc:3060] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:37.925597 30343 ts_tablet_manager.cc:1434] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:20:37.926817 30343 tablet_bootstrap.cc:492] T 97c5550b956c4f36af10de2db7490b8b P b0439d4e94904196847cd825fcc8ebd7: Bootstrap starting.
I20260709 12:20:37.934095 30343 tablet_bootstrap.cc:654] T 97c5550b956c4f36af10de2db7490b8b P b0439d4e94904196847cd825fcc8ebd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.936358 30570 raft_consensus.cc:515] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:37.943959 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7b5f5579594d8381af5f96a15e24d9" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:37.944692 30294 raft_consensus.cc:3060] T af7b5f5579594d8381af5f96a15e24d9 P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:37.947594 30343 tablet_bootstrap.cc:492] T 97c5550b956c4f36af10de2db7490b8b P b0439d4e94904196847cd825fcc8ebd7: No bootstrap required, opened a new log
I20260709 12:20:37.950174 30343 ts_tablet_manager.cc:1403] T 97c5550b956c4f36af10de2db7490b8b P b0439d4e94904196847cd825fcc8ebd7: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.005s
I20260709 12:20:37.954983 30343 raft_consensus.cc:359] T 97c5550b956c4f36af10de2db7490b8b P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:37.955698 30343 raft_consensus.cc:385] T 97c5550b956c4f36af10de2db7490b8b P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.957026 30114 leader_election.cc:304] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:37.955351 29970 catalog_manager.cc:5697] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 1 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:37.957880 30759 raft_consensus.cc:2804] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:37.958253 30759 raft_consensus.cc:493] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.958575 30759 raft_consensus.cc:3060] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:37.964561 30294 raft_consensus.cc:2468] T af7b5f5579594d8381af5f96a15e24d9 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:37.967042 30115 leader_election.cc:304] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:37.966681 29970 catalog_manager.cc:5697] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 1 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.968958 30070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7b5f5579594d8381af5f96a15e24d9" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:37.969398 30447 raft_consensus.cc:2804] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:37.969709 30070 raft_consensus.cc:3060] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:37.967825 30759 raft_consensus.cc:515] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:37.972059 30759 leader_election.cc:290] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:37.972662 30447 raft_consensus.cc:697] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:37.973603 30447 consensus_queue.cc:237] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:37.980348 30070 raft_consensus.cc:2468] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:37.956001 30343 raft_consensus.cc:740] T 97c5550b956c4f36af10de2db7490b8b P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.984126 30068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f01efd7c139e45c3809ed6a668f1faca" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:37.984797 30068 raft_consensus.cc:3060] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:37.942770 30570 leader_election.cc:290] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 1 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:37.981655 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f01efd7c139e45c3809ed6a668f1faca" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:37.990386 30343 consensus_queue.cc:260] T 97c5550b956c4f36af10de2db7490b8b P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:37.993969 30343 ts_tablet_manager.cc:1434] T 97c5550b956c4f36af10de2db7490b8b P b0439d4e94904196847cd825fcc8ebd7: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
I20260709 12:20:38.030294 30068 raft_consensus.cc:2468] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 2.
I20260709 12:20:38.031679 30114 leader_election.cc:304] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:38.032568 30759 raft_consensus.cc:2804] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:38.033067 30759 raft_consensus.cc:697] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:38.036384 30759 consensus_queue.cc:237] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:38.048749 30294 raft_consensus.cc:3060] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.051738 29967 catalog_manager.cc:5697] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:38.064491 30579 consensus_queue.cc:1048] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:38.082870 30731 consensus_queue.cc:1048] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:38.094841 29971 catalog_manager.cc:5697] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 1 to 2, leader changed from f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4) to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:38.158305 30146 raft_consensus.cc:1240] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Rejecting Update request from peer f6c1f7275e654f49abaf1c80ed662511 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:38.159797 30561 consensus_queue.cc:1059] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:38.160413 30561 consensus_queue.cc:1243] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Peer b0439d4e94904196847cd825fcc8ebd7 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:20:38.160813 30560 raft_consensus.cc:3055] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:38.161197 30560 raft_consensus.cc:740] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:38.162052 30560 consensus_queue.cc:260] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:38.163235 30560 raft_consensus.cc:3060] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:38.183526 30800 raft_consensus.cc:493] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.184100 30800 raft_consensus.cc:515] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:38.185878 30800 leader_election.cc:290] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:38.186491 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094cffecb264ab689cd0baf985837d8" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:38.186833 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094cffecb264ab689cd0baf985837d8" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:38.187170 30146 raft_consensus.cc:2468] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 0.
I20260709 12:20:38.187546 30223 raft_consensus.cc:2468] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 0.
I20260709 12:20:38.188288 30037 leader_election.cc:304] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:38.189138 30731 raft_consensus.cc:2804] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:38.189481 30731 raft_consensus.cc:493] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.189838 30731 raft_consensus.cc:3060] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.198132 30731 raft_consensus.cc:515] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:38.200609 30731 leader_election.cc:290] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:38.200999 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094cffecb264ab689cd0baf985837d8" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:38.201172 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094cffecb264ab689cd0baf985837d8" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:38.201640 30146 raft_consensus.cc:3060] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.201851 30221 raft_consensus.cc:3060] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.208825 30221 raft_consensus.cc:2468] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 1.
I20260709 12:20:38.208941 30146 raft_consensus.cc:2468] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 1.
I20260709 12:20:38.210031 30037 leader_election.cc:304] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:38.211110 30731 raft_consensus.cc:2804] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:38.211535 30731 raft_consensus.cc:697] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:38.212311 30731 consensus_queue.cc:237] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:38.216857 30560 consensus_queue.cc:1048] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:38.224438 29971 catalog_manager.cc:5697] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:38.232364 30146 raft_consensus.cc:3060] T 97c5550b956c4f36af10de2db7490b8b P b0439d4e94904196847cd825fcc8ebd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.249512 30560 consensus_queue.cc:1048] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:38.254010 21244 tablet_server.cc:179] TabletServer@127.20.191.1:0 shutting down...
W20260709 12:20:38.261721 30114 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:38.298751 30114 consensus_peers.cc:597] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.299610 30114 consensus_peers.cc:597] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.318172 30114 consensus_peers.cc:597] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.335717 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:38.336797 21244 tablet_replica.cc:333] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.337687 21244 raft_consensus.cc:2243] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.338302 21244 raft_consensus.cc:2272] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.340132 21244 tablet_replica.cc:333] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.340764 21244 raft_consensus.cc:2243] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.341564 21244 raft_consensus.cc:2272] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.345679 21244 tablet_replica.cc:333] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.346662 21244 raft_consensus.cc:2243] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.347198 21244 raft_consensus.cc:2272] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:38.348284 30262 consensus_peers.cc:597] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.350782 21244 tablet_replica.cc:333] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.351787 21244 raft_consensus.cc:2243] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.352756 21244 raft_consensus.cc:2272] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.355649 21244 tablet_replica.cc:333] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.356297 21244 raft_consensus.cc:2243] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.357076 21244 raft_consensus.cc:2272] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.359403 21244 tablet_replica.cc:333] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.360090 21244 raft_consensus.cc:2243] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.360525 21244 raft_consensus.cc:2272] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.363044 21244 tablet_replica.cc:333] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.363660 21244 raft_consensus.cc:2243] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.364514 21244 raft_consensus.cc:2272] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.366569 21244 tablet_replica.cc:333] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.367201 21244 raft_consensus.cc:2243] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.367630 21244 raft_consensus.cc:2272] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.370009 21244 tablet_replica.cc:333] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.370870 21244 raft_consensus.cc:2243] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.371309 21244 raft_consensus.cc:2272] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:38.374248 30114 consensus_peers.cc:597] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.374470 21244 tablet_replica.cc:333] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.375278 21244 raft_consensus.cc:2243] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.375854 21244 raft_consensus.cc:2272] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.378527 21244 tablet_replica.cc:333] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.379326 21244 raft_consensus.cc:2243] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.379772 21244 raft_consensus.cc:2272] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.382316 21244 tablet_replica.cc:333] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.383069 21244 raft_consensus.cc:2243] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.383656 21244 raft_consensus.cc:2272] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:38.384999 30188 consensus_peers.cc:597] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.386811 21244 tablet_replica.cc:333] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.387754 21244 raft_consensus.cc:2243] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.388342 21244 raft_consensus.cc:2272] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:38.391155 30188 consensus_peers.cc:597] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.391430 21244 tablet_replica.cc:333] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.392333 21244 raft_consensus.cc:2243] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.392899 21244 raft_consensus.cc:2272] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:38.394361 30114 consensus_peers.cc:597] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.395676 21244 tablet_replica.cc:333] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.396595 21244 raft_consensus.cc:2243] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.397138 21244 raft_consensus.cc:2272] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:38.398524 30262 consensus_peers.cc:597] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.399771 21244 tablet_replica.cc:333] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.400566 21244 raft_consensus.cc:2243] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.401057 21244 raft_consensus.cc:2272] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.403401 21244 tablet_replica.cc:333] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.403949 21244 raft_consensus.cc:2243] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.404417 21244 raft_consensus.cc:2272] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.407306 21244 tablet_replica.cc:333] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.408205 21244 raft_consensus.cc:2243] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.409267 21244 raft_consensus.cc:2272] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:38.409461 30262 consensus_peers.cc:597] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.410583 30262 consensus_peers.cc:597] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.412133 21244 tablet_replica.cc:333] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.412940 21244 raft_consensus.cc:2243] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.413439 21244 raft_consensus.cc:2272] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.416803 21244 tablet_replica.cc:333] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.417372 21244 raft_consensus.cc:2243] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.417929 21244 raft_consensus.cc:2272] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.420352 21244 tablet_replica.cc:333] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.420961 21244 raft_consensus.cc:2243] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.421518 21244 raft_consensus.cc:2272] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.422523 30294 raft_consensus.cc:1275] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Refusing update from remote peer b0439d4e94904196847cd825fcc8ebd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:20:38.422950 30294 pending_rounds.cc:85] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511: Aborting all ops after (but not including) 0
I20260709 12:20:38.423188 30294 pending_rounds.cc:107] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:20:38.423498 30294 raft_consensus.cc:2889] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:38.424764 21244 tablet_replica.cc:333] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.424882 30759 consensus_queue.cc:1048] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:38.425469 21244 raft_consensus.cc:2243] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.426043 21244 raft_consensus.cc:2272] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.428867 21244 tablet_replica.cc:333] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.429678 21244 raft_consensus.cc:2243] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.430294 21244 raft_consensus.cc:2272] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:38.432274 30114 consensus_peers.cc:597] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.434214 21244 tablet_replica.cc:333] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
W20260709 12:20:38.434818 30114 consensus_peers.cc:597] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.435236 21244 raft_consensus.cc:2243] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.435942 21244 raft_consensus.cc:2272] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.439301 21244 tablet_replica.cc:333] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.440289 21244 raft_consensus.cc:2243] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.441501 21244 raft_consensus.cc:2272] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.445915 21244 tablet_replica.cc:333] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.446985 21244 raft_consensus.cc:2243] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.448110 21244 raft_consensus.cc:2272] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.451249 21244 tablet_replica.cc:333] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
W20260709 12:20:38.451635 30188 consensus_peers.cc:597] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.452083 21244 raft_consensus.cc:2243] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.453315 21244 raft_consensus.cc:2272] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.456225 21244 tablet_replica.cc:333] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.457104 21244 raft_consensus.cc:2243] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.457736 21244 raft_consensus.cc:2272] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.460510 21244 tablet_replica.cc:333] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.461324 21244 raft_consensus.cc:2243] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.461966 21244 raft_consensus.cc:2272] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.464782 21244 tablet_replica.cc:333] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.465606 21244 raft_consensus.cc:2243] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.466140 21244 raft_consensus.cc:2272] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.469390 21244 tablet_replica.cc:333] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.470359 21244 raft_consensus.cc:2243] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.470988 21244 raft_consensus.cc:2272] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.473608 21244 tablet_replica.cc:333] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.474473 21244 raft_consensus.cc:2243] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.475072 21244 raft_consensus.cc:2272] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.477988 21244 tablet_replica.cc:333] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.478641 21244 raft_consensus.cc:2243] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.479209 21244 raft_consensus.cc:2272] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.482223 21244 tablet_replica.cc:333] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
W20260709 12:20:38.482785 30114 consensus_peers.cc:597] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.483044 21244 raft_consensus.cc:2243] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.483917 21244 pending_rounds.cc:70] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026: Trying to abort 1 pending ops.
I20260709 12:20:38.484198 21244 pending_rounds.cc:77] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305624118126268416 op_type: NO_OP noop_request { }
I20260709 12:20:38.484577 21244 raft_consensus.cc:2889] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:38.484916 21244 raft_consensus.cc:2272] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.487229 21244 tablet_replica.cc:333] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.487885 21244 raft_consensus.cc:2243] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.488373 21244 raft_consensus.cc:2272] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.490854 21244 tablet_replica.cc:333] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.491643 21244 raft_consensus.cc:2243] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.492177 21244 raft_consensus.cc:2272] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:38.493263 30262 consensus_peers.cc:597] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.494753 21244 tablet_replica.cc:333] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.495384 21244 raft_consensus.cc:2243] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.495939 21244 raft_consensus.cc:2272] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:38.498062 30188 consensus_peers.cc:597] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.498585 21244 tablet_replica.cc:333] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.499183 21244 raft_consensus.cc:2243] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.499981 21244 raft_consensus.cc:2272] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.501999 21244 tablet_replica.cc:333] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.502533 21244 raft_consensus.cc:2243] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.503048 21244 raft_consensus.cc:2272] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.506043 21244 tablet_replica.cc:333] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.506577 21244 raft_consensus.cc:2243] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.507129 21244 raft_consensus.cc:2272] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.509084 21244 tablet_replica.cc:333] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.509590 21244 raft_consensus.cc:2243] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.510030 21244 raft_consensus.cc:2272] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.512001 21244 tablet_replica.cc:333] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.512557 21244 raft_consensus.cc:2243] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.512998 21244 raft_consensus.cc:2272] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.515565 21244 tablet_replica.cc:333] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
W20260709 12:20:38.515767 30114 consensus_peers.cc:597] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.516317 21244 raft_consensus.cc:2243] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.516860 21244 raft_consensus.cc:2272] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.519315 21244 tablet_replica.cc:333] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.519824 21244 raft_consensus.cc:2243] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.520272 21244 raft_consensus.cc:2272] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.522176 21244 tablet_replica.cc:333] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026: stopping tablet replica
I20260709 12:20:38.522686 21244 raft_consensus.cc:2243] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.523499 21244 raft_consensus.cc:2272] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:38.528471 30188 consensus_peers.cc:597] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.528471 30262 consensus_peers.cc:597] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.536429 30114 consensus_peers.cc:597] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.545986 30262 consensus_peers.cc:597] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.576470 30759 consensus_queue.cc:1048] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:20:38.578058 30114 consensus_peers.cc:597] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.593022 30040 connection.cc:466] server connection from 127.0.0.1:41716 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41716 (request call id 159) could send its response
W20260709 12:20:38.594822 30114 connection.cc:573] client connection to 127.20.191.1:43571 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:20:38.594822 30262 connection.cc:573] client connection to 127.20.191.1:43571 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:20:38.602304 30262 consensus_peers.cc:597] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.602771 30262 consensus_peers.cc:597] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.610872 21244 tablet_server.cc:196] TabletServer@127.20.191.1:0 shutdown complete.
W20260709 12:20:38.612738 30114 consensus_peers.cc:597] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.631793 30114 consensus_peers.cc:597] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.661274 30262 consensus_peers.cc:597] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.714093 30188 consensus_peers.cc:597] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.715056 30188 consensus_peers.cc:597] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.720551 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:38.723511 30188 consensus_peers.cc:597] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.734318 30813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:38.742087 30114 consensus_peers.cc:597] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.744246 30814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:38.756410 21244 server_base.cc:1061] running on GCE node
W20260709 12:20:38.761656 30817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:38.763222 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:38.763574 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:38.763832 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599638763811 us; error 0 us; skew 500 ppm
I20260709 12:20:38.764689 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:38.775557 21244 webserver.cc:533] Webserver started at http://127.20.191.1:39373/ using document root <none> and password file <none>
I20260709 12:20:38.776331 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:38.776616 21244 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:20:38.786260 21244 fs_manager.cc:714] Time spent opening directory manager: real 0.008s	user 0.003s	sys 0.001s
I20260709 12:20:38.794153 30822 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:38.794991 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:20:38.795295 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-0-root
uuid: "22a1255131174934a6bca3c0bf000026"
format_stamp: "Formatted at 2026-07-09 12:20:27 on dist-test-slave-7c1h"
I20260709 12:20:38.795652 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599324869158-21244-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:20:38.804709 30188 consensus_peers.cc:597] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.814679 30114 consensus_peers.cc:597] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.831040 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:38.832494 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:38.834098 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:38.839576 30829 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:20:39.153584 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:20:39.154052 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.316s	user 0.009s	sys 0.000s
I20260709 12:20:39.154420 21244 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:20:39.162899 30829 tablet_bootstrap.cc:492] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.175552 30829 tablet_bootstrap.cc:492] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.176693 30829 tablet_bootstrap.cc:492] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.177223 30829 ts_tablet_manager.cc:1403] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 12:20:39.179244 30829 raft_consensus.cc:359] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.179768 30829 raft_consensus.cc:740] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.180380 30829 consensus_queue.cc:260] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.182664 30829 ts_tablet_manager.cc:1434] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:20:39.183431 30829 tablet_bootstrap.cc:492] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.214010 30829 tablet_bootstrap.cc:492] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.214986 30829 tablet_bootstrap.cc:492] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.215669 30829 ts_tablet_manager.cc:1403] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.004s
I20260709 12:20:39.219251 30829 raft_consensus.cc:359] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.220816 30829 raft_consensus.cc:740] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.221704 30829 consensus_queue.cc:260] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.224040 30829 ts_tablet_manager.cc:1434] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:20:39.225034 30829 tablet_bootstrap.cc:492] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.255177 30829 tablet_bootstrap.cc:492] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.256142 30829 tablet_bootstrap.cc:492] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.256794 30829 ts_tablet_manager.cc:1403] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.004s
I20260709 12:20:39.259331 30829 raft_consensus.cc:359] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.260022 30829 raft_consensus.cc:740] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.260773 30829 consensus_queue.cc:260] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.263135 30829 ts_tablet_manager.cc:1434] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:20:39.263909 30829 tablet_bootstrap.cc:492] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.280836 30829 tablet_bootstrap.cc:492] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.281890 30829 tablet_bootstrap.cc:492] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.282632 30829 ts_tablet_manager.cc:1403] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:20:39.284993 30829 raft_consensus.cc:359] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.285645 30829 raft_consensus.cc:740] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.286322 30829 consensus_queue.cc:260] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.288187 30829 ts_tablet_manager.cc:1434] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:20:39.288847 30829 tablet_bootstrap.cc:492] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.300694 30829 tablet_bootstrap.cc:492] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.301426 30829 tablet_bootstrap.cc:492] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.301986 30829 ts_tablet_manager.cc:1403] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 12:20:39.303784 30829 raft_consensus.cc:359] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.304294 30829 raft_consensus.cc:740] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.304843 30829 consensus_queue.cc:260] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.306372 30829 ts_tablet_manager.cc:1434] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:20:39.307065 30829 tablet_bootstrap.cc:492] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.319217 30829 tablet_bootstrap.cc:492] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.319932 30829 tablet_bootstrap.cc:492] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.320436 30829 ts_tablet_manager.cc:1403] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:20:39.322309 30829 raft_consensus.cc:359] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.322908 30829 raft_consensus.cc:740] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.323601 30829 consensus_queue.cc:260] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.325608 30829 ts_tablet_manager.cc:1434] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:20:39.326435 30829 tablet_bootstrap.cc:492] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.342638 30829 tablet_bootstrap.cc:492] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.343641 30829 tablet_bootstrap.cc:492] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.344266 30829 ts_tablet_manager.cc:1403] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 12:20:39.346868 30829 raft_consensus.cc:359] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.347525 30829 raft_consensus.cc:740] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.348172 30829 consensus_queue.cc:260] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.350205 30829 ts_tablet_manager.cc:1434] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:20:39.351004 30829 tablet_bootstrap.cc:492] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.365864 30829 tablet_bootstrap.cc:492] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.366729 30829 tablet_bootstrap.cc:492] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.367216 30829 ts_tablet_manager.cc:1403] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:20:39.368953 30829 raft_consensus.cc:359] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.369427 30829 raft_consensus.cc:740] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.370007 30829 consensus_queue.cc:260] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.371454 30829 ts_tablet_manager.cc:1434] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:20:39.372098 30829 tablet_bootstrap.cc:492] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.386758 30829 tablet_bootstrap.cc:492] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.387450 30829 tablet_bootstrap.cc:492] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.387951 30829 ts_tablet_manager.cc:1403] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:20:39.389674 30829 raft_consensus.cc:359] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.390210 30829 raft_consensus.cc:740] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.390781 30829 consensus_queue.cc:260] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.392251 30829 ts_tablet_manager.cc:1434] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:20:39.392959 30829 tablet_bootstrap.cc:492] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.404300 30829 tablet_bootstrap.cc:492] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.405057 30829 tablet_bootstrap.cc:492] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.405598 30829 ts_tablet_manager.cc:1403] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:20:39.408308 30829 raft_consensus.cc:359] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.408980 30829 raft_consensus.cc:740] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.409703 30829 consensus_queue.cc:260] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.411131 21244 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:20:39.411496 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.257s	user 0.238s	sys 0.004s
I20260709 12:20:39.411744 30829 ts_tablet_manager.cc:1434] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:20:39.412593 30829 tablet_bootstrap.cc:492] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.421701 30728 raft_consensus.cc:493] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.422430 30728 raft_consensus.cc:515] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.424472 30728 leader_election.cc:290] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:39.430250 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55101a88e97746d0bc20a0bc0ed8989c" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
W20260709 12:20:39.431847 30188 leader_election.cc:336] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.433357 30186 leader_election.cc:304] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:39.434141 30728 raft_consensus.cc:2749] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:39.439924 30829 tablet_bootstrap.cc:492] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.441020 30829 tablet_bootstrap.cc:492] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.441740 30829 ts_tablet_manager.cc:1403] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.004s
I20260709 12:20:39.444643 30829 raft_consensus.cc:359] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.446774 30728 raft_consensus.cc:493] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.447402 30728 raft_consensus.cc:515] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.449506 30728 leader_election.cc:290] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:39.445400 30829 raft_consensus.cc:740] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.451349 30829 consensus_queue.cc:260] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.452849 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f5109a89314f8bbf67848895ef8918" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:39.456204 30829 ts_tablet_manager.cc:1434] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:20:39.457188 30829 tablet_bootstrap.cc:492] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
W20260709 12:20:39.459573 30188 leader_election.cc:336] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.460201 30188 leader_election.cc:304] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:39.461163 30728 raft_consensus.cc:2749] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:39.480540 30570 raft_consensus.cc:493] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.481166 30570 raft_consensus.cc:515] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.482414 30493 raft_consensus.cc:493] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.483093 30493 raft_consensus.cc:515] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.483453 30570 leader_election.cc:290] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:39.485211 30493 leader_election.cc:290] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:39.494328 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caa8a59f42477199989f2612bb7136" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
W20260709 12:20:39.511125 30114 leader_election.cc:336] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.511736 30114 leader_election.cc:304] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7; no voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511
W20260709 12:20:39.514356 30114 leader_election.cc:336] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.515903 30829 tablet_bootstrap.cc:492] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.514874 30865 raft_consensus.cc:2749] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:39.516912 30829 tablet_bootstrap.cc:492] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.517642 30829 ts_tablet_manager.cc:1403] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.061s	user 0.031s	sys 0.024s
I20260709 12:20:39.518991 30865 raft_consensus.cc:493] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.519623 30865 raft_consensus.cc:515] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.520298 30829 raft_consensus.cc:359] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.521011 30829 raft_consensus.cc:740] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.521900 30829 consensus_queue.cc:260] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.522749 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5692f07fd174dbfa06976e17c1c6b00" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:39.524150 30829 ts_tablet_manager.cc:1434] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:20:39.524982 30728 raft_consensus.cc:493] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.525296 30829 tablet_bootstrap.cc:492] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.525899 30728 raft_consensus.cc:515] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
W20260709 12:20:39.533512 30188 leader_election.cc:336] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.534792 30728 leader_election.cc:290] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:39.535672 30865 leader_election.cc:290] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
W20260709 12:20:39.541174 30113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:44035, user_credentials={real_user=slave}} blocked reactor thread for 60152us
I20260709 12:20:39.543000 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55101a88e97746d0bc20a0bc0ed8989c" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:39.543694 30223 raft_consensus.cc:2468] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:39.547896 30829 tablet_bootstrap.cc:492] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:20:39.547708 30114 leader_election.cc:336] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.543045 30864 raft_consensus.cc:493] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.547628 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb12e58a824780acab66b641b29009" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:39.548851 30829 tablet_bootstrap.cc:492] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.549599 30864 raft_consensus.cc:515] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.548414 30114 leader_election.cc:304] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7; no voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:39.550684 30865 raft_consensus.cc:2749] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:39.551374 30113 leader_election.cc:304] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:39.551796 30186 leader_election.cc:304] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:39.553506 30728 raft_consensus.cc:2749] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:39.553435 30865 raft_consensus.cc:2804] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:39.555356 30726 raft_consensus.cc:493] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.556023 30726 raft_consensus.cc:515] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.557655 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f5109a89314f8bbf67848895ef8918" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:39.558422 30726 leader_election.cc:290] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:39.558554 30223 raft_consensus.cc:2468] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:39.552271 30829 ts_tablet_manager.cc:1403] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.027s	user 0.023s	sys 0.000s
I20260709 12:20:39.562279 30829 raft_consensus.cc:359] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.563055 30829 raft_consensus.cc:740] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.563838 30829 consensus_queue.cc:260] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.555204 30865 raft_consensus.cc:493] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.551837 30864 leader_election.cc:290] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
W20260709 12:20:39.563706 30262 leader_election.cc:336] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.566169 30829 ts_tablet_manager.cc:1434] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:39.567130 30829 tablet_bootstrap.cc:492] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.569896 30864 raft_consensus.cc:493] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.570408 30865 raft_consensus.cc:3060] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.573112 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58b35cd70b1481993195f5bdd8ad3fe" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:39.573108 30864 raft_consensus.cc:515] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.578886 30146 raft_consensus.cc:2468] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:39.570986 30113 leader_election.cc:304] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:39.582257 30570 raft_consensus.cc:2804] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:39.582628 30570 raft_consensus.cc:493] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
W20260709 12:20:39.582633 30114 leader_election.cc:336] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.583297 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58b35cd70b1481993195f5bdd8ad3fe" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:39.584975 30297 raft_consensus.cc:2468] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:39.582967 30570 raft_consensus.cc:3060] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.585868 30865 raft_consensus.cc:515] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.586273 30115 leader_election.cc:304] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:39.588017 30865 leader_election.cc:290] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:39.588042 30829 tablet_bootstrap.cc:492] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.588755 30865 raft_consensus.cc:2804] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:39.589119 30865 raft_consensus.cc:493] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.589457 30726 raft_consensus.cc:493] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.589851 30728 raft_consensus.cc:493] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.590144 30726 raft_consensus.cc:515] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.590484 30728 raft_consensus.cc:515] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.591012 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55101a88e97746d0bc20a0bc0ed8989c" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:39.591583 30223 raft_consensus.cc:3060] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.593918 30726 leader_election.cc:290] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:39.594449 30726 raft_consensus.cc:493] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.594903 30726 raft_consensus.cc:515] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.597222 30726 leader_election.cc:290] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:39.594986 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b12541deba40218ef3f8c40f40312a" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:39.589463 30865 raft_consensus.cc:3060] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.598039 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8364709c0e424d6791fed2d28528c655" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:39.600673 30728 leader_election.cc:290] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
W20260709 12:20:39.602003 30262 leader_election.cc:336] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.602921 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b12541deba40218ef3f8c40f40312a" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:39.603633 30297 raft_consensus.cc:2468] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
I20260709 12:20:39.604799 30219 raft_consensus.cc:2468] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
W20260709 12:20:39.605520 30262 leader_election.cc:336] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.598039 30829 tablet_bootstrap.cc:492] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.606030 30262 leader_election.cc:304] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:39.606633 30829 ts_tablet_manager.cc:1403] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.003s
I20260709 12:20:39.606887 30189 leader_election.cc:304] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:39.608188 30820 raft_consensus.cc:2804] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:39.608639 30820 raft_consensus.cc:493] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.607662 30726 raft_consensus.cc:2749] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:39.609067 30820 raft_consensus.cc:3060] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.608350 30261 leader_election.cc:304] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:39.609577 30829 raft_consensus.cc:359] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.610139 30726 raft_consensus.cc:2804] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:39.612293 30829 raft_consensus.cc:740] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.613118 30829 consensus_queue.cc:260] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
W20260709 12:20:39.614197 30188 leader_election.cc:336] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.615235 30829 ts_tablet_manager.cc:1434] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:20:39.616108 30829 tablet_bootstrap.cc:492] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.618162 30726 raft_consensus.cc:493] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.618798 30726 raft_consensus.cc:3060] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.618639 30820 raft_consensus.cc:515] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.619448 30570 raft_consensus.cc:515] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.621142 30865 raft_consensus.cc:515] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.621620 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b12541deba40218ef3f8c40f40312a" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:39.584327 30864 leader_election.cc:290] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:39.623594 30570 leader_election.cc:290] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:39.625813 30865 leader_election.cc:290] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:39.626616 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58b35cd70b1481993195f5bdd8ad3fe" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:39.627315 30294 raft_consensus.cc:3060] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:39.628357 30188 leader_election.cc:336] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
W20260709 12:20:39.629114 30114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.1:43571, user_credentials={real_user=slave}} blocked reactor thread for 56313.8us
I20260709 12:20:39.629215 30820 leader_election.cc:290] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:39.618916 30223 raft_consensus.cc:2468] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 2.
I20260709 12:20:39.627321 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f5109a89314f8bbf67848895ef8918" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:39.631974 30113 leader_election.cc:304] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:39.633447 30260 leader_election.cc:304] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:39.634941 30219 raft_consensus.cc:3060] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.635613 30865 raft_consensus.cc:2804] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:39.642105 30865 raft_consensus.cc:697] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:39.642980 30294 raft_consensus.cc:2468] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 2.
I20260709 12:20:39.643146 30865 consensus_queue.cc:237] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.651889 30561 raft_consensus.cc:2764] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:20:39.655841 30115 leader_election.cc:304] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:39.658356 30864 raft_consensus.cc:2804] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:39.658977 30864 raft_consensus.cc:697] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:39.660010 30219 raft_consensus.cc:2468] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 2.
I20260709 12:20:39.659685 30726 raft_consensus.cc:515] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.661527 30297 raft_consensus.cc:2393] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f3ef588fc4b54ec09355022d7a5a5e86 in current term 2: Already voted for candidate f6c1f7275e654f49abaf1c80ed662511 in this term.
I20260709 12:20:39.661947 30113 leader_election.cc:304] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:39.660050 30864 consensus_queue.cc:237] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.663604 30726 leader_election.cc:290] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:39.666167 30189 leader_election.cc:304] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:39.667932 30820 raft_consensus.cc:2749] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:39.668452 30829 tablet_bootstrap.cc:492] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.669471 30829 tablet_bootstrap.cc:492] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.670142 30829 ts_tablet_manager.cc:1403] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.054s	user 0.026s	sys 0.008s
I20260709 12:20:39.666416 30493 raft_consensus.cc:2804] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:39.671909 30493 raft_consensus.cc:697] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:39.672783 30493 consensus_queue.cc:237] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.675818 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b12541deba40218ef3f8c40f40312a" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:39.676612 30219 raft_consensus.cc:2393] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f6c1f7275e654f49abaf1c80ed662511 in current term 2: Already voted for candidate f3ef588fc4b54ec09355022d7a5a5e86 in this term.
I20260709 12:20:39.677822 30829 raft_consensus.cc:359] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.678541 30829 raft_consensus.cc:740] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.680394 30829 consensus_queue.cc:260] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
W20260709 12:20:39.681527 30262 leader_election.cc:336] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.683010 30261 leader_election.cc:304] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:39.683466 29971 catalog_manager.cc:5697] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 1 to 2, leader changed from 22a1255131174934a6bca3c0bf000026 (127.20.191.1) to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:39.684770 30560 raft_consensus.cc:2749] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:39.686820 30561 raft_consensus.cc:493] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.686882 30829 ts_tablet_manager.cc:1434] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:20:39.687318 30561 raft_consensus.cc:515] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.687980 30829 tablet_bootstrap.cc:492] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.689337 30561 leader_election.cc:290] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:39.690901 30820 raft_consensus.cc:493] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.691452 30820 raft_consensus.cc:515] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.694876 30820 leader_election.cc:290] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
W20260709 12:20:39.700544 30188 leader_election.cc:336] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.704457 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaa1e367a834921bed89b00cf7b2487" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:39.713405 30189 leader_election.cc:304] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:39.714399 30829 tablet_bootstrap.cc:492] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:20:39.715273 30262 leader_election.cc:336] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.717478 30820 raft_consensus.cc:2749] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:39.715370 30829 tablet_bootstrap.cc:492] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.722374 30829 ts_tablet_manager.cc:1403] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.000s
I20260709 12:20:39.727581 30829 raft_consensus.cc:359] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.728348 30829 raft_consensus.cc:740] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.728487 30728 raft_consensus.cc:493] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.729074 30728 raft_consensus.cc:515] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.729122 30829 consensus_queue.cc:260] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.731503 30829 ts_tablet_manager.cc:1434] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:20:39.732491 30829 tablet_bootstrap.cc:492] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.737402 30728 leader_election.cc:290] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
W20260709 12:20:39.736912 30188 leader_election.cc:336] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.742043 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17f97873bb48ca864a13321c11f401" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:39.753249 30189 leader_election.cc:304] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:39.754228 30728 raft_consensus.cc:2749] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:39.754087 30820 raft_consensus.cc:493] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.755031 30820 raft_consensus.cc:515] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.757319 30820 leader_election.cc:290] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:39.763800 30561 raft_consensus.cc:493] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.764323 30561 raft_consensus.cc:515] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.765534 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5692f07fd174dbfa06976e17c1c6b00" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:39.766348 30146 raft_consensus.cc:2468] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:39.766634 30561 leader_election.cc:290] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:39.767239 30829 tablet_bootstrap.cc:492] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.768234 30829 tablet_bootstrap.cc:492] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
W20260709 12:20:39.763274 30188 leader_election.cc:336] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.768901 30829 ts_tablet_manager.cc:1403] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.004s
I20260709 12:20:39.773288 30829 raft_consensus.cc:359] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.774026 30829 raft_consensus.cc:740] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.774803 30829 consensus_queue.cc:260] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
W20260709 12:20:39.775147 30262 leader_election.cc:336] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.776971 30829 ts_tablet_manager.cc:1434] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:20:39.777937 30829 tablet_bootstrap.cc:492] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.778957 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8364709c0e424d6791fed2d28528c655" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:39.779610 30297 raft_consensus.cc:2468] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
I20260709 12:20:39.780705 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaa1e367a834921bed89b00cf7b2487" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:39.781384 30219 raft_consensus.cc:2468] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
W20260709 12:20:39.786778 30114 leader_election.cc:336] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.787263 30261 leader_election.cc:304] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:39.795428 30561 raft_consensus.cc:2804] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:39.795857 30561 raft_consensus.cc:493] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.796187 30561 raft_consensus.cc:3060] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.802839 30829 tablet_bootstrap.cc:492] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.803867 30829 tablet_bootstrap.cc:492] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.804527 30829 ts_tablet_manager.cc:1403] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.003s
W20260709 12:20:39.804579 30114 leader_election.cc:336] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
W20260709 12:20:39.806413 30114 leader_election.cc:336] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
W20260709 12:20:39.807256 30114 leader_election.cc:336] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.807850 30829 raft_consensus.cc:359] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.808692 30829 raft_consensus.cc:740] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.805312 30561 raft_consensus.cc:515] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.809527 30829 consensus_queue.cc:260] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.812022 30829 ts_tablet_manager.cc:1434] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:20:39.812906 30829 tablet_bootstrap.cc:492] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.816349 30189 leader_election.cc:304] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:39.816970 30561 leader_election.cc:290] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
W20260709 12:20:39.819566 30262 leader_election.cc:336] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.821293 30820 raft_consensus.cc:2804] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:39.821803 30820 raft_consensus.cc:493] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.822168 30820 raft_consensus.cc:3060] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.824595 30260 leader_election.cc:304] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:39.826079 30726 raft_consensus.cc:2804] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:39.826525 30726 raft_consensus.cc:493] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.826946 30726 raft_consensus.cc:3060] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.831040 30820 raft_consensus.cc:515] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.833798 30820 leader_election.cc:290] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:39.838696 30829 tablet_bootstrap.cc:492] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:20:39.849244 30188 leader_election.cc:336] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.850387 30560 raft_consensus.cc:493] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.867344 30829 tablet_bootstrap.cc:492] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.867049 30560 raft_consensus.cc:515] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.868168 30829 ts_tablet_manager.cc:1403] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.012s
I20260709 12:20:39.869475 30560 leader_election.cc:290] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:39.861375 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8364709c0e424d6791fed2d28528c655" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:39.871125 30297 raft_consensus.cc:3060] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.870843 30829 raft_consensus.cc:359] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.862233 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaa1e367a834921bed89b00cf7b2487" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:39.871658 30829 raft_consensus.cc:740] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.872130 30219 raft_consensus.cc:3060] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.872568 30829 consensus_queue.cc:260] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.872902 30726 raft_consensus.cc:515] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.874965 30829 ts_tablet_manager.cc:1434] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:20:39.875871 30829 tablet_bootstrap.cc:492] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.879783 30219 raft_consensus.cc:2468] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 2.
I20260709 12:20:39.881364 30726 leader_election.cc:290] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:39.882055 30261 leader_election.cc:304] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:39.884081 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17f97873bb48ca864a13321c11f401" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:39.884802 30219 raft_consensus.cc:2468] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:39.885895 30261 leader_election.cc:304] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:39.887495 30726 raft_consensus.cc:2804] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:39.887778 30560 raft_consensus.cc:2804] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:39.888182 30726 raft_consensus.cc:697] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [term 2 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:39.888317 30560 raft_consensus.cc:493] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.889182 30889 raft_consensus.cc:493] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.889318 30560 raft_consensus.cc:3060] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.889809 30889 raft_consensus.cc:515] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.889971 30726 consensus_queue.cc:237] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.891947 30889 leader_election.cc:290] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:39.897647 30560 raft_consensus.cc:515] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.929719 30560 leader_election.cc:290] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:39.930725 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17f97873bb48ca864a13321c11f401" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:39.931375 30219 raft_consensus.cc:3060] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:39.933406 30262 leader_election.cc:336] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
W20260709 12:20:39.934257 30262 leader_election.cc:336] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
W20260709 12:20:39.934675 30262 leader_election.cc:336] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.941149 30297 raft_consensus.cc:2468] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 2.
I20260709 12:20:39.920259 30829 tablet_bootstrap.cc:492] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.943795 30829 tablet_bootstrap.cc:492] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:39.944494 30829 ts_tablet_manager.cc:1403] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.012s
I20260709 12:20:39.945214 30493 raft_consensus.cc:493] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:39.945709 30493 raft_consensus.cc:515] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.942623 30219 raft_consensus.cc:2468] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 2.
I20260709 12:20:39.946123 30189 leader_election.cc:304] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:39.947216 30829 raft_consensus.cc:359] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.947902 30829 raft_consensus.cc:740] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.948025 30493 leader_election.cc:290] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:39.948460 30728 raft_consensus.cc:2804] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:39.944164 29971 catalog_manager.cc:5697] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 1 to 2, leader changed from 22a1255131174934a6bca3c0bf000026 (127.20.191.1) to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:39.947950 30261 leader_election.cc:304] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:39.948753 30829 consensus_queue.cc:260] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:39.949453 30728 raft_consensus.cc:697] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:39.950101 30560 raft_consensus.cc:2804] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:39.950536 30560 raft_consensus.cc:697] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 2 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:39.950340 30728 consensus_queue.cc:237] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.951331 30560 consensus_queue.cc:237] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:39.913712 30864 raft_consensus.cc:493] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.958070 30864 raft_consensus.cc:515] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.955412 29971 catalog_manager.cc:5697] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 1 to 2, leader changed from 22a1255131174934a6bca3c0bf000026 (127.20.191.1) to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:39.960700 30864 leader_election.cc:290] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:39.962510 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb12e58a824780acab66b641b29009" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:39.964486 30219 raft_consensus.cc:2468] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:39.965755 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094cffecb264ab689cd0baf985837d8" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:39.966398 30829 ts_tablet_manager.cc:1434] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:20:39.966519 30223 raft_consensus.cc:2468] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 1.
I20260709 12:20:39.967490 30829 tablet_bootstrap.cc:492] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:39.978884 30113 leader_election.cc:304] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:39.979954 30864 raft_consensus.cc:2804] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:39.980420 30864 raft_consensus.cc:493] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
W20260709 12:20:39.981592 30262 leader_election.cc:336] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:39.981943 30864 raft_consensus.cc:3060] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:39.980861 30114 leader_election.cc:336] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
W20260709 12:20:39.909935 30260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:40479, user_credentials={real_user=slave}} blocked reactor thread for 56852us
I20260709 12:20:39.989064 30113 leader_election.cc:304] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:39.990974 30493 raft_consensus.cc:2804] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:39.991400 30493 raft_consensus.cc:493] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.991703 30493 raft_consensus.cc:3060] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.990257 30864 raft_consensus.cc:515] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:39.996301 30829 tablet_bootstrap.cc:492] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.999794 30864 leader_election.cc:290] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:40.000708 30829 tablet_bootstrap.cc:492] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:40.000952 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb12e58a824780acab66b641b29009" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:40.002135 30223 raft_consensus.cc:3060] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.002386 30829 ts_tablet_manager.cc:1403] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.007s
I20260709 12:20:40.008100 30223 raft_consensus.cc:2468] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 2.
I20260709 12:20:40.005095 30829 raft_consensus.cc:359] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.008702 30829 raft_consensus.cc:740] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:40.009213 30113 leader_election.cc:304] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:40.008601 29967 catalog_manager.cc:5697] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 1 to 2, leader changed from 22a1255131174934a6bca3c0bf000026 (127.20.191.1) to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 2 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:40.009827 30829 consensus_queue.cc:260] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.010346 30864 raft_consensus.cc:2804] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:40.010869 30864 raft_consensus.cc:697] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:40.012120 30829 ts_tablet_manager.cc:1434] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:20:40.013424 30829 tablet_bootstrap.cc:492] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:40.013945 30864 consensus_queue.cc:237] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
W20260709 12:20:40.032251 30114 leader_election.cc:336] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:40.035781 30829 tablet_bootstrap.cc:492] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:40.036733 30829 tablet_bootstrap.cc:492] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:40.037534 30829 ts_tablet_manager.cc:1403] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 12:20:40.040555 30829 raft_consensus.cc:359] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.041468 30829 raft_consensus.cc:740] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:40.042409 30829 consensus_queue.cc:260] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.044504 30829 ts_tablet_manager.cc:1434] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 12:20:40.045297 30829 tablet_bootstrap.cc:492] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:40.004526 29971 catalog_manager.cc:5697] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 1 to 2, leader changed from 22a1255131174934a6bca3c0bf000026 (127.20.191.1) to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 2 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:40.060228 30145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caa8a59f42477199989f2612bb7136" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:40.061014 30145 raft_consensus.cc:2468] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 1.
I20260709 12:20:40.066385 30493 raft_consensus.cc:515] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:40.068347 30260 leader_election.cc:304] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:40.069458 30560 raft_consensus.cc:2804] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:40.069859 30560 raft_consensus.cc:493] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:40.070235 30560 raft_consensus.cc:3060] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.107167 30493 leader_election.cc:290] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:40.109513 30560 raft_consensus.cc:515] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.082257 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5692f07fd174dbfa06976e17c1c6b00" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:40.114198 30146 raft_consensus.cc:3060] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.119251 29967 catalog_manager.cc:5697] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 1 to 2, leader changed from 22a1255131174934a6bca3c0bf000026 (127.20.191.1) to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:40.124650 30560 leader_election.cc:290] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 election: Requested vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:40.121420 30146 raft_consensus.cc:2468] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 2.
W20260709 12:20:40.130352 30114 leader_election.cc:336] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:40.135090 29971 catalog_manager.cc:5697] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 1 to 2, leader changed from 22a1255131174934a6bca3c0bf000026 (127.20.191.1) to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 2 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:40.147897 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caa8a59f42477199989f2612bb7136" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:40.148681 30147 raft_consensus.cc:3060] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.148973 30260 leader_election.cc:304] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:40.150455 30560 raft_consensus.cc:2804] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:40.150941 30560 raft_consensus.cc:697] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [term 2 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
W20260709 12:20:40.151197 30114 consensus_peers.cc:597] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:40.151698 30114 leader_election.cc:336] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:40.151721 30560 consensus_queue.cc:237] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.157701 30219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094cffecb264ab689cd0baf985837d8" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:40.158512 30219 raft_consensus.cc:3060] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.160838 30221 raft_consensus.cc:1275] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Refusing update from remote peer b0439d4e94904196847cd825fcc8ebd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:40.163753 30223 raft_consensus.cc:1275] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Refusing update from remote peer b0439d4e94904196847cd825fcc8ebd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:20:40.168241 30262 leader_election.cc:336] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
W20260709 12:20:40.178942 30114 consensus_peers.cc:597] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:40.183559 30829 tablet_bootstrap.cc:492] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:40.184574 30829 tablet_bootstrap.cc:492] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:40.185247 30829 ts_tablet_manager.cc:1403] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.140s	user 0.015s	sys 0.008s
I20260709 12:20:40.192899 30829 raft_consensus.cc:359] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.193411 30293 raft_consensus.cc:1275] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Refusing update from remote peer b0439d4e94904196847cd825fcc8ebd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:40.195585 29971 catalog_manager.cc:5697] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 1 to 2, leader changed from 22a1255131174934a6bca3c0bf000026 (127.20.191.1) to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 2 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:40.201213 30865 consensus_queue.cc:1048] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:40.193570 30829 raft_consensus.cc:740] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:40.215052 30829 consensus_queue.cc:260] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.218139 30829 ts_tablet_manager.cc:1434] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 12:20:40.220391 30829 tablet_bootstrap.cc:492] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:40.238106 30219 raft_consensus.cc:2468] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 2.
I20260709 12:20:40.246345 30759 consensus_queue.cc:1048] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:40.257802 30829 tablet_bootstrap.cc:492] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:40.259095 30829 tablet_bootstrap.cc:492] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:40.259768 30829 ts_tablet_manager.cc:1403] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.003s
I20260709 12:20:40.261209 30759 consensus_queue.cc:1048] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:40.262466 30829 raft_consensus.cc:359] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.263177 30829 raft_consensus.cc:740] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:40.264006 30829 consensus_queue.cc:260] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.266227 30829 ts_tablet_manager.cc:1434] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:20:40.266717 30147 raft_consensus.cc:2468] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 2.
I20260709 12:20:40.267014 30829 tablet_bootstrap.cc:492] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:40.268756 30260 leader_election.cc:304] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:40.269524 30726 raft_consensus.cc:2804] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:40.270072 30726 raft_consensus.cc:697] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 2 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:40.270776 30113 leader_election.cc:304] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 22a1255131174934a6bca3c0bf000026
I20260709 12:20:40.271082 30726 consensus_queue.cc:237] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.280818 30759 raft_consensus.cc:2804] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:40.281371 30759 raft_consensus.cc:697] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:40.282217 30759 consensus_queue.cc:237] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
W20260709 12:20:40.289351 30114 consensus_peers.cc:597] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:40.320705 30221 raft_consensus.cc:1275] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Refusing update from remote peer f6c1f7275e654f49abaf1c80ed662511: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:40.322345 30726 consensus_queue.cc:1048] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:40.323455 29971 catalog_manager.cc:5697] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 1 to 2, leader changed from 22a1255131174934a6bca3c0bf000026 (127.20.191.1) to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 2 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:40.381255 29971 catalog_manager.cc:5697] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 1 to 2, leader changed from 22a1255131174934a6bca3c0bf000026 (127.20.191.1) to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:40.384516 30829 tablet_bootstrap.cc:492] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:40.385545 30829 tablet_bootstrap.cc:492] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:40.386217 30829 ts_tablet_manager.cc:1403] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.119s	user 0.051s	sys 0.040s
I20260709 12:20:40.388832 30829 raft_consensus.cc:359] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:40.389506 30829 raft_consensus.cc:740] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:40.392359 30829 consensus_queue.cc:260] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:40.394723 30829 ts_tablet_manager.cc:1434] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:40.395476 30829 tablet_bootstrap.cc:492] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
W20260709 12:20:40.398188 30188 consensus_peers.cc:597] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:40.402604 30262 consensus_peers.cc:597] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:40.415889 30829 tablet_bootstrap.cc:492] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:40.416810 30829 tablet_bootstrap.cc:492] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:40.417520 30829 ts_tablet_manager.cc:1403] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.007s
I20260709 12:20:40.422323 30293 raft_consensus.cc:1275] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Refusing update from remote peer f3ef588fc4b54ec09355022d7a5a5e86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:40.424022 30904 consensus_queue.cc:1048] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:40.421938 30829 raft_consensus.cc:359] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.424856 30829 raft_consensus.cc:740] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:40.427554 30829 consensus_queue.cc:260] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.430274 30829 ts_tablet_manager.cc:1434] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:20:40.431612 30829 tablet_bootstrap.cc:492] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
W20260709 12:20:40.440637 30262 consensus_peers.cc:597] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:40.447971 30833 raft_consensus.cc:493] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.448626 30833 raft_consensus.cc:515] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:40.495872 30833 leader_election.cc:290] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:40.500231 30829 tablet_bootstrap.cc:492] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:20:40.501339 30829 tablet_bootstrap.cc:492] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:40.521708 30833 raft_consensus.cc:493] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.522378 30833 raft_consensus.cc:515] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.538527 30833 leader_election.cc:290] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:40.539101 30833 raft_consensus.cc:493] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.542439 30829 ts_tablet_manager.cc:1403] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.111s	user 0.012s	sys 0.018s
I20260709 12:20:40.547044 30829 raft_consensus.cc:359] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:40.548009 30829 raft_consensus.cc:740] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:40.557497 30829 consensus_queue.cc:260] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:40.575001 30931 raft_consensus.cc:493] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.575731 30931 raft_consensus.cc:515] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:40.551692 30833 raft_consensus.cc:515] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.584142 30833 leader_election.cc:290] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:40.597110 30222 raft_consensus.cc:1275] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Refusing update from remote peer f6c1f7275e654f49abaf1c80ed662511: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:40.608261 30726 consensus_queue.cc:1048] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:40.614065 30829 ts_tablet_manager.cc:1434] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.070s	user 0.004s	sys 0.004s
I20260709 12:20:40.615238 30829 tablet_bootstrap.cc:492] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:40.619393 30934 raft_consensus.cc:493] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:40.619915 30114 consensus_peers.cc:597] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:40.620561 30114 consensus_peers.cc:597] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:40.624059 30223 raft_consensus.cc:1275] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Refusing update from remote peer b0439d4e94904196847cd825fcc8ebd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:40.624949 30931 leader_election.cc:290] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:40.637228 30147 raft_consensus.cc:1275] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Refusing update from remote peer f6c1f7275e654f49abaf1c80ed662511: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:40.639102 30726 consensus_queue.cc:1048] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:40.620003 30934 raft_consensus.cc:515] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.660769 30759 consensus_queue.cc:1048] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:20:40.676343 30934 leader_election.cc:290] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:40.679507 30149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f18dd45e30e4e3aafdc917396dc2181" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:40.679989 30145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27678468a40344eca39b8bab02b0b368" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:40.682641 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caa8a59f42477199989f2612bb7136" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:40.683368 30146 raft_consensus.cc:2393] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a1255131174934a6bca3c0bf000026 in current term 2: Already voted for candidate f6c1f7275e654f49abaf1c80ed662511 in this term.
I20260709 12:20:40.684078 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0b7d6a4d5d4eb1a1c115b60981d41c" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:40.686224 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961df2c56aac4887bbb0971fd85cd3b0" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
W20260709 12:20:40.696277 30262 consensus_peers.cc:597] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:40.718266 30145 raft_consensus.cc:1275] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Refusing update from remote peer f6c1f7275e654f49abaf1c80ed662511: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:40.726536 30293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f18dd45e30e4e3aafdc917396dc2181" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:40.727200 30296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27678468a40344eca39b8bab02b0b368" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:40.727347 30295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961df2c56aac4887bbb0971fd85cd3b0" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:40.728480 30826 leader_election.cc:304] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:40.728775 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caa8a59f42477199989f2612bb7136" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:40.730103 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0b7d6a4d5d4eb1a1c115b60981d41c" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:40.730763 30826 leader_election.cc:304] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:40.732956 30931 raft_consensus.cc:2749] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:40.733393 30826 leader_election.cc:304] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:40.733800 30931 raft_consensus.cc:2749] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:40.734635 30931 raft_consensus.cc:2749] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:40.735244 30826 leader_election.cc:304] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:40.736210 30833 raft_consensus.cc:3060] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.740756 30889 consensus_queue.cc:1048] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:40.755676 30114 consensus_peers.cc:597] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:40.761315 30113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:44035, user_credentials={real_user=slave}} blocked reactor thread for 100328us
W20260709 12:20:40.769865 30188 consensus_peers.cc:597] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:40.808777 30833 raft_consensus.cc:2749] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:40.801367 30826 leader_election.cc:304] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:40.810999 30833 raft_consensus.cc:2749] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:40.814714 30262 consensus_peers.cc:597] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:40.830678 30262 consensus_peers.cc:597] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:40.834175 30833 raft_consensus.cc:493] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.835414 30833 raft_consensus.cc:515] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:40.840885 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17f97873bb48ca864a13321c11f401" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:40.841925 30833 leader_election.cc:290] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:40.830793 30829 tablet_bootstrap.cc:492] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:20:40.846673 30188 consensus_peers.cc:597] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:40.847503 30829 tablet_bootstrap.cc:492] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:40.848366 30829 ts_tablet_manager.cc:1403] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.233s	user 0.059s	sys 0.072s
I20260709 12:20:40.852499 30829 raft_consensus.cc:359] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:40.853256 30829 raft_consensus.cc:740] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:40.853399 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17f97873bb48ca864a13321c11f401" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:40.854681 30829 consensus_queue.cc:260] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:40.857148 30829 ts_tablet_manager.cc:1434] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:20:40.857995 30829 tablet_bootstrap.cc:492] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
W20260709 12:20:40.863647 30262 consensus_peers.cc:597] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:40.867368 30188 consensus_peers.cc:597] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:40.870309 30826 leader_election.cc:304] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:40.871567 30833 raft_consensus.cc:2749] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:40.872668 30833 raft_consensus.cc:493] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.873116 30833 raft_consensus.cc:515] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:40.875152 30833 leader_election.cc:290] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:40.877372 30222 raft_consensus.cc:1275] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Refusing update from remote peer b0439d4e94904196847cd825fcc8ebd7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:20:40.878973 30114 consensus_peers.cc:597] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:40.879308 30262 consensus_peers.cc:597] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:40.879485 30114 consensus_peers.cc:597] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:40.880916 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c8763c7b2b4fb891cbebff4035dbe6" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:40.883689 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c8763c7b2b4fb891cbebff4035dbe6" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
W20260709 12:20:40.885231 30114 consensus_peers.cc:597] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:40.886726 30824 leader_election.cc:304] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:40.887542 30938 consensus_queue.cc:1048] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:40.888396 30833 raft_consensus.cc:2749] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:40.899268 30114 consensus_peers.cc:597] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:40.903838 30829 tablet_bootstrap.cc:492] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:40.905469 30829 tablet_bootstrap.cc:492] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:40.906144 30829 ts_tablet_manager.cc:1403] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.048s	user 0.027s	sys 0.002s
I20260709 12:20:40.908800 30829 raft_consensus.cc:359] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:40.909543 30829 raft_consensus.cc:740] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:40.910825 30829 consensus_queue.cc:260] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:40.912850 30829 ts_tablet_manager.cc:1434] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:20:40.913640 30829 tablet_bootstrap.cc:492] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:40.941752 30829 tablet_bootstrap.cc:492] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:40.942718 30829 tablet_bootstrap.cc:492] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:40.943341 30829 ts_tablet_manager.cc:1403] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.004s
I20260709 12:20:40.945912 30829 raft_consensus.cc:359] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.946588 30829 raft_consensus.cc:740] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:40.947355 30829 consensus_queue.cc:260] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
W20260709 12:20:40.949141 30114 consensus_peers.cc:597] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:40.949831 30829 ts_tablet_manager.cc:1434] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:20:40.950805 30829 tablet_bootstrap.cc:492] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:40.967260 30833 raft_consensus.cc:493] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.967615 30829 tablet_bootstrap.cc:492] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:40.967971 30833 raft_consensus.cc:515] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.968670 30829 tablet_bootstrap.cc:492] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:40.969450 30829 ts_tablet_manager.cc:1403] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 12:20:40.971748 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f28aae897045be9eed015c98ba6908" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:40.972154 30829 raft_consensus.cc:359] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.972899 30829 raft_consensus.cc:740] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:40.973572 30829 consensus_queue.cc:260] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:40.975736 30829 ts_tablet_manager.cc:1434] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:20:40.976491 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f28aae897045be9eed015c98ba6908" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:40.977185 30833 leader_election.cc:290] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:40.976547 30829 tablet_bootstrap.cc:492] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:40.979031 30826 leader_election.cc:304] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:40.982378 30833 raft_consensus.cc:2749] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:40.993937 30262 consensus_peers.cc:597] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:41.001282 30829 tablet_bootstrap.cc:492] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:41.002362 30829 tablet_bootstrap.cc:492] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:41.003046 30829 ts_tablet_manager.cc:1403] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.003s
I20260709 12:20:41.003535 30971 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.1:43571 every 8 connection(s)
I20260709 12:20:41.006713 30829 raft_consensus.cc:359] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.008396 30829 raft_consensus.cc:740] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:41.009145 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.1:43571
I20260709 12:20:41.009140 30829 consensus_queue.cc:260] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.012372 30829 ts_tablet_manager.cc:1434] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:20:41.013177 30829 tablet_bootstrap.cc:492] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:41.014125 30833 raft_consensus.cc:493] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.014684 30833 raft_consensus.cc:515] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:41.016939 30833 leader_election.cc:290] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:41.020042 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c8f2fbe93624983bd807e8ac2f76aff" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:41.048626 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c8f2fbe93624983bd807e8ac2f76aff" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:41.050670 30829 tablet_bootstrap.cc:492] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:41.051716 30829 tablet_bootstrap.cc:492] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:41.052392 30829 ts_tablet_manager.cc:1403] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.000s
I20260709 12:20:41.059393 30833 raft_consensus.cc:493] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.060022 30833 raft_consensus.cc:515] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:41.062170 30833 leader_election.cc:290] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:41.064064 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3111cf2203d14eb8a006d35fee44552e" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:41.064174 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3111cf2203d14eb8a006d35fee44552e" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:41.057193 30829 raft_consensus.cc:359] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.066228 30829 raft_consensus.cc:740] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:41.066730 30823 leader_election.cc:304] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:41.065593 30826 leader_election.cc:304] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:41.067056 30829 consensus_queue.cc:260] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.068210 30934 raft_consensus.cc:2749] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:41.068588 30931 raft_consensus.cc:2749] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:41.069252 30829 ts_tablet_manager.cc:1434] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:20:41.070238 30829 tablet_bootstrap.cc:492] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
W20260709 12:20:41.072563 30188 consensus_peers.cc:597] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:41.074443 30833 raft_consensus.cc:493] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.075044 30833 raft_consensus.cc:515] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:41.084667 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0696a915ada148cca9600585d0152f86" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:41.085408 30833 leader_election.cc:290] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:41.087209 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0696a915ada148cca9600585d0152f86" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:41.089004 30824 leader_election.cc:304] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:41.089748 30833 raft_consensus.cc:2749] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:41.094009 30829 tablet_bootstrap.cc:492] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:41.095067 30829 tablet_bootstrap.cc:492] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:41.095764 30829 ts_tablet_manager.cc:1403] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.000s
I20260709 12:20:41.098492 30829 raft_consensus.cc:359] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.099210 30829 raft_consensus.cc:740] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:41.099922 30829 consensus_queue.cc:260] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.101589 30829 ts_tablet_manager.cc:1434] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:20:41.102522 30829 tablet_bootstrap.cc:492] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:41.121574 30900 raft_consensus.cc:3060] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.127620 30936 raft_consensus.cc:3060] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.134152 30931 raft_consensus.cc:493] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.134744 30931 raft_consensus.cc:515] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:41.136787 30931 leader_election.cc:290] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:41.140969 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f5109a89314f8bbf67848895ef8918" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:41.142658 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f5109a89314f8bbf67848895ef8918" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:41.145220 30974 heartbeater.cc:344] Connected to a master server at 127.20.191.62:36647
I20260709 12:20:41.145650 30974 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:41.146613 30974 heartbeater.cc:507] Master 127.20.191.62:36647 requested a full tablet report, sending...
I20260709 12:20:41.147167 30824 leader_election.cc:304] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:41.148720 30931 raft_consensus.cc:2749] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:41.153963 30114 consensus_peers.cc:597] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:41.177409 30829 tablet_bootstrap.cc:492] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:41.182773 30900 raft_consensus.cc:3060] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.182986 30829 tablet_bootstrap.cc:492] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:41.183300 30728 raft_consensus.cc:493] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.184122 30829 ts_tablet_manager.cc:1403] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.043s
I20260709 12:20:41.183917 30728 raft_consensus.cc:515] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.185995 30728 leader_election.cc:290] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:41.186625 30829 raft_consensus.cc:359] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.187340 30829 raft_consensus.cc:740] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:41.190580 30906 raft_consensus.cc:3060] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.187808 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b12541deba40218ef3f8c40f40312a" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:41.188117 30829 consensus_queue.cc:260] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.192135 30297 raft_consensus.cc:2468] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 2.
I20260709 12:20:41.193562 30829 ts_tablet_manager.cc:1434] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:20:41.191390 30936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b12541deba40218ef3f8c40f40312a" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026" is_pre_election: true
I20260709 12:20:41.194217 30189 leader_election.cc:304] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:41.195611 30829 tablet_bootstrap.cc:492] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:41.196341 30904 raft_consensus.cc:2804] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:41.196960 30904 raft_consensus.cc:493] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.197319 30904 raft_consensus.cc:3060] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.194723 30936 raft_consensus.cc:2468] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 1.
I20260709 12:20:41.215572 30833 raft_consensus.cc:493] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.218670 30833 raft_consensus.cc:515] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:41.226480 30931 raft_consensus.cc:493] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.229549 30223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d01a3a6c7f24268a9c505f7d2f0efcd" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:41.226680 30833 leader_election.cc:290] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:41.234655 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d01a3a6c7f24268a9c505f7d2f0efcd" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:41.229867 30931 raft_consensus.cc:515] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:41.237744 30823 leader_election.cc:304] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:41.238632 30934 raft_consensus.cc:2749] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:41.239492 30931 leader_election.cc:290] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:41.241205 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581f9562c91e46eea64ec770bcb8671b" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511" is_pre_election: true
I20260709 12:20:41.241647 29970 ts_manager.cc:194] Re-registered known tserver with Master: 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:41.246112 30829 tablet_bootstrap.cc:492] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:41.247522 30833 raft_consensus.cc:493] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.248759 30833 raft_consensus.cc:515] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:41.249195 30829 tablet_bootstrap.cc:492] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:41.249982 30829 ts_tablet_manager.cc:1403] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.056s	user 0.026s	sys 0.009s
I20260709 12:20:41.250946 30833 leader_election.cc:290] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:41.253011 30829 raft_consensus.cc:359] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:41.253652 30829 raft_consensus.cc:740] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:41.253784 30222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb12e58a824780acab66b641b29009" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" is_pre_election: true
I20260709 12:20:41.244112 30147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581f9562c91e46eea64ec770bcb8671b" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
I20260709 12:20:41.254437 30829 consensus_queue.cc:260] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:41.255002 30904 raft_consensus.cc:515] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.256536 30145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb12e58a824780acab66b641b29009" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0439d4e94904196847cd825fcc8ebd7" is_pre_election: true
W20260709 12:20:41.257177 30188 consensus_peers.cc:597] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:41.258062 30823 leader_election.cc:304] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:41.259585 30931 raft_consensus.cc:2749] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:41.261077 30823 leader_election.cc:304] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a1255131174934a6bca3c0bf000026; no voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:41.263289 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b12541deba40218ef3f8c40f40312a" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:41.263566 30833 raft_consensus.cc:2749] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:41.263918 30297 raft_consensus.cc:3060] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.268689 30904 leader_election.cc:290] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 3 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:41.269788 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b12541deba40218ef3f8c40f40312a" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a1255131174934a6bca3c0bf000026"
I20260709 12:20:41.270490 30900 raft_consensus.cc:3060] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.270602 30829 ts_tablet_manager.cc:1434] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.001s
I20260709 12:20:41.271706 30829 tablet_bootstrap.cc:492] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:41.272322 30297 raft_consensus.cc:2468] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 3.
I20260709 12:20:41.273551 30189 leader_election.cc:304] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:41.274448 30904 raft_consensus.cc:2804] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:41.274992 30904 raft_consensus.cc:697] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 3 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:41.275900 30904 consensus_queue.cc:237] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.285032 30900 raft_consensus.cc:2468] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 3.
I20260709 12:20:41.293555 30829 tablet_bootstrap.cc:492] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:41.294427 30829 tablet_bootstrap.cc:492] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:41.294961 30829 ts_tablet_manager.cc:1403] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.006s
I20260709 12:20:41.296753 30829 raft_consensus.cc:359] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.296424 29971 catalog_manager.cc:5697] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 1 to 3, leader changed from 22a1255131174934a6bca3c0bf000026 (127.20.191.1) to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 3 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:41.297394 30829 raft_consensus.cc:740] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:41.298171 30829 consensus_queue.cc:260] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.300252 30829 ts_tablet_manager.cc:1434] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:20:41.301544 30829 tablet_bootstrap.cc:492] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:41.322270 30829 tablet_bootstrap.cc:492] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:41.323205 30829 tablet_bootstrap.cc:492] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:41.323763 30829 ts_tablet_manager.cc:1403] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.003s
I20260709 12:20:41.325963 30829 raft_consensus.cc:359] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:41.326555 30829 raft_consensus.cc:740] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:41.327082 30829 consensus_queue.cc:260] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:41.328667 30829 ts_tablet_manager.cc:1434] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:20:41.329351 30829 tablet_bootstrap.cc:492] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:41.340941 29970 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40066
I20260709 12:20:41.343942 30829 tablet_bootstrap.cc:492] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:41.345029 30829 tablet_bootstrap.cc:492] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:41.345709 30829 ts_tablet_manager.cc:1403] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:20:41.347060 30974 heartbeater.cc:499] Master 127.20.191.62:36647 was elected leader, sending a full tablet report...
I20260709 12:20:41.348285 30829 raft_consensus.cc:359] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:41.348940 30829 raft_consensus.cc:740] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:41.349460 30829 consensus_queue.cc:260] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:41.351516 30829 ts_tablet_manager.cc:1434] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:20:41.352377 30829 tablet_bootstrap.cc:492] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:41.371379 30829 tablet_bootstrap.cc:492] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:41.372210 30829 tablet_bootstrap.cc:492] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:41.372843 30829 ts_tablet_manager.cc:1403] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.000s
I20260709 12:20:41.375913 30829 raft_consensus.cc:359] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.376610 30829 raft_consensus.cc:740] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:41.378000 30829 consensus_queue.cc:260] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.380245 30829 ts_tablet_manager.cc:1434] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:20:41.381117 30829 tablet_bootstrap.cc:492] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:41.396955 30829 tablet_bootstrap.cc:492] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:41.398043 30829 tablet_bootstrap.cc:492] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:41.398720 30829 ts_tablet_manager.cc:1403] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:20:41.401292 30829 raft_consensus.cc:359] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:41.401983 30829 raft_consensus.cc:740] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:41.402694 30829 consensus_queue.cc:260] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:41.404778 30829 ts_tablet_manager.cc:1434] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:20:41.421388 30829 tablet_bootstrap.cc:492] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:41.461593 30829 tablet_bootstrap.cc:492] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:41.462699 30829 tablet_bootstrap.cc:492] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:41.463485 30829 ts_tablet_manager.cc:1403] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.008s
I20260709 12:20:41.466457 30829 raft_consensus.cc:359] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.467212 30829 raft_consensus.cc:740] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:41.467984 30829 consensus_queue.cc:260] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.470618 30829 ts_tablet_manager.cc:1434] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:20:41.471491 30829 tablet_bootstrap.cc:492] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:41.493258 30829 tablet_bootstrap.cc:492] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:41.494117 30829 tablet_bootstrap.cc:492] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:41.494805 30829 ts_tablet_manager.cc:1403] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 12:20:41.497133 30829 raft_consensus.cc:359] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.497820 30829 raft_consensus.cc:740] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:41.498442 30829 consensus_queue.cc:260] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:41.500490 30829 ts_tablet_manager.cc:1434] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:20:41.501276 30829 tablet_bootstrap.cc:492] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
I20260709 12:20:41.506351 30900 raft_consensus.cc:3060] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.515333 30900 pending_rounds.cc:85] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026: Aborting all ops after (but not including) 0
I20260709 12:20:41.515722 30900 pending_rounds.cc:107] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:20:41.516005 30900 raft_consensus.cc:2889] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:41.528965 30829 tablet_bootstrap.cc:492] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:41.530097 30829 tablet_bootstrap.cc:492] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:41.531359 30829 ts_tablet_manager.cc:1403] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.000s
I20260709 12:20:41.533689 30829 raft_consensus.cc:359] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:41.534951 30829 raft_consensus.cc:740] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:41.537740 30829 consensus_queue.cc:260] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:41.538344 30919 raft_consensus.cc:3060] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.539703 30829 ts_tablet_manager.cc:1434] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.003s
I20260709 12:20:41.541887 30900 raft_consensus.cc:3060] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.547068 30829 tablet_bootstrap.cc:492] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026: Bootstrap starting.
W20260709 12:20:41.548305 30114 consensus_peers.cc:597] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:41.573917 30829 tablet_bootstrap.cc:492] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:41.574883 30829 tablet_bootstrap.cc:492] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026: Bootstrap complete.
I20260709 12:20:41.575523 30829 ts_tablet_manager.cc:1403] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.005s
I20260709 12:20:41.577785 30829 raft_consensus.cc:359] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:41.578459 30829 raft_consensus.cc:740] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Initialized, Role: FOLLOWER
I20260709 12:20:41.579077 30829 consensus_queue.cc:260] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:41.581315 30829 ts_tablet_manager.cc:1434] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:20:41.616549 30919 raft_consensus.cc:3060] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.678184 30900 raft_consensus.cc:3060] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.818264 30297 raft_consensus.cc:1275] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Refusing update from remote peer f3ef588fc4b54ec09355022d7a5a5e86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:41.819813 30985 consensus_queue.cc:1048] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:41.830801 30900 raft_consensus.cc:1275] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 3 FOLLOWER]: Refusing update from remote peer f3ef588fc4b54ec09355022d7a5a5e86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:41.832111 30728 consensus_queue.cc:1048] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:46.624413 30003 debug-util.cc:398] Leaking SignalData structure 0x7b08000eac20 after lost signal to thread 21247
W20260709 12:20:46.625464 30003 debug-util.cc:398] Leaking SignalData structure 0x7b0800108500 after lost signal to thread 30006
W20260709 12:20:46.626617 30003 debug-util.cc:398] Leaking SignalData structure 0x7b0800325ec0 after lost signal to thread 30173
W20260709 12:20:46.627512 30003 debug-util.cc:398] Leaking SignalData structure 0x7b080004b5e0 after lost signal to thread 30247
W20260709 12:20:46.628505 30003 debug-util.cc:398] Leaking SignalData structure 0x7b080010f9e0 after lost signal to thread 30321
W20260709 12:20:46.629452 30003 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd1c0 after lost signal to thread 30971
I20260709 12:20:51.085875 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:51.148005 30146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27678468a40344eca39b8bab02b0b368"
dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
mode: GRACEFUL
new_leader_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:35582
I20260709 12:20:51.148814 30146 raft_consensus.cc:606] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Received request to transfer leadership to TS 22a1255131174934a6bca3c0bf000026
I20260709 12:20:51.151422 30146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b981cc4916444c0a31e5fd3b14aaa67"
dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
mode: GRACEFUL
new_leader_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:35582
I20260709 12:20:51.151901 30146 raft_consensus.cc:606] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Received request to transfer leadership to TS 22a1255131174934a6bca3c0bf000026
I20260709 12:20:51.154286 30146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ad560d215f8475ab9f93ff568eef9f9"
dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
mode: GRACEFUL
new_leader_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:35582
I20260709 12:20:51.154778 30146 raft_consensus.cc:606] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Received request to transfer leadership to TS 22a1255131174934a6bca3c0bf000026
I20260709 12:20:51.157076 30146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bd853575cf54f3f91608d485c3d16ca"
dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
mode: GRACEFUL
new_leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
 from {username='slave'} at 127.0.0.1:35582
I20260709 12:20:51.157660 30146 raft_consensus.cc:606] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Received request to transfer leadership to TS f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:51.159727 30146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af7b5f5579594d8381af5f96a15e24d9"
dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
mode: GRACEFUL
new_leader_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:35582
I20260709 12:20:51.160143 30146 raft_consensus.cc:606] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Received request to transfer leadership to TS 22a1255131174934a6bca3c0bf000026
I20260709 12:20:51.174034 30297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c32f11599774407e9de2e65083c53e17"
dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
mode: GRACEFUL
new_leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
 from {username='slave'} at 127.0.0.1:40438
I20260709 12:20:51.174695 30297 raft_consensus.cc:606] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Received request to transfer leadership to TS f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:51.176028 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:51.177177 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:51.178131 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:51.213958 31040 raft_consensus.cc:993] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7: : Instructing follower 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:51.214681 31024 raft_consensus.cc:1081] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Signalling peer 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:51.216293 30884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af7b5f5579594d8381af5f96a15e24d9"
dest_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:53734
I20260709 12:20:51.216892 30884 raft_consensus.cc:493] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:51.217852 30884 raft_consensus.cc:3060] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.229419 30884 raft_consensus.cc:515] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:51.231734 30884 leader_election.cc:290] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:51.232499 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7b5f5579594d8381af5f96a15e24d9" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:51.233011 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7b5f5579594d8381af5f96a15e24d9" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:51.233382 30297 raft_consensus.cc:3060] T af7b5f5579594d8381af5f96a15e24d9 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.233682 30146 raft_consensus.cc:3055] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.233975 30146 raft_consensus.cc:740] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:51.234684 30146 consensus_queue.cc:260] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:51.235718 30146 raft_consensus.cc:3060] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.241242 30297 raft_consensus.cc:2468] T af7b5f5579594d8381af5f96a15e24d9 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 2.
I20260709 12:20:51.241998 30146 raft_consensus.cc:2468] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 2.
I20260709 12:20:51.242637 30826 leader_election.cc:304] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:51.244390 31058 raft_consensus.cc:2804] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:51.245440 31058 raft_consensus.cc:697] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [term 2 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:51.246456 31058 consensus_queue.cc:237] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:51.259380 29970 catalog_manager.cc:5697] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 1 to 2, leader changed from b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2) to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:51.368921 31024 raft_consensus.cc:993] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7: : Instructing follower 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:51.369472 31040 raft_consensus.cc:1081] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Signalling peer 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:51.371325 30883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27678468a40344eca39b8bab02b0b368"
dest_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:53734
I20260709 12:20:51.371834 30883 raft_consensus.cc:493] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:51.372124 30883 raft_consensus.cc:3060] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:51.377707 30883 raft_consensus.cc:515] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:51.379408 30883 leader_election.cc:290] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 3 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:51.380401 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27678468a40344eca39b8bab02b0b368" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:51.380445 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27678468a40344eca39b8bab02b0b368" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:51.381157 30146 raft_consensus.cc:3055] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:51.381247 30297 raft_consensus.cc:3060] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:51.381714 30146 raft_consensus.cc:740] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:51.384217 31024 raft_consensus.cc:993] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7: : Instructing follower 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:51.382604 30146 consensus_queue.cc:260] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:51.384752 31024 raft_consensus.cc:1081] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Signalling peer 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:51.385432 30146 raft_consensus.cc:3060] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:51.386790 30883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ad560d215f8475ab9f93ff568eef9f9"
dest_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:53734
I20260709 12:20:51.387465 30883 raft_consensus.cc:493] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:51.387962 30883 raft_consensus.cc:3060] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.388612 30297 raft_consensus.cc:2468] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 3.
I20260709 12:20:51.390209 30826 leader_election.cc:304] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:51.391098 31058 raft_consensus.cc:2804] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:51.391574 31058 raft_consensus.cc:697] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 3 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:51.392592 31058 consensus_queue.cc:237] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:51.393726 30146 raft_consensus.cc:2468] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 3.
I20260709 12:20:51.396237 30883 raft_consensus.cc:515] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:51.410384 30883 leader_election.cc:290] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:51.413600 30217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad560d215f8475ab9f93ff568eef9f9" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:51.414294 30217 raft_consensus.cc:3060] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.416241 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad560d215f8475ab9f93ff568eef9f9" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:51.416895 30146 raft_consensus.cc:3055] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.417245 30146 raft_consensus.cc:740] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:51.418049 30146 consensus_queue.cc:260] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:51.419066 30146 raft_consensus.cc:3060] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.419893 29970 catalog_manager.cc:5697] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 2 to 3, leader changed from b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2) to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 3 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:51.422482 30217 raft_consensus.cc:2468] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 2.
I20260709 12:20:51.424021 30824 leader_election.cc:304] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:51.424785 31058 raft_consensus.cc:2804] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:51.425107 30146 raft_consensus.cc:2468] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 2.
I20260709 12:20:51.425189 31058 raft_consensus.cc:697] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 2 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:51.426479 31058 consensus_queue.cc:237] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:51.439217 29971 catalog_manager.cc:5697] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 1 to 2, leader changed from b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2) to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:51.557282 31024 raft_consensus.cc:993] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7: : Instructing follower 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:51.557840 31024 raft_consensus.cc:1081] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Signalling peer 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:51.559973 30883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b981cc4916444c0a31e5fd3b14aaa67"
dest_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:53734
I20260709 12:20:51.562026 31024 raft_consensus.cc:993] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7: : Instructing follower f3ef588fc4b54ec09355022d7a5a5e86 to start an election
I20260709 12:20:51.560618 30883 raft_consensus.cc:493] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:51.562668 31052 raft_consensus.cc:1081] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Signalling peer f3ef588fc4b54ec09355022d7a5a5e86 to start an election
I20260709 12:20:51.563135 30883 raft_consensus.cc:3060] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.565843 30217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5bd853575cf54f3f91608d485c3d16ca"
dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
 from {username='slave'} at 127.0.0.1:36302
I20260709 12:20:51.566591 30217 raft_consensus.cc:493] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:51.567046 30217 raft_consensus.cc:3060] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.574703 30217 raft_consensus.cc:515] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:51.576493 31054 raft_consensus.cc:993] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511: : Instructing follower f3ef588fc4b54ec09355022d7a5a5e86 to start an election
I20260709 12:20:51.576382 30883 raft_consensus.cc:515] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:51.577105 31054 raft_consensus.cc:1081] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Signalling peer f3ef588fc4b54ec09355022d7a5a5e86 to start an election
I20260709 12:20:51.578588 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd853575cf54f3f91608d485c3d16ca" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:51.579159 30295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b981cc4916444c0a31e5fd3b14aaa67" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:51.579569 30221 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c32f11599774407e9de2e65083c53e17"
dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
 from {username='slave'} at 127.0.0.1:36300
I20260709 12:20:51.579737 30217 leader_election.cc:290] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:51.580005 30295 raft_consensus.cc:3060] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.580087 30221 raft_consensus.cc:493] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:51.580514 30221 raft_consensus.cc:3060] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.579210 30146 raft_consensus.cc:3055] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.581632 30146 raft_consensus.cc:740] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:51.582435 30146 consensus_queue.cc:260] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:51.583624 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd853575cf54f3f91608d485c3d16ca" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:51.583851 30146 raft_consensus.cc:3060] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.584476 30297 raft_consensus.cc:3060] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.587514 30883 leader_election.cc:290] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:51.589401 30144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b981cc4916444c0a31e5fd3b14aaa67" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:51.590128 30144 raft_consensus.cc:3055] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.590442 30144 raft_consensus.cc:740] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:51.591300 30144 consensus_queue.cc:260] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:51.592819 30144 raft_consensus.cc:3060] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.593704 30146 raft_consensus.cc:2468] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 2.
I20260709 12:20:51.595923 30186 leader_election.cc:304] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:51.596859 31050 raft_consensus.cc:2804] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:51.597393 31050 raft_consensus.cc:697] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:51.598371 31050 consensus_queue.cc:237] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:51.599918 30295 raft_consensus.cc:2468] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 2.
I20260709 12:20:51.601205 30826 leader_election.cc:304] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:51.601395 30297 raft_consensus.cc:2468] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 2.
I20260709 12:20:51.602226 31058 raft_consensus.cc:2804] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:51.602770 31058 raft_consensus.cc:697] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 2 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:51.603776 31058 consensus_queue.cc:237] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:51.605095 30144 raft_consensus.cc:2468] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 2.
I20260709 12:20:51.601065 30221 raft_consensus.cc:515] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:51.608574 30221 leader_election.cc:290] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:51.610203 30144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32f11599774407e9de2e65083c53e17" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:51.610934 30144 raft_consensus.cc:3060] T c32f11599774407e9de2e65083c53e17 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.611754 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32f11599774407e9de2e65083c53e17" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:51.612375 30297 raft_consensus.cc:3055] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.612658 30297 raft_consensus.cc:740] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:51.613409 30297 consensus_queue.cc:260] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:51.614588 30297 raft_consensus.cc:3060] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.618639 30144 raft_consensus.cc:2468] T c32f11599774407e9de2e65083c53e17 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 2.
I20260709 12:20:51.624306 30186 leader_election.cc:304] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:51.626082 31053 raft_consensus.cc:2804] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:51.626626 31053 raft_consensus.cc:697] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:51.627539 31053 consensus_queue.cc:237] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:51.628475 29971 catalog_manager.cc:5697] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 1 to 2, leader changed from b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2) to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 2 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:51.637329 30297 raft_consensus.cc:2468] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 2.
I20260709 12:20:51.657884 29971 catalog_manager.cc:5697] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 1 to 2, leader changed from f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4) to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 2 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:51.663905 29970 catalog_manager.cc:5697] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 1 to 2, leader changed from b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2) to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:51.793190 30144 raft_consensus.cc:1275] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:51.796008 31058 consensus_queue.cc:1048] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:51.817284 30297 raft_consensus.cc:1275] T af7b5f5579594d8381af5f96a15e24d9 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:51.820277 31059 consensus_queue.cc:1048] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:51.829877 30144 raft_consensus.cc:1275] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:51.831115 30217 raft_consensus.cc:1275] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:51.831491 31059 consensus_queue.cc:1048] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:51.855003 31059 consensus_queue.cc:1048] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:51.912669 30297 raft_consensus.cc:1275] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:51.914539 31059 consensus_queue.cc:1048] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:51.927364 30148 raft_consensus.cc:1275] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 3 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:51.929183 31077 consensus_queue.cc:1048] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:52.084143 30144 raft_consensus.cc:1275] T c32f11599774407e9de2e65083c53e17 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Refusing update from remote peer f3ef588fc4b54ec09355022d7a5a5e86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:52.085649 31069 consensus_queue.cc:1048] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:52.094154 30297 raft_consensus.cc:1275] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Refusing update from remote peer f3ef588fc4b54ec09355022d7a5a5e86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:52.095737 31069 consensus_queue.cc:1048] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:52.155488 30144 raft_consensus.cc:1275] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Refusing update from remote peer f3ef588fc4b54ec09355022d7a5a5e86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:52.156818 31069 consensus_queue.cc:1048] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:52.175544 30297 raft_consensus.cc:1275] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Refusing update from remote peer f3ef588fc4b54ec09355022d7a5a5e86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:52.179718 31053 consensus_queue.cc:1048] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:52.185416 30295 raft_consensus.cc:1275] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:52.187458 31077 consensus_queue.cc:1048] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:52.217509 30144 raft_consensus.cc:1275] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:52.218521 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:52.219560 31077 consensus_queue.cc:1048] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:52.267395 30144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03f2f494c25b47459faf1d6e4a245f08"
dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
mode: GRACEFUL
new_leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
 from {username='slave'} at 127.0.0.1:35582
I20260709 12:20:52.267907 30144 raft_consensus.cc:606] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Received request to transfer leadership to TS f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:52.270512 30144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c55d09601aa4eceaf3916006afcc93a"
dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
mode: GRACEFUL
new_leader_uuid: "f6c1f7275e654f49abaf1c80ed662511"
 from {username='slave'} at 127.0.0.1:35582
I20260709 12:20:52.271036 30144 raft_consensus.cc:606] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Received request to transfer leadership to TS f6c1f7275e654f49abaf1c80ed662511
I20260709 12:20:52.273518 30144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a289b0636994e34965a2dc0137e5b94"
dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
mode: GRACEFUL
new_leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
 from {username='slave'} at 127.0.0.1:35582
I20260709 12:20:52.274001 30144 raft_consensus.cc:606] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Received request to transfer leadership to TS f3ef588fc4b54ec09355022d7a5a5e86
I20260709 12:20:52.276288 30295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b17f97873bb48ca864a13321c11f401"
dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
mode: GRACEFUL
new_leader_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:40438
I20260709 12:20:52.276726 30295 raft_consensus.cc:606] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 2 LEADER]: Received request to transfer leadership to TS 22a1255131174934a6bca3c0bf000026
I20260709 12:20:52.279024 30144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d01a3a6c7f24268a9c505f7d2f0efcd"
dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
mode: GRACEFUL
new_leader_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:35582
I20260709 12:20:52.279489 30144 raft_consensus.cc:606] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Received request to transfer leadership to TS 22a1255131174934a6bca3c0bf000026
I20260709 12:20:52.304920 30221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6b12541deba40218ef3f8c40f40312a"
dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
mode: GRACEFUL
new_leader_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:39578
I20260709 12:20:52.305399 30221 raft_consensus.cc:606] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 3 LEADER]: Received request to transfer leadership to TS 22a1255131174934a6bca3c0bf000026
I20260709 12:20:52.309159 30144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f01efd7c139e45c3809ed6a668f1faca"
dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
mode: GRACEFUL
new_leader_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:35582
I20260709 12:20:52.309700 30144 raft_consensus.cc:606] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Received request to transfer leadership to TS 22a1255131174934a6bca3c0bf000026
I20260709 12:20:52.310693 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:20:52.311918 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:52.312573 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:52.416112 31024 raft_consensus.cc:993] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7: : Instructing follower 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:52.416544 31052 raft_consensus.cc:1081] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Signalling peer 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:52.418023 30883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f01efd7c139e45c3809ed6a668f1faca"
dest_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:53734
I20260709 12:20:52.418476 30883 raft_consensus.cc:493] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.418740 30883 raft_consensus.cc:3060] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.423727 30883 raft_consensus.cc:515] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:52.425262 30883 leader_election.cc:290] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 3 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:52.426293 30144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f01efd7c139e45c3809ed6a668f1faca" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:52.426293 30295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f01efd7c139e45c3809ed6a668f1faca" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:52.427106 30144 raft_consensus.cc:3055] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:52.427129 30295 raft_consensus.cc:3060] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.427556 30144 raft_consensus.cc:740] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:52.428401 30144 consensus_queue.cc:260] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:52.429605 30144 raft_consensus.cc:3060] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.434319 30295 raft_consensus.cc:2468] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 3.
I20260709 12:20:52.435572 30826 leader_election.cc:304] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:52.436370 31077 raft_consensus.cc:2804] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:52.436594 30144 raft_consensus.cc:2468] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 3.
I20260709 12:20:52.436829 31077 raft_consensus.cc:697] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 3 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:52.438201 31077 consensus_queue.cc:237] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:52.448136 29970 catalog_manager.cc:5697] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 2 to 3, leader changed from b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2) to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 3 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.449041 31024 raft_consensus.cc:993] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7: : Instructing follower f3ef588fc4b54ec09355022d7a5a5e86 to start an election
I20260709 12:20:52.449648 31052 raft_consensus.cc:1081] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Signalling peer f3ef588fc4b54ec09355022d7a5a5e86 to start an election
I20260709 12:20:52.451257 30221 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a289b0636994e34965a2dc0137e5b94"
dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
 from {username='slave'} at 127.0.0.1:36302
I20260709 12:20:52.451843 30221 raft_consensus.cc:493] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.452184 30221 raft_consensus.cc:3060] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.460548 30221 raft_consensus.cc:515] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:52.463371 30144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a289b0636994e34965a2dc0137e5b94" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:52.464087 30144 raft_consensus.cc:3055] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.464282 30295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a289b0636994e34965a2dc0137e5b94" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:52.464399 30144 raft_consensus.cc:740] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:52.463335 30221 leader_election.cc:290] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:52.465020 30295 raft_consensus.cc:3060] T 3a289b0636994e34965a2dc0137e5b94 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.466303 30144 consensus_queue.cc:260] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:52.467202 30144 raft_consensus.cc:3060] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.470980 30295 raft_consensus.cc:2468] T 3a289b0636994e34965a2dc0137e5b94 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 2.
I20260709 12:20:52.473289 30144 raft_consensus.cc:2468] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 2.
I20260709 12:20:52.473505 30189 leader_election.cc:304] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:52.474510 31053 raft_consensus.cc:2804] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:52.474972 31053 raft_consensus.cc:697] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:52.475812 31053 consensus_queue.cc:237] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:52.488390 29970 catalog_manager.cc:5697] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 1 to 2, leader changed from b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2) to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 2 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.604679 31052 raft_consensus.cc:993] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7: : Instructing follower f3ef588fc4b54ec09355022d7a5a5e86 to start an election
I20260709 12:20:52.605134 31024 raft_consensus.cc:1081] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Signalling peer f3ef588fc4b54ec09355022d7a5a5e86 to start an election
I20260709 12:20:52.606575 30221 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03f2f494c25b47459faf1d6e4a245f08"
dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
 from {username='slave'} at 127.0.0.1:36302
I20260709 12:20:52.607059 30221 raft_consensus.cc:493] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.607368 30221 raft_consensus.cc:3060] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.613838 31024 raft_consensus.cc:993] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7: : Instructing follower f6c1f7275e654f49abaf1c80ed662511 to start an election
I20260709 12:20:52.614387 31040 raft_consensus.cc:1081] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Signalling peer f6c1f7275e654f49abaf1c80ed662511 to start an election
I20260709 12:20:52.616312 30295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c55d09601aa4eceaf3916006afcc93a"
dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
 from {username='slave'} at 127.0.0.1:60070
I20260709 12:20:52.616978 30295 raft_consensus.cc:493] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.617378 30295 raft_consensus.cc:3060] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.617746 30221 raft_consensus.cc:515] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:52.620177 30221 leader_election.cc:290] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:52.620736 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f2f494c25b47459faf1d6e4a245f08" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:52.621345 30297 raft_consensus.cc:3060] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.621296 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f2f494c25b47459faf1d6e4a245f08" candidate_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:52.625943 30148 raft_consensus.cc:3055] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.626279 30148 raft_consensus.cc:740] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:52.627105 30148 consensus_queue.cc:260] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:52.627820 30295 raft_consensus.cc:515] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:52.628191 30148 raft_consensus.cc:3060] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.631506 30295 leader_election.cc:290] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:52.632524 30144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c55d09601aa4eceaf3916006afcc93a" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:52.633036 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c55d09601aa4eceaf3916006afcc93a" candidate_uuid: "f6c1f7275e654f49abaf1c80ed662511" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:52.633154 30144 raft_consensus.cc:3055] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.632477 30297 raft_consensus.cc:2468] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 2.
I20260709 12:20:52.633620 30144 raft_consensus.cc:740] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:52.633641 30221 raft_consensus.cc:3060] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.634780 30144 consensus_queue.cc:260] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:52.635308 30189 leader_election.cc:304] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3ef588fc4b54ec09355022d7a5a5e86, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:52.636243 31069 raft_consensus.cc:2804] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:52.636301 30144 raft_consensus.cc:3060] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.636773 31069 raft_consensus.cc:697] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 LEADER]: Becoming Leader. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:52.637653 31069 consensus_queue.cc:237] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:52.639354 30148 raft_consensus.cc:2468] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ef588fc4b54ec09355022d7a5a5e86 in term 2.
I20260709 12:20:52.643483 30144 raft_consensus.cc:2468] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 2.
I20260709 12:20:52.645340 30260 leader_election.cc:304] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:52.643483 30221 raft_consensus.cc:2468] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c1f7275e654f49abaf1c80ed662511 in term 2.
I20260709 12:20:52.646453 31051 raft_consensus.cc:2804] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:52.646922 31051 raft_consensus.cc:697] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [term 2 LEADER]: Becoming Leader. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:52.647855 31051 consensus_queue.cc:237] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:52.658138 29970 catalog_manager.cc:5697] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 reported cstate change: term changed from 1 to 2, leader changed from b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2) to f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4). New cstate: current_term: 2 leader_uuid: "f6c1f7275e654f49abaf1c80ed662511" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:52.662091 29972 catalog_manager.cc:5697] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 reported cstate change: term changed from 1 to 2, leader changed from b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2) to f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3). New cstate: current_term: 2 leader_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.721117 31054 raft_consensus.cc:993] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511: : Instructing follower 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:52.721961 31072 raft_consensus.cc:1081] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 2 LEADER]: Signalling peer 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:52.723541 30883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b17f97873bb48ca864a13321c11f401"
dest_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:53762
I20260709 12:20:52.723991 30883 raft_consensus.cc:493] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.724218 30883 raft_consensus.cc:3060] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.730458 30883 raft_consensus.cc:515] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:52.732300 30883 leader_election.cc:290] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 3 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:52.732904 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17f97873bb48ca864a13321c11f401" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:52.733240 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17f97873bb48ca864a13321c11f401" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:52.733536 30221 raft_consensus.cc:3060] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.733803 30297 raft_consensus.cc:3055] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:52.734102 30297 raft_consensus.cc:740] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:52.734760 30297 consensus_queue.cc:260] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:52.735885 30297 raft_consensus.cc:3060] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.739694 30221 raft_consensus.cc:2468] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 3.
I20260709 12:20:52.741179 30824 leader_election.cc:304] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:52.742013 31058 raft_consensus.cc:2804] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:52.742489 31058 raft_consensus.cc:697] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 3 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:52.743268 30297 raft_consensus.cc:2468] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 3.
I20260709 12:20:52.743315 31058 consensus_queue.cc:237] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:52.754077 29972 catalog_manager.cc:5697] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 2 to 3, leader changed from f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4) to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 3 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:52.798986 31040 raft_consensus.cc:993] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7: : Instructing follower 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:52.799506 31052 raft_consensus.cc:1081] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Signalling peer 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:52.800944 30884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d01a3a6c7f24268a9c505f7d2f0efcd"
dest_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:53734
I20260709 12:20:52.801483 30884 raft_consensus.cc:493] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.801802 30884 raft_consensus.cc:3060] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.808326 30884 raft_consensus.cc:515] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:52.810240 30884 leader_election.cc:290] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:52.810735 30148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d01a3a6c7f24268a9c505f7d2f0efcd" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:52.811355 30148 raft_consensus.cc:3055] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.811229 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d01a3a6c7f24268a9c505f7d2f0efcd" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:52.811805 30148 raft_consensus.cc:740] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:52.812036 30221 raft_consensus.cc:3060] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.812630 30148 consensus_queue.cc:260] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:52.813714 30148 raft_consensus.cc:3060] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.818503 30221 raft_consensus.cc:2468] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 2.
I20260709 12:20:52.819172 30148 raft_consensus.cc:2468] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 2.
I20260709 12:20:52.819803 30824 leader_election.cc:304] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:52.820657 31058 raft_consensus.cc:2804] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:52.821156 31058 raft_consensus.cc:697] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 2 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:52.821959 31058 consensus_queue.cc:237] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:52.836439 29972 catalog_manager.cc:5697] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 1 to 2, leader changed from b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2) to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.845410 31069 raft_consensus.cc:993] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86: : Instructing follower 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:52.845942 31069 raft_consensus.cc:1081] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 3 LEADER]: Signalling peer 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:52.847330 30883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6b12541deba40218ef3f8c40f40312a"
dest_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:53746
I20260709 12:20:52.847779 30883 raft_consensus.cc:493] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.848133 30883 raft_consensus.cc:3060] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.852948 30883 raft_consensus.cc:515] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:52.854835 30883 leader_election.cc:290] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 4 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:52.855751 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b12541deba40218ef3f8c40f40312a" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:52.855702 30218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b12541deba40218ef3f8c40f40312a" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:52.856583 30297 raft_consensus.cc:3060] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.856693 30218 raft_consensus.cc:3055] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:52.857138 30218 raft_consensus.cc:740] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:52.857851 30218 consensus_queue.cc:260] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:52.858839 30218 raft_consensus.cc:3060] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.862294 30297 raft_consensus.cc:2468] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 4.
I20260709 12:20:52.863595 30826 leader_election.cc:304] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:52.864203 31058 raft_consensus.cc:2804] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:52.864800 31058 raft_consensus.cc:697] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 4 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:52.865381 30218 raft_consensus.cc:2468] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 4.
I20260709 12:20:52.865628 31058 consensus_queue.cc:237] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:52.873811 29972 catalog_manager.cc:5697] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 3 to 4, leader changed from f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3) to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 4 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:52.937341 30297 raft_consensus.cc:1275] T 3a289b0636994e34965a2dc0137e5b94 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Refusing update from remote peer f3ef588fc4b54ec09355022d7a5a5e86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:52.939728 31071 consensus_queue.cc:1048] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:52.961174 30148 raft_consensus.cc:1275] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Refusing update from remote peer f3ef588fc4b54ec09355022d7a5a5e86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:52.962718 31071 consensus_queue.cc:1048] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:52.969722 30148 raft_consensus.cc:1275] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 3 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:52.970971 31058 consensus_queue.cc:1048] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:52.982983 30297 raft_consensus.cc:1275] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:52.984655 31058 consensus_queue.cc:1048] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.123401 30297 raft_consensus.cc:1275] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Refusing update from remote peer f3ef588fc4b54ec09355022d7a5a5e86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.124653 31071 consensus_queue.cc:1048] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.137247 30148 raft_consensus.cc:1275] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Refusing update from remote peer f3ef588fc4b54ec09355022d7a5a5e86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.138295 30144 raft_consensus.cc:1275] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Refusing update from remote peer f6c1f7275e654f49abaf1c80ed662511: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.138954 31071 consensus_queue.cc:1048] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:53.139880 31051 consensus_queue.cc:1048] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.161700 30221 raft_consensus.cc:1275] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Refusing update from remote peer f6c1f7275e654f49abaf1c80ed662511: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.163477 31054 consensus_queue.cc:1048] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.179690 30297 raft_consensus.cc:1275] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:53.181128 31058 consensus_queue.cc:1048] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:53.198098 30221 raft_consensus.cc:1275] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 3 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:53.200050 31077 consensus_queue.cc:1048] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:53.257184 30148 raft_consensus.cc:1275] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.261375 31077 consensus_queue.cc:1048] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.272270 30217 raft_consensus.cc:1275] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.276327 31058 consensus_queue.cc:1048] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.343107 30221 raft_consensus.cc:1275] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 4 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:53.345146 31120 consensus_queue.cc:1048] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:53.351464 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:53.363940 30297 raft_consensus.cc:1275] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 4 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:53.366178 31120 consensus_queue.cc:1048] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:53.414669 30221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03f2f494c25b47459faf1d6e4a245f08"
dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
mode: GRACEFUL
new_leader_uuid: "b0439d4e94904196847cd825fcc8ebd7"
 from {username='slave'} at 127.0.0.1:39578
I20260709 12:20:53.415161 30221 raft_consensus.cc:606] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 LEADER]: Received request to transfer leadership to TS b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:53.417651 30294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d0b7d6a4d5d4eb1a1c115b60981d41c"
dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
mode: GRACEFUL
new_leader_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:40438
I20260709 12:20:53.418186 30294 raft_consensus.cc:606] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Received request to transfer leadership to TS 22a1255131174934a6bca3c0bf000026
I20260709 12:20:53.420614 30144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1aca82ece24244f792b8e4d302f4f4f9"
dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
mode: GRACEFUL
new_leader_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:35582
I20260709 12:20:53.421077 30144 raft_consensus.cc:606] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Received request to transfer leadership to TS 22a1255131174934a6bca3c0bf000026
I20260709 12:20:53.423532 30221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41c11e80998149a79fca99acf176427e"
dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
mode: GRACEFUL
new_leader_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:39578
I20260709 12:20:53.423985 30221 raft_consensus.cc:606] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Received request to transfer leadership to TS 22a1255131174934a6bca3c0bf000026
I20260709 12:20:53.426241 30221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68f77894695f4690bea31f432539542e"
dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
mode: GRACEFUL
new_leader_uuid: "b0439d4e94904196847cd825fcc8ebd7"
 from {username='slave'} at 127.0.0.1:39578
I20260709 12:20:53.426656 30221 raft_consensus.cc:606] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Received request to transfer leadership to TS b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:53.427753 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:53.429311 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:53.429945 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:53.462422 31071 raft_consensus.cc:993] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86: : Instructing follower 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:53.462960 31053 raft_consensus.cc:1081] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Signalling peer 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:53.464753 30883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41c11e80998149a79fca99acf176427e"
dest_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:53746
I20260709 12:20:53.465303 30883 raft_consensus.cc:493] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:53.465876 30883 raft_consensus.cc:3060] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.474732 30883 raft_consensus.cc:515] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:53.478710 30144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c11e80998149a79fca99acf176427e" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:53.479118 30883 leader_election.cc:290] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:53.479350 30144 raft_consensus.cc:3060] T 41c11e80998149a79fca99acf176427e P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.479683 31051 raft_consensus.cc:993] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511: : Instructing follower 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:53.480230 31054 raft_consensus.cc:1081] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Signalling peer 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:53.479859 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c11e80998149a79fca99acf176427e" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:53.480912 30221 raft_consensus.cc:3055] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:53.481213 30221 raft_consensus.cc:740] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:53.482000 30883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d0b7d6a4d5d4eb1a1c115b60981d41c"
dest_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:53762
I20260709 12:20:53.482118 30221 consensus_queue.cc:260] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:53.482582 30883 raft_consensus.cc:493] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:53.483002 30883 raft_consensus.cc:3060] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.483407 30221 raft_consensus.cc:3060] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.486702 30144 raft_consensus.cc:2468] T 41c11e80998149a79fca99acf176427e P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 2.
I20260709 12:20:53.488018 30823 leader_election.cc:304] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:53.488941 31058 raft_consensus.cc:2804] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:53.489403 31058 raft_consensus.cc:697] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [term 2 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:53.490027 30221 raft_consensus.cc:2468] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 2.
I20260709 12:20:53.489858 30883 raft_consensus.cc:515] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:53.490255 31058 consensus_queue.cc:237] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:53.492278 30883 leader_election.cc:290] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:53.492728 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0b7d6a4d5d4eb1a1c115b60981d41c" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:53.492741 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0b7d6a4d5d4eb1a1c115b60981d41c" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:53.493458 30221 raft_consensus.cc:3060] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.493530 30294 raft_consensus.cc:3055] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:53.493944 30294 raft_consensus.cc:740] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:53.494716 30294 consensus_queue.cc:260] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:53.495875 30294 raft_consensus.cc:3060] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.500679 30221 raft_consensus.cc:2468] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 2.
I20260709 12:20:53.501780 30824 leader_election.cc:304] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:53.501931 29970 catalog_manager.cc:5697] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 1 to 2, leader changed from f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3) to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.502856 31058 raft_consensus.cc:2804] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:53.503450 30294 raft_consensus.cc:2468] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 2.
I20260709 12:20:53.503557 31058 raft_consensus.cc:697] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 2 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:53.504853 31058 consensus_queue.cc:237] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:53.519541 29970 catalog_manager.cc:5697] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 1 to 2, leader changed from f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4) to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:53.679754 31050 raft_consensus.cc:993] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86: : Instructing follower b0439d4e94904196847cd825fcc8ebd7 to start an election
I20260709 12:20:53.680387 31071 raft_consensus.cc:1081] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 LEADER]: Signalling peer b0439d4e94904196847cd825fcc8ebd7 to start an election
I20260709 12:20:53.682070 30148 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03f2f494c25b47459faf1d6e4a245f08"
dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
 from {username='slave'} at 127.0.0.1:55688
I20260709 12:20:53.682600 30148 raft_consensus.cc:493] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:53.682940 30148 raft_consensus.cc:3060] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.691694 31071 raft_consensus.cc:993] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86: : Instructing follower b0439d4e94904196847cd825fcc8ebd7 to start an election
I20260709 12:20:53.692269 31071 raft_consensus.cc:1081] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Signalling peer b0439d4e94904196847cd825fcc8ebd7 to start an election
I20260709 12:20:53.692735 30148 raft_consensus.cc:515] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:53.693813 30144 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68f77894695f4690bea31f432539542e"
dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
 from {username='slave'} at 127.0.0.1:55688
I20260709 12:20:53.694306 30144 raft_consensus.cc:493] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:53.694567 30144 raft_consensus.cc:3060] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.695397 30148 leader_election.cc:290] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 3 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:53.696172 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f2f494c25b47459faf1d6e4a245f08" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:53.696885 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f2f494c25b47459faf1d6e4a245f08" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:53.697335 30221 raft_consensus.cc:3055] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:53.697415 30294 raft_consensus.cc:3060] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.697724 30221 raft_consensus.cc:740] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:53.698909 30221 consensus_queue.cc:260] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:53.700151 30221 raft_consensus.cc:3060] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.703081 30144 raft_consensus.cc:515] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:53.705895 30217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f77894695f4690bea31f432539542e" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:53.706491 30217 raft_consensus.cc:3055] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:53.706787 30217 raft_consensus.cc:740] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3ef588fc4b54ec09355022d7a5a5e86, State: Running, Role: LEADER
I20260709 12:20:53.707520 30217 consensus_queue.cc:260] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:53.708245 30221 raft_consensus.cc:2468] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 3.
I20260709 12:20:53.708611 30217 raft_consensus.cc:3060] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.709566 30113 leader_election.cc:304] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:53.712934 31040 raft_consensus.cc:2804] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:53.713464 31040 raft_consensus.cc:697] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 3 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:53.714283 31040 consensus_queue.cc:237] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:53.727910 30294 raft_consensus.cc:2468] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 3.
I20260709 12:20:53.729102 30217 raft_consensus.cc:2468] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 2.
I20260709 12:20:53.729444 30144 leader_election.cc:290] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:53.730376 30113 leader_election.cc:304] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0439d4e94904196847cd825fcc8ebd7, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:53.731271 31052 raft_consensus.cc:2804] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:53.732642 31052 raft_consensus.cc:697] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Becoming Leader. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:53.733479 31052 consensus_queue.cc:237] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } }
I20260709 12:20:53.741226 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f77894695f4690bea31f432539542e" candidate_uuid: "b0439d4e94904196847cd825fcc8ebd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:53.742053 30294 raft_consensus.cc:3060] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.748605 29970 catalog_manager.cc:5697] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 2 to 3, leader changed from f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3) to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 3 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.750325 29970 catalog_manager.cc:5697] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 reported cstate change: term changed from 1 to 2, leader changed from f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3) to b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "b0439d4e94904196847cd825fcc8ebd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.751230 30294 raft_consensus.cc:2468] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0439d4e94904196847cd825fcc8ebd7 in term 2.
I20260709 12:20:53.796965 31040 raft_consensus.cc:993] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7: : Instructing follower 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:53.797412 31040 raft_consensus.cc:1081] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Signalling peer 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:53.798934 30884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1aca82ece24244f792b8e4d302f4f4f9"
dest_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:53734
I20260709 12:20:53.799391 30884 raft_consensus.cc:493] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:53.799656 30884 raft_consensus.cc:3060] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.804875 30884 raft_consensus.cc:515] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:53.806532 30884 leader_election.cc:290] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:53.807907 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aca82ece24244f792b8e4d302f4f4f9" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:53.808161 30294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aca82ece24244f792b8e4d302f4f4f9" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:53.808574 30146 raft_consensus.cc:3055] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:53.809057 30146 raft_consensus.cc:740] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:53.809607 30294 raft_consensus.cc:3060] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.809796 30146 consensus_queue.cc:260] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:53.811303 30146 raft_consensus.cc:3060] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.817484 30294 raft_consensus.cc:2468] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 2.
I20260709 12:20:53.821638 30826 leader_election.cc:304] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f6c1f7275e654f49abaf1c80ed662511; no voters: 
I20260709 12:20:53.822628 30146 raft_consensus.cc:2468] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 2.
I20260709 12:20:53.822677 31058 raft_consensus.cc:2804] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:53.824430 31058 raft_consensus.cc:697] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [term 2 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:53.825325 31058 consensus_queue.cc:237] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:53.838972 29970 catalog_manager.cc:5697] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 1 to 2, leader changed from b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2) to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.971863 30217 raft_consensus.cc:1275] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.973196 31077 consensus_queue.cc:1048] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.988188 30294 raft_consensus.cc:1275] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.991525 31079 consensus_queue.cc:1048] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:54.061156 30146 raft_consensus.cc:1275] T 41c11e80998149a79fca99acf176427e P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:54.062352 31079 consensus_queue.cc:1048] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:54.070363 30217 raft_consensus.cc:1275] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:54.072738 31077 consensus_queue.cc:1048] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:54.178378 30294 raft_consensus.cc:1275] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Refusing update from remote peer b0439d4e94904196847cd825fcc8ebd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:54.179589 31052 consensus_queue.cc:1048] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:54.187157 30217 raft_consensus.cc:1275] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Refusing update from remote peer b0439d4e94904196847cd825fcc8ebd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:54.187922 30221 raft_consensus.cc:1275] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 3 FOLLOWER]: Refusing update from remote peer b0439d4e94904196847cd825fcc8ebd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:54.189792 31040 consensus_queue.cc:1048] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:20:54.191606 31115 consensus_queue.cc:1048] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:54.216017 30294 raft_consensus.cc:1275] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Refusing update from remote peer b0439d4e94904196847cd825fcc8ebd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:54.217485 31115 consensus_queue.cc:1048] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:54.344779 30294 raft_consensus.cc:1275] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:54.346096 31079 consensus_queue.cc:1048] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:54.368512 30146 raft_consensus.cc:1275] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:54.370388 31077 consensus_queue.cc:1048] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:54.468289 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:54.502970 30146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e48bba41f0240ac820f0e23f6067b67"
dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
mode: GRACEFUL
new_leader_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:35582
I20260709 12:20:54.503459 30146 raft_consensus.cc:606] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Received request to transfer leadership to TS 22a1255131174934a6bca3c0bf000026
I20260709 12:20:54.505797 30297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6bfe6b1a3764834aa3501ebdf533ddf"
dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
mode: GRACEFUL
new_leader_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:40438
I20260709 12:20:54.506287 30297 raft_consensus.cc:606] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Received request to transfer leadership to TS 22a1255131174934a6bca3c0bf000026
I20260709 12:20:54.508790 30146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f58b35cd70b1481993195f5bdd8ad3fe"
dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
mode: GRACEFUL
new_leader_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:35582
I20260709 12:20:54.509334 30146 raft_consensus.cc:606] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Received request to transfer leadership to TS 22a1255131174934a6bca3c0bf000026
I20260709 12:20:54.510300 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:20:54.511643 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:54.512253 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:54.592495 31115 raft_consensus.cc:993] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7: : Instructing follower 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:54.592926 31115 raft_consensus.cc:1081] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Signalling peer 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:54.594355 30884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e48bba41f0240ac820f0e23f6067b67"
dest_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:53734
I20260709 12:20:54.594806 30884 raft_consensus.cc:493] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:54.595098 30884 raft_consensus.cc:3060] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.600126 30884 raft_consensus.cc:515] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:54.602622 30884 leader_election.cc:290] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 election: Requested vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035)
I20260709 12:20:54.602828 30146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e48bba41f0240ac820f0e23f6067b67" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:54.603657 30146 raft_consensus.cc:3055] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:54.604063 30146 raft_consensus.cc:740] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:54.604516 30217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e48bba41f0240ac820f0e23f6067b67" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:54.605087 30146 consensus_queue.cc:260] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:54.605196 30217 raft_consensus.cc:3060] T 1e48bba41f0240ac820f0e23f6067b67 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.606555 30146 raft_consensus.cc:3060] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.611948 30217 raft_consensus.cc:2468] T 1e48bba41f0240ac820f0e23f6067b67 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 2.
I20260709 12:20:54.612115 30146 raft_consensus.cc:2468] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 2.
I20260709 12:20:54.613224 30824 leader_election.cc:304] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:54.613996 31120 raft_consensus.cc:2804] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:54.614487 31120 raft_consensus.cc:697] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 2 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:54.615159 31120 consensus_queue.cc:237] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } }
I20260709 12:20:54.625012 29967 catalog_manager.cc:5697] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 1 to 2, leader changed from b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2) to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.691797 31143 raft_consensus.cc:993] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511: : Instructing follower 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:54.692265 31054 raft_consensus.cc:1081] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Signalling peer 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:54.693812 30884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6bfe6b1a3764834aa3501ebdf533ddf"
dest_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:53762
I20260709 12:20:54.694425 30884 raft_consensus.cc:493] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:54.694800 30884 raft_consensus.cc:3060] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.700416 30884 raft_consensus.cc:515] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:54.702987 30221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bfe6b1a3764834aa3501ebdf533ddf" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3ef588fc4b54ec09355022d7a5a5e86"
I20260709 12:20:54.703619 30221 raft_consensus.cc:3060] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.703809 30884 leader_election.cc:290] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 election: Requested vote from peers f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035), f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729)
I20260709 12:20:54.704736 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bfe6b1a3764834aa3501ebdf533ddf" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:54.705271 30297 raft_consensus.cc:3055] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:54.705467 30297 raft_consensus.cc:740] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6c1f7275e654f49abaf1c80ed662511, State: Running, Role: LEADER
I20260709 12:20:54.706153 30297 consensus_queue.cc:260] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:54.707122 30297 raft_consensus.cc:3060] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.708943 30221 raft_consensus.cc:2468] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 2.
I20260709 12:20:54.710117 30824 leader_election.cc:304] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, f3ef588fc4b54ec09355022d7a5a5e86; no voters: 
I20260709 12:20:54.710932 31120 raft_consensus.cc:2804] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:54.713749 31120 raft_consensus.cc:697] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [term 2 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:54.714753 31120 consensus_queue.cc:237] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:54.716266 30297 raft_consensus.cc:2468] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 2.
I20260709 12:20:54.724069 29967 catalog_manager.cc:5697] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 1 to 2, leader changed from f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4) to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:54.835084 31128 raft_consensus.cc:993] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7: : Instructing follower 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:54.835652 31115 raft_consensus.cc:1081] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Signalling peer 22a1255131174934a6bca3c0bf000026 to start an election
I20260709 12:20:54.837153 30883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f58b35cd70b1481993195f5bdd8ad3fe"
dest_uuid: "22a1255131174934a6bca3c0bf000026"
 from {username='slave'} at 127.0.0.1:53734
I20260709 12:20:54.837839 30883 raft_consensus.cc:493] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:54.838267 30883 raft_consensus.cc:3060] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:54.845604 30883 raft_consensus.cc:515] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:54.848085 30297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58b35cd70b1481993195f5bdd8ad3fe" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f6c1f7275e654f49abaf1c80ed662511"
I20260709 12:20:54.848488 30883 leader_election.cc:290] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 3 election: Requested vote from peers f6c1f7275e654f49abaf1c80ed662511 (127.20.191.4:33729), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:54.848685 30297 raft_consensus.cc:3060] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:54.854420 30144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58b35cd70b1481993195f5bdd8ad3fe" candidate_uuid: "22a1255131174934a6bca3c0bf000026" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b0439d4e94904196847cd825fcc8ebd7"
I20260709 12:20:54.855036 30144 raft_consensus.cc:3055] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:54.855319 30144 raft_consensus.cc:740] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0439d4e94904196847cd825fcc8ebd7, State: Running, Role: LEADER
I20260709 12:20:54.856055 30144 consensus_queue.cc:260] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:54.857090 30144 raft_consensus.cc:3060] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:54.864199 30297 raft_consensus.cc:2468] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 3.
I20260709 12:20:54.864725 30144 raft_consensus.cc:2468] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a1255131174934a6bca3c0bf000026 in term 3.
I20260709 12:20:54.865137 30294 raft_consensus.cc:1240] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Rejecting Update request from peer b0439d4e94904196847cd825fcc8ebd7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:54.866063 30823 leader_election.cc:304] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7; no voters: 
I20260709 12:20:54.867460 31120 raft_consensus.cc:2804] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:54.868165 31120 raft_consensus.cc:697] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 3 LEADER]: Becoming Leader. State: Replica: 22a1255131174934a6bca3c0bf000026, State: Running, Role: LEADER
I20260709 12:20:54.869638 31120 consensus_queue.cc:237] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:54.882360 29967 catalog_manager.cc:5697] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 reported cstate change: term changed from 2 to 3, leader changed from b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2) to 22a1255131174934a6bca3c0bf000026 (127.20.191.1). New cstate: current_term: 3 leader_uuid: "22a1255131174934a6bca3c0bf000026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:55.076179 30221 raft_consensus.cc:1275] T 1e48bba41f0240ac820f0e23f6067b67 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:55.077358 31077 consensus_queue.cc:1048] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:55.090507 30144 raft_consensus.cc:1275] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:55.093377 31154 consensus_queue.cc:1048] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:55.294340 30294 raft_consensus.cc:1275] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:55.295450 31154 consensus_queue.cc:1048] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:55.306159 30217 raft_consensus.cc:1275] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:55.307552 31120 consensus_queue.cc:1048] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ef588fc4b54ec09355022d7a5a5e86" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 44035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:55.332470 30294 raft_consensus.cc:1275] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:55.335034 31058 consensus_queue.cc:1048] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:55.346271 30147 raft_consensus.cc:1275] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 3 FOLLOWER]: Refusing update from remote peer 22a1255131174934a6bca3c0bf000026: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:55.347759 31077 consensus_queue.cc:1048] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:55.553062 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:55.589591 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:55.590504 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:55.590931 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:55.626941 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:55.668119 21244 tablet_server.cc:179] TabletServer@127.20.191.1:43571 shutting down...
W20260709 12:20:55.678422 30188 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 229 similar messages]
W20260709 12:20:55.682565 30188 consensus_peers.cc:597] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:55.690821 30114 consensus_peers.cc:597] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:55.702905 30188 consensus_peers.cc:597] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.718258 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:55.719231 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.720167 21244 raft_consensus.cc:2243] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.720826 21244 raft_consensus.cc:2272] T ea68554f4650455e9aa55638ed533430 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.723285 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.724076 21244 raft_consensus.cc:2243] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.724931 21244 raft_consensus.cc:2272] T 41c11e80998149a79fca99acf176427e P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.727129 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.727826 21244 raft_consensus.cc:2243] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.728238 21244 raft_consensus.cc:2272] T 9aaa1e367a834921bed89b00cf7b2487 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.730295 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.730846 21244 raft_consensus.cc:2243] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.731220 21244 raft_consensus.cc:2272] T 1efc41cad99a42d5a67d2db6d27a9061 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.733435 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.734105 21244 raft_consensus.cc:2243] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.734560 21244 raft_consensus.cc:2272] T 55101a88e97746d0bc20a0bc0ed8989c P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.736646 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.737236 21244 raft_consensus.cc:2243] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.737619 21244 raft_consensus.cc:2272] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.739805 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.740505 21244 raft_consensus.cc:2243] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.741357 21244 raft_consensus.cc:2272] T e6b12541deba40218ef3f8c40f40312a P 22a1255131174934a6bca3c0bf000026 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:55.742681 30114 consensus_peers.cc:597] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.743896 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.744841 21244 raft_consensus.cc:2243] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.745239 21244 raft_consensus.cc:2272] T ca034599de8146968cc8adcb232a2ca4 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.747747 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.748363 21244 raft_consensus.cc:2243] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.749130 21244 raft_consensus.cc:2272] T 3b981cc4916444c0a31e5fd3b14aaa67 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.751164 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.751744 21244 raft_consensus.cc:2243] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.752126 21244 raft_consensus.cc:2272] T 3664ea9a740d4d4eaa2ba8371126d21b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.754277 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.754817 21244 raft_consensus.cc:2243] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.755247 21244 raft_consensus.cc:2272] T 8f47831b773245faa71c01cb8c967a7a P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.757284 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.757918 21244 raft_consensus.cc:2243] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.758311 21244 raft_consensus.cc:2272] T f159a8c7a6304cfc9a399f5c37fe3e1b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.760326 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.760864 21244 raft_consensus.cc:2243] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.761608 21244 raft_consensus.cc:2272] T af7b5f5579594d8381af5f96a15e24d9 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.763962 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.764531 21244 raft_consensus.cc:2243] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.764976 21244 raft_consensus.cc:2272] T e5da70c81d654d3e9e50fa2778189857 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.767593 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.768213 21244 raft_consensus.cc:2243] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.768620 21244 raft_consensus.cc:2272] T 9c98f7fba9544225a8c7e515247ec5c9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.770722 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.771279 21244 raft_consensus.cc:2243] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.772049 21244 raft_consensus.cc:2272] T 27678468a40344eca39b8bab02b0b368 P 22a1255131174934a6bca3c0bf000026 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.774560 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.775135 21244 raft_consensus.cc:2243] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.775954 21244 raft_consensus.cc:2272] T f01efd7c139e45c3809ed6a668f1faca P 22a1255131174934a6bca3c0bf000026 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:55.777375 30188 consensus_peers.cc:597] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.778550 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.779465 21244 raft_consensus.cc:2243] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.780220 21244 raft_consensus.cc:2272] T 4ad560d215f8475ab9f93ff568eef9f9 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.782776 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.783393 21244 raft_consensus.cc:2243] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.783845 21244 raft_consensus.cc:2272] T 67a9ecec74344c1693efb9acb6e38e26 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.785667 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.786283 21244 raft_consensus.cc:2243] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.787086 21244 raft_consensus.cc:2272] T 1aca82ece24244f792b8e4d302f4f4f9 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.789278 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.790131 21244 raft_consensus.cc:2243] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.790874 21244 raft_consensus.cc:2272] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.792850 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.793342 21244 raft_consensus.cc:2243] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.793707 21244 raft_consensus.cc:2272] T 0696a915ada148cca9600585d0152f86 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.795763 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.796311 21244 raft_consensus.cc:2243] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.796762 21244 raft_consensus.cc:2272] T b5692f07fd174dbfa06976e17c1c6b00 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.798936 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.799651 21244 raft_consensus.cc:2243] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.800246 21244 raft_consensus.cc:2272] T 3111cf2203d14eb8a006d35fee44552e P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:55.802263 30114 consensus_peers.cc:597] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.803198 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.803808 21244 raft_consensus.cc:2243] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.804210 21244 raft_consensus.cc:2272] T 15f28aae897045be9eed015c98ba6908 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.806284 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.806838 21244 raft_consensus.cc:2243] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.807217 21244 raft_consensus.cc:2272] T 1c80cf731d884ab6bcb89a294b8b905c P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.809222 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.809753 21244 raft_consensus.cc:2243] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.810155 21244 raft_consensus.cc:2272] T cdeb0fe4f15c4ea9893bae143fa20651 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.811930 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.812441 21244 raft_consensus.cc:2243] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.812813 21244 raft_consensus.cc:2272] T 975b191d2b5544a6838af42f2be670c9 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.814960 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.815636 21244 raft_consensus.cc:2243] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.816228 21244 raft_consensus.cc:2272] T d094cffecb264ab689cd0baf985837d8 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.818681 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.819231 21244 raft_consensus.cc:2243] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.819602 21244 raft_consensus.cc:2272] T 27c8763c7b2b4fb891cbebff4035dbe6 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.822194 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.822952 21244 raft_consensus.cc:2243] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.823454 21244 raft_consensus.cc:2272] T 7423bc8fd1a54058b083a1c5affa2440 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:55.823863 30114 consensus_peers.cc:597] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.826145 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.827044 21244 raft_consensus.cc:2243] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.827553 21244 raft_consensus.cc:2272] T 8364709c0e424d6791fed2d28528c655 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.830435 21244 tablet_replica.cc:333] stopping tablet replica
W20260709 12:20:55.830451 30262 consensus_peers.cc:597] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.831301 21244 raft_consensus.cc:2243] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:55.831339 30262 consensus_peers.cc:597] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.831909 21244 raft_consensus.cc:2272] T 4f18dd45e30e4e3aafdc917396dc2181 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.834698 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.835325 21244 raft_consensus.cc:2243] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.835749 21244 raft_consensus.cc:2272] T a5f5109a89314f8bbf67848895ef8918 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.838446 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.839234 21244 raft_consensus.cc:2243] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.840061 21244 raft_consensus.cc:2272] T f58b35cd70b1481993195f5bdd8ad3fe P 22a1255131174934a6bca3c0bf000026 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.842756 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.843326 21244 raft_consensus.cc:2243] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.844071 21244 raft_consensus.cc:2272] T 5b17f97873bb48ca864a13321c11f401 P 22a1255131174934a6bca3c0bf000026 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:55.844352 30114 consensus_peers.cc:597] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.846846 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.847527 21244 raft_consensus.cc:2243] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.847993 21244 raft_consensus.cc:2272] T a6fb12e58a824780acab66b641b29009 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:55.848403 30114 consensus_peers.cc:597] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.850015 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.850656 21244 raft_consensus.cc:2243] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.851130 21244 raft_consensus.cc:2272] T 22caa8a59f42477199989f2612bb7136 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.853353 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.853960 21244 raft_consensus.cc:2243] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.854737 21244 raft_consensus.cc:2272] T 5d01a3a6c7f24268a9c505f7d2f0efcd P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.857168 21244 tablet_replica.cc:333] stopping tablet replica
W20260709 12:20:55.857239 30262 consensus_peers.cc:597] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.857728 21244 raft_consensus.cc:2243] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.858779 21244 raft_consensus.cc:2272] T 1e48bba41f0240ac820f0e23f6067b67 P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:55.860985 30262 consensus_peers.cc:597] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.861559 21244 tablet_replica.cc:333] stopping tablet replica
W20260709 12:20:55.862602 30262 consensus_peers.cc:597] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.862679 21244 raft_consensus.cc:2243] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.863418 21244 raft_consensus.cc:2272] T 6c8f2fbe93624983bd807e8ac2f76aff P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.866161 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.866743 21244 raft_consensus.cc:2243] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.867524 21244 raft_consensus.cc:2272] T a6bfe6b1a3764834aa3501ebdf533ddf P 22a1255131174934a6bca3c0bf000026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.870452 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.871146 21244 raft_consensus.cc:2243] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.871608 21244 raft_consensus.cc:2272] T 581f9562c91e46eea64ec770bcb8671b P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.873530 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.874011 21244 raft_consensus.cc:2243] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.874397 21244 raft_consensus.cc:2272] T d8157cddb556437c85c52ceb0ec7b614 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.876269 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:55.876708 21244 raft_consensus.cc:2243] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.877043 21244 raft_consensus.cc:2272] T 961df2c56aac4887bbb0971fd85cd3b0 P 22a1255131174934a6bca3c0bf000026 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:55.885876 30114 consensus_peers.cc:597] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:55.898322 30188 consensus_peers.cc:597] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:55.909351 30114 consensus_peers.cc:597] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:55.917064 30114 consensus_peers.cc:597] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:55.921432 30188 consensus_peers.cc:597] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.952521 21244 tablet_server.cc:196] TabletServer@127.20.191.1:43571 shutdown complete.
W20260709 12:20:55.983958 30262 consensus_peers.cc:597] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.018417 30262 consensus_peers.cc:597] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.019573 30114 consensus_peers.cc:597] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.020196 30114 consensus_peers.cc:597] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.023403 30188 consensus_peers.cc:597] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.031019 21244 tablet_server.cc:179] TabletServer@127.20.191.2:0 shutting down...
W20260709 12:20:56.045879 30188 consensus_peers.cc:597] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.059950 30260 consensus_peers.cc:597] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.071621 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:56.072568 21244 tablet_replica.cc:333] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.073460 21244 raft_consensus.cc:2243] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.074043 21244 raft_consensus.cc:2272] T af7b5f5579594d8381af5f96a15e24d9 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.076236 21244 tablet_replica.cc:333] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.076895 21244 raft_consensus.cc:2243] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.077757 21244 raft_consensus.cc:2272] T 55101a88e97746d0bc20a0bc0ed8989c P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.080024 21244 tablet_replica.cc:333] T 97c5550b956c4f36af10de2db7490b8b P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.080677 21244 raft_consensus.cc:2243] T 97c5550b956c4f36af10de2db7490b8b P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.081218 21244 raft_consensus.cc:2272] T 97c5550b956c4f36af10de2db7490b8b P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.084013 21244 tablet_replica.cc:333] T c32f11599774407e9de2e65083c53e17 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.084868 21244 raft_consensus.cc:2243] T c32f11599774407e9de2e65083c53e17 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.085383 21244 raft_consensus.cc:2272] T c32f11599774407e9de2e65083c53e17 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.088040 21244 tablet_replica.cc:333] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.088928 21244 raft_consensus.cc:2243] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.089951 21244 raft_consensus.cc:2272] T a5f5109a89314f8bbf67848895ef8918 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.092674 21244 tablet_replica.cc:333] T d782d59119bc45d08292b0b77cabedc9 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.093495 21244 raft_consensus.cc:2243] T d782d59119bc45d08292b0b77cabedc9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.094070 21244 raft_consensus.cc:2272] T d782d59119bc45d08292b0b77cabedc9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.097476 21244 tablet_replica.cc:333] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.098275 21244 raft_consensus.cc:2243] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.101997 21244 raft_consensus.cc:2272] T 961df2c56aac4887bbb0971fd85cd3b0 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.104941 21244 tablet_replica.cc:333] T 2982be43a6544a2cbf3fbddd81601115 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.105815 21244 raft_consensus.cc:2243] T 2982be43a6544a2cbf3fbddd81601115 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.106338 21244 raft_consensus.cc:2272] T 2982be43a6544a2cbf3fbddd81601115 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.109117 21244 tablet_replica.cc:333] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.109944 21244 raft_consensus.cc:2243] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.110430 21244 raft_consensus.cc:2272] T f58b35cd70b1481993195f5bdd8ad3fe P b0439d4e94904196847cd825fcc8ebd7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:56.114102 30260 consensus_peers.cc:597] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.114754 21244 tablet_replica.cc:333] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.115725 21244 raft_consensus.cc:2243] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.116255 21244 raft_consensus.cc:2272] T 5bd853575cf54f3f91608d485c3d16ca P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:56.118716 30262 consensus_peers.cc:597] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.119201 21244 tablet_replica.cc:333] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.120091 21244 raft_consensus.cc:2243] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.121080 21244 raft_consensus.cc:2272] T 581f9562c91e46eea64ec770bcb8671b P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:56.123988 30188 consensus_peers.cc:597] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.124130 21244 tablet_replica.cc:333] T 64c571ad30094eb3ac0b270c6a3c6a28 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.125236 21244 raft_consensus.cc:2243] T 64c571ad30094eb3ac0b270c6a3c6a28 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.125872 21244 raft_consensus.cc:2272] T 64c571ad30094eb3ac0b270c6a3c6a28 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:56.125811 30260 consensus_peers.cc:597] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.128994 21244 tablet_replica.cc:333] T 67a9ecec74344c1693efb9acb6e38e26 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.129873 21244 raft_consensus.cc:2243] T 67a9ecec74344c1693efb9acb6e38e26 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.130506 21244 raft_consensus.cc:2272] T 67a9ecec74344c1693efb9acb6e38e26 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:56.130906 30260 consensus_peers.cc:597] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.131143 30262 consensus_peers.cc:597] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.133116 21244 tablet_replica.cc:333] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.133955 21244 raft_consensus.cc:2243] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.134430 21244 raft_consensus.cc:2272] T 4ad560d215f8475ab9f93ff568eef9f9 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:56.136202 30186 consensus_peers.cc:597] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.136911 21244 tablet_replica.cc:333] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.137586 21244 raft_consensus.cc:2243] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.138370 21244 raft_consensus.cc:2272] T 1c80cf731d884ab6bcb89a294b8b905c P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.140380 21244 tablet_replica.cc:333] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.140933 21244 raft_consensus.cc:2243] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.141739 21244 raft_consensus.cc:2272] T 3111cf2203d14eb8a006d35fee44552e P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.144173 21244 tablet_replica.cc:333] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.144918 21244 raft_consensus.cc:2243] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.145378 21244 raft_consensus.cc:2272] T 15f28aae897045be9eed015c98ba6908 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:56.145947 30260 consensus_peers.cc:597] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.147534 21244 tablet_replica.cc:333] T 41c11e80998149a79fca99acf176427e P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.148205 21244 raft_consensus.cc:2243] T 41c11e80998149a79fca99acf176427e P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.148658 21244 raft_consensus.cc:2272] T 41c11e80998149a79fca99acf176427e P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.150642 21244 tablet_replica.cc:333] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.151248 21244 raft_consensus.cc:2243] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.152081 21244 raft_consensus.cc:2272] T 0e9a81d1a7404da0aac49a76cb38f0de P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.154268 21244 tablet_replica.cc:333] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.154795 21244 raft_consensus.cc:2243] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.155601 21244 raft_consensus.cc:2272] T ea68554f4650455e9aa55638ed533430 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.158260 21244 tablet_replica.cc:333] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.159004 21244 raft_consensus.cc:2243] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:20:56.159476 30188 consensus_peers.cc:597] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.159986 21244 raft_consensus.cc:2272] T 9c98f7fba9544225a8c7e515247ec5c9 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.162032 21244 tablet_replica.cc:333] T 438c3adce9a646b8944ac27608e94314 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.162557 21244 raft_consensus.cc:2243] T 438c3adce9a646b8944ac27608e94314 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.162941 21244 raft_consensus.cc:2272] T 438c3adce9a646b8944ac27608e94314 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.164897 21244 tablet_replica.cc:333] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.165457 21244 raft_consensus.cc:2243] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.166242 21244 raft_consensus.cc:2272] T d094cffecb264ab689cd0baf985837d8 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.168219 21244 tablet_replica.cc:333] T 27c8763c7b2b4fb891cbebff4035dbe6 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.168999 21244 raft_consensus.cc:2243] T 27c8763c7b2b4fb891cbebff4035dbe6 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.169538 21244 raft_consensus.cc:2272] T 27c8763c7b2b4fb891cbebff4035dbe6 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.172026 21244 tablet_replica.cc:333] T 4f18dd45e30e4e3aafdc917396dc2181 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.172616 21244 raft_consensus.cc:2243] T 4f18dd45e30e4e3aafdc917396dc2181 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.172997 21244 raft_consensus.cc:2272] T 4f18dd45e30e4e3aafdc917396dc2181 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.174942 21244 tablet_replica.cc:333] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.175446 21244 raft_consensus.cc:2243] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.175786 21244 raft_consensus.cc:2272] T 1c55d09601aa4eceaf3916006afcc93a P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.177534 21244 tablet_replica.cc:333] T e5da70c81d654d3e9e50fa2778189857 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.178103 21244 raft_consensus.cc:2243] T e5da70c81d654d3e9e50fa2778189857 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.178490 21244 raft_consensus.cc:2272] T e5da70c81d654d3e9e50fa2778189857 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.181049 21244 tablet_replica.cc:333] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.181852 21244 raft_consensus.cc:2243] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.182686 21244 raft_consensus.cc:2272] T 68f77894695f4690bea31f432539542e P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.185420 21244 tablet_replica.cc:333] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.186223 21244 raft_consensus.cc:2243] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.186739 21244 raft_consensus.cc:2272] T f01efd7c139e45c3809ed6a668f1faca P b0439d4e94904196847cd825fcc8ebd7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.189640 21244 tablet_replica.cc:333] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.190606 21244 raft_consensus.cc:2243] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.191152 21244 raft_consensus.cc:2272] T 27678468a40344eca39b8bab02b0b368 P b0439d4e94904196847cd825fcc8ebd7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:56.189569 30262 consensus_peers.cc:597] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.193223 30262 consensus_peers.cc:597] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 -> Peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Couldn't send request to peer 22a1255131174934a6bca3c0bf000026. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.194020 21244 tablet_replica.cc:333] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.194967 21244 raft_consensus.cc:2243] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.195508 21244 raft_consensus.cc:2272] T 5d01a3a6c7f24268a9c505f7d2f0efcd P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.201267 21244 tablet_replica.cc:333] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.202183 21244 raft_consensus.cc:2243] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.202797 21244 raft_consensus.cc:2272] T 3b981cc4916444c0a31e5fd3b14aaa67 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.205437 21244 tablet_replica.cc:333] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.206182 21244 raft_consensus.cc:2243] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.207050 21244 raft_consensus.cc:2272] T 03f2f494c25b47459faf1d6e4a245f08 P b0439d4e94904196847cd825fcc8ebd7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.209161 21244 tablet_replica.cc:333] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.209730 21244 raft_consensus.cc:2243] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.210237 21244 raft_consensus.cc:2272] T bd0710767a1a447f9670e840fb1e68a4 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.212314 21244 tablet_replica.cc:333] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.212936 21244 raft_consensus.cc:2243] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.213510 21244 raft_consensus.cc:2272] T 22caa8a59f42477199989f2612bb7136 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.215909 21244 tablet_replica.cc:333] T 6c8f2fbe93624983bd807e8ac2f76aff P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.216472 21244 raft_consensus.cc:2243] T 6c8f2fbe93624983bd807e8ac2f76aff P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.216933 21244 raft_consensus.cc:2272] T 6c8f2fbe93624983bd807e8ac2f76aff P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.219583 21244 tablet_replica.cc:333] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.220141 21244 raft_consensus.cc:2243] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:56.220443 30186 consensus_peers.cc:597] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.220582 21244 raft_consensus.cc:2272] T 1e48bba41f0240ac820f0e23f6067b67 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.222723 21244 tablet_replica.cc:333] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.223295 21244 raft_consensus.cc:2243] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.223764 21244 raft_consensus.cc:2272] T b5692f07fd174dbfa06976e17c1c6b00 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.226044 21244 tablet_replica.cc:333] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.226572 21244 raft_consensus.cc:2243] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.227352 21244 raft_consensus.cc:2272] T 0696a915ada148cca9600585d0152f86 P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.229315 21244 tablet_replica.cc:333] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.229907 21244 raft_consensus.cc:2243] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.230325 21244 raft_consensus.cc:2272] T 1aca82ece24244f792b8e4d302f4f4f9 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.232288 21244 tablet_replica.cc:333] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.232805 21244 raft_consensus.cc:2243] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.233582 21244 raft_consensus.cc:2272] T d0c2af5bb5b548d8855b05242cb9d33c P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.235860 21244 tablet_replica.cc:333] T 8f47831b773245faa71c01cb8c967a7a P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.236454 21244 raft_consensus.cc:2243] T 8f47831b773245faa71c01cb8c967a7a P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.236976 21244 raft_consensus.cc:2272] T 8f47831b773245faa71c01cb8c967a7a P b0439d4e94904196847cd825fcc8ebd7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:56.238039 30260 consensus_peers.cc:597] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.239171 21244 tablet_replica.cc:333] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.239717 21244 raft_consensus.cc:2243] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.240118 21244 raft_consensus.cc:2272] T 3a289b0636994e34965a2dc0137e5b94 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.241979 21244 tablet_replica.cc:333] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7: stopping tablet replica
I20260709 12:20:56.242437 21244 raft_consensus.cc:2243] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.243247 21244 raft_consensus.cc:2272] T a6fb12e58a824780acab66b641b29009 P b0439d4e94904196847cd825fcc8ebd7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:56.248894 30186 consensus_peers.cc:597] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.249577 30260 consensus_peers.cc:597] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.255079 30186 consensus_peers.cc:597] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.280277 30186 consensus_peers.cc:597] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.317122 21244 tablet_server.cc:196] TabletServer@127.20.191.2:0 shutdown complete.
W20260709 12:20:56.329813 30260 consensus_peers.cc:597] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:40479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.403550 21244 tablet_server.cc:179] TabletServer@127.20.191.3:0 shutting down...
W20260709 12:20:56.431366 30260 consensus_peers.cc:597] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:40479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.450697 30261 consensus_peers.cc:597] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 -> Peer f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035): Couldn't send request to peer f3ef588fc4b54ec09355022d7a5a5e86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.476002 30260 consensus_peers.cc:597] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:40479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.479919 30186 consensus_peers.cc:597] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:40479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.483755 30186 consensus_peers.cc:597] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:40479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.484225 30186 consensus_peers.cc:597] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:40479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.484615 30186 consensus_peers.cc:597] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 -> Peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Couldn't send request to peer b0439d4e94904196847cd825fcc8ebd7. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:40479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.487545 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:56.488314 21244 tablet_replica.cc:333] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.489156 21244 raft_consensus.cc:2243] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.489678 21244 raft_consensus.cc:2272] T e6b12541deba40218ef3f8c40f40312a P f3ef588fc4b54ec09355022d7a5a5e86 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.491681 21244 tablet_replica.cc:333] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.492215 21244 raft_consensus.cc:2243] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.492565 21244 raft_consensus.cc:2272] T 55101a88e97746d0bc20a0bc0ed8989c P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.494721 21244 tablet_replica.cc:333] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.495471 21244 raft_consensus.cc:2243] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.495965 21244 raft_consensus.cc:2272] T 97c5550b956c4f36af10de2db7490b8b P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:56.497624 30261 consensus_peers.cc:597] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 -> Peer f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035): Couldn't send request to peer f3ef588fc4b54ec09355022d7a5a5e86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.498464 21244 tablet_replica.cc:333] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.499326 21244 raft_consensus.cc:2243] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.500147 21244 raft_consensus.cc:2272] T c32f11599774407e9de2e65083c53e17 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.502487 21244 tablet_replica.cc:333] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.502992 21244 raft_consensus.cc:2243] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.503352 21244 raft_consensus.cc:2272] T a5f5109a89314f8bbf67848895ef8918 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.505110 21244 tablet_replica.cc:333] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.505720 21244 raft_consensus.cc:2243] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.506731 21244 raft_consensus.cc:2272] T d782d59119bc45d08292b0b77cabedc9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.508788 21244 tablet_replica.cc:333] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.509353 21244 raft_consensus.cc:2243] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.510193 21244 raft_consensus.cc:2272] T 8364709c0e424d6791fed2d28528c655 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.512229 21244 tablet_replica.cc:333] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.512815 21244 raft_consensus.cc:2243] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.513230 21244 raft_consensus.cc:2272] T 9aaa1e367a834921bed89b00cf7b2487 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.515547 21244 tablet_replica.cc:333] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.516240 21244 raft_consensus.cc:2243] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.516805 21244 raft_consensus.cc:2272] T 1c80cf731d884ab6bcb89a294b8b905c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.519487 21244 tablet_replica.cc:333] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.520299 21244 raft_consensus.cc:2243] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.520856 21244 raft_consensus.cc:2272] T 3111cf2203d14eb8a006d35fee44552e P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.522923 21244 tablet_replica.cc:333] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.523485 21244 raft_consensus.cc:2243] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.524245 21244 raft_consensus.cc:2272] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.526733 21244 tablet_replica.cc:333] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.527590 21244 raft_consensus.cc:2243] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.528574 21244 raft_consensus.cc:2272] T 5bd853575cf54f3f91608d485c3d16ca P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.531013 21244 tablet_replica.cc:333] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.531692 21244 raft_consensus.cc:2243] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.532172 21244 raft_consensus.cc:2272] T f159a8c7a6304cfc9a399f5c37fe3e1b P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.534596 21244 tablet_replica.cc:333] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.535207 21244 raft_consensus.cc:2243] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.535946 21244 raft_consensus.cc:2272] T 3a289b0636994e34965a2dc0137e5b94 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.538020 21244 tablet_replica.cc:333] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.538587 21244 raft_consensus.cc:2243] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.539361 21244 raft_consensus.cc:2272] T 8f47831b773245faa71c01cb8c967a7a P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.541925 21244 tablet_replica.cc:333] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.542594 21244 raft_consensus.cc:2243] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.543072 21244 raft_consensus.cc:2272] T d0c2af5bb5b548d8855b05242cb9d33c P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.545312 21244 tablet_replica.cc:333] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.546084 21244 raft_consensus.cc:2243] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.546602 21244 raft_consensus.cc:2272] T 3664ea9a740d4d4eaa2ba8371126d21b P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.549280 21244 tablet_replica.cc:333] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.550056 21244 raft_consensus.cc:2243] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.550580 21244 raft_consensus.cc:2272] T 4ad560d215f8475ab9f93ff568eef9f9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.552429 21244 tablet_replica.cc:333] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.552980 21244 raft_consensus.cc:2243] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.553449 21244 raft_consensus.cc:2272] T 64c571ad30094eb3ac0b270c6a3c6a28 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.555593 21244 tablet_replica.cc:333] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.556202 21244 raft_consensus.cc:2243] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.556986 21244 raft_consensus.cc:2272] T 438c3adce9a646b8944ac27608e94314 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.558936 21244 tablet_replica.cc:333] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.559657 21244 raft_consensus.cc:2243] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.560688 21244 raft_consensus.cc:2272] T cdeb0fe4f15c4ea9893bae143fa20651 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.563509 21244 tablet_replica.cc:333] T 975b191d2b5544a6838af42f2be670c9 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.564424 21244 raft_consensus.cc:2243] T 975b191d2b5544a6838af42f2be670c9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.564978 21244 raft_consensus.cc:2272] T 975b191d2b5544a6838af42f2be670c9 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.568157 21244 tablet_replica.cc:333] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.568941 21244 raft_consensus.cc:2243] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.569869 21244 raft_consensus.cc:2272] T 2982be43a6544a2cbf3fbddd81601115 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.572467 21244 tablet_replica.cc:333] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.573287 21244 raft_consensus.cc:2243] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.573808 21244 raft_consensus.cc:2272] T 5b17f97873bb48ca864a13321c11f401 P f3ef588fc4b54ec09355022d7a5a5e86 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.576442 21244 tablet_replica.cc:333] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.577191 21244 raft_consensus.cc:2243] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.578159 21244 raft_consensus.cc:2272] T 7423bc8fd1a54058b083a1c5affa2440 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.580236 21244 tablet_replica.cc:333] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.580744 21244 raft_consensus.cc:2243] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.581476 21244 raft_consensus.cc:2272] T ca034599de8146968cc8adcb232a2ca4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.583465 21244 tablet_replica.cc:333] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.583974 21244 raft_consensus.cc:2243] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.584357 21244 raft_consensus.cc:2272] T 0696a915ada148cca9600585d0152f86 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.586251 21244 tablet_replica.cc:333] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.586758 21244 raft_consensus.cc:2243] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.587131 21244 raft_consensus.cc:2272] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.589166 21244 tablet_replica.cc:333] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.589685 21244 raft_consensus.cc:2243] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.590122 21244 raft_consensus.cc:2272] T d094cffecb264ab689cd0baf985837d8 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.592083 21244 tablet_replica.cc:333] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.592868 21244 raft_consensus.cc:2243] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.593843 21244 raft_consensus.cc:2272] T 27c8763c7b2b4fb891cbebff4035dbe6 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.596567 21244 tablet_replica.cc:333] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.597223 21244 raft_consensus.cc:2243] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.598088 21244 raft_consensus.cc:2272] T d8157cddb556437c85c52ceb0ec7b614 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.600476 21244 tablet_replica.cc:333] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.601166 21244 raft_consensus.cc:2243] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.601686 21244 raft_consensus.cc:2272] T 1c55d09601aa4eceaf3916006afcc93a P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:56.602634 30261 consensus_peers.cc:597] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 -> Peer f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035): Couldn't send request to peer f3ef588fc4b54ec09355022d7a5a5e86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.604018 21244 tablet_replica.cc:333] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.604635 21244 raft_consensus.cc:2243] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.605399 21244 raft_consensus.cc:2272] T e5da70c81d654d3e9e50fa2778189857 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.607582 21244 tablet_replica.cc:333] T 1efc41cad99a42d5a67d2db6d27a9061 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.608294 21244 raft_consensus.cc:2243] T 1efc41cad99a42d5a67d2db6d27a9061 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.608795 21244 raft_consensus.cc:2272] T 1efc41cad99a42d5a67d2db6d27a9061 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.611312 21244 tablet_replica.cc:333] T 1e48bba41f0240ac820f0e23f6067b67 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.612041 21244 raft_consensus.cc:2243] T 1e48bba41f0240ac820f0e23f6067b67 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.612533 21244 raft_consensus.cc:2272] T 1e48bba41f0240ac820f0e23f6067b67 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.615178 21244 tablet_replica.cc:333] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.615753 21244 raft_consensus.cc:2243] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.616245 21244 raft_consensus.cc:2272] T 03f2f494c25b47459faf1d6e4a245f08 P f3ef588fc4b54ec09355022d7a5a5e86 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.618376 21244 tablet_replica.cc:333] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.618904 21244 raft_consensus.cc:2243] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.619757 21244 raft_consensus.cc:2272] T bd0710767a1a447f9670e840fb1e68a4 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.622093 21244 tablet_replica.cc:333] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.622632 21244 raft_consensus.cc:2243] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.623070 21244 raft_consensus.cc:2272] T a6bfe6b1a3764834aa3501ebdf533ddf P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.625289 21244 tablet_replica.cc:333] T ea68554f4650455e9aa55638ed533430 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.625882 21244 raft_consensus.cc:2243] T ea68554f4650455e9aa55638ed533430 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.626312 21244 raft_consensus.cc:2272] T ea68554f4650455e9aa55638ed533430 P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.628240 21244 tablet_replica.cc:333] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.628768 21244 raft_consensus.cc:2243] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.629232 21244 raft_consensus.cc:2272] T 41c11e80998149a79fca99acf176427e P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.631217 21244 tablet_replica.cc:333] T 0e9a81d1a7404da0aac49a76cb38f0de P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.631701 21244 raft_consensus.cc:2243] T 0e9a81d1a7404da0aac49a76cb38f0de P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.632129 21244 raft_consensus.cc:2272] T 0e9a81d1a7404da0aac49a76cb38f0de P f3ef588fc4b54ec09355022d7a5a5e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.634137 21244 tablet_replica.cc:333] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.634625 21244 raft_consensus.cc:2243] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.635082 21244 raft_consensus.cc:2272] T a6fb12e58a824780acab66b641b29009 P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.636986 21244 tablet_replica.cc:333] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.637444 21244 raft_consensus.cc:2243] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.637904 21244 raft_consensus.cc:2272] T 5d01a3a6c7f24268a9c505f7d2f0efcd P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.639834 21244 tablet_replica.cc:333] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86: stopping tablet replica
I20260709 12:20:56.640297 21244 raft_consensus.cc:2243] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.640691 21244 raft_consensus.cc:2272] T 68f77894695f4690bea31f432539542e P f3ef588fc4b54ec09355022d7a5a5e86 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:56.647341 30261 consensus_peers.cc:597] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 -> Peer f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035): Couldn't send request to peer f3ef588fc4b54ec09355022d7a5a5e86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.663132 30261 consensus_peers.cc:597] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 -> Peer f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035): Couldn't send request to peer f3ef588fc4b54ec09355022d7a5a5e86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.726938 21244 tablet_server.cc:196] TabletServer@127.20.191.3:0 shutdown complete.
W20260709 12:20:56.738826 30261 consensus_peers.cc:597] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 -> Peer f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035): Couldn't send request to peer f3ef588fc4b54ec09355022d7a5a5e86. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.3:44035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.771649 30261 consensus_peers.cc:597] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 -> Peer f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035): Couldn't send request to peer f3ef588fc4b54ec09355022d7a5a5e86. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.3:44035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.775820 30261 consensus_peers.cc:597] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 -> Peer f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035): Couldn't send request to peer f3ef588fc4b54ec09355022d7a5a5e86. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.3:44035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.808637 21244 tablet_server.cc:179] TabletServer@127.20.191.4:0 shutting down...
I20260709 12:20:56.852856 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:56.853592 21244 tablet_replica.cc:333] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.854383 21244 raft_consensus.cc:2243] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.854892 21244 raft_consensus.cc:2272] T e6b12541deba40218ef3f8c40f40312a P f6c1f7275e654f49abaf1c80ed662511 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.857398 21244 tablet_replica.cc:333] T af7b5f5579594d8381af5f96a15e24d9 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.858304 21244 raft_consensus.cc:2243] T af7b5f5579594d8381af5f96a15e24d9 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.858901 21244 raft_consensus.cc:2272] T af7b5f5579594d8381af5f96a15e24d9 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.861508 21244 tablet_replica.cc:333] T 961df2c56aac4887bbb0971fd85cd3b0 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.862051 31054 raft_consensus.cc:493] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:56.862305 21244 raft_consensus.cc:2243] T 961df2c56aac4887bbb0971fd85cd3b0 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:56.862612 30261 consensus_peers.cc:597] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 -> Peer f3ef588fc4b54ec09355022d7a5a5e86 (127.20.191.3:44035): Couldn't send request to peer f3ef588fc4b54ec09355022d7a5a5e86. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.3:44035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.862529 31054 raft_consensus.cc:515] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:56.863036 21244 raft_consensus.cc:2272] T 961df2c56aac4887bbb0971fd85cd3b0 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.864373 31054 leader_election.cc:290] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:56.865669 21244 tablet_replica.cc:333] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.866531 21244 raft_consensus.cc:2243] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.867513 21244 raft_consensus.cc:2272] T 97c5550b956c4f36af10de2db7490b8b P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:56.868758 30260 leader_election.cc:336] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Network error: Client connection negotiation failed: client connection to 127.20.191.2:40479: connect: Connection refused (error 111)
W20260709 12:20:56.869282 30262 leader_election.cc:336] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:56.869678 30262 leader_election.cc:304] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:56.870177 21244 tablet_replica.cc:333] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.870455 31054 raft_consensus.cc:2749] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:56.871025 21244 raft_consensus.cc:2243] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.871519 21244 raft_consensus.cc:2272] T c32f11599774407e9de2e65083c53e17 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.873430 21244 tablet_replica.cc:333] T d782d59119bc45d08292b0b77cabedc9 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.874084 21244 raft_consensus.cc:2243] T d782d59119bc45d08292b0b77cabedc9 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.874539 21244 raft_consensus.cc:2272] T d782d59119bc45d08292b0b77cabedc9 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.876473 21244 tablet_replica.cc:333] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.877025 21244 raft_consensus.cc:2243] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.877889 21244 raft_consensus.cc:2272] T 6c8f2fbe93624983bd807e8ac2f76aff P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.879835 21244 tablet_replica.cc:333] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.880411 21244 raft_consensus.cc:2243] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.881156 21244 raft_consensus.cc:2272] T 9aaa1e367a834921bed89b00cf7b2487 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.883152 21244 tablet_replica.cc:333] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.883718 21244 raft_consensus.cc:2243] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.884140 21244 raft_consensus.cc:2272] T 60e61e6fb8fe4b2ba4edb9d057c98d4c P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.885967 21244 tablet_replica.cc:333] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.886493 21244 raft_consensus.cc:2243] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.886890 21244 raft_consensus.cc:2272] T 5bd853575cf54f3f91608d485c3d16ca P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.888725 21244 tablet_replica.cc:333] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.889245 21244 raft_consensus.cc:2243] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.890021 21244 raft_consensus.cc:2272] T 15f28aae897045be9eed015c98ba6908 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.891938 21244 tablet_replica.cc:333] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.892463 21244 raft_consensus.cc:2243] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.893173 21244 raft_consensus.cc:2272] T b5692f07fd174dbfa06976e17c1c6b00 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.895171 21244 tablet_replica.cc:333] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.895714 21244 raft_consensus.cc:2243] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.896104 21244 raft_consensus.cc:2272] T 1aca82ece24244f792b8e4d302f4f4f9 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.897980 21244 tablet_replica.cc:333] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.898538 21244 raft_consensus.cc:2243] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.898931 21244 raft_consensus.cc:2272] T 0d0b7d6a4d5d4eb1a1c115b60981d41c P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.900774 21244 tablet_replica.cc:333] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.901378 21244 raft_consensus.cc:2243] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.901829 21244 raft_consensus.cc:2272] T d8157cddb556437c85c52ceb0ec7b614 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.903831 21244 tablet_replica.cc:333] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.904337 21244 raft_consensus.cc:2243] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.905077 21244 raft_consensus.cc:2272] T 1c55d09601aa4eceaf3916006afcc93a P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.907107 21244 tablet_replica.cc:333] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.907613 21244 raft_consensus.cc:2243] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.908316 21244 raft_consensus.cc:2272] T 3664ea9a740d4d4eaa2ba8371126d21b P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.910238 21244 tablet_replica.cc:333] T 9c98f7fba9544225a8c7e515247ec5c9 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.910758 21244 raft_consensus.cc:2243] T 9c98f7fba9544225a8c7e515247ec5c9 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.911134 21244 raft_consensus.cc:2272] T 9c98f7fba9544225a8c7e515247ec5c9 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.913214 21244 tablet_replica.cc:333] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.913816 21244 raft_consensus.cc:2243] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.914695 21244 raft_consensus.cc:2272] T f159a8c7a6304cfc9a399f5c37fe3e1b P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.916859 21244 tablet_replica.cc:333] T d0c2af5bb5b548d8855b05242cb9d33c P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.917431 21244 raft_consensus.cc:2243] T d0c2af5bb5b548d8855b05242cb9d33c P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.917900 21244 raft_consensus.cc:2272] T d0c2af5bb5b548d8855b05242cb9d33c P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.919862 21244 tablet_replica.cc:333] T 3a289b0636994e34965a2dc0137e5b94 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.920452 21244 raft_consensus.cc:2243] T 3a289b0636994e34965a2dc0137e5b94 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.920877 21244 raft_consensus.cc:2272] T 3a289b0636994e34965a2dc0137e5b94 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.922914 21244 tablet_replica.cc:333] T 438c3adce9a646b8944ac27608e94314 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.923462 21244 raft_consensus.cc:2243] T 438c3adce9a646b8944ac27608e94314 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.923887 21244 raft_consensus.cc:2272] T 438c3adce9a646b8944ac27608e94314 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.925920 21244 tablet_replica.cc:333] T cdeb0fe4f15c4ea9893bae143fa20651 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.926477 21244 raft_consensus.cc:2243] T cdeb0fe4f15c4ea9893bae143fa20651 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.926870 21244 raft_consensus.cc:2272] T cdeb0fe4f15c4ea9893bae143fa20651 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.928862 21244 tablet_replica.cc:333] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.929419 21244 raft_consensus.cc:2243] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.930258 21244 raft_consensus.cc:2272] T 975b191d2b5544a6838af42f2be670c9 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.932219 21244 tablet_replica.cc:333] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.932801 21244 raft_consensus.cc:2243] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.933228 21244 raft_consensus.cc:2272] T 3b981cc4916444c0a31e5fd3b14aaa67 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.935288 21244 tablet_replica.cc:333] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.935847 21244 raft_consensus.cc:2243] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.936586 21244 raft_consensus.cc:2272] T 1efc41cad99a42d5a67d2db6d27a9061 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.938635 21244 tablet_replica.cc:333] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.939224 21244 raft_consensus.cc:2243] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.939873 21244 raft_consensus.cc:2272] T 03f2f494c25b47459faf1d6e4a245f08 P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.939999 31054 raft_consensus.cc:493] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:56.940466 31054 raft_consensus.cc:515] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } } peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } }
I20260709 12:20:56.942131 31054 leader_election.cc:290] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479), 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571)
I20260709 12:20:56.942276 21244 tablet_replica.cc:333] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.943114 21244 raft_consensus.cc:2243] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.944125 21244 raft_consensus.cc:2272] T 22caa8a59f42477199989f2612bb7136 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.946615 21244 tablet_replica.cc:333] T bd0710767a1a447f9670e840fb1e68a4 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
W20260709 12:20:56.946657 30262 leader_election.cc:336] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
W20260709 12:20:56.947216 30260 leader_election.cc:336] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Network error: Client connection negotiation failed: client connection to 127.20.191.2:40479: connect: Connection refused (error 111)
I20260709 12:20:56.947283 21244 raft_consensus.cc:2243] T bd0710767a1a447f9670e840fb1e68a4 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.947626 30260 leader_election.cc:304] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:56.947856 21244 raft_consensus.cc:2272] T bd0710767a1a447f9670e840fb1e68a4 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.948170 31054 raft_consensus.cc:2749] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.949185 31054 raft_consensus.cc:493] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22a1255131174934a6bca3c0bf000026)
I20260709 12:20:56.949607 31054 raft_consensus.cc:515] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c1f7275e654f49abaf1c80ed662511" member_type: VOTER last_known_addr { host: "127.20.191.4" port: 33729 } } peers { permanent_uuid: "22a1255131174934a6bca3c0bf000026" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 43571 } } peers { permanent_uuid: "b0439d4e94904196847cd825fcc8ebd7" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 40479 } }
I20260709 12:20:56.950560 21244 tablet_replica.cc:333] T 581f9562c91e46eea64ec770bcb8671b P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.951375 21244 raft_consensus.cc:2243] T 581f9562c91e46eea64ec770bcb8671b P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.951398 31054 leader_election.cc:290] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571), b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479)
I20260709 12:20:56.952030 21244 raft_consensus.cc:2272] T 581f9562c91e46eea64ec770bcb8671b P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.954794 21244 tablet_replica.cc:333] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
W20260709 12:20:56.955457 30262 leader_election.cc:336] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 22a1255131174934a6bca3c0bf000026 (127.20.191.1:43571): Network error: Client connection negotiation failed: client connection to 127.20.191.1:43571: connect: Connection refused (error 111)
I20260709 12:20:56.955619 21244 raft_consensus.cc:2243] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:56.956012 30260 leader_election.cc:336] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b0439d4e94904196847cd825fcc8ebd7 (127.20.191.2:40479): Network error: Client connection negotiation failed: client connection to 127.20.191.2:40479: connect: Connection refused (error 111)
I20260709 12:20:56.956229 21244 raft_consensus.cc:2272] T a6bfe6b1a3764834aa3501ebdf533ddf P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.956362 30260 leader_election.cc:304] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c1f7275e654f49abaf1c80ed662511; no voters: 22a1255131174934a6bca3c0bf000026, b0439d4e94904196847cd825fcc8ebd7
I20260709 12:20:56.957048 31054 raft_consensus.cc:2749] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.958658 21244 tablet_replica.cc:333] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.959264 21244 raft_consensus.cc:2243] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.960018 21244 raft_consensus.cc:2272] T 64c571ad30094eb3ac0b270c6a3c6a28 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.962002 21244 tablet_replica.cc:333] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.962491 21244 raft_consensus.cc:2243] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.963199 21244 raft_consensus.cc:2272] T 67a9ecec74344c1693efb9acb6e38e26 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.965121 21244 tablet_replica.cc:333] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.965677 21244 raft_consensus.cc:2243] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.966114 21244 raft_consensus.cc:2272] T f58b35cd70b1481993195f5bdd8ad3fe P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.968017 21244 tablet_replica.cc:333] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.968537 21244 raft_consensus.cc:2243] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.969249 21244 raft_consensus.cc:2272] T 2982be43a6544a2cbf3fbddd81601115 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.971513 21244 tablet_replica.cc:333] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.971997 21244 raft_consensus.cc:2243] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.972383 21244 raft_consensus.cc:2272] T 5b17f97873bb48ca864a13321c11f401 P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.974198 21244 tablet_replica.cc:333] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.974655 21244 raft_consensus.cc:2243] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.975067 21244 raft_consensus.cc:2272] T ca034599de8146968cc8adcb232a2ca4 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.976886 21244 tablet_replica.cc:333] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.977370 21244 raft_consensus.cc:2243] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.977751 21244 raft_consensus.cc:2272] T 8364709c0e424d6791fed2d28528c655 P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.979568 21244 tablet_replica.cc:333] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.980026 21244 raft_consensus.cc:2243] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.980698 21244 raft_consensus.cc:2272] T 4f18dd45e30e4e3aafdc917396dc2181 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.982551 21244 tablet_replica.cc:333] T 7423bc8fd1a54058b083a1c5affa2440 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.983001 21244 raft_consensus.cc:2243] T 7423bc8fd1a54058b083a1c5affa2440 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.983353 21244 raft_consensus.cc:2272] T 7423bc8fd1a54058b083a1c5affa2440 P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.985155 21244 tablet_replica.cc:333] T 0e9a81d1a7404da0aac49a76cb38f0de P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.985603 21244 raft_consensus.cc:2243] T 0e9a81d1a7404da0aac49a76cb38f0de P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.986016 21244 raft_consensus.cc:2272] T 0e9a81d1a7404da0aac49a76cb38f0de P f6c1f7275e654f49abaf1c80ed662511 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.987784 21244 tablet_replica.cc:333] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.988257 21244 raft_consensus.cc:2243] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.988629 21244 raft_consensus.cc:2272] T 68f77894695f4690bea31f432539542e P f6c1f7275e654f49abaf1c80ed662511 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.990459 21244 tablet_replica.cc:333] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.990885 21244 raft_consensus.cc:2243] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.991230 21244 raft_consensus.cc:2272] T f01efd7c139e45c3809ed6a668f1faca P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.992957 21244 tablet_replica.cc:333] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511: stopping tablet replica
I20260709 12:20:56.993357 21244 raft_consensus.cc:2243] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:56.993736 21244 raft_consensus.cc:2272] T 27678468a40344eca39b8bab02b0b368 P f6c1f7275e654f49abaf1c80ed662511 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:57.056767 21244 tablet_server.cc:196] TabletServer@127.20.191.4:0 shutdown complete.
I20260709 12:20:57.207269 21244 master.cc:562] Master@127.20.191.62:36647 shutting down...
I20260709 12:20:57.233593 21244 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:57.234459 21244 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:57.234794 21244 tablet_replica.cc:333] T 00000000000000000000000000000000 P e66f7e986b194f1888b8f70b2912b109: stopping tablet replica
I20260709 12:20:57.275317 21244 master.cc:584] Master@127.20.191.62:36647 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (30079 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:20:57.366595 21244 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.191.62:43621
I20260709 12:20:57.367730 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:57.373833 31176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:57.374162 31177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:57.375434 21244 server_base.cc:1061] running on GCE node
W20260709 12:20:57.375480 31179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:57.376536 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:57.376735 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:57.376871 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599657376855 us; error 0 us; skew 500 ppm
I20260709 12:20:57.377413 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:57.380025 21244 webserver.cc:533] Webserver started at http://127.20.191.62:42981/ using document root <none> and password file <none>
I20260709 12:20:57.380554 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:57.380738 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:57.381006 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:57.382341 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/master-0-root/instance:
uuid: "0a7f34b680bc4c5485d161de2d914fad"
format_stamp: "Formatted at 2026-07-09 12:20:57 on dist-test-slave-7c1h"
I20260709 12:20:57.387050 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:20:57.390669 31184 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:57.391526 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:20:57.391834 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/master-0-root
uuid: "0a7f34b680bc4c5485d161de2d914fad"
format_stamp: "Formatted at 2026-07-09 12:20:57 on dist-test-slave-7c1h"
I20260709 12:20:57.392127 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:57.410688 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:57.411947 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:57.452406 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.62:43621
I20260709 12:20:57.452529 31235 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.62:43621 every 8 connection(s)
I20260709 12:20:57.457372 31236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:57.470042 31236 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad: Bootstrap starting.
I20260709 12:20:57.475236 31236 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.479915 31236 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad: No bootstrap required, opened a new log
I20260709 12:20:57.482334 31236 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a7f34b680bc4c5485d161de2d914fad" member_type: VOTER }
I20260709 12:20:57.482813 31236 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.483038 31236 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a7f34b680bc4c5485d161de2d914fad, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.483697 31236 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a7f34b680bc4c5485d161de2d914fad" member_type: VOTER }
I20260709 12:20:57.484189 31236 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:20:57.484417 31236 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:20:57.484678 31236 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.489529 31236 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a7f34b680bc4c5485d161de2d914fad" member_type: VOTER }
I20260709 12:20:57.490105 31236 leader_election.cc:304] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a7f34b680bc4c5485d161de2d914fad; no voters: 
I20260709 12:20:57.491263 31236 leader_election.cc:290] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:20:57.491726 31239 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:57.493183 31239 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [term 1 LEADER]: Becoming Leader. State: Replica: 0a7f34b680bc4c5485d161de2d914fad, State: Running, Role: LEADER
I20260709 12:20:57.493992 31239 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a7f34b680bc4c5485d161de2d914fad" member_type: VOTER }
I20260709 12:20:57.494323 31236 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:20:57.502067 31240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a7f34b680bc4c5485d161de2d914fad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a7f34b680bc4c5485d161de2d914fad" member_type: VOTER } }
I20260709 12:20:57.502911 31240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:57.504379 31241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a7f34b680bc4c5485d161de2d914fad. Latest consensus state: current_term: 1 leader_uuid: "0a7f34b680bc4c5485d161de2d914fad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a7f34b680bc4c5485d161de2d914fad" member_type: VOTER } }
I20260709 12:20:57.505067 31241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:57.505802 31249 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:20:57.513090 31249 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:20:57.514219 21244 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:20:57.523347 31249 catalog_manager.cc:1383] Generated new cluster ID: 6756b0f610ab45be8c56c024cc5a514f
I20260709 12:20:57.523676 31249 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:20:57.540249 31249 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:20:57.541673 31249 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:20:57.555404 31249 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad: Generated new TSK 0
I20260709 12:20:57.556068 31249 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:20:57.580821 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:57.587674 31257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:57.587911 31258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:57.589910 31260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:57.590237 21244 server_base.cc:1061] running on GCE node
I20260709 12:20:57.591248 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:57.591449 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:57.591603 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599657591586 us; error 0 us; skew 500 ppm
I20260709 12:20:57.592147 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:57.594638 21244 webserver.cc:533] Webserver started at http://127.20.191.1:39103/ using document root <none> and password file <none>
I20260709 12:20:57.595112 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:57.595301 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:57.595539 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:57.596789 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-0-root/instance:
uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
format_stamp: "Formatted at 2026-07-09 12:20:57 on dist-test-slave-7c1h"
I20260709 12:20:57.601341 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:20:57.604967 31265 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:57.605731 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:20:57.606066 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-0-root
uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
format_stamp: "Formatted at 2026-07-09 12:20:57 on dist-test-slave-7c1h"
I20260709 12:20:57.606352 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:57.642832 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:57.644120 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:57.645615 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:57.647976 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:57.648190 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:57.648433 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:57.648600 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:57.689882 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.1:42997
I20260709 12:20:57.690006 31327 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.1:42997 every 8 connection(s)
I20260709 12:20:57.695101 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:57.702397 31332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:57.704629 31333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:57.707494 21244 server_base.cc:1061] running on GCE node
W20260709 12:20:57.708691 31335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:57.713650 31328 heartbeater.cc:344] Connected to a master server at 127.20.191.62:43621
I20260709 12:20:57.714417 31328 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:57.715649 31328 heartbeater.cc:507] Master 127.20.191.62:43621 requested a full tablet report, sending...
I20260709 12:20:57.718190 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:57.718532 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:57.718699 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599657718681 us; error 0 us; skew 500 ppm
I20260709 12:20:57.719105 31201 ts_manager.cc:194] Registered new tserver with Master: ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997)
I20260709 12:20:57.719353 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:57.721264 31201 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45208
I20260709 12:20:57.722079 21244 webserver.cc:533] Webserver started at http://127.20.191.2:43163/ using document root <none> and password file <none>
I20260709 12:20:57.722646 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:57.722836 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:57.723147 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:57.724768 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-1-root/instance:
uuid: "c109dd3c635648459f4b8b39e11bc4d4"
format_stamp: "Formatted at 2026-07-09 12:20:57 on dist-test-slave-7c1h"
I20260709 12:20:57.730020 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.007s
I20260709 12:20:57.733647 31340 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:57.734521 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:20:57.734834 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-1-root
uuid: "c109dd3c635648459f4b8b39e11bc4d4"
format_stamp: "Formatted at 2026-07-09 12:20:57 on dist-test-slave-7c1h"
I20260709 12:20:57.735124 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:57.745568 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:57.746816 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:57.748338 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:57.750794 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:57.751015 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:57.751233 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:57.751384 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:57.796177 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.2:33657
I20260709 12:20:57.796442 31402 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.2:33657 every 8 connection(s)
I20260709 12:20:57.801052 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:57.808593 31406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:57.810827 31407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:57.814291 31409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:57.814786 21244 server_base.cc:1061] running on GCE node
I20260709 12:20:57.815040 31403 heartbeater.cc:344] Connected to a master server at 127.20.191.62:43621
I20260709 12:20:57.815459 31403 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:57.815784 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:57.816026 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:57.816215 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599657816197 us; error 0 us; skew 500 ppm
I20260709 12:20:57.816258 31403 heartbeater.cc:507] Master 127.20.191.62:43621 requested a full tablet report, sending...
I20260709 12:20:57.816900 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:57.818632 31201 ts_manager.cc:194] Registered new tserver with Master: c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:20:57.819670 21244 webserver.cc:533] Webserver started at http://127.20.191.3:46407/ using document root <none> and password file <none>
I20260709 12:20:57.820266 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:57.820210 31201 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45214
I20260709 12:20:57.820672 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:57.820977 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:57.822352 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-2-root/instance:
uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
format_stamp: "Formatted at 2026-07-09 12:20:57 on dist-test-slave-7c1h"
I20260709 12:20:57.827155 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:20:57.830869 31414 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:57.831691 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:20:57.832020 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-2-root
uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
format_stamp: "Formatted at 2026-07-09 12:20:57 on dist-test-slave-7c1h"
I20260709 12:20:57.832307 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:57.849156 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:57.850459 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:57.851998 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:57.854436 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:57.854656 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:57.854889 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:57.855046 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:57.895721 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.3:42455
I20260709 12:20:57.895838 31476 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.3:42455 every 8 connection(s)
I20260709 12:20:57.911432 31477 heartbeater.cc:344] Connected to a master server at 127.20.191.62:43621
I20260709 12:20:57.912156 31477 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:57.913266 31477 heartbeater.cc:507] Master 127.20.191.62:43621 requested a full tablet report, sending...
I20260709 12:20:57.915652 31201 ts_manager.cc:194] Registered new tserver with Master: 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:20:57.916879 21244 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017958738s
I20260709 12:20:57.917140 31201 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45224
I20260709 12:20:57.944126 31201 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45236:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:57.947149 31201 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:58.025846 31293 tablet_service.cc:1511] Processing CreateTablet for tablet fa55de36bac74222b2a8fd30d864f1d7 (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:20:58.027431 31293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa55de36bac74222b2a8fd30d864f1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.033133 31442 tablet_service.cc:1511] Processing CreateTablet for tablet fa55de36bac74222b2a8fd30d864f1d7 (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:20:58.034145 31437 tablet_service.cc:1511] Processing CreateTablet for tablet 5c823555de1945e5827161b0499a00d9 (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:20:58.034966 31442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa55de36bac74222b2a8fd30d864f1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.035719 31437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c823555de1945e5827161b0499a00d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.038797 31292 tablet_service.cc:1511] Processing CreateTablet for tablet ef9c407a3aed46b69eb4b4c875adc6b4 (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:20:58.040473 31292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef9c407a3aed46b69eb4b4c875adc6b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.040151 31440 tablet_service.cc:1511] Processing CreateTablet for tablet 08604d1cb7384c1e85b7928e9ef4fcbb (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:20:58.041688 31440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08604d1cb7384c1e85b7928e9ef4fcbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.045490 31291 tablet_service.cc:1511] Processing CreateTablet for tablet 08604d1cb7384c1e85b7928e9ef4fcbb (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:20:58.043162 31439 tablet_service.cc:1511] Processing CreateTablet for tablet 6d66a37a6c894ba7ab6a17172f04740c (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:20:58.050972 31291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08604d1cb7384c1e85b7928e9ef4fcbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.051689 31439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d66a37a6c894ba7ab6a17172f04740c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.038923 31441 tablet_service.cc:1511] Processing CreateTablet for tablet ef9c407a3aed46b69eb4b4c875adc6b4 (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:20:58.054031 31441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef9c407a3aed46b69eb4b4c875adc6b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.044790 31438 tablet_service.cc:1511] Processing CreateTablet for tablet ff7a45ef6a6a4ead9c8421b94e3f9155 (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:20:58.056286 31438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7a45ef6a6a4ead9c8421b94e3f9155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.062952 31290 tablet_service.cc:1511] Processing CreateTablet for tablet 6d66a37a6c894ba7ab6a17172f04740c (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:20:58.064626 31290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d66a37a6c894ba7ab6a17172f04740c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.073697 31436 tablet_service.cc:1511] Processing CreateTablet for tablet 07cd3429d1d442d586b729a487b800c0 (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:20:58.077977 31435 tablet_service.cc:1511] Processing CreateTablet for tablet 36f58a2613aa49eca2e2df2436ae93aa (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:20:58.079674 31436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07cd3429d1d442d586b729a487b800c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.080932 31435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f58a2613aa49eca2e2df2436ae93aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.083665 31289 tablet_service.cc:1511] Processing CreateTablet for tablet ff7a45ef6a6a4ead9c8421b94e3f9155 (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:20:58.085475 31289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7a45ef6a6a4ead9c8421b94e3f9155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.087198 31434 tablet_service.cc:1511] Processing CreateTablet for tablet 94e029757f2e4b11abdb36a95b2fd7dc (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:20:58.088796 31434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94e029757f2e4b11abdb36a95b2fd7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.089181 31287 tablet_service.cc:1511] Processing CreateTablet for tablet 07cd3429d1d442d586b729a487b800c0 (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:20:58.091606 31286 tablet_service.cc:1511] Processing CreateTablet for tablet 36f58a2613aa49eca2e2df2436ae93aa (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:20:58.093117 31433 tablet_service.cc:1511] Processing CreateTablet for tablet e0821fd6ca4c44eab8c17649a7e8d898 (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:20:58.094728 31433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0821fd6ca4c44eab8c17649a7e8d898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.094623 31285 tablet_service.cc:1511] Processing CreateTablet for tablet 94e029757f2e4b11abdb36a95b2fd7dc (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:20:58.096025 31285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94e029757f2e4b11abdb36a95b2fd7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.099030 31284 tablet_service.cc:1511] Processing CreateTablet for tablet e0821fd6ca4c44eab8c17649a7e8d898 (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:20:58.099597 31368 tablet_service.cc:1511] Processing CreateTablet for tablet fa55de36bac74222b2a8fd30d864f1d7 (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:20:58.087735 31288 tablet_service.cc:1511] Processing CreateTablet for tablet 5c823555de1945e5827161b0499a00d9 (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:20:58.100975 31368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa55de36bac74222b2a8fd30d864f1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.101055 31288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c823555de1945e5827161b0499a00d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.102607 31284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0821fd6ca4c44eab8c17649a7e8d898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.105219 31286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f58a2613aa49eca2e2df2436ae93aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.106376 31367 tablet_service.cc:1511] Processing CreateTablet for tablet ef9c407a3aed46b69eb4b4c875adc6b4 (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:20:58.107854 31367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef9c407a3aed46b69eb4b4c875adc6b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.114239 31287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07cd3429d1d442d586b729a487b800c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.120496 31366 tablet_service.cc:1511] Processing CreateTablet for tablet 08604d1cb7384c1e85b7928e9ef4fcbb (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:20:58.122299 31366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08604d1cb7384c1e85b7928e9ef4fcbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.148677 31365 tablet_service.cc:1511] Processing CreateTablet for tablet 6d66a37a6c894ba7ab6a17172f04740c (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:20:58.150393 31365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d66a37a6c894ba7ab6a17172f04740c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.155887 31364 tablet_service.cc:1511] Processing CreateTablet for tablet ff7a45ef6a6a4ead9c8421b94e3f9155 (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:20:58.156417 31363 tablet_service.cc:1511] Processing CreateTablet for tablet 5c823555de1945e5827161b0499a00d9 (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:20:58.157485 31364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7a45ef6a6a4ead9c8421b94e3f9155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.158160 31363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c823555de1945e5827161b0499a00d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.185575 31364 tablet_service.cc:1511] Processing CreateTablet for tablet 07cd3429d1d442d586b729a487b800c0 (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:20:58.187098 31364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07cd3429d1d442d586b729a487b800c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.201354 31360 tablet_service.cc:1511] Processing CreateTablet for tablet e0821fd6ca4c44eab8c17649a7e8d898 (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:20:58.199982 31361 tablet_service.cc:1511] Processing CreateTablet for tablet 94e029757f2e4b11abdb36a95b2fd7dc (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:20:58.199832 31362 tablet_service.cc:1511] Processing CreateTablet for tablet 36f58a2613aa49eca2e2df2436ae93aa (DEFAULT_TABLE table=test-workload [id=c9d2ecda7fc54eaca23894c0818c3098]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:20:58.202883 31360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0821fd6ca4c44eab8c17649a7e8d898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.203840 31361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94e029757f2e4b11abdb36a95b2fd7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.207957 31362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f58a2613aa49eca2e2df2436ae93aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:58.289525 31493 tablet_bootstrap.cc:492] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4: Bootstrap starting.
I20260709 12:20:58.290396 31492 tablet_bootstrap.cc:492] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0: Bootstrap starting.
I20260709 12:20:58.290827 31494 tablet_bootstrap.cc:492] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:20:58.300927 31493 tablet_bootstrap.cc:654] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.302639 31494 tablet_bootstrap.cc:654] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.314342 31492 tablet_bootstrap.cc:654] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.320075 31493 tablet_bootstrap.cc:492] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4: No bootstrap required, opened a new log
I20260709 12:20:58.320745 31493 ts_tablet_manager.cc:1403] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.009s
I20260709 12:20:58.324949 31493 raft_consensus.cc:359] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } } peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } }
I20260709 12:20:58.326166 31493 raft_consensus.cc:385] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.326583 31493 raft_consensus.cc:740] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.327596 31493 consensus_queue.cc:260] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } } peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } }
I20260709 12:20:58.332466 31494 tablet_bootstrap.cc:492] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc: No bootstrap required, opened a new log
I20260709 12:20:58.333171 31494 ts_tablet_manager.cc:1403] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.003s
I20260709 12:20:58.334950 31492 tablet_bootstrap.cc:492] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0: No bootstrap required, opened a new log
I20260709 12:20:58.335526 31492 ts_tablet_manager.cc:1403] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.003s
I20260709 12:20:58.337495 31494 raft_consensus.cc:359] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.338385 31494 raft_consensus.cc:385] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.338719 31494 raft_consensus.cc:740] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.338583 31492 raft_consensus.cc:359] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.339394 31492 raft_consensus.cc:385] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.339751 31492 raft_consensus.cc:740] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.339934 31403 heartbeater.cc:499] Master 127.20.191.62:43621 was elected leader, sending a full tablet report...
I20260709 12:20:58.340267 31494 consensus_queue.cc:260] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.340749 31492 consensus_queue.cc:260] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.341331 31499 raft_consensus.cc:493] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.341943 31499 raft_consensus.cc:515] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.339524 31493 ts_tablet_manager.cc:1434] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4: Time spent starting tablet: real 0.018s	user 0.012s	sys 0.001s
I20260709 12:20:58.345206 31493 tablet_bootstrap.cc:492] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4: Bootstrap starting.
I20260709 12:20:58.352110 31493 tablet_bootstrap.cc:654] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.355192 31477 heartbeater.cc:499] Master 127.20.191.62:43621 was elected leader, sending a full tablet report...
I20260709 12:20:58.355909 31492 ts_tablet_manager.cc:1434] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent starting tablet: real 0.020s	user 0.013s	sys 0.007s
I20260709 12:20:58.357285 31492 tablet_bootstrap.cc:492] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0: Bootstrap starting.
I20260709 12:20:58.365024 31492 tablet_bootstrap.cc:654] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.365142 31493 tablet_bootstrap.cc:492] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4: No bootstrap required, opened a new log
I20260709 12:20:58.365808 31493 ts_tablet_manager.cc:1403] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 12:20:58.369081 31493 raft_consensus.cc:359] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.369880 31493 raft_consensus.cc:385] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.370200 31493 raft_consensus.cc:740] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.371186 31493 consensus_queue.cc:260] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.374264 31493 ts_tablet_manager.cc:1434] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:20:58.375444 31493 tablet_bootstrap.cc:492] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4: Bootstrap starting.
I20260709 12:20:58.382452 31499 leader_election.cc:290] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:20:58.385079 31492 tablet_bootstrap.cc:492] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0: No bootstrap required, opened a new log
I20260709 12:20:58.385756 31492 ts_tablet_manager.cc:1403] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.015s
I20260709 12:20:58.388967 31492 raft_consensus.cc:359] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.390221 31493 tablet_bootstrap.cc:654] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.393288 31328 heartbeater.cc:499] Master 127.20.191.62:43621 was elected leader, sending a full tablet report...
I20260709 12:20:58.393641 31492 raft_consensus.cc:385] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.394217 31492 raft_consensus.cc:740] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.395453 31492 consensus_queue.cc:260] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.398200 31492 ts_tablet_manager.cc:1434] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.006s
I20260709 12:20:58.399561 31492 tablet_bootstrap.cc:492] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0: Bootstrap starting.
I20260709 12:20:58.415566 31492 tablet_bootstrap.cc:654] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.418457 31494 ts_tablet_manager.cc:1434] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.085s	user 0.050s	sys 0.035s
I20260709 12:20:58.419643 31494 tablet_bootstrap.cc:492] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:20:58.423084 31493 tablet_bootstrap.cc:492] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4: No bootstrap required, opened a new log
I20260709 12:20:58.423756 31493 ts_tablet_manager.cc:1403] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.012s
I20260709 12:20:58.426452 31494 tablet_bootstrap.cc:654] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.427150 31493 raft_consensus.cc:359] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.427984 31493 raft_consensus.cc:385] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.428279 31493 raft_consensus.cc:740] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.429162 31493 consensus_queue.cc:260] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.431730 31493 ts_tablet_manager.cc:1434] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:20:58.433012 31493 tablet_bootstrap.cc:492] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4: Bootstrap starting.
I20260709 12:20:58.438715 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" is_pre_election: true
I20260709 12:20:58.439703 31452 raft_consensus.cc:2468] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba1cb7ff4d4340b3a277621adcad9fbc in term 0.
I20260709 12:20:58.440505 31494 tablet_bootstrap.cc:492] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc: No bootstrap required, opened a new log
I20260709 12:20:58.441069 31494 ts_tablet_manager.cc:1403] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.008s
I20260709 12:20:58.442543 31493 tablet_bootstrap.cc:654] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.441938 31268 leader_election.cc:304] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc; no voters: 
I20260709 12:20:58.443794 31500 raft_consensus.cc:2804] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:58.444242 31500 raft_consensus.cc:493] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.444202 31494 raft_consensus.cc:359] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.444870 31500 raft_consensus.cc:3060] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.445111 31494 raft_consensus.cc:385] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.445505 31494 raft_consensus.cc:740] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.447114 31494 consensus_queue.cc:260] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.449755 31494 ts_tablet_manager.cc:1434] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:20:58.450872 31494 tablet_bootstrap.cc:492] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:20:58.458411 31494 tablet_bootstrap.cc:654] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.465745 31500 raft_consensus.cc:515] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.470134 31500 leader_election.cc:290] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 election: Requested vote from peers c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:20:58.473345 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
I20260709 12:20:58.473910 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4" is_pre_election: true
I20260709 12:20:58.474130 31452 raft_consensus.cc:3060] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.474340 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
I20260709 12:20:58.474756 31378 raft_consensus.cc:2468] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba1cb7ff4d4340b3a277621adcad9fbc in term 0.
I20260709 12:20:58.476303 31492 tablet_bootstrap.cc:492] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0: No bootstrap required, opened a new log
I20260709 12:20:58.477087 31492 ts_tablet_manager.cc:1403] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.037s
I20260709 12:20:58.479655 31377 raft_consensus.cc:3060] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.480417 31492 raft_consensus.cc:359] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.481298 31492 raft_consensus.cc:385] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.482090 31492 raft_consensus.cc:740] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.483281 31492 consensus_queue.cc:260] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.485231 31452 raft_consensus.cc:2468] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba1cb7ff4d4340b3a277621adcad9fbc in term 1.
I20260709 12:20:58.485631 31492 ts_tablet_manager.cc:1434] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:20:58.486809 31492 tablet_bootstrap.cc:492] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0: Bootstrap starting.
I20260709 12:20:58.487337 31268 leader_election.cc:304] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc; no voters: 
I20260709 12:20:58.492208 31377 raft_consensus.cc:2468] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba1cb7ff4d4340b3a277621adcad9fbc in term 1.
I20260709 12:20:58.495680 31498 raft_consensus.cc:493] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.496313 31498 raft_consensus.cc:515] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } } peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } }
I20260709 12:20:58.496862 31492 tablet_bootstrap.cc:654] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.496927 31494 tablet_bootstrap.cc:492] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc: No bootstrap required, opened a new log
I20260709 12:20:58.498443 31494 ts_tablet_manager.cc:1403] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.019s
I20260709 12:20:58.499250 31493 tablet_bootstrap.cc:492] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4: No bootstrap required, opened a new log
I20260709 12:20:58.499886 31493 ts_tablet_manager.cc:1403] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4: Time spent bootstrapping tablet: real 0.067s	user 0.021s	sys 0.013s
I20260709 12:20:58.501631 31494 raft_consensus.cc:359] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.502497 31494 raft_consensus.cc:385] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.502791 31494 raft_consensus.cc:740] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.503178 31493 raft_consensus.cc:359] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.503957 31493 raft_consensus.cc:385] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.503690 31494 consensus_queue.cc:260] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.504374 31493 raft_consensus.cc:740] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.504828 31499 raft_consensus.cc:2804] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:20:58.505429 31248 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:58.505340 31493 consensus_queue.cc:260] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.504278 31498 leader_election.cc:290] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455), ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997)
I20260709 12:20:58.512488 31494 ts_tablet_manager.cc:1434] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:20:58.518083 31499 raft_consensus.cc:697] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 LEADER]: Becoming Leader. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Running, Role: LEADER
I20260709 12:20:58.519243 31499 consensus_queue.cc:237] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.522143 31494 tablet_bootstrap.cc:492] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:20:58.528446 31493 ts_tablet_manager.cc:1434] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4: Time spent starting tablet: real 0.028s	user 0.020s	sys 0.007s
I20260709 12:20:58.529546 31494 tablet_bootstrap.cc:654] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.529603 31493 tablet_bootstrap.cc:492] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4: Bootstrap starting.
I20260709 12:20:58.540112 31493 tablet_bootstrap.cc:654] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.543123 31303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa55de36bac74222b2a8fd30d864f1d7" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" is_pre_election: true
W20260709 12:20:58.545071 31342 leader_election.cc:343] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:58.545470 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa55de36bac74222b2a8fd30d864f1d7" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" is_pre_election: true
W20260709 12:20:58.547299 31343 leader_election.cc:343] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:58.547827 31343 leader_election.cc:304] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c109dd3c635648459f4b8b39e11bc4d4; no voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc
I20260709 12:20:58.549327 31515 raft_consensus.cc:2749] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:58.550123 31494 tablet_bootstrap.cc:492] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc: No bootstrap required, opened a new log
I20260709 12:20:58.550743 31494 ts_tablet_manager.cc:1403] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.003s
I20260709 12:20:58.554220 31494 raft_consensus.cc:359] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } } peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } }
I20260709 12:20:58.555058 31494 raft_consensus.cc:385] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.555367 31494 raft_consensus.cc:740] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.555420 31492 tablet_bootstrap.cc:492] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0: No bootstrap required, opened a new log
I20260709 12:20:58.556154 31492 ts_tablet_manager.cc:1403] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.017s
I20260709 12:20:58.556262 31494 consensus_queue.cc:260] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } } peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } }
I20260709 12:20:58.558348 31493 tablet_bootstrap.cc:492] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4: No bootstrap required, opened a new log
I20260709 12:20:58.558910 31494 ts_tablet_manager.cc:1434] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:58.558933 31493 ts_tablet_manager.cc:1403] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.007s
I20260709 12:20:58.559294 31492 raft_consensus.cc:359] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.560113 31492 raft_consensus.cc:385] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.560195 31494 tablet_bootstrap.cc:492] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:20:58.560489 31492 raft_consensus.cc:740] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.561417 31492 consensus_queue.cc:260] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.563014 31493 raft_consensus.cc:359] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.563833 31493 raft_consensus.cc:385] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.564179 31493 raft_consensus.cc:740] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.565128 31493 consensus_queue.cc:260] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.566385 31492 ts_tablet_manager.cc:1434] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:20:58.567472 31492 tablet_bootstrap.cc:492] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0: Bootstrap starting.
I20260709 12:20:58.567705 31494 tablet_bootstrap.cc:654] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.570360 31493 ts_tablet_manager.cc:1434] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:20:58.571535 31493 tablet_bootstrap.cc:492] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4: Bootstrap starting.
I20260709 12:20:58.579373 31493 tablet_bootstrap.cc:654] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.579373 31492 tablet_bootstrap.cc:654] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.564287 31200 catalog_manager.cc:5697] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc reported cstate change: term changed from 0 to 1, leader changed from <none> to ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1). New cstate: current_term: 1 leader_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:58.583706 31494 tablet_bootstrap.cc:492] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc: No bootstrap required, opened a new log
I20260709 12:20:58.584239 31494 ts_tablet_manager.cc:1403] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.003s
I20260709 12:20:58.587250 31494 raft_consensus.cc:359] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.587989 31494 raft_consensus.cc:385] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.588270 31494 raft_consensus.cc:740] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.589226 31499 raft_consensus.cc:493] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.588982 31494 consensus_queue.cc:260] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.589727 31499 raft_consensus.cc:515] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.591583 31494 ts_tablet_manager.cc:1434] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:58.591917 31499 leader_election.cc:290] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:20:58.592664 31494 tablet_bootstrap.cc:492] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:20:58.593662 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cd3429d1d442d586b729a487b800c0" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" is_pre_election: true
I20260709 12:20:58.593943 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cd3429d1d442d586b729a487b800c0" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4" is_pre_election: true
W20260709 12:20:58.595584 31267 leader_election.cc:343] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:58.596186 31268 leader_election.cc:343] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:58.596640 31268 leader_election.cc:304] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba1cb7ff4d4340b3a277621adcad9fbc; no voters: 8681be3c8e024edda6eb16ccb8bf7ac0, c109dd3c635648459f4b8b39e11bc4d4
I20260709 12:20:58.597837 31499 raft_consensus.cc:2749] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:58.599834 31494 tablet_bootstrap.cc:654] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.601891 31493 tablet_bootstrap.cc:492] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4: No bootstrap required, opened a new log
I20260709 12:20:58.602461 31492 tablet_bootstrap.cc:492] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0: No bootstrap required, opened a new log
I20260709 12:20:58.602578 31493 ts_tablet_manager.cc:1403] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.008s
I20260709 12:20:58.603092 31492 ts_tablet_manager.cc:1403] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.004s
I20260709 12:20:58.606217 31493 raft_consensus.cc:359] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.606534 31492 raft_consensus.cc:359] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.607102 31493 raft_consensus.cc:385] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.607513 31492 raft_consensus.cc:385] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.607736 31493 raft_consensus.cc:740] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.608268 31492 raft_consensus.cc:740] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.609122 31493 consensus_queue.cc:260] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.609192 31492 consensus_queue.cc:260] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.614774 31515 raft_consensus.cc:493] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.615468 31515 raft_consensus.cc:515] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.614722 31494 tablet_bootstrap.cc:492] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc: No bootstrap required, opened a new log
I20260709 12:20:58.616534 31494 ts_tablet_manager.cc:1403] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.008s
I20260709 12:20:58.616948 31492 ts_tablet_manager.cc:1434] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 12:20:58.618116 31492 tablet_bootstrap.cc:492] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0: Bootstrap starting.
I20260709 12:20:58.619903 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" is_pre_election: true
I20260709 12:20:58.619665 31494 raft_consensus.cc:359] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.616384 31493 ts_tablet_manager.cc:1434] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
W20260709 12:20:58.621436 31343 leader_election.cc:343] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:58.620464 31494 raft_consensus.cc:385] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.621977 31494 raft_consensus.cc:740] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.622364 31303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" is_pre_election: true
I20260709 12:20:58.622875 31494 consensus_queue.cc:260] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
W20260709 12:20:58.623791 31342 leader_election.cc:343] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:58.624274 31342 leader_election.cc:304] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c109dd3c635648459f4b8b39e11bc4d4; no voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc
I20260709 12:20:58.625432 31494 ts_tablet_manager.cc:1434] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:20:58.625470 31498 raft_consensus.cc:2749] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:58.625798 31515 leader_election.cc:290] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:20:58.626633 31494 tablet_bootstrap.cc:492] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:20:58.621464 31493 tablet_bootstrap.cc:492] T 6d66a37a6c894ba7ab6a17172f04740c P c109dd3c635648459f4b8b39e11bc4d4: Bootstrap starting.
I20260709 12:20:58.627079 31492 tablet_bootstrap.cc:654] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.633559 31494 tablet_bootstrap.cc:654] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.633563 31493 tablet_bootstrap.cc:654] T 6d66a37a6c894ba7ab6a17172f04740c P c109dd3c635648459f4b8b39e11bc4d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.643488 31499 raft_consensus.cc:493] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.644070 31499 raft_consensus.cc:515] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.646216 31492 tablet_bootstrap.cc:492] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0: No bootstrap required, opened a new log
I20260709 12:20:58.646824 31492 ts_tablet_manager.cc:1403] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.014s
I20260709 12:20:58.647567 31499 leader_election.cc:290] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:20:58.649226 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e029757f2e4b11abdb36a95b2fd7dc" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" is_pre_election: true
I20260709 12:20:58.650020 31452 raft_consensus.cc:2468] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba1cb7ff4d4340b3a277621adcad9fbc in term 0.
I20260709 12:20:58.651371 31268 leader_election.cc:304] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc; no voters: 
I20260709 12:20:58.652261 31499 raft_consensus.cc:2804] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:58.652675 31499 raft_consensus.cc:493] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.653049 31499 raft_consensus.cc:3060] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.647006 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e029757f2e4b11abdb36a95b2fd7dc" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4" is_pre_election: true
I20260709 12:20:58.654433 31377 raft_consensus.cc:2468] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba1cb7ff4d4340b3a277621adcad9fbc in term 0.
I20260709 12:20:58.660737 31499 raft_consensus.cc:515] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.664428 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e029757f2e4b11abdb36a95b2fd7dc" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
I20260709 12:20:58.664645 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e029757f2e4b11abdb36a95b2fd7dc" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
I20260709 12:20:58.665005 31377 raft_consensus.cc:3060] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.665174 31452 raft_consensus.cc:3060] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.672237 31452 raft_consensus.cc:2468] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba1cb7ff4d4340b3a277621adcad9fbc in term 1.
I20260709 12:20:58.673480 31268 leader_election.cc:304] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc; no voters: 
I20260709 12:20:58.674358 31500 raft_consensus.cc:2804] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:58.674804 31500 raft_consensus.cc:697] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 LEADER]: Becoming Leader. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Running, Role: LEADER
I20260709 12:20:58.675148 31377 raft_consensus.cc:2468] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba1cb7ff4d4340b3a277621adcad9fbc in term 1.
I20260709 12:20:58.675598 31500 consensus_queue.cc:237] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.650020 31492 raft_consensus.cc:359] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.677876 31492 raft_consensus.cc:385] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.678305 31492 raft_consensus.cc:740] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.679375 31492 consensus_queue.cc:260] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.680310 31493 tablet_bootstrap.cc:492] T 6d66a37a6c894ba7ab6a17172f04740c P c109dd3c635648459f4b8b39e11bc4d4: No bootstrap required, opened a new log
I20260709 12:20:58.680976 31493 ts_tablet_manager.cc:1403] T 6d66a37a6c894ba7ab6a17172f04740c P c109dd3c635648459f4b8b39e11bc4d4: Time spent bootstrapping tablet: real 0.060s	user 0.004s	sys 0.039s
I20260709 12:20:58.684450 31493 raft_consensus.cc:359] T 6d66a37a6c894ba7ab6a17172f04740c P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.685302 31493 raft_consensus.cc:385] T 6d66a37a6c894ba7ab6a17172f04740c P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.685601 31493 raft_consensus.cc:740] T 6d66a37a6c894ba7ab6a17172f04740c P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.687062 31501 raft_consensus.cc:493] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.687690 31501 raft_consensus.cc:515] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.688191 31493 consensus_queue.cc:260] T 6d66a37a6c894ba7ab6a17172f04740c P c109dd3c635648459f4b8b39e11bc4d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.690454 31501 leader_election.cc:290] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:20:58.695367 31499 leader_election.cc:290] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 election: Requested vote from peers c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:20:58.696329 31494 tablet_bootstrap.cc:492] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc: No bootstrap required, opened a new log
I20260709 12:20:58.696981 31494 ts_tablet_manager.cc:1403] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.071s	user 0.040s	sys 0.022s
I20260709 12:20:58.690891 31493 ts_tablet_manager.cc:1434] T 6d66a37a6c894ba7ab6a17172f04740c P c109dd3c635648459f4b8b39e11bc4d4: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:20:58.693148 31492 ts_tablet_manager.cc:1434] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 12:20:58.699755 31201 catalog_manager.cc:5697] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc reported cstate change: term changed from 0 to 1, leader changed from <none> to ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1). New cstate: current_term: 1 leader_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:58.701987 31493 tablet_bootstrap.cc:492] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4: Bootstrap starting.
I20260709 12:20:58.704200 31494 raft_consensus.cc:359] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.706141 31494 raft_consensus.cc:385] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.706459 31494 raft_consensus.cc:740] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.707264 31494 consensus_queue.cc:260] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.712399 31493 tablet_bootstrap.cc:654] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.712589 31494 ts_tablet_manager.cc:1434] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:20:58.713692 31494 tablet_bootstrap.cc:492] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:20:58.720439 31492 tablet_bootstrap.cc:492] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0: Bootstrap starting.
I20260709 12:20:58.724011 31303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f58a2613aa49eca2e2df2436ae93aa" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" is_pre_election: true
I20260709 12:20:58.724846 31303 raft_consensus.cc:2468] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 0.
I20260709 12:20:58.725790 31494 tablet_bootstrap.cc:654] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.726310 31416 leader_election.cc:304] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc; no voters: 
I20260709 12:20:58.727231 31501 raft_consensus.cc:2804] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:58.727626 31501 raft_consensus.cc:493] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.727964 31501 raft_consensus.cc:3060] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.730652 31492 tablet_bootstrap.cc:654] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.738137 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f58a2613aa49eca2e2df2436ae93aa" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4" is_pre_election: true
I20260709 12:20:58.736891 31501 raft_consensus.cc:515] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
W20260709 12:20:58.739882 31416 leader_election.cc:343] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:58.743155 31303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f58a2613aa49eca2e2df2436ae93aa" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:20:58.743880 31303 raft_consensus.cc:3060] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.744252 31493 tablet_bootstrap.cc:492] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4: No bootstrap required, opened a new log
I20260709 12:20:58.744916 31493 ts_tablet_manager.cc:1403] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.007s
I20260709 12:20:58.748126 31493 raft_consensus.cc:359] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.748939 31493 raft_consensus.cc:385] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.749209 31493 raft_consensus.cc:740] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.749933 31501 leader_election.cc:290] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:20:58.750976 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f58a2613aa49eca2e2df2436ae93aa" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
I20260709 12:20:58.756660 31493 consensus_queue.cc:260] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.759064 31493 ts_tablet_manager.cc:1434] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:20:58.759516 31303 raft_consensus.cc:2468] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 1.
W20260709 12:20:58.760411 31416 leader_election.cc:343] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:58.760666 31499 raft_consensus.cc:493] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.760130 31493 tablet_bootstrap.cc:492] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4: Bootstrap starting.
I20260709 12:20:58.761178 31499 raft_consensus.cc:515] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.761442 31416 leader_election.cc:304] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc; no voters: c109dd3c635648459f4b8b39e11bc4d4
I20260709 12:20:58.764039 31494 tablet_bootstrap.cc:492] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc: No bootstrap required, opened a new log
I20260709 12:20:58.764617 31494 ts_tablet_manager.cc:1403] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.021s
I20260709 12:20:58.766808 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c823555de1945e5827161b0499a00d9" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4" is_pre_election: true
I20260709 12:20:58.767565 31377 raft_consensus.cc:2468] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba1cb7ff4d4340b3a277621adcad9fbc in term 0.
I20260709 12:20:58.767874 31492 tablet_bootstrap.cc:492] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0: No bootstrap required, opened a new log
I20260709 12:20:58.768167 31501 raft_consensus.cc:2804] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:58.768455 31492 ts_tablet_manager.cc:1403] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.020s
I20260709 12:20:58.768834 31493 tablet_bootstrap.cc:654] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.768733 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c823555de1945e5827161b0499a00d9" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" is_pre_election: true
W20260709 12:20:58.771322 31268 leader_election.cc:343] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:58.771755 31492 raft_consensus.cc:359] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } } peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } }
I20260709 12:20:58.767776 31494 raft_consensus.cc:359] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.772687 31267 leader_election.cc:304] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba1cb7ff4d4340b3a277621adcad9fbc, c109dd3c635648459f4b8b39e11bc4d4; no voters: 8681be3c8e024edda6eb16ccb8bf7ac0
I20260709 12:20:58.773152 31494 raft_consensus.cc:385] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.773480 31494 raft_consensus.cc:740] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.763948 31499 leader_election.cc:290] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:20:58.773896 31500 raft_consensus.cc:2804] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:58.774427 31500 raft_consensus.cc:493] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.774277 31494 consensus_queue.cc:260] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.774876 31500 raft_consensus.cc:3060] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.779794 31494 ts_tablet_manager.cc:1434] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:20:58.780884 31494 tablet_bootstrap.cc:492] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:20:58.783578 31500 raft_consensus.cc:515] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.772670 31492 raft_consensus.cc:385] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.786209 31492 raft_consensus.cc:740] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.787256 31492 consensus_queue.cc:260] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } } peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } }
I20260709 12:20:58.787640 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c823555de1945e5827161b0499a00d9" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
I20260709 12:20:58.788359 31377 raft_consensus.cc:3060] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.790627 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c823555de1945e5827161b0499a00d9" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
W20260709 12:20:58.792418 31268 leader_election.cc:343] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:58.793088 31500 leader_election.cc:290] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 election: Requested vote from peers c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:20:58.793546 31494 tablet_bootstrap.cc:654] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.802179 31492 ts_tablet_manager.cc:1434] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.005s
I20260709 12:20:58.808203 31501 raft_consensus.cc:697] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 LEADER]: Becoming Leader. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:20:58.808929 31492 tablet_bootstrap.cc:492] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0: Bootstrap starting.
I20260709 12:20:58.809240 31501 consensus_queue.cc:237] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.809695 31515 raft_consensus.cc:493] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.810246 31515 raft_consensus.cc:515] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.810745 31493 tablet_bootstrap.cc:492] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4: No bootstrap required, opened a new log
I20260709 12:20:58.811257 31493 ts_tablet_manager.cc:1403] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.024s
I20260709 12:20:58.812345 31515 leader_election.cc:290] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:20:58.814260 31303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9c407a3aed46b69eb4b4c875adc6b4" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" is_pre_election: true
I20260709 12:20:58.814230 31493 raft_consensus.cc:359] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.814992 31493 raft_consensus.cc:385] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.815261 31493 raft_consensus.cc:740] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.815219 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9c407a3aed46b69eb4b4c875adc6b4" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" is_pre_election: true
W20260709 12:20:58.815985 31342 leader_election.cc:343] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:58.816165 31452 raft_consensus.cc:2468] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 0.
I20260709 12:20:58.816288 31493 consensus_queue.cc:260] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.817852 31343 leader_election.cc:304] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, c109dd3c635648459f4b8b39e11bc4d4; no voters: ba1cb7ff4d4340b3a277621adcad9fbc
I20260709 12:20:58.818485 31493 ts_tablet_manager.cc:1434] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:58.819515 31493 tablet_bootstrap.cc:492] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4: Bootstrap starting.
I20260709 12:20:58.820523 31492 tablet_bootstrap.cc:654] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.821528 31499 raft_consensus.cc:493] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.822141 31499 raft_consensus.cc:515] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.819547 31498 raft_consensus.cc:2804] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:58.823378 31498 raft_consensus.cc:493] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.823740 31498 raft_consensus.cc:3060] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.825328 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4" is_pre_election: true
I20260709 12:20:58.825618 31493 tablet_bootstrap.cc:654] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.826064 31378 raft_consensus.cc:2468] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba1cb7ff4d4340b3a277621adcad9fbc in term 0.
I20260709 12:20:58.827527 31267 leader_election.cc:304] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba1cb7ff4d4340b3a277621adcad9fbc, c109dd3c635648459f4b8b39e11bc4d4; no voters: 
I20260709 12:20:58.828425 31500 raft_consensus.cc:2804] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:58.828814 31500 raft_consensus.cc:493] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.829161 31500 raft_consensus.cc:3060] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.837360 31377 raft_consensus.cc:2468] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba1cb7ff4d4340b3a277621adcad9fbc in term 1.
I20260709 12:20:58.838810 31499 leader_election.cc:290] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:20:58.840538 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" is_pre_election: true
W20260709 12:20:58.842281 31268 leader_election.cc:343] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:58.838934 31267 leader_election.cc:304] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba1cb7ff4d4340b3a277621adcad9fbc, c109dd3c635648459f4b8b39e11bc4d4; no voters: 8681be3c8e024edda6eb16ccb8bf7ac0
I20260709 12:20:58.844960 31499 raft_consensus.cc:2804] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:58.846402 31499 raft_consensus.cc:697] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 LEADER]: Becoming Leader. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Running, Role: LEADER
I20260709 12:20:58.847342 31499 consensus_queue.cc:237] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.851157 31498 raft_consensus.cc:515] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.854841 31303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9c407a3aed46b69eb4b4c875adc6b4" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:20:58.854925 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9c407a3aed46b69eb4b4c875adc6b4" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
I20260709 12:20:58.855656 31452 raft_consensus.cc:3060] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:58.856791 31342 leader_election.cc:343] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:58.863996 31452 raft_consensus.cc:2468] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 1.
I20260709 12:20:58.865535 31343 leader_election.cc:304] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, c109dd3c635648459f4b8b39e11bc4d4; no voters: ba1cb7ff4d4340b3a277621adcad9fbc
I20260709 12:20:58.866571 31515 raft_consensus.cc:2804] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:58.874342 31498 leader_election.cc:290] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:20:58.871714 31500 raft_consensus.cc:515] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.883672 31493 tablet_bootstrap.cc:492] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4: No bootstrap required, opened a new log
I20260709 12:20:58.884219 31493 ts_tablet_manager.cc:1403] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4: Time spent bootstrapping tablet: real 0.065s	user 0.024s	sys 0.035s
I20260709 12:20:58.884747 31492 tablet_bootstrap.cc:492] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0: No bootstrap required, opened a new log
I20260709 12:20:58.885233 31492 ts_tablet_manager.cc:1403] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent bootstrapping tablet: real 0.077s	user 0.021s	sys 0.021s
I20260709 12:20:58.886984 31493 raft_consensus.cc:359] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.887461 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
I20260709 12:20:58.887745 31493 raft_consensus.cc:385] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.887821 31492 raft_consensus.cc:359] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.888370 31493 raft_consensus.cc:740] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.888717 31492 raft_consensus.cc:385] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:20:58.889060 31268 leader_election.cc:343] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:58.889153 31492 raft_consensus.cc:740] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.889183 31493 consensus_queue.cc:260] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.888314 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
I20260709 12:20:58.887729 31200 catalog_manager.cc:5697] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:58.890547 31500 leader_election.cc:290] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 election: Requested vote from peers c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:20:58.890678 31377 raft_consensus.cc:3060] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.891527 31493 ts_tablet_manager.cc:1434] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:58.880501 31515 raft_consensus.cc:697] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 LEADER]: Becoming Leader. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:20:58.890095 31492 consensus_queue.cc:260] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.895267 31494 tablet_bootstrap.cc:492] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc: No bootstrap required, opened a new log
I20260709 12:20:58.895830 31492 ts_tablet_manager.cc:1434] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:20:58.895852 31494 ts_tablet_manager.cc:1403] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.115s	user 0.013s	sys 0.034s
I20260709 12:20:58.897019 31492 tablet_bootstrap.cc:492] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0: Bootstrap starting.
I20260709 12:20:58.898171 31515 consensus_queue.cc:237] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.898914 31494 raft_consensus.cc:359] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.899593 31494 raft_consensus.cc:385] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.899966 31494 raft_consensus.cc:740] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.897635 31501 raft_consensus.cc:493] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.900868 31494 consensus_queue.cc:260] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.901468 31501 raft_consensus.cc:515] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } } peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } }
I20260709 12:20:58.902176 31500 raft_consensus.cc:493] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.902606 31500 raft_consensus.cc:515] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.903151 31492 tablet_bootstrap.cc:654] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:58.903369 31478 tablet.cc:2406] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:20:58.904691 31377 raft_consensus.cc:2468] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba1cb7ff4d4340b3a277621adcad9fbc in term 1.
I20260709 12:20:58.904865 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa55de36bac74222b2a8fd30d864f1d7" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4" is_pre_election: true
I20260709 12:20:58.905498 31378 raft_consensus.cc:2468] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 0.
I20260709 12:20:58.906984 31303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa55de36bac74222b2a8fd30d864f1d7" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" is_pre_election: true
I20260709 12:20:58.907673 31303 raft_consensus.cc:2468] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 0.
I20260709 12:20:58.909709 31267 leader_election.cc:304] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba1cb7ff4d4340b3a277621adcad9fbc, c109dd3c635648459f4b8b39e11bc4d4; no voters: 8681be3c8e024edda6eb16ccb8bf7ac0
I20260709 12:20:58.910665 31416 leader_election.cc:304] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc; no voters: 
I20260709 12:20:58.911720 31537 raft_consensus.cc:2804] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:58.912154 31537 raft_consensus.cc:493] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.912475 31537 raft_consensus.cc:3060] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.915216 31514 raft_consensus.cc:2804] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:58.916666 31535 raft_consensus.cc:493] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.917193 31535 raft_consensus.cc:515] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.918407 31201 catalog_manager.cc:5697] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc reported cstate change: term changed from 0 to 1, leader changed from <none> to ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1). New cstate: current_term: 1 leader_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:58.920387 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9c407a3aed46b69eb4b4c875adc6b4" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4" is_pre_election: true
I20260709 12:20:58.923921 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d66a37a6c894ba7ab6a17172f04740c" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4" is_pre_election: true
I20260709 12:20:58.924569 31378 raft_consensus.cc:2468] T 6d66a37a6c894ba7ab6a17172f04740c P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 0.
I20260709 12:20:58.926537 31303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d66a37a6c894ba7ab6a17172f04740c" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" is_pre_election: true
I20260709 12:20:58.927165 31303 raft_consensus.cc:2468] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 0.
I20260709 12:20:58.919401 31535 leader_election.cc:290] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:20:58.928434 31416 leader_election.cc:304] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, c109dd3c635648459f4b8b39e11bc4d4; no voters: 
I20260709 12:20:58.929378 31535 raft_consensus.cc:2804] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:58.929782 31535 raft_consensus.cc:493] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.930132 31535 raft_consensus.cc:3060] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.930224 31537 raft_consensus.cc:515] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } } peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } }
I20260709 12:20:58.932936 31537 leader_election.cc:290] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:20:58.930531 31514 raft_consensus.cc:697] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 LEADER]: Becoming Leader. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Running, Role: LEADER
I20260709 12:20:58.935277 31514 consensus_queue.cc:237] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.939769 31303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa55de36bac74222b2a8fd30d864f1d7" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:20:58.940479 31303 raft_consensus.cc:3060] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.942600 31201 catalog_manager.cc:5697] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:58.945152 31494 ts_tablet_manager.cc:1434] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.001s
I20260709 12:20:58.949720 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9c407a3aed46b69eb4b4c875adc6b4" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" is_pre_election: true
I20260709 12:20:58.905547 31501 leader_election.cc:290] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:20:58.950549 31452 raft_consensus.cc:2393] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba1cb7ff4d4340b3a277621adcad9fbc in current term 1: Already voted for candidate c109dd3c635648459f4b8b39e11bc4d4 in this term.
I20260709 12:20:58.945916 31500 leader_election.cc:290] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:20:58.946802 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa55de36bac74222b2a8fd30d864f1d7" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
I20260709 12:20:58.947438 31537 raft_consensus.cc:493] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.951570 31494 tablet_bootstrap.cc:492] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:20:58.951851 31537 raft_consensus.cc:515] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.951588 31377 raft_consensus.cc:3060] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.956259 31268 leader_election.cc:304] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba1cb7ff4d4340b3a277621adcad9fbc; no voters: 8681be3c8e024edda6eb16ccb8bf7ac0, c109dd3c635648459f4b8b39e11bc4d4
I20260709 12:20:58.957587 31500 raft_consensus.cc:3060] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.957962 31515 raft_consensus.cc:493] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.958454 31515 raft_consensus.cc:515] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.961745 31515 leader_election.cc:290] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:20:58.962946 31494 tablet_bootstrap.cc:654] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:58.963166 31451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08604d1cb7384c1e85b7928e9ef4fcbb" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" is_pre_election: true
I20260709 12:20:58.965709 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cd3429d1d442d586b729a487b800c0" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4" is_pre_election: true
I20260709 12:20:58.966236 31451 raft_consensus.cc:2468] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 0.
I20260709 12:20:58.961663 31302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08604d1cb7384c1e85b7928e9ef4fcbb" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" is_pre_election: true
I20260709 12:20:58.966459 31378 raft_consensus.cc:2468] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 0.
W20260709 12:20:58.967758 31342 leader_election.cc:343] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:58.967792 31416 leader_election.cc:304] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, c109dd3c635648459f4b8b39e11bc4d4; no voters: 
I20260709 12:20:58.948078 31546 consensus_queue.cc:1048] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:20:58.968849 31501 raft_consensus.cc:2804] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:58.969269 31501 raft_consensus.cc:493] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.969712 31501 raft_consensus.cc:3060] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.973243 31492 tablet_bootstrap.cc:492] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0: No bootstrap required, opened a new log
I20260709 12:20:58.973937 31492 ts_tablet_manager.cc:1403] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent bootstrapping tablet: real 0.077s	user 0.031s	sys 0.032s
I20260709 12:20:58.977295 31492 raft_consensus.cc:359] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.978120 31492 raft_consensus.cc:385] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.978405 31492 raft_consensus.cc:740] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.979056 31501 raft_consensus.cc:515] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.979287 31492 consensus_queue.cc:260] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.949018 31535 raft_consensus.cc:515] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.983349 31535 leader_election.cc:290] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:20:58.964556 31537 leader_election.cc:290] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:20:58.965251 31377 raft_consensus.cc:2468] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 1.
I20260709 12:20:58.985684 31302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cd3429d1d442d586b729a487b800c0" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" is_pre_election: true
I20260709 12:20:58.986433 31302 raft_consensus.cc:2468] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 0.
I20260709 12:20:58.986955 31343 leader_election.cc:304] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, c109dd3c635648459f4b8b39e11bc4d4; no voters: ba1cb7ff4d4340b3a277621adcad9fbc
I20260709 12:20:58.987978 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d66a37a6c894ba7ab6a17172f04740c" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
I20260709 12:20:58.988298 31515 raft_consensus.cc:2804] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:58.983376 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cd3429d1d442d586b729a487b800c0" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
I20260709 12:20:58.988878 31515 raft_consensus.cc:493] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.989320 31515 raft_consensus.cc:3060] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.989687 31378 raft_consensus.cc:3060] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.990355 31301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d66a37a6c894ba7ab6a17172f04740c" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:20:58.990981 31301 raft_consensus.cc:3060] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.992789 31302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cd3429d1d442d586b729a487b800c0" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:20:58.993376 31302 raft_consensus.cc:3060] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.994627 31416 leader_election.cc:304] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, c109dd3c635648459f4b8b39e11bc4d4; no voters: 
I20260709 12:20:58.996058 31537 raft_consensus.cc:2804] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:58.996495 31537 raft_consensus.cc:697] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 LEADER]: Becoming Leader. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:20:58.997304 31537 consensus_queue.cc:237] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } } peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } }
I20260709 12:20:58.998080 31515 raft_consensus.cc:515] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:58.989188 31377 raft_consensus.cc:3060] T 6d66a37a6c894ba7ab6a17172f04740c P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:59.001521 31300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08604d1cb7384c1e85b7928e9ef4fcbb" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
W20260709 12:20:59.003345 31342 leader_election.cc:343] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:59.004079 31301 raft_consensus.cc:2468] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 1.
I20260709 12:20:59.008827 31377 raft_consensus.cc:2468] T 6d66a37a6c894ba7ab6a17172f04740c P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 1.
I20260709 12:20:59.009703 31451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08604d1cb7384c1e85b7928e9ef4fcbb" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
I20260709 12:20:59.010221 31200 catalog_manager.cc:5697] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc reported cstate change: term changed from 0 to 1, leader changed from <none> to ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1). New cstate: current_term: 1 leader_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:59.011911 31515 leader_election.cc:290] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:20:59.018780 31416 leader_election.cc:304] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc; no voters: 
I20260709 12:20:59.027159 31535 raft_consensus.cc:2804] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:59.027637 31535 raft_consensus.cc:697] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 LEADER]: Becoming Leader. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:20:59.028544 31535 consensus_queue.cc:237] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:59.017618 31500 raft_consensus.cc:2749] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:59.022032 31451 raft_consensus.cc:3060] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:59.024919 31303 raft_consensus.cc:2468] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 1.
I20260709 12:20:59.043044 31451 raft_consensus.cc:2468] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 1.
I20260709 12:20:59.025417 31302 raft_consensus.cc:2468] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 1.
I20260709 12:20:59.044273 31343 leader_election.cc:304] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, c109dd3c635648459f4b8b39e11bc4d4; no voters: ba1cb7ff4d4340b3a277621adcad9fbc
I20260709 12:20:59.045656 31515 raft_consensus.cc:2804] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:59.045625 31416 leader_election.cc:304] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc; no voters: 
I20260709 12:20:59.046347 31515 raft_consensus.cc:697] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 1 LEADER]: Becoming Leader. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:20:59.021387 31378 raft_consensus.cc:2468] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 1.
I20260709 12:20:59.047488 31515 consensus_queue.cc:237] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:59.052721 31535 raft_consensus.cc:2804] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:59.053285 31535 raft_consensus.cc:697] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 LEADER]: Becoming Leader. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:20:59.054177 31535 consensus_queue.cc:237] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:59.024812 31501 leader_election.cc:290] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:20:59.074450 31492 ts_tablet_manager.cc:1434] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent starting tablet: real 0.100s	user 0.022s	sys 0.038s
I20260709 12:20:59.075577 31492 tablet_bootstrap.cc:492] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0: Bootstrap starting.
I20260709 12:20:59.075493 31494 tablet_bootstrap.cc:492] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc: No bootstrap required, opened a new log
I20260709 12:20:59.077641 31494 ts_tablet_manager.cc:1403] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.126s	user 0.043s	sys 0.060s
I20260709 12:20:59.078161 31200 catalog_manager.cc:5697] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:59.080368 31494 raft_consensus.cc:359] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:59.081254 31494 raft_consensus.cc:385] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:59.081553 31494 raft_consensus.cc:740] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:20:59.081965 31492 tablet_bootstrap.cc:654] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:59.082366 31494 consensus_queue.cc:260] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:59.084733 31494 ts_tablet_manager.cc:1434] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:20:59.093159 31492 tablet_bootstrap.cc:492] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0: No bootstrap required, opened a new log
I20260709 12:20:59.093732 31492 ts_tablet_manager.cc:1403] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:20:59.097319 31492 raft_consensus.cc:359] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:59.098068 31492 raft_consensus.cc:385] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:59.099620 31492 raft_consensus.cc:740] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Initialized, Role: FOLLOWER
I20260709 12:20:59.101207 31492 consensus_queue.cc:260] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:59.101460 31500 consensus_queue.cc:1048] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:59.103703 31492 ts_tablet_manager.cc:1434] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:20:59.105387 31201 catalog_manager.cc:5697] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:59.111119 31199 catalog_manager.cc:5697] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:59.112805 31199 catalog_manager.cc:5697] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:59.119508 31500 consensus_queue.cc:1048] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:59.131243 31499 consensus_queue.cc:1048] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:59.235069 31549 consensus_queue.cc:1048] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:59.241730 31499 raft_consensus.cc:493] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.242264 31499 raft_consensus.cc:515] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:59.244436 31499 leader_election.cc:290] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:20:59.245153 31378 raft_consensus.cc:3060] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:59.246527 31451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08604d1cb7384c1e85b7928e9ef4fcbb" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" is_pre_election: true
I20260709 12:20:59.246616 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08604d1cb7384c1e85b7928e9ef4fcbb" candidate_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4" is_pre_election: true
I20260709 12:20:59.247443 31451 raft_consensus.cc:2393] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba1cb7ff4d4340b3a277621adcad9fbc in current term 1: Already voted for candidate c109dd3c635648459f4b8b39e11bc4d4 in this term.
I20260709 12:20:59.248823 31267 leader_election.cc:304] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba1cb7ff4d4340b3a277621adcad9fbc; no voters: 8681be3c8e024edda6eb16ccb8bf7ac0, c109dd3c635648459f4b8b39e11bc4d4
I20260709 12:20:59.249644 31546 raft_consensus.cc:3060] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:59.255172 21244 ts_manager.cc:295] Set tserver state for ba1cb7ff4d4340b3a277621adcad9fbc to MAINTENANCE_MODE
I20260709 12:20:59.256075 21244 tablet_server.cc:179] TabletServer@127.20.191.1:0 shutting down...
I20260709 12:20:59.257038 31546 raft_consensus.cc:2749] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:59.259220 31537 consensus_queue.cc:1048] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:59.289249 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:59.291337 21244 tablet_replica.cc:333] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc: stopping tablet replica
I20260709 12:20:59.292048 21244 raft_consensus.cc:2243] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.292557 21244 raft_consensus.cc:2272] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.295444 21244 tablet_replica.cc:333] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc: stopping tablet replica
I20260709 12:20:59.296236 21244 raft_consensus.cc:2243] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.296691 21244 raft_consensus.cc:2272] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.299130 21244 tablet_replica.cc:333] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc: stopping tablet replica
I20260709 12:20:59.299926 21244 raft_consensus.cc:2243] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.300384 21244 raft_consensus.cc:2272] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.302350 21244 tablet_replica.cc:333] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc: stopping tablet replica
I20260709 12:20:59.302892 21244 raft_consensus.cc:2243] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:59.303880 21244 pending_rounds.cc:70] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc: Trying to abort 1 pending ops.
I20260709 12:20:59.304117 21244 pending_rounds.cc:77] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305624203008323584 op_type: NO_OP noop_request { }
I20260709 12:20:59.304438 21244 raft_consensus.cc:2889] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:59.304731 21244 raft_consensus.cc:2272] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.306962 21244 tablet_replica.cc:333] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc: stopping tablet replica
I20260709 12:20:59.307603 21244 raft_consensus.cc:2243] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:59.308473 21244 raft_consensus.cc:2272] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.310824 21244 tablet_replica.cc:333] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc: stopping tablet replica
I20260709 12:20:59.311419 21244 raft_consensus.cc:2243] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:59.312091 21244 pending_rounds.cc:70] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc: Trying to abort 1 pending ops.
I20260709 12:20:59.312263 21244 pending_rounds.cc:77] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305624202744954880 op_type: NO_OP noop_request { }
I20260709 12:20:59.312554 21244 raft_consensus.cc:2889] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:59.312829 21244 raft_consensus.cc:2272] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.315522 21244 tablet_replica.cc:333] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc: stopping tablet replica
I20260709 12:20:59.316195 21244 raft_consensus.cc:2243] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:59.317128 21244 raft_consensus.cc:2272] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.319659 21244 tablet_replica.cc:333] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc: stopping tablet replica
I20260709 12:20:59.320253 21244 raft_consensus.cc:2243] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.320641 21244 raft_consensus.cc:2272] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.322445 21244 tablet_replica.cc:333] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc: stopping tablet replica
I20260709 12:20:59.322933 21244 raft_consensus.cc:2243] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.323318 21244 raft_consensus.cc:2272] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.325132 21244 tablet_replica.cc:333] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc: stopping tablet replica
I20260709 12:20:59.325589 21244 raft_consensus.cc:2243] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.326036 21244 raft_consensus.cc:2272] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:59.353084 31342 consensus_peers.cc:597] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.356493 21244 tablet_server.cc:196] TabletServer@127.20.191.1:0 shutdown complete.
I20260709 12:20:59.356648 31537 raft_consensus.cc:493] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.357329 31537 raft_consensus.cc:515] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:59.359164 31537 leader_election.cc:290] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:20:59.361598 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c823555de1945e5827161b0499a00d9" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4" is_pre_election: true
I20260709 12:20:59.362538 31378 raft_consensus.cc:2393] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in current term 1: Already voted for candidate ba1cb7ff4d4340b3a277621adcad9fbc in this term.
W20260709 12:20:59.364701 31416 leader_election.cc:336] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111)
I20260709 12:20:59.365163 31416 leader_election.cc:304] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0; no voters: ba1cb7ff4d4340b3a277621adcad9fbc, c109dd3c635648459f4b8b39e11bc4d4
I20260709 12:20:59.365960 31537 raft_consensus.cc:3060] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:59.371409 31537 raft_consensus.cc:2749] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:59.396066 31537 consensus_queue.cc:1048] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:59.405990 31501 raft_consensus.cc:493] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.406504 31501 raft_consensus.cc:515] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:20:59.408805 31501 leader_election.cc:290] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:20:59.412801 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4" is_pre_election: true
W20260709 12:20:59.413162 31416 consensus_peers.cc:597] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.413868 31378 raft_consensus.cc:2393] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in current term 1: Already voted for candidate ba1cb7ff4d4340b3a277621adcad9fbc in this term.
W20260709 12:20:59.415778 31416 leader_election.cc:336] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111)
I20260709 12:20:59.416193 31416 leader_election.cc:304] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0; no voters: ba1cb7ff4d4340b3a277621adcad9fbc, c109dd3c635648459f4b8b39e11bc4d4
I20260709 12:20:59.417047 31535 raft_consensus.cc:3060] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:59.423348 31535 raft_consensus.cc:2749] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:59.447129 31416 consensus_peers.cc:597] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.504402 31515 consensus_queue.cc:1048] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:20:59.506562 31248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:20:59.521505 31342 consensus_peers.cc:597] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:59.533041 31416 consensus_peers.cc:597] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.610946 31515 consensus_queue.cc:1048] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:59.627316 31535 consensus_queue.cc:1048] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:59.651791 31535 consensus_queue.cc:1048] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:20:59.836894 31416 consensus_peers.cc:597] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:00.507609 31248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:21:00.587041 31515 raft_consensus.cc:493] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba1cb7ff4d4340b3a277621adcad9fbc)
I20260709 12:21:00.587617 31515 raft_consensus.cc:515] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:00.589224 31515 leader_election.cc:290] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:21:00.590366 31451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" is_pre_election: true
W20260709 12:21:00.592769 31342 leader_election.cc:336] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111)
I20260709 12:21:00.593137 31342 leader_election.cc:304] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c109dd3c635648459f4b8b39e11bc4d4; no voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc
I20260709 12:21:00.593808 31515 raft_consensus.cc:2749] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:00.605978 31535 raft_consensus.cc:493] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba1cb7ff4d4340b3a277621adcad9fbc)
I20260709 12:21:00.606510 31535 raft_consensus.cc:515] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:00.608104 31535 leader_election.cc:290] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:21:00.609543 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4" is_pre_election: true
I20260709 12:21:00.610188 31378 raft_consensus.cc:2468] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 1.
I20260709 12:21:00.611354 31416 leader_election.cc:304] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, c109dd3c635648459f4b8b39e11bc4d4; no voters: 
W20260709 12:21:00.612036 31416 leader_election.cc:336] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111)
I20260709 12:21:00.612035 31535 raft_consensus.cc:2804] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:00.612672 31535 raft_consensus.cc:493] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ba1cb7ff4d4340b3a277621adcad9fbc)
I20260709 12:21:00.613063 31535 raft_consensus.cc:3060] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.618172 31535 raft_consensus.cc:515] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:00.620476 31535 leader_election.cc:290] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:21:00.623164 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
I20260709 12:21:00.624023 31378 raft_consensus.cc:3060] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:00.624810 31416 leader_election.cc:336] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111)
I20260709 12:21:00.629608 31378 raft_consensus.cc:2468] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 2.
I20260709 12:21:00.630734 31416 leader_election.cc:304] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, c109dd3c635648459f4b8b39e11bc4d4; no voters: ba1cb7ff4d4340b3a277621adcad9fbc
I20260709 12:21:00.630853 31515 raft_consensus.cc:493] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba1cb7ff4d4340b3a277621adcad9fbc)
I20260709 12:21:00.631439 31535 raft_consensus.cc:2804] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:00.631354 31515 raft_consensus.cc:515] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:00.631954 31535 raft_consensus.cc:697] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 LEADER]: Becoming Leader. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:21:00.632719 31535 consensus_queue.cc:237] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:00.633394 31515 leader_election.cc:290] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:21:00.634717 31451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e029757f2e4b11abdb36a95b2fd7dc" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" is_pre_election: true
I20260709 12:21:00.635428 31451 raft_consensus.cc:2468] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 1.
I20260709 12:21:00.635926 31501 raft_consensus.cc:493] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba1cb7ff4d4340b3a277621adcad9fbc)
I20260709 12:21:00.636410 31501 raft_consensus.cc:515] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:00.636900 31343 leader_election.cc:304] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, c109dd3c635648459f4b8b39e11bc4d4; no voters: 
I20260709 12:21:00.637969 31515 raft_consensus.cc:2804] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:00.638425 31515 raft_consensus.cc:493] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ba1cb7ff4d4340b3a277621adcad9fbc)
I20260709 12:21:00.638504 31501 leader_election.cc:290] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:21:00.638994 31515 raft_consensus.cc:3060] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.640595 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e029757f2e4b11abdb36a95b2fd7dc" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4" is_pre_election: true
W20260709 12:21:00.637821 31342 leader_election.cc:336] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111)
W20260709 12:21:00.644588 31416 leader_election.cc:336] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111)
I20260709 12:21:00.645334 31200 catalog_manager.cc:5697] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 reported cstate change: term changed from 1 to 2, leader changed from ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1) to 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3). New cstate: current_term: 2 leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:00.646842 31515 raft_consensus.cc:515] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:00.647977 31378 raft_consensus.cc:2393] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in current term 2: Already voted for candidate c109dd3c635648459f4b8b39e11bc4d4 in this term.
I20260709 12:21:00.650490 31451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e029757f2e4b11abdb36a95b2fd7dc" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
I20260709 12:21:00.651261 31416 leader_election.cc:304] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0; no voters: ba1cb7ff4d4340b3a277621adcad9fbc, c109dd3c635648459f4b8b39e11bc4d4
I20260709 12:21:00.651368 31451 raft_consensus.cc:3060] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.651891 31515 leader_election.cc:290] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
W20260709 12:21:00.654306 31342 leader_election.cc:336] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111)
I20260709 12:21:00.659461 31451 raft_consensus.cc:2468] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 2.
I20260709 12:21:00.660010 31535 raft_consensus.cc:2749] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:00.660830 31343 leader_election.cc:304] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, c109dd3c635648459f4b8b39e11bc4d4; no voters: ba1cb7ff4d4340b3a277621adcad9fbc
I20260709 12:21:00.661716 31515 raft_consensus.cc:2804] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:00.662812 31515 raft_consensus.cc:697] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Becoming Leader. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:21:00.663681 31515 consensus_queue.cc:237] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:00.670747 31200 catalog_manager.cc:5697] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 reported cstate change: term changed from 1 to 2, leader changed from ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1) to c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:00.693883 31416 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111) [suppressed 123 similar messages]
I20260709 12:21:01.017400 31378 raft_consensus.cc:1275] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Refusing update from remote peer 8681be3c8e024edda6eb16ccb8bf7ac0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:01.018607 31535 consensus_queue.cc:1048] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:01.032873 31416 consensus_peers.cc:597] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:01.036788 31515 raft_consensus.cc:493] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.037299 31515 raft_consensus.cc:515] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:01.038954 31515 leader_election.cc:290] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:21:01.040058 31451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c823555de1945e5827161b0499a00d9" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" is_pre_election: true
I20260709 12:21:01.040771 31451 raft_consensus.cc:2468] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 1.
I20260709 12:21:01.041751 31343 leader_election.cc:304] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, c109dd3c635648459f4b8b39e11bc4d4; no voters: 
W20260709 12:21:01.042433 31342 leader_election.cc:336] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111)
I20260709 12:21:01.042447 31515 raft_consensus.cc:2804] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:01.042872 31515 raft_consensus.cc:493] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.043134 31515 raft_consensus.cc:3060] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:01.048241 31515 raft_consensus.cc:515] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:01.049926 31515 leader_election.cc:290] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:21:01.051031 31451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c823555de1945e5827161b0499a00d9" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
I20260709 12:21:01.051715 31451 raft_consensus.cc:3060] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:01.053994 31342 leader_election.cc:336] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111)
I20260709 12:21:01.058105 31451 raft_consensus.cc:2468] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 2.
I20260709 12:21:01.059526 31343 leader_election.cc:304] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, c109dd3c635648459f4b8b39e11bc4d4; no voters: ba1cb7ff4d4340b3a277621adcad9fbc
I20260709 12:21:01.060673 31515 raft_consensus.cc:2804] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:01.061116 31515 raft_consensus.cc:697] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Becoming Leader. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:21:01.061934 31515 consensus_queue.cc:237] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:01.071031 31201 catalog_manager.cc:5697] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 reported cstate change: term changed from 1 to 2, leader changed from ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1) to c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:01.133860 31451 raft_consensus.cc:1275] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Refusing update from remote peer c109dd3c635648459f4b8b39e11bc4d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:01.135172 31515 consensus_queue.cc:1048] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:01.141438 31501 raft_consensus.cc:493] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.142000 31501 raft_consensus.cc:515] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:01.144507 31501 leader_election.cc:290] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:21:01.147603 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4" is_pre_election: true
I20260709 12:21:01.148375 31378 raft_consensus.cc:2468] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 1.
I20260709 12:21:01.150425 31416 leader_election.cc:304] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, c109dd3c635648459f4b8b39e11bc4d4; no voters: 
I20260709 12:21:01.151340 31535 raft_consensus.cc:2804] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:21:01.151394 31416 leader_election.cc:336] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111)
W20260709 12:21:01.151542 31342 consensus_peers.cc:597] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:01.151914 31535 raft_consensus.cc:493] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.152375 31535 raft_consensus.cc:3060] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:01.159881 31535 raft_consensus.cc:515] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:01.161593 31535 leader_election.cc:290] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:21:01.163012 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
I20260709 12:21:01.163678 31378 raft_consensus.cc:3060] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:01.164961 31416 leader_election.cc:336] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111)
I20260709 12:21:01.169181 31378 raft_consensus.cc:2468] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 2.
I20260709 12:21:01.170297 31416 leader_election.cc:304] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, c109dd3c635648459f4b8b39e11bc4d4; no voters: ba1cb7ff4d4340b3a277621adcad9fbc
I20260709 12:21:01.170990 31535 raft_consensus.cc:2804] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:01.171386 31535 raft_consensus.cc:697] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 LEADER]: Becoming Leader. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:21:01.172170 31535 consensus_queue.cc:237] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:01.178933 31200 catalog_manager.cc:5697] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 reported cstate change: term changed from 1 to 2, leader changed from ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1) to 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3). New cstate: current_term: 2 leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:01.491211 31451 raft_consensus.cc:1275] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Refusing update from remote peer c109dd3c635648459f4b8b39e11bc4d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:21:01.492601 31515 consensus_queue.cc:1048] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:01.508558 31248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:21:01.508925 31342 consensus_peers.cc:597] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:01.575152 31416 consensus_peers.cc:597] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:01.593508 31416 consensus_peers.cc:597] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:01.784106 31378 raft_consensus.cc:1275] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Refusing update from remote peer 8681be3c8e024edda6eb16ccb8bf7ac0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:21:01.785418 31535 consensus_queue.cc:1048] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:01.824568 31342 consensus_peers.cc:597] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:01.982656 31416 consensus_peers.cc:597] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:02.045747 31342 consensus_peers.cc:597] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:02.173653 31416 consensus_peers.cc:597] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:02.371827 31416 consensus_peers.cc:597] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:02.509619 31248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:21:03.458124 31416 consensus_peers.cc:597] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:03.510684 31248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:21:03.719805 31342 consensus_peers.cc:597] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:03.877946 31416 consensus_peers.cc:597] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:04.006500 31416 consensus_peers.cc:597] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:04.066295 31342 consensus_peers.cc:597] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:04.277422 31416 consensus_peers.cc:597] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:04.280164 31342 consensus_peers.cc:597] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:04.377873 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:04.384510 31594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:04.384919 31595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:04.386929 21244 server_base.cc:1061] running on GCE node
W20260709 12:21:04.387322 31597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:04.388212 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:04.388442 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:04.388615 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599664388597 us; error 0 us; skew 500 ppm
I20260709 12:21:04.389226 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:04.391754 21244 webserver.cc:533] Webserver started at http://127.20.191.1:39103/ using document root <none> and password file <none>
I20260709 12:21:04.392279 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:04.392453 21244 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:21:04.396790 21244 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:21:04.400679 31602 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:04.401594 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:21:04.401961 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-0-root
uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
format_stamp: "Formatted at 2026-07-09 12:20:57 on dist-test-slave-7c1h"
I20260709 12:21:04.402271 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599324869158-21244-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:04.420012 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:04.421132 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:04.422809 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:04.426787 31609 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:21:04.485407 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:21:04.485716 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.060s	user 0.003s	sys 0.000s
I20260709 12:21:04.486052 21244 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:21:04.491447 31609 tablet_bootstrap.cc:492] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:21:04.504555 31609 tablet_bootstrap.cc:492] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:21:04.505577 31609 tablet_bootstrap.cc:492] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap complete.
I20260709 12:21:04.506230 31609 ts_tablet_manager.cc:1403] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 12:21:04.508383 31609 raft_consensus.cc:359] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.509083 31609 raft_consensus.cc:740] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:21:04.509703 31609 consensus_queue.cc:260] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
W20260709 12:21:04.511837 31248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:21:04.512475 31609 ts_tablet_manager.cc:1434] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:21:04.513265 31609 tablet_bootstrap.cc:492] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:21:04.524649 31609 tablet_bootstrap.cc:492] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:04.527076 31609 tablet_bootstrap.cc:492] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap complete.
I20260709 12:21:04.529414 31609 ts_tablet_manager.cc:1403] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:21:04.532850 31609 raft_consensus.cc:359] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.533804 31609 raft_consensus.cc:740] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:21:04.534528 31609 consensus_queue.cc:260] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.535458 21244 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:21:04.535763 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.050s	user 0.048s	sys 0.000s
I20260709 12:21:04.536157 31609 ts_tablet_manager.cc:1434] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.002s
I20260709 12:21:04.537048 31609 tablet_bootstrap.cc:492] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
W20260709 12:21:04.552021 31342 consensus_peers.cc:597] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:04.559170 31609 tablet_bootstrap.cc:492] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:04.560272 31609 tablet_bootstrap.cc:492] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap complete.
I20260709 12:21:04.560899 31609 ts_tablet_manager.cc:1403] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.005s
I20260709 12:21:04.563508 31609 raft_consensus.cc:359] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.565256 31609 raft_consensus.cc:740] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:21:04.565992 31609 consensus_queue.cc:260] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.567925 31609 ts_tablet_manager.cc:1434] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 12:21:04.567898 31416 consensus_peers.cc:597] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:04.568926 31609 tablet_bootstrap.cc:492] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:21:04.585435 31609 tablet_bootstrap.cc:492] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:21:04.586440 31609 tablet_bootstrap.cc:492] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap complete.
I20260709 12:21:04.586977 31609 ts_tablet_manager.cc:1403] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:21:04.588732 31609 raft_consensus.cc:359] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.589455 31609 raft_consensus.cc:740] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:21:04.590163 31609 consensus_queue.cc:260] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.591674 31609 ts_tablet_manager.cc:1434] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:21:04.592635 31609 tablet_bootstrap.cc:492] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:21:04.604955 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.1:42997
I20260709 12:21:04.605114 31672 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.1:42997 every 8 connection(s)
I20260709 12:21:04.605269 31609 tablet_bootstrap.cc:492] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:04.606593 31609 tablet_bootstrap.cc:492] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap complete.
I20260709 12:21:04.607496 31609 ts_tablet_manager.cc:1403] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.005s
I20260709 12:21:04.609735 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:04.610139 31609 raft_consensus.cc:359] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.611553 31609 raft_consensus.cc:740] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:21:04.612334 31609 consensus_queue.cc:260] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.614732 31609 ts_tablet_manager.cc:1434] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:04.615917 31609 tablet_bootstrap.cc:492] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:21:04.640359 31609 tablet_bootstrap.cc:492] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:04.641279 31609 tablet_bootstrap.cc:492] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap complete.
I20260709 12:21:04.642006 31609 ts_tablet_manager.cc:1403] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.002s
I20260709 12:21:04.644388 31609 raft_consensus.cc:359] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.644889 31609 raft_consensus.cc:740] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:21:04.645409 31609 consensus_queue.cc:260] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.647092 31609 ts_tablet_manager.cc:1434] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:21:04.647881 31609 tablet_bootstrap.cc:492] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:21:04.649657 31378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c823555de1945e5827161b0499a00d9"
dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
mode: GRACEFUL
new_leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
 from {username='slave'} at 127.0.0.1:51040
I20260709 12:21:04.650432 31378 raft_consensus.cc:606] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Received request to transfer leadership to TS 8681be3c8e024edda6eb16ccb8bf7ac0
I20260709 12:21:04.653689 31673 heartbeater.cc:344] Connected to a master server at 127.20.191.62:43621
I20260709 12:21:04.654127 31673 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:04.655128 31673 heartbeater.cc:507] Master 127.20.191.62:43621 requested a full tablet report, sending...
I20260709 12:21:04.659741 31609 tablet_bootstrap.cc:492] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:04.660661 31609 tablet_bootstrap.cc:492] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap complete.
I20260709 12:21:04.661114 31201 ts_manager.cc:194] Re-registered known tserver with Master: ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997)
I20260709 12:21:04.661397 31609 ts_tablet_manager.cc:1403] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.001s
I20260709 12:21:04.663960 31609 raft_consensus.cc:359] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.664635 31609 raft_consensus.cc:740] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:21:04.665313 31609 consensus_queue.cc:260] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.665745 31452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa55de36bac74222b2a8fd30d864f1d7"
dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
mode: GRACEFUL
new_leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
 from {username='slave'} at 127.0.0.1:34732
I20260709 12:21:04.666440 31452 raft_consensus.cc:606] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 LEADER]: Received request to transfer leadership to TS c109dd3c635648459f4b8b39e11bc4d4
I20260709 12:21:04.667107 31609 ts_tablet_manager.cc:1434] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:21:04.667882 31609 tablet_bootstrap.cc:492] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:21:04.669368 31452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155"
dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
mode: GRACEFUL
new_leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
 from {username='slave'} at 127.0.0.1:34732
I20260709 12:21:04.670049 31452 raft_consensus.cc:606] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 LEADER]: Received request to transfer leadership to TS c109dd3c635648459f4b8b39e11bc4d4
I20260709 12:21:04.671155 31201 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54658
I20260709 12:21:04.671357 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:21:04.672019 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:04.672752 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:04.673959 31673 heartbeater.cc:499] Master 127.20.191.62:43621 was elected leader, sending a full tablet report...
I20260709 12:21:04.679211 31609 tablet_bootstrap.cc:492] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:04.680073 31609 tablet_bootstrap.cc:492] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap complete.
I20260709 12:21:04.680678 31609 ts_tablet_manager.cc:1403] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:21:04.682478 31609 raft_consensus.cc:359] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } } peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } }
I20260709 12:21:04.683504 31609 raft_consensus.cc:740] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:21:04.684245 31609 consensus_queue.cc:260] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } } peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } }
I20260709 12:21:04.685676 31609 ts_tablet_manager.cc:1434] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:21:04.686656 31609 tablet_bootstrap.cc:492] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:21:04.697739 31609 tablet_bootstrap.cc:492] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:04.698458 31609 tablet_bootstrap.cc:492] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap complete.
I20260709 12:21:04.699034 31609 ts_tablet_manager.cc:1403] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 12:21:04.700762 31609 raft_consensus.cc:359] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.701238 31609 raft_consensus.cc:740] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:21:04.701839 31609 consensus_queue.cc:260] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.703527 31609 ts_tablet_manager.cc:1434] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:21:04.704460 31609 tablet_bootstrap.cc:492] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap starting.
I20260709 12:21:04.715214 31609 tablet_bootstrap.cc:492] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:04.715857 31609 tablet_bootstrap.cc:492] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc: Bootstrap complete.
I20260709 12:21:04.716409 31609 ts_tablet_manager.cc:1403] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:21:04.718169 31609 raft_consensus.cc:359] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.718658 31609 raft_consensus.cc:740] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1cb7ff4d4340b3a277621adcad9fbc, State: Initialized, Role: FOLLOWER
I20260709 12:21:04.719210 31609 consensus_queue.cc:260] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.720904 31609 ts_tablet_manager.cc:1434] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:21:04.735354 31646 raft_consensus.cc:3060] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:04.805281 31646 raft_consensus.cc:3060] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:04.979666 31592 raft_consensus.cc:993] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4: : Instructing follower 8681be3c8e024edda6eb16ccb8bf7ac0 to start an election
I20260709 12:21:04.980126 31691 raft_consensus.cc:1081] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Signalling peer 8681be3c8e024edda6eb16ccb8bf7ac0 to start an election
I20260709 12:21:04.981710 31452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c823555de1945e5827161b0499a00d9"
dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
 from {username='slave'} at 127.0.0.1:39300
I20260709 12:21:04.982231 31452 raft_consensus.cc:493] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:04.982486 31452 raft_consensus.cc:3060] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:04.987478 31452 raft_consensus.cc:515] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.989319 31452 leader_election.cc:290] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 3 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:21:04.990346 31646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c823555de1945e5827161b0499a00d9" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:21:04.990346 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c823555de1945e5827161b0499a00d9" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
I20260709 12:21:04.991088 31646 raft_consensus.cc:3060] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:21:04.991411 31378 raft_consensus.cc:3055] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:04.991731 31378 raft_consensus.cc:740] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:21:04.992533 31378 consensus_queue.cc:260] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:04.993834 31378 raft_consensus.cc:3060] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:04.998422 31646 raft_consensus.cc:2468] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 3.
I20260709 12:21:04.999789 31416 leader_election.cc:304] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc; no voters: 
I20260709 12:21:05.000461 31613 raft_consensus.cc:2804] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:05.000620 31378 raft_consensus.cc:2468] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 3.
I20260709 12:21:05.000996 31613 raft_consensus.cc:697] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 LEADER]: Becoming Leader. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:21:05.001915 31613 consensus_queue.cc:237] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:05.007333 31593 raft_consensus.cc:993] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0: : Instructing follower c109dd3c635648459f4b8b39e11bc4d4 to start an election
I20260709 12:21:05.007824 31593 raft_consensus.cc:1081] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 LEADER]: Signalling peer c109dd3c635648459f4b8b39e11bc4d4 to start an election
I20260709 12:21:05.009946 31378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa55de36bac74222b2a8fd30d864f1d7"
dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
 from {username='slave'} at 127.0.0.1:43134
I20260709 12:21:05.010548 31378 raft_consensus.cc:493] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:05.010926 31378 raft_consensus.cc:3060] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:05.011430 31200 catalog_manager.cc:5697] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 reported cstate change: term changed from 2 to 3, leader changed from c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2) to 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3). New cstate: current_term: 3 leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:05.018611 31378 raft_consensus.cc:515] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } } peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } }
I20260709 12:21:05.021011 31378 leader_election.cc:290] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 election: Requested vote from peers 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455), ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997)
I20260709 12:21:05.021898 31646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa55de36bac74222b2a8fd30d864f1d7" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:21:05.022651 31646 raft_consensus.cc:3060] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:05.022876 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa55de36bac74222b2a8fd30d864f1d7" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
I20260709 12:21:05.023900 31452 raft_consensus.cc:3055] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:05.024216 31452 raft_consensus.cc:740] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:21:05.025041 31452 consensus_queue.cc:260] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } } peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } }
I20260709 12:21:05.026352 31452 raft_consensus.cc:3060] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:05.029635 31645 raft_consensus.cc:3060] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:05.031754 31646 raft_consensus.cc:2468] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 2.
I20260709 12:21:05.032979 31342 leader_election.cc:304] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba1cb7ff4d4340b3a277621adcad9fbc, c109dd3c635648459f4b8b39e11bc4d4; no voters: 
I20260709 12:21:05.033950 31691 raft_consensus.cc:2804] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:05.034873 31691 raft_consensus.cc:697] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Becoming Leader. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:21:05.035737 31691 consensus_queue.cc:237] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } } peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } }
I20260709 12:21:05.040030 31452 raft_consensus.cc:2468] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 2.
I20260709 12:21:05.040302 31645 pending_rounds.cc:85] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc: Aborting all ops after (but not including) 0
I20260709 12:21:05.040796 31645 pending_rounds.cc:107] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:21:05.041100 31645 raft_consensus.cc:2889] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:05.051064 31201 catalog_manager.cc:5697] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 reported cstate change: term changed from 1 to 2, leader changed from 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3) to c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:05.216619 31613 raft_consensus.cc:993] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0: : Instructing follower c109dd3c635648459f4b8b39e11bc4d4 to start an election
I20260709 12:21:05.217074 31593 raft_consensus.cc:1081] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 LEADER]: Signalling peer c109dd3c635648459f4b8b39e11bc4d4 to start an election
I20260709 12:21:05.218667 31378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155"
dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
 from {username='slave'} at 127.0.0.1:43134
I20260709 12:21:05.219130 31378 raft_consensus.cc:493] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:05.219367 31378 raft_consensus.cc:3060] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:05.225235 31378 raft_consensus.cc:515] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:05.226747 31378 leader_election.cc:290] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 3 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:21:05.227769 31645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:21:05.227788 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
I20260709 12:21:05.228406 31645 raft_consensus.cc:3060] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:05.228891 31452 raft_consensus.cc:3055] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:05.229223 31452 raft_consensus.cc:740] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:21:05.230412 31452 consensus_queue.cc:260] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:05.231452 31452 raft_consensus.cc:3060] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:05.234318 31645 raft_consensus.cc:2468] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 3.
I20260709 12:21:05.235513 31342 leader_election.cc:304] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba1cb7ff4d4340b3a277621adcad9fbc, c109dd3c635648459f4b8b39e11bc4d4; no voters: 
I20260709 12:21:05.236218 31691 raft_consensus.cc:2804] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:05.236630 31691 raft_consensus.cc:697] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 LEADER]: Becoming Leader. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:21:05.236852 31452 raft_consensus.cc:2468] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 3.
I20260709 12:21:05.237445 31691 consensus_queue.cc:237] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:05.244385 31200 catalog_manager.cc:5697] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 reported cstate change: term changed from 2 to 3, leader changed from 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3) to c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2). New cstate: current_term: 3 leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:05.469798 31378 raft_consensus.cc:1275] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 FOLLOWER]: Refusing update from remote peer 8681be3c8e024edda6eb16ccb8bf7ac0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:05.470963 31613 consensus_queue.cc:1048] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:05.473680 31452 raft_consensus.cc:1275] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Refusing update from remote peer c109dd3c635648459f4b8b39e11bc4d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:05.475349 31691 consensus_queue.cc:1048] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:05.483043 31645 raft_consensus.cc:1275] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 3 FOLLOWER]: Refusing update from remote peer 8681be3c8e024edda6eb16ccb8bf7ac0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:05.486140 31704 consensus_queue.cc:1048] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:05.486801 31704 consensus_queue.cc:1243] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Peer ba1cb7ff4d4340b3a277621adcad9fbc log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:21:05.490351 31645 pending_rounds.cc:85] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc: Aborting all ops after (but not including) 0
I20260709 12:21:05.490696 31645 pending_rounds.cc:107] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:21:05.490958 31645 raft_consensus.cc:2889] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:05.493287 31646 raft_consensus.cc:1275] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Refusing update from remote peer c109dd3c635648459f4b8b39e11bc4d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:05.495138 31592 consensus_queue.cc:1048] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:05.513236 31248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:21:05.684505 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:05.691744 31452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898"
dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
mode: GRACEFUL
new_leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
 from {username='slave'} at 127.0.0.1:34732
I20260709 12:21:05.692289 31452 raft_consensus.cc:606] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 LEADER]: Received request to transfer leadership to TS c109dd3c635648459f4b8b39e11bc4d4
I20260709 12:21:05.694808 31378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef9c407a3aed46b69eb4b4c875adc6b4"
dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
mode: GRACEFUL
new_leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
 from {username='slave'} at 127.0.0.1:51040
I20260709 12:21:05.695250 31378 raft_consensus.cc:606] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 LEADER]: Received request to transfer leadership to TS 8681be3c8e024edda6eb16ccb8bf7ac0
I20260709 12:21:05.697453 31378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155"
dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
mode: GRACEFUL
new_leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
 from {username='slave'} at 127.0.0.1:51040
I20260709 12:21:05.697896 31378 raft_consensus.cc:606] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 LEADER]: Received request to transfer leadership to TS 8681be3c8e024edda6eb16ccb8bf7ac0
I20260709 12:21:05.698854 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:21:05.699424 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:05.700152 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:05.713738 31452 raft_consensus.cc:1275] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 FOLLOWER]: Refusing update from remote peer c109dd3c635648459f4b8b39e11bc4d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:05.715265 31592 consensus_queue.cc:1048] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:05.722419 31702 raft_consensus.cc:993] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4: : Instructing follower 8681be3c8e024edda6eb16ccb8bf7ac0 to start an election
I20260709 12:21:05.722909 31702 raft_consensus.cc:1081] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 LEADER]: Signalling peer 8681be3c8e024edda6eb16ccb8bf7ac0 to start an election
I20260709 12:21:05.724645 31451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155"
dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
 from {username='slave'} at 127.0.0.1:39300
I20260709 12:21:05.725301 31451 raft_consensus.cc:493] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:05.725725 31451 raft_consensus.cc:3060] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:05.726259 31646 raft_consensus.cc:1275] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 3 FOLLOWER]: Refusing update from remote peer c109dd3c635648459f4b8b39e11bc4d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:05.727969 31592 consensus_queue.cc:1048] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:05.734890 31451 raft_consensus.cc:515] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:05.736002 31452 raft_consensus.cc:1240] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 FOLLOWER]: Rejecting Update request from peer c109dd3c635648459f4b8b39e11bc4d4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:05.737187 31451 leader_election.cc:290] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 4 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:21:05.738757 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
I20260709 12:21:05.739049 31646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:21:05.739327 31378 raft_consensus.cc:3055] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:05.739859 31378 raft_consensus.cc:740] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:21:05.739880 31646 raft_consensus.cc:3060] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:05.740680 31378 consensus_queue.cc:260] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:05.741796 31378 raft_consensus.cc:3060] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:05.746029 31592 consensus_queue.cc:1175] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" responder_term: 4 status { last_received { term: 3 index: 3 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c109dd3c635648459f4b8b39e11bc4d4 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:21:05.746563 31646 raft_consensus.cc:2468] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 4.
I20260709 12:21:05.747419 31378 raft_consensus.cc:2468] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 4.
I20260709 12:21:05.748255 31416 leader_election.cc:304] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc; no voters: 
I20260709 12:21:05.749472 31593 raft_consensus.cc:2804] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:05.750074 31593 raft_consensus.cc:697] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 LEADER]: Becoming Leader. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:21:05.751070 31593 consensus_queue.cc:237] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:05.758206 31200 catalog_manager.cc:5697] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 reported cstate change: term changed from 3 to 4, leader changed from c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2) to 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3). New cstate: current_term: 4 leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:05.856302 31593 raft_consensus.cc:993] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0: : Instructing follower c109dd3c635648459f4b8b39e11bc4d4 to start an election
I20260709 12:21:05.856765 31705 raft_consensus.cc:1081] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 LEADER]: Signalling peer c109dd3c635648459f4b8b39e11bc4d4 to start an election
I20260709 12:21:05.858342 31378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898"
dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
 from {username='slave'} at 127.0.0.1:43134
I20260709 12:21:05.858832 31378 raft_consensus.cc:493] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:05.859093 31378 raft_consensus.cc:3060] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:05.863595 31378 raft_consensus.cc:515] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:05.865171 31378 leader_election.cc:290] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 3 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:21:05.866083 31646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:21:05.866302 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
I20260709 12:21:05.866796 31646 raft_consensus.cc:3060] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:05.866824 31452 raft_consensus.cc:3055] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:05.867256 31452 raft_consensus.cc:740] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:21:05.867890 31452 consensus_queue.cc:260] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:05.868796 31452 raft_consensus.cc:3060] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:05.872541 31646 raft_consensus.cc:2468] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 3.
I20260709 12:21:05.873847 31342 leader_election.cc:304] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba1cb7ff4d4340b3a277621adcad9fbc, c109dd3c635648459f4b8b39e11bc4d4; no voters: 
I20260709 12:21:05.874704 31592 raft_consensus.cc:2804] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:05.875102 31592 raft_consensus.cc:697] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 LEADER]: Becoming Leader. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:21:05.875180 31452 raft_consensus.cc:2468] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 3.
I20260709 12:21:05.875887 31592 consensus_queue.cc:237] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:05.883545 31200 catalog_manager.cc:5697] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 reported cstate change: term changed from 2 to 3, leader changed from 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3) to c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2). New cstate: current_term: 3 leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:06.109886 31702 raft_consensus.cc:993] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4: : Instructing follower 8681be3c8e024edda6eb16ccb8bf7ac0 to start an election
I20260709 12:21:06.110369 31592 raft_consensus.cc:1081] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 LEADER]: Signalling peer 8681be3c8e024edda6eb16ccb8bf7ac0 to start an election
I20260709 12:21:06.111831 31452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef9c407a3aed46b69eb4b4c875adc6b4"
dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
 from {username='slave'} at 127.0.0.1:39300
I20260709 12:21:06.112287 31452 raft_consensus.cc:493] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:06.112541 31452 raft_consensus.cc:3060] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:06.117524 31452 raft_consensus.cc:515] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:06.119318 31452 leader_election.cc:290] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:21:06.120052 31646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9c407a3aed46b69eb4b4c875adc6b4" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:21:06.120288 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9c407a3aed46b69eb4b4c875adc6b4" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
I20260709 12:21:06.120739 31646 raft_consensus.cc:3060] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:06.120815 31378 raft_consensus.cc:3055] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:06.121191 31378 raft_consensus.cc:740] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:21:06.121882 31378 consensus_queue.cc:260] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:06.122743 31378 raft_consensus.cc:3060] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:06.125891 31646 raft_consensus.cc:2468] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 2.
I20260709 12:21:06.127025 31416 leader_election.cc:304] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc; no voters: 
I20260709 12:21:06.127182 31378 raft_consensus.cc:2468] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 2.
I20260709 12:21:06.127676 31705 raft_consensus.cc:2804] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:06.128094 31705 raft_consensus.cc:697] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 LEADER]: Becoming Leader. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:21:06.128854 31705 consensus_queue.cc:237] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:06.136586 31200 catalog_manager.cc:5697] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 reported cstate change: term changed from 1 to 2, leader changed from c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2) to 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3). New cstate: current_term: 2 leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:06.139147 31378 raft_consensus.cc:1275] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 4 FOLLOWER]: Refusing update from remote peer 8681be3c8e024edda6eb16ccb8bf7ac0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:06.140355 31705 consensus_queue.cc:1048] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:06.150563 31646 raft_consensus.cc:1275] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 4 FOLLOWER]: Refusing update from remote peer 8681be3c8e024edda6eb16ccb8bf7ac0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:06.151889 31704 consensus_queue.cc:1048] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:06.322089 31452 raft_consensus.cc:1275] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 FOLLOWER]: Refusing update from remote peer c109dd3c635648459f4b8b39e11bc4d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:06.323689 31592 consensus_queue.cc:1048] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:06.333063 31646 raft_consensus.cc:1275] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 3 FOLLOWER]: Refusing update from remote peer c109dd3c635648459f4b8b39e11bc4d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:06.335494 31592 consensus_queue.cc:1048] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:06.514698 31248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:21:06.679237 31378 raft_consensus.cc:1275] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Refusing update from remote peer 8681be3c8e024edda6eb16ccb8bf7ac0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:06.680600 31719 consensus_queue.cc:1048] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:06.691076 31646 raft_consensus.cc:1275] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Refusing update from remote peer 8681be3c8e024edda6eb16ccb8bf7ac0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:06.692560 31725 consensus_queue.cc:1048] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:06.706669 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:06.714798 31451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07cd3429d1d442d586b729a487b800c0"
dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
mode: GRACEFUL
new_leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
 from {username='slave'} at 127.0.0.1:34732
I20260709 12:21:06.715323 31451 raft_consensus.cc:606] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 LEADER]: Received request to transfer leadership to TS c109dd3c635648459f4b8b39e11bc4d4
I20260709 12:21:06.717836 31378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94e029757f2e4b11abdb36a95b2fd7dc"
dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
mode: GRACEFUL
new_leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
 from {username='slave'} at 127.0.0.1:51040
I20260709 12:21:06.718292 31378 raft_consensus.cc:606] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Received request to transfer leadership to TS 8681be3c8e024edda6eb16ccb8bf7ac0
I20260709 12:21:06.720701 31451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155"
dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
mode: GRACEFUL
new_leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
 from {username='slave'} at 127.0.0.1:34732
I20260709 12:21:06.721205 31451 raft_consensus.cc:606] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 LEADER]: Received request to transfer leadership to TS c109dd3c635648459f4b8b39e11bc4d4
I20260709 12:21:06.722165 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:21:06.722687 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:06.723274 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:06.730002 31724 raft_consensus.cc:993] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0: : Instructing follower c109dd3c635648459f4b8b39e11bc4d4 to start an election
I20260709 12:21:06.730509 31725 raft_consensus.cc:1081] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 LEADER]: Signalling peer c109dd3c635648459f4b8b39e11bc4d4 to start an election
I20260709 12:21:06.731972 31378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155"
dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
 from {username='slave'} at 127.0.0.1:43134
I20260709 12:21:06.732604 31378 raft_consensus.cc:493] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:06.732887 31378 raft_consensus.cc:3060] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:06.739069 31378 raft_consensus.cc:515] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:06.741015 31378 leader_election.cc:290] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 5 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:21:06.741662 31646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:21:06.741950 31451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7a45ef6a6a4ead9c8421b94e3f9155" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
I20260709 12:21:06.742434 31646 raft_consensus.cc:3060] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:06.742606 31451 raft_consensus.cc:3055] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:06.743057 31451 raft_consensus.cc:740] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:21:06.743906 31451 consensus_queue.cc:260] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:06.745160 31451 raft_consensus.cc:3060] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:06.749351 31646 raft_consensus.cc:2468] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 5.
I20260709 12:21:06.750677 31342 leader_election.cc:304] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba1cb7ff4d4340b3a277621adcad9fbc, c109dd3c635648459f4b8b39e11bc4d4; no voters: 
I20260709 12:21:06.751503 31702 raft_consensus.cc:2804] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:06.752071 31702 raft_consensus.cc:697] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 5 LEADER]: Becoming Leader. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:21:06.752200 31451 raft_consensus.cc:2468] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 5.
I20260709 12:21:06.753100 31702 consensus_queue.cc:237] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:06.760555 31200 catalog_manager.cc:5697] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 reported cstate change: term changed from 4 to 5, leader changed from 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3) to c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2). New cstate: current_term: 5 leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:06.958652 31719 raft_consensus.cc:993] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0: : Instructing follower c109dd3c635648459f4b8b39e11bc4d4 to start an election
I20260709 12:21:06.959090 31725 raft_consensus.cc:1081] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 LEADER]: Signalling peer c109dd3c635648459f4b8b39e11bc4d4 to start an election
I20260709 12:21:06.960441 31378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07cd3429d1d442d586b729a487b800c0"
dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
 from {username='slave'} at 127.0.0.1:43134
I20260709 12:21:06.960904 31378 raft_consensus.cc:493] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:06.961150 31378 raft_consensus.cc:3060] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:06.965847 31378 raft_consensus.cc:515] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:06.967370 31378 leader_election.cc:290] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:21:06.968236 31646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cd3429d1d442d586b729a487b800c0" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:21:06.968492 31451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cd3429d1d442d586b729a487b800c0" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
I20260709 12:21:06.968845 31646 raft_consensus.cc:3060] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:06.969060 31451 raft_consensus.cc:3055] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:06.969367 31451 raft_consensus.cc:740] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:21:06.970067 31451 consensus_queue.cc:260] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:06.971067 31451 raft_consensus.cc:3060] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:06.975174 31646 raft_consensus.cc:2468] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 2.
I20260709 12:21:06.976284 31342 leader_election.cc:304] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba1cb7ff4d4340b3a277621adcad9fbc, c109dd3c635648459f4b8b39e11bc4d4; no voters: 
I20260709 12:21:06.976917 31702 raft_consensus.cc:2804] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:06.976980 31451 raft_consensus.cc:2468] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 2.
I20260709 12:21:06.977375 31702 raft_consensus.cc:697] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Becoming Leader. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:21:06.978236 31702 consensus_queue.cc:237] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:06.984670 31200 catalog_manager.cc:5697] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 reported cstate change: term changed from 1 to 2, leader changed from 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3) to c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:07.035966 31592 raft_consensus.cc:993] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4: : Instructing follower 8681be3c8e024edda6eb16ccb8bf7ac0 to start an election
I20260709 12:21:07.036523 31592 raft_consensus.cc:1081] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Signalling peer 8681be3c8e024edda6eb16ccb8bf7ac0 to start an election
I20260709 12:21:07.038266 31451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94e029757f2e4b11abdb36a95b2fd7dc"
dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
 from {username='slave'} at 127.0.0.1:39300
I20260709 12:21:07.038863 31451 raft_consensus.cc:493] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:07.039149 31451 raft_consensus.cc:3060] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.044194 31451 raft_consensus.cc:515] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:07.045718 31451 leader_election.cc:290] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 3 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:21:07.046728 31646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e029757f2e4b11abdb36a95b2fd7dc" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:21:07.046990 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e029757f2e4b11abdb36a95b2fd7dc" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
I20260709 12:21:07.047405 31646 raft_consensus.cc:3060] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.047498 31378 raft_consensus.cc:3055] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:07.047873 31378 raft_consensus.cc:740] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:21:07.048590 31378 consensus_queue.cc:260] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:07.049731 31378 raft_consensus.cc:3060] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.055087 31646 raft_consensus.cc:2468] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 3.
I20260709 12:21:07.056457 31416 leader_election.cc:304] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc; no voters: 
I20260709 12:21:07.056648 31378 raft_consensus.cc:2468] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 3.
I20260709 12:21:07.057126 31725 raft_consensus.cc:2804] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:07.057534 31725 raft_consensus.cc:697] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 LEADER]: Becoming Leader. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:21:07.058362 31725 consensus_queue.cc:237] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:07.065096 31200 catalog_manager.cc:5697] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 reported cstate change: term changed from 2 to 3, leader changed from c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2) to 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3). New cstate: current_term: 3 leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:07.248340 31646 raft_consensus.cc:1275] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 5 FOLLOWER]: Refusing update from remote peer c109dd3c635648459f4b8b39e11bc4d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:07.250157 31592 consensus_queue.cc:1048] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:07.269807 31451 raft_consensus.cc:1275] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 5 FOLLOWER]: Refusing update from remote peer c109dd3c635648459f4b8b39e11bc4d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:07.275071 31737 consensus_queue.cc:1048] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:07.422640 31451 raft_consensus.cc:1275] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Refusing update from remote peer c109dd3c635648459f4b8b39e11bc4d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:07.424165 31737 consensus_queue.cc:1048] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:07.438516 31646 raft_consensus.cc:1275] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Refusing update from remote peer c109dd3c635648459f4b8b39e11bc4d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:07.439844 31737 consensus_queue.cc:1048] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:07.516199 31248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:21:07.612965 31378 raft_consensus.cc:1275] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 3 FOLLOWER]: Refusing update from remote peer 8681be3c8e024edda6eb16ccb8bf7ac0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:07.613873 31646 raft_consensus.cc:1275] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 3 FOLLOWER]: Refusing update from remote peer 8681be3c8e024edda6eb16ccb8bf7ac0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:07.614751 31724 consensus_queue.cc:1048] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:07.615682 31725 consensus_queue.cc:1048] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:07.731593 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:07.744415 31378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08604d1cb7384c1e85b7928e9ef4fcbb"
dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
mode: GRACEFUL
new_leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
 from {username='slave'} at 127.0.0.1:51040
I20260709 12:21:07.745029 31378 raft_consensus.cc:606] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 1 LEADER]: Received request to transfer leadership to TS 8681be3c8e024edda6eb16ccb8bf7ac0
I20260709 12:21:07.747869 31451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36f58a2613aa49eca2e2df2436ae93aa"
dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
mode: GRACEFUL
new_leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
 from {username='slave'} at 127.0.0.1:34732
I20260709 12:21:07.748418 31451 raft_consensus.cc:606] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 LEADER]: Received request to transfer leadership to TS c109dd3c635648459f4b8b39e11bc4d4
I20260709 12:21:07.751250 31378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898"
dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
mode: GRACEFUL
new_leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
 from {username='slave'} at 127.0.0.1:51040
I20260709 12:21:07.751767 31378 raft_consensus.cc:606] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 LEADER]: Received request to transfer leadership to TS 8681be3c8e024edda6eb16ccb8bf7ac0
I20260709 12:21:07.752923 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:21:07.753437 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:07.754325 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:07.831382 31719 raft_consensus.cc:993] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0: : Instructing follower c109dd3c635648459f4b8b39e11bc4d4 to start an election
I20260709 12:21:07.831897 31744 raft_consensus.cc:1081] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 LEADER]: Signalling peer c109dd3c635648459f4b8b39e11bc4d4 to start an election
I20260709 12:21:07.833385 31378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36f58a2613aa49eca2e2df2436ae93aa"
dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
 from {username='slave'} at 127.0.0.1:43134
I20260709 12:21:07.834052 31378 raft_consensus.cc:493] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:07.834344 31378 raft_consensus.cc:3060] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:07.841619 31378 raft_consensus.cc:515] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:07.843339 31378 leader_election.cc:290] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:21:07.844406 31646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f58a2613aa49eca2e2df2436ae93aa" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:21:07.844638 31451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f58a2613aa49eca2e2df2436ae93aa" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
I20260709 12:21:07.845299 31451 raft_consensus.cc:3055] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:07.845299 31646 raft_consensus.cc:3060] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:07.845758 31451 raft_consensus.cc:740] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:21:07.846886 31451 consensus_queue.cc:260] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:07.848156 31451 raft_consensus.cc:3060] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:07.852368 31646 raft_consensus.cc:2468] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 2.
I20260709 12:21:07.854009 31342 leader_election.cc:304] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba1cb7ff4d4340b3a277621adcad9fbc, c109dd3c635648459f4b8b39e11bc4d4; no voters: 
I20260709 12:21:07.855034 31721 raft_consensus.cc:2804] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:07.855458 31721 raft_consensus.cc:697] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Becoming Leader. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:21:07.856385 31451 raft_consensus.cc:2468] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 2.
I20260709 12:21:07.856603 31721 consensus_queue.cc:237] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:07.867733 31200 catalog_manager.cc:5697] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 reported cstate change: term changed from 1 to 2, leader changed from 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3) to c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:08.229346 31737 raft_consensus.cc:993] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4: : Instructing follower 8681be3c8e024edda6eb16ccb8bf7ac0 to start an election
I20260709 12:21:08.229856 31721 raft_consensus.cc:1081] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 LEADER]: Signalling peer 8681be3c8e024edda6eb16ccb8bf7ac0 to start an election
I20260709 12:21:08.231338 31451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898"
dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
 from {username='slave'} at 127.0.0.1:39300
I20260709 12:21:08.231817 31451 raft_consensus.cc:493] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:08.232087 31451 raft_consensus.cc:3060] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:08.233989 31737 raft_consensus.cc:993] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4: : Instructing follower 8681be3c8e024edda6eb16ccb8bf7ac0 to start an election
I20260709 12:21:08.234601 31721 raft_consensus.cc:1081] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 1 LEADER]: Signalling peer 8681be3c8e024edda6eb16ccb8bf7ac0 to start an election
I20260709 12:21:08.236286 31452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08604d1cb7384c1e85b7928e9ef4fcbb"
dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
 from {username='slave'} at 127.0.0.1:39300
I20260709 12:21:08.236799 31452 raft_consensus.cc:493] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:08.237133 31452 raft_consensus.cc:3060] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.238245 31451 raft_consensus.cc:515] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:08.239825 31451 leader_election.cc:290] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 4 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:21:08.240773 31646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:21:08.241178 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
I20260709 12:21:08.241365 31646 raft_consensus.cc:3060] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:08.241808 31378 raft_consensus.cc:3055] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:08.242136 31378 raft_consensus.cc:740] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:21:08.243040 31378 consensus_queue.cc:260] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:08.244349 31378 raft_consensus.cc:3060] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:08.245340 31452 raft_consensus.cc:515] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:08.247447 31452 leader_election.cc:290] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:21:08.247776 31646 raft_consensus.cc:2468] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 4.
I20260709 12:21:08.248461 31645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08604d1cb7384c1e85b7928e9ef4fcbb" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:21:08.249125 31645 raft_consensus.cc:3060] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.249508 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08604d1cb7384c1e85b7928e9ef4fcbb" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
I20260709 12:21:08.250257 31376 raft_consensus.cc:3055] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:08.250193 31416 leader_election.cc:304] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc; no voters: 
I20260709 12:21:08.250687 31376 raft_consensus.cc:740] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:21:08.251241 31378 raft_consensus.cc:2468] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 4.
I20260709 12:21:08.251312 31744 raft_consensus.cc:2804] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:08.252132 31744 raft_consensus.cc:697] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 LEADER]: Becoming Leader. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:21:08.251626 31376 consensus_queue.cc:260] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:08.253393 31744 consensus_queue.cc:237] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:08.254392 31376 raft_consensus.cc:3060] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.256855 31645 raft_consensus.cc:2468] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 2.
I20260709 12:21:08.258937 31416 leader_election.cc:304] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc; no voters: 
I20260709 12:21:08.260205 31744 raft_consensus.cc:2804] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:08.260784 31744 raft_consensus.cc:697] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 LEADER]: Becoming Leader. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:21:08.261801 31744 consensus_queue.cc:237] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:08.262959 31200 catalog_manager.cc:5697] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 reported cstate change: term changed from 3 to 4, leader changed from c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2) to 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3). New cstate: current_term: 4 leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:08.264650 31376 raft_consensus.cc:2468] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 2.
I20260709 12:21:08.276000 31200 catalog_manager.cc:5697] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 reported cstate change: term changed from 1 to 2, leader changed from c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2) to 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3). New cstate: current_term: 2 leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:08.353858 31452 raft_consensus.cc:1275] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Refusing update from remote peer c109dd3c635648459f4b8b39e11bc4d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:08.355289 31721 consensus_queue.cc:1048] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:08.366323 31645 raft_consensus.cc:1275] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Refusing update from remote peer c109dd3c635648459f4b8b39e11bc4d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:08.367947 31702 consensus_queue.cc:1048] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:08.517300 31248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:21:08.672627 31376 raft_consensus.cc:1275] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 4 FOLLOWER]: Refusing update from remote peer 8681be3c8e024edda6eb16ccb8bf7ac0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:08.674113 31744 consensus_queue.cc:1048] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:08.684006 31645 raft_consensus.cc:1275] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 4 FOLLOWER]: Refusing update from remote peer 8681be3c8e024edda6eb16ccb8bf7ac0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:08.686075 31744 consensus_queue.cc:1048] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:08.707276 31376 raft_consensus.cc:1275] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Refusing update from remote peer 8681be3c8e024edda6eb16ccb8bf7ac0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:08.708513 31759 consensus_queue.cc:1048] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:08.718245 31645 raft_consensus.cc:1275] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Refusing update from remote peer 8681be3c8e024edda6eb16ccb8bf7ac0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:08.720099 31759 consensus_queue.cc:1048] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:08.761258 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:08.769156 31376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36f58a2613aa49eca2e2df2436ae93aa"
dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
mode: GRACEFUL
new_leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
 from {username='slave'} at 127.0.0.1:51040
I20260709 12:21:08.769706 31376 raft_consensus.cc:606] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Received request to transfer leadership to TS 8681be3c8e024edda6eb16ccb8bf7ac0
I20260709 12:21:08.772742 31452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c823555de1945e5827161b0499a00d9"
dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
mode: GRACEFUL
new_leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
 from {username='slave'} at 127.0.0.1:34732
I20260709 12:21:08.773286 31452 raft_consensus.cc:606] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 LEADER]: Received request to transfer leadership to TS c109dd3c635648459f4b8b39e11bc4d4
I20260709 12:21:08.776013 31452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898"
dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
mode: GRACEFUL
new_leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
 from {username='slave'} at 127.0.0.1:34732
I20260709 12:21:08.776489 31452 raft_consensus.cc:606] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 LEADER]: Received request to transfer leadership to TS c109dd3c635648459f4b8b39e11bc4d4
I20260709 12:21:08.777921 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:21:08.778409 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:08.778970 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:08.894032 31721 raft_consensus.cc:993] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4: : Instructing follower 8681be3c8e024edda6eb16ccb8bf7ac0 to start an election
I20260709 12:21:08.894519 31764 raft_consensus.cc:1081] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Signalling peer 8681be3c8e024edda6eb16ccb8bf7ac0 to start an election
I20260709 12:21:08.896066 31452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36f58a2613aa49eca2e2df2436ae93aa"
dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
 from {username='slave'} at 127.0.0.1:39300
I20260709 12:21:08.896487 31452 raft_consensus.cc:493] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:08.896714 31452 raft_consensus.cc:3060] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:08.901633 31452 raft_consensus.cc:515] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:08.903113 31452 leader_election.cc:290] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 3 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657)
I20260709 12:21:08.904033 31646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f58a2613aa49eca2e2df2436ae93aa" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:21:08.904304 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f58a2613aa49eca2e2df2436ae93aa" candidate_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
I20260709 12:21:08.904711 31646 raft_consensus.cc:3060] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:08.904860 31376 raft_consensus.cc:3055] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:08.905246 31376 raft_consensus.cc:740] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:21:08.906086 31376 consensus_queue.cc:260] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:08.907371 31376 raft_consensus.cc:3060] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:08.911989 31646 raft_consensus.cc:2468] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 3.
I20260709 12:21:08.913379 31416 leader_election.cc:304] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8681be3c8e024edda6eb16ccb8bf7ac0, ba1cb7ff4d4340b3a277621adcad9fbc; no voters: 
I20260709 12:21:08.914244 31759 raft_consensus.cc:2804] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:08.914821 31376 raft_consensus.cc:2468] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8681be3c8e024edda6eb16ccb8bf7ac0 in term 3.
I20260709 12:21:08.914719 31759 raft_consensus.cc:697] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 LEADER]: Becoming Leader. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:21:08.916303 31759 consensus_queue.cc:237] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:08.922946 31200 catalog_manager.cc:5697] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 reported cstate change: term changed from 2 to 3, leader changed from c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2) to 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3). New cstate: current_term: 3 leader_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:08.943333 31762 raft_consensus.cc:993] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0: : Instructing follower c109dd3c635648459f4b8b39e11bc4d4 to start an election
I20260709 12:21:08.943778 31759 raft_consensus.cc:1081] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 LEADER]: Signalling peer c109dd3c635648459f4b8b39e11bc4d4 to start an election
I20260709 12:21:08.945482 31376 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c823555de1945e5827161b0499a00d9"
dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
 from {username='slave'} at 127.0.0.1:43134
I20260709 12:21:08.946045 31376 raft_consensus.cc:493] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:08.946344 31376 raft_consensus.cc:3060] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:08.951762 31376 raft_consensus.cc:515] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:08.953434 31376 leader_election.cc:290] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 4 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:21:08.954468 31646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c823555de1945e5827161b0499a00d9" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:21:08.954689 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c823555de1945e5827161b0499a00d9" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
I20260709 12:21:08.955135 31646 raft_consensus.cc:3060] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:08.955209 31452 raft_consensus.cc:3055] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:08.955581 31452 raft_consensus.cc:740] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:21:08.956326 31452 consensus_queue.cc:260] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:08.957288 31452 raft_consensus.cc:3060] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:08.960520 31646 raft_consensus.cc:2468] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 4.
I20260709 12:21:08.961864 31342 leader_election.cc:304] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba1cb7ff4d4340b3a277621adcad9fbc, c109dd3c635648459f4b8b39e11bc4d4; no voters: 
I20260709 12:21:08.962729 31764 raft_consensus.cc:2804] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:08.963147 31764 raft_consensus.cc:697] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 4 LEADER]: Becoming Leader. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:21:08.963255 31452 raft_consensus.cc:2468] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 4.
I20260709 12:21:08.964146 31764 consensus_queue.cc:237] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:08.970973 31200 catalog_manager.cc:5697] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 reported cstate change: term changed from 3 to 4, leader changed from 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3) to c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2). New cstate: current_term: 4 leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:09.275224 31719 raft_consensus.cc:993] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0: : Instructing follower c109dd3c635648459f4b8b39e11bc4d4 to start an election
I20260709 12:21:09.275699 31759 raft_consensus.cc:1081] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 LEADER]: Signalling peer c109dd3c635648459f4b8b39e11bc4d4 to start an election
I20260709 12:21:09.277173 31376 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898"
dest_uuid: "c109dd3c635648459f4b8b39e11bc4d4"
 from {username='slave'} at 127.0.0.1:43134
I20260709 12:21:09.277717 31376 raft_consensus.cc:493] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:09.278034 31376 raft_consensus.cc:3060] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.284294 31376 raft_consensus.cc:515] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:09.286289 31376 leader_election.cc:290] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 5 election: Requested vote from peers ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997), 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3:42455)
I20260709 12:21:09.287032 31646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc"
I20260709 12:21:09.287335 31452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0821fd6ca4c44eab8c17649a7e8d898" candidate_uuid: "c109dd3c635648459f4b8b39e11bc4d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0"
I20260709 12:21:09.287742 31646 raft_consensus.cc:3060] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.287866 31452 raft_consensus.cc:3055] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:09.288285 31452 raft_consensus.cc:740] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8681be3c8e024edda6eb16ccb8bf7ac0, State: Running, Role: LEADER
I20260709 12:21:09.289110 31452 consensus_queue.cc:260] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:09.290366 31452 raft_consensus.cc:3060] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.295162 31646 raft_consensus.cc:2468] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 5.
I20260709 12:21:09.296394 31342 leader_election.cc:304] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba1cb7ff4d4340b3a277621adcad9fbc, c109dd3c635648459f4b8b39e11bc4d4; no voters: 
I20260709 12:21:09.297132 31452 raft_consensus.cc:2468] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c109dd3c635648459f4b8b39e11bc4d4 in term 5.
I20260709 12:21:09.297176 31764 raft_consensus.cc:2804] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:09.297816 31764 raft_consensus.cc:697] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 5 LEADER]: Becoming Leader. State: Replica: c109dd3c635648459f4b8b39e11bc4d4, State: Running, Role: LEADER
I20260709 12:21:09.298600 31764 consensus_queue.cc:237] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } }
I20260709 12:21:09.304811 31200 catalog_manager.cc:5697] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 reported cstate change: term changed from 4 to 5, leader changed from 8681be3c8e024edda6eb16ccb8bf7ac0 (127.20.191.3) to c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2). New cstate: current_term: 5 leader_uuid: "c109dd3c635648459f4b8b39e11bc4d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:09.312306 31376 raft_consensus.cc:1275] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [term 3 FOLLOWER]: Refusing update from remote peer 8681be3c8e024edda6eb16ccb8bf7ac0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:09.313520 31759 consensus_queue.cc:1048] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c109dd3c635648459f4b8b39e11bc4d4" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:09.321352 31646 raft_consensus.cc:1275] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [term 3 FOLLOWER]: Refusing update from remote peer 8681be3c8e024edda6eb16ccb8bf7ac0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:09.322950 31759 consensus_queue.cc:1048] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:09.420943 31452 raft_consensus.cc:1275] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 FOLLOWER]: Refusing update from remote peer c109dd3c635648459f4b8b39e11bc4d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:09.422209 31764 consensus_queue.cc:1048] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:09.431739 31646 raft_consensus.cc:1275] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 4 FOLLOWER]: Refusing update from remote peer c109dd3c635648459f4b8b39e11bc4d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:09.433229 31721 consensus_queue.cc:1048] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:21:09.518389 31248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:21:09.689555 31646 raft_consensus.cc:1275] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 5 FOLLOWER]: Refusing update from remote peer c109dd3c635648459f4b8b39e11bc4d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:09.691414 31774 consensus_queue.cc:1048] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba1cb7ff4d4340b3a277621adcad9fbc" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:09.701432 31452 raft_consensus.cc:1275] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 5 FOLLOWER]: Refusing update from remote peer c109dd3c635648459f4b8b39e11bc4d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:09.703064 31774 consensus_queue.cc:1048] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8681be3c8e024edda6eb16ccb8bf7ac0" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:09.786386 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:09.817860 21244 tablet_server.cc:179] TabletServer@127.20.191.1:42997 shutting down...
I20260709 12:21:09.840679 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:09.841545 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:09.842384 21244 raft_consensus.cc:2243] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.843009 21244 raft_consensus.cc:2272] T ef9c407a3aed46b69eb4b4c875adc6b4 P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:09.845259 31416 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 82 similar messages]
I20260709 12:21:09.846316 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:09.847188 21244 raft_consensus.cc:2243] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.847816 21244 raft_consensus.cc:2272] T 6d66a37a6c894ba7ab6a17172f04740c P ba1cb7ff4d4340b3a277621adcad9fbc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:09.848730 31416 consensus_peers.cc:597] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:09.851245 21244 tablet_replica.cc:333] stopping tablet replica
W20260709 12:21:09.851943 31342 consensus_peers.cc:597] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:09.852217 21244 raft_consensus.cc:2243] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.852759 21244 raft_consensus.cc:2272] T 08604d1cb7384c1e85b7928e9ef4fcbb P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.855209 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:09.855790 21244 raft_consensus.cc:2243] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.856207 21244 raft_consensus.cc:2272] T 36f58a2613aa49eca2e2df2436ae93aa P ba1cb7ff4d4340b3a277621adcad9fbc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.859279 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:09.859886 21244 raft_consensus.cc:2243] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.860354 21244 raft_consensus.cc:2272] T 94e029757f2e4b11abdb36a95b2fd7dc P ba1cb7ff4d4340b3a277621adcad9fbc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.862520 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:09.863045 21244 raft_consensus.cc:2243] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.863528 21244 raft_consensus.cc:2272] T e0821fd6ca4c44eab8c17649a7e8d898 P ba1cb7ff4d4340b3a277621adcad9fbc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.866390 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:09.866989 21244 raft_consensus.cc:2243] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.867545 21244 raft_consensus.cc:2272] T fa55de36bac74222b2a8fd30d864f1d7 P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.870047 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:09.870559 21244 raft_consensus.cc:2243] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.871076 21244 raft_consensus.cc:2272] T ff7a45ef6a6a4ead9c8421b94e3f9155 P ba1cb7ff4d4340b3a277621adcad9fbc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.873543 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:09.874114 21244 raft_consensus.cc:2243] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.874552 21244 raft_consensus.cc:2272] T 07cd3429d1d442d586b729a487b800c0 P ba1cb7ff4d4340b3a277621adcad9fbc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.876541 21244 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:09.877020 21244 raft_consensus.cc:2243] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.877466 21244 raft_consensus.cc:2272] T 5c823555de1945e5827161b0499a00d9 P ba1cb7ff4d4340b3a277621adcad9fbc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.898191 21244 tablet_server.cc:196] TabletServer@127.20.191.1:42997 shutdown complete.
I20260709 12:21:09.925098 21244 tablet_server.cc:179] TabletServer@127.20.191.2:0 shutting down...
I20260709 12:21:09.954618 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:09.955514 21244 tablet_replica.cc:333] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4: stopping tablet replica
I20260709 12:21:09.956456 21244 raft_consensus.cc:2243] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.957013 21244 raft_consensus.cc:2272] T 36f58a2613aa49eca2e2df2436ae93aa P c109dd3c635648459f4b8b39e11bc4d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.959829 21244 tablet_replica.cc:333] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4: stopping tablet replica
I20260709 12:21:09.960551 21244 raft_consensus.cc:2243] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:09.961609 21244 raft_consensus.cc:2272] T 07cd3429d1d442d586b729a487b800c0 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.964519 21244 tablet_replica.cc:333] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4: stopping tablet replica
I20260709 12:21:09.965296 21244 raft_consensus.cc:2243] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:21:09.966234 21244 raft_consensus.cc:2272] T 5c823555de1945e5827161b0499a00d9 P c109dd3c635648459f4b8b39e11bc4d4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.969934 21244 tablet_replica.cc:333] T 6d66a37a6c894ba7ab6a17172f04740c P c109dd3c635648459f4b8b39e11bc4d4: stopping tablet replica
I20260709 12:21:09.970692 21244 raft_consensus.cc:2243] T 6d66a37a6c894ba7ab6a17172f04740c P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.971194 21244 raft_consensus.cc:2272] T 6d66a37a6c894ba7ab6a17172f04740c P c109dd3c635648459f4b8b39e11bc4d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.973693 21244 tablet_replica.cc:333] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4: stopping tablet replica
I20260709 12:21:09.974480 21244 raft_consensus.cc:2243] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.974987 21244 raft_consensus.cc:2272] T ef9c407a3aed46b69eb4b4c875adc6b4 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.977263 21244 tablet_replica.cc:333] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4: stopping tablet replica
I20260709 12:21:09.977921 21244 raft_consensus.cc:2243] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.978344 21244 raft_consensus.cc:2272] T 08604d1cb7384c1e85b7928e9ef4fcbb P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.980406 21244 tablet_replica.cc:333] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4: stopping tablet replica
I20260709 12:21:09.980906 21244 raft_consensus.cc:2243] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.981323 21244 raft_consensus.cc:2272] T 94e029757f2e4b11abdb36a95b2fd7dc P c109dd3c635648459f4b8b39e11bc4d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.983454 21244 tablet_replica.cc:333] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4: stopping tablet replica
I20260709 12:21:09.984009 21244 raft_consensus.cc:2243] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:21:09.984792 21244 raft_consensus.cc:2272] T e0821fd6ca4c44eab8c17649a7e8d898 P c109dd3c635648459f4b8b39e11bc4d4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.987533 21244 tablet_replica.cc:333] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4: stopping tablet replica
I20260709 12:21:09.988093 21244 raft_consensus.cc:2243] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:21:09.988978 21244 raft_consensus.cc:2272] T ff7a45ef6a6a4ead9c8421b94e3f9155 P c109dd3c635648459f4b8b39e11bc4d4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.991199 21244 tablet_replica.cc:333] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4: stopping tablet replica
I20260709 12:21:09.991719 21244 raft_consensus.cc:2243] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:09.992631 21244 raft_consensus.cc:2272] T fa55de36bac74222b2a8fd30d864f1d7 P c109dd3c635648459f4b8b39e11bc4d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.016315 21244 tablet_server.cc:196] TabletServer@127.20.191.2:0 shutdown complete.
W20260709 12:21:10.022941 31416 consensus_peers.cc:597] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 -> Peer ba1cb7ff4d4340b3a277621adcad9fbc (127.20.191.1:42997): Couldn't send request to peer ba1cb7ff4d4340b3a277621adcad9fbc. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:10.041966 21244 tablet_server.cc:179] TabletServer@127.20.191.3:0 shutting down...
W20260709 12:21:10.069550 31416 consensus_peers.cc:597] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 -> Peer c109dd3c635648459f4b8b39e11bc4d4 (127.20.191.2:33657): Couldn't send request to peer c109dd3c635648459f4b8b39e11bc4d4. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:33657: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:10.070601 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:10.071251 21244 tablet_replica.cc:333] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0: stopping tablet replica
I20260709 12:21:10.071920 21244 raft_consensus.cc:2243] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:10.072361 21244 raft_consensus.cc:2272] T 5c823555de1945e5827161b0499a00d9 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.075067 21244 tablet_replica.cc:333] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0: stopping tablet replica
I20260709 12:21:10.075642 21244 raft_consensus.cc:2243] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:10.076059 21244 raft_consensus.cc:2272] T 07cd3429d1d442d586b729a487b800c0 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.078137 21244 tablet_replica.cc:333] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0: stopping tablet replica
I20260709 12:21:10.078624 21244 raft_consensus.cc:2243] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:10.079352 21244 raft_consensus.cc:2272] T 08604d1cb7384c1e85b7928e9ef4fcbb P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.081245 21244 tablet_replica.cc:333] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0: stopping tablet replica
I20260709 12:21:10.081904 21244 raft_consensus.cc:2243] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:10.082300 21244 raft_consensus.cc:2272] T e0821fd6ca4c44eab8c17649a7e8d898 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.085240 21244 tablet_replica.cc:333] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0: stopping tablet replica
I20260709 12:21:10.085968 21244 raft_consensus.cc:2243] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:10.086745 21244 raft_consensus.cc:2272] T 94e029757f2e4b11abdb36a95b2fd7dc P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.089282 21244 tablet_replica.cc:333] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0: stopping tablet replica
I20260709 12:21:10.089910 21244 raft_consensus.cc:2243] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:10.090691 21244 raft_consensus.cc:2272] T ef9c407a3aed46b69eb4b4c875adc6b4 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.092872 21244 tablet_replica.cc:333] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0: stopping tablet replica
I20260709 12:21:10.093499 21244 raft_consensus.cc:2243] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:10.094544 21244 raft_consensus.cc:2272] T 6d66a37a6c894ba7ab6a17172f04740c P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.097046 21244 tablet_replica.cc:333] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0: stopping tablet replica
I20260709 12:21:10.097595 21244 raft_consensus.cc:2243] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:10.098153 21244 raft_consensus.cc:2272] T fa55de36bac74222b2a8fd30d864f1d7 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.100275 21244 tablet_replica.cc:333] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0: stopping tablet replica
I20260709 12:21:10.101269 21244 raft_consensus.cc:2243] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:10.102089 21244 raft_consensus.cc:2272] T ff7a45ef6a6a4ead9c8421b94e3f9155 P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.105031 21244 tablet_replica.cc:333] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0: stopping tablet replica
I20260709 12:21:10.105584 21244 raft_consensus.cc:2243] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:10.106453 21244 raft_consensus.cc:2272] T 36f58a2613aa49eca2e2df2436ae93aa P 8681be3c8e024edda6eb16ccb8bf7ac0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.138913 21244 tablet_server.cc:196] TabletServer@127.20.191.3:0 shutdown complete.
I20260709 12:21:10.165437 21244 master.cc:562] Master@127.20.191.62:43621 shutting down...
I20260709 12:21:10.189025 21244 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:10.189561 21244 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.189919 21244 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0a7f34b680bc4c5485d161de2d914fad: stopping tablet replica
I20260709 12:21:10.211360 21244 master.cc:584] Master@127.20.191.62:43621 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12887 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:21:10.253640 21244 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.191.62:37857
I20260709 12:21:10.254853 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:10.260341 31785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:10.260413 31784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:10.261332 31787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:10.263305 21244 server_base.cc:1061] running on GCE node
I20260709 12:21:10.264235 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:10.264413 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:10.264571 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599670264557 us; error 0 us; skew 500 ppm
I20260709 12:21:10.265085 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:10.267674 21244 webserver.cc:533] Webserver started at http://127.20.191.62:33999/ using document root <none> and password file <none>
I20260709 12:21:10.268191 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:10.268357 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:10.268635 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:10.269802 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/master-0-root/instance:
uuid: "ce55ac9f327844f39981b130cf42e1ab"
format_stamp: "Formatted at 2026-07-09 12:21:10 on dist-test-slave-7c1h"
I20260709 12:21:10.274631 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:21:10.278196 31792 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:10.278959 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 12:21:10.279245 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/master-0-root
uuid: "ce55ac9f327844f39981b130cf42e1ab"
format_stamp: "Formatted at 2026-07-09 12:21:10 on dist-test-slave-7c1h"
I20260709 12:21:10.279575 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:10.292407 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:10.293730 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:10.334628 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.62:37857
I20260709 12:21:10.334736 31843 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.62:37857 every 8 connection(s)
I20260709 12:21:10.338656 31844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:10.351228 31844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab: Bootstrap starting.
I20260709 12:21:10.356550 31844 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:10.361091 31844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab: No bootstrap required, opened a new log
I20260709 12:21:10.363379 31844 raft_consensus.cc:359] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce55ac9f327844f39981b130cf42e1ab" member_type: VOTER }
I20260709 12:21:10.363801 31844 raft_consensus.cc:385] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:10.364029 31844 raft_consensus.cc:740] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce55ac9f327844f39981b130cf42e1ab, State: Initialized, Role: FOLLOWER
I20260709 12:21:10.364651 31844 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce55ac9f327844f39981b130cf42e1ab" member_type: VOTER }
I20260709 12:21:10.365118 31844 raft_consensus.cc:399] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:21:10.365326 31844 raft_consensus.cc:493] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:21:10.365577 31844 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:10.370671 31844 raft_consensus.cc:515] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce55ac9f327844f39981b130cf42e1ab" member_type: VOTER }
I20260709 12:21:10.371253 31844 leader_election.cc:304] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce55ac9f327844f39981b130cf42e1ab; no voters: 
I20260709 12:21:10.372399 31844 leader_election.cc:290] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:21:10.372864 31847 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:10.374306 31847 raft_consensus.cc:697] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [term 1 LEADER]: Becoming Leader. State: Replica: ce55ac9f327844f39981b130cf42e1ab, State: Running, Role: LEADER
I20260709 12:21:10.375033 31847 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce55ac9f327844f39981b130cf42e1ab" member_type: VOTER }
I20260709 12:21:10.375461 31844 sys_catalog.cc:565] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:21:10.380316 31849 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce55ac9f327844f39981b130cf42e1ab. Latest consensus state: current_term: 1 leader_uuid: "ce55ac9f327844f39981b130cf42e1ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce55ac9f327844f39981b130cf42e1ab" member_type: VOTER } }
I20260709 12:21:10.381155 31849 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:10.382385 31848 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce55ac9f327844f39981b130cf42e1ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce55ac9f327844f39981b130cf42e1ab" member_type: VOTER } }
I20260709 12:21:10.383133 31848 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:10.385263 31855 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:21:10.390805 31855 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:21:10.393208 21244 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:21:10.400276 31855 catalog_manager.cc:1383] Generated new cluster ID: ac59e5023d284168aff0f996f8d96e85
I20260709 12:21:10.400600 31855 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:21:10.454995 31855 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:21:10.456364 31855 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:21:10.479586 31855 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab: Generated new TSK 0
I20260709 12:21:10.480172 31855 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:21:10.524559 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:10.531703 31865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:10.533414 31866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:10.534509 31868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:10.534861 21244 server_base.cc:1061] running on GCE node
I20260709 12:21:10.535812 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:10.535995 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:10.536119 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599670536107 us; error 0 us; skew 500 ppm
I20260709 12:21:10.536614 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:10.539018 21244 webserver.cc:533] Webserver started at http://127.20.191.1:40649/ using document root <none> and password file <none>
I20260709 12:21:10.539466 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:10.539630 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:10.539845 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:10.540871 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/ts-0-root/instance:
uuid: "3b3951143a384f049fc5ccbc6de793a2"
format_stamp: "Formatted at 2026-07-09 12:21:10 on dist-test-slave-7c1h"
I20260709 12:21:10.545819 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:21:10.549494 31873 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:10.550318 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:21:10.550639 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/ts-0-root
uuid: "3b3951143a384f049fc5ccbc6de793a2"
format_stamp: "Formatted at 2026-07-09 12:21:10 on dist-test-slave-7c1h"
I20260709 12:21:10.550916 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:10.562819 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:10.564087 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:10.565620 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:10.567970 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:10.568176 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:10.568413 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:10.568579 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:10.609793 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.1:36379
I20260709 12:21:10.609961 31935 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.1:36379 every 8 connection(s)
I20260709 12:21:10.614625 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:10.622838 31940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:10.622994 31941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:10.625988 31943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:10.626857 21244 server_base.cc:1061] running on GCE node
I20260709 12:21:10.628091 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:10.628360 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:10.628356 31936 heartbeater.cc:344] Connected to a master server at 127.20.191.62:37857
I20260709 12:21:10.628566 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599670628549 us; error 0 us; skew 500 ppm
I20260709 12:21:10.628933 31936 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:10.629347 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:10.629760 31936 heartbeater.cc:507] Master 127.20.191.62:37857 requested a full tablet report, sending...
I20260709 12:21:10.632004 31809 ts_manager.cc:194] Registered new tserver with Master: 3b3951143a384f049fc5ccbc6de793a2 (127.20.191.1:36379)
I20260709 12:21:10.632124 21244 webserver.cc:533] Webserver started at http://127.20.191.2:36605/ using document root <none> and password file <none>
I20260709 12:21:10.632754 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:10.632923 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:10.633178 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:10.634021 31809 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33844
I20260709 12:21:10.634399 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/ts-1-root/instance:
uuid: "55c7361a93554f5080f2cc1156764e3d"
format_stamp: "Formatted at 2026-07-09 12:21:10 on dist-test-slave-7c1h"
I20260709 12:21:10.639499 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:21:10.642946 31948 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:10.643711 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:21:10.643993 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/ts-1-root
uuid: "55c7361a93554f5080f2cc1156764e3d"
format_stamp: "Formatted at 2026-07-09 12:21:10 on dist-test-slave-7c1h"
I20260709 12:21:10.644271 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:10.662348 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:10.663501 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:10.664950 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:10.667279 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:10.667495 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:10.667722 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:10.667876 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:10.708743 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.2:44641
I20260709 12:21:10.708846 32010 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.2:44641 every 8 connection(s)
I20260709 12:21:10.713598 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:10.721009 32014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:10.721549 32015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:10.724877 32017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:10.725095 21244 server_base.cc:1061] running on GCE node
I20260709 12:21:10.725786 32011 heartbeater.cc:344] Connected to a master server at 127.20.191.62:37857
I20260709 12:21:10.726179 32011 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:10.726244 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:10.726554 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:10.726722 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599670726705 us; error 0 us; skew 500 ppm
I20260709 12:21:10.726984 32011 heartbeater.cc:507] Master 127.20.191.62:37857 requested a full tablet report, sending...
I20260709 12:21:10.727345 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:10.729332 31809 ts_manager.cc:194] Registered new tserver with Master: 55c7361a93554f5080f2cc1156764e3d (127.20.191.2:44641)
I20260709 12:21:10.730582 21244 webserver.cc:533] Webserver started at http://127.20.191.3:33149/ using document root <none> and password file <none>
I20260709 12:21:10.731381 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:10.731343 31809 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33846
I20260709 12:21:10.731874 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:10.732227 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:10.733584 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/ts-2-root/instance:
uuid: "6c49455c651145b18ec5b8347431953a"
format_stamp: "Formatted at 2026-07-09 12:21:10 on dist-test-slave-7c1h"
I20260709 12:21:10.738370 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:21:10.742265 32022 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:10.743098 21244 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:21:10.743422 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/ts-2-root
uuid: "6c49455c651145b18ec5b8347431953a"
format_stamp: "Formatted at 2026-07-09 12:21:10 on dist-test-slave-7c1h"
I20260709 12:21:10.743738 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599324869158-21244-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:10.763732 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:10.765023 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:10.766547 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:10.768849 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:10.769060 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:10.769328 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:10.769474 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:10.810585 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.3:41573
I20260709 12:21:10.810704 32084 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.3:41573 every 8 connection(s)
I20260709 12:21:10.824453 32085 heartbeater.cc:344] Connected to a master server at 127.20.191.62:37857
I20260709 12:21:10.824884 32085 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:10.825670 32085 heartbeater.cc:507] Master 127.20.191.62:37857 requested a full tablet report, sending...
I20260709 12:21:10.827767 31809 ts_manager.cc:194] Registered new tserver with Master: 6c49455c651145b18ec5b8347431953a (127.20.191.3:41573)
I20260709 12:21:10.828717 21244 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014886531s
I20260709 12:21:10.829190 31809 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33856
I20260709 12:21:10.855435 31809 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33868:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:21:10.857579 31809 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:21:10.920581 31900 tablet_service.cc:1511] Processing CreateTablet for tablet 791b6bac77444aff87f47e5e173f3aa0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=162075f2fde843b7abe94e3c4165defa]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:21:10.920753 31901 tablet_service.cc:1511] Processing CreateTablet for tablet 068a346ecfa34d718b43ece4a0975af9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=162075f2fde843b7abe94e3c4165defa]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:21:10.921974 32050 tablet_service.cc:1511] Processing CreateTablet for tablet 068a346ecfa34d718b43ece4a0975af9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=162075f2fde843b7abe94e3c4165defa]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:21:10.923146 32050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 068a346ecfa34d718b43ece4a0975af9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:10.923062 32049 tablet_service.cc:1511] Processing CreateTablet for tablet 791b6bac77444aff87f47e5e173f3aa0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=162075f2fde843b7abe94e3c4165defa]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:21:10.924628 32049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791b6bac77444aff87f47e5e173f3aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:10.925376 31976 tablet_service.cc:1511] Processing CreateTablet for tablet 068a346ecfa34d718b43ece4a0975af9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=162075f2fde843b7abe94e3c4165defa]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:21:10.925897 31975 tablet_service.cc:1511] Processing CreateTablet for tablet 791b6bac77444aff87f47e5e173f3aa0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=162075f2fde843b7abe94e3c4165defa]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:21:10.926790 31976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 068a346ecfa34d718b43ece4a0975af9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:10.927407 31975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791b6bac77444aff87f47e5e173f3aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:10.922009 31900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791b6bac77444aff87f47e5e173f3aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:10.930990 31901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 068a346ecfa34d718b43ece4a0975af9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:10.949498 32100 tablet_bootstrap.cc:492] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a: Bootstrap starting.
I20260709 12:21:10.958372 32100 tablet_bootstrap.cc:654] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:10.963052 32101 tablet_bootstrap.cc:492] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d: Bootstrap starting.
I20260709 12:21:10.968544 32102 tablet_bootstrap.cc:492] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2: Bootstrap starting.
I20260709 12:21:10.969858 32101 tablet_bootstrap.cc:654] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:10.970934 32100 tablet_bootstrap.cc:492] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a: No bootstrap required, opened a new log
I20260709 12:21:10.971483 32100 ts_tablet_manager.cc:1403] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.011s
I20260709 12:21:10.974529 32101 tablet_bootstrap.cc:492] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d: No bootstrap required, opened a new log
I20260709 12:21:10.975013 32101 ts_tablet_manager.cc:1403] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d: Time spent bootstrapping tablet: real 0.012s	user 0.002s	sys 0.010s
I20260709 12:21:10.974706 32100 raft_consensus.cc:359] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:10.975524 32100 raft_consensus.cc:385] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:10.975824 32100 raft_consensus.cc:740] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c49455c651145b18ec5b8347431953a, State: Initialized, Role: FOLLOWER
I20260709 12:21:10.976595 32102 tablet_bootstrap.cc:654] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:10.976720 32100 consensus_queue.cc:260] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:10.977573 32101 raft_consensus.cc:359] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } }
I20260709 12:21:10.978186 32101 raft_consensus.cc:385] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:10.978477 32101 raft_consensus.cc:740] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55c7361a93554f5080f2cc1156764e3d, State: Initialized, Role: FOLLOWER
I20260709 12:21:10.979369 32085 heartbeater.cc:499] Master 127.20.191.62:37857 was elected leader, sending a full tablet report...
I20260709 12:21:10.979879 32100 ts_tablet_manager.cc:1434] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:21:10.979426 32101 consensus_queue.cc:260] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } }
I20260709 12:21:10.981060 32100 tablet_bootstrap.cc:492] T 068a346ecfa34d718b43ece4a0975af9 P 6c49455c651145b18ec5b8347431953a: Bootstrap starting.
I20260709 12:21:10.992641 32100 tablet_bootstrap.cc:654] T 068a346ecfa34d718b43ece4a0975af9 P 6c49455c651145b18ec5b8347431953a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.006042 32011 heartbeater.cc:499] Master 127.20.191.62:37857 was elected leader, sending a full tablet report...
I20260709 12:21:11.005527 32100 tablet_bootstrap.cc:492] T 068a346ecfa34d718b43ece4a0975af9 P 6c49455c651145b18ec5b8347431953a: No bootstrap required, opened a new log
I20260709 12:21:11.006698 32101 ts_tablet_manager.cc:1434] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d: Time spent starting tablet: real 0.031s	user 0.011s	sys 0.019s
I20260709 12:21:11.006897 32100 ts_tablet_manager.cc:1403] T 068a346ecfa34d718b43ece4a0975af9 P 6c49455c651145b18ec5b8347431953a: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.007s
I20260709 12:21:11.007786 32101 tablet_bootstrap.cc:492] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d: Bootstrap starting.
I20260709 12:21:11.009943 32102 tablet_bootstrap.cc:492] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2: No bootstrap required, opened a new log
I20260709 12:21:11.010622 32102 ts_tablet_manager.cc:1403] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2: Time spent bootstrapping tablet: real 0.042s	user 0.028s	sys 0.011s
I20260709 12:21:11.013551 32100 raft_consensus.cc:359] T 068a346ecfa34d718b43ece4a0975af9 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } }
I20260709 12:21:11.014469 32100 raft_consensus.cc:385] T 068a346ecfa34d718b43ece4a0975af9 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.013984 32102 raft_consensus.cc:359] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } }
I20260709 12:21:11.014802 32100 raft_consensus.cc:740] T 068a346ecfa34d718b43ece4a0975af9 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c49455c651145b18ec5b8347431953a, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.015022 32102 raft_consensus.cc:385] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.015286 32101 tablet_bootstrap.cc:654] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.015585 32102 raft_consensus.cc:740] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b3951143a384f049fc5ccbc6de793a2, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.015654 32100 consensus_queue.cc:260] T 068a346ecfa34d718b43ece4a0975af9 P 6c49455c651145b18ec5b8347431953a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } }
I20260709 12:21:11.016719 32102 consensus_queue.cc:260] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } }
I20260709 12:21:11.020140 32100 ts_tablet_manager.cc:1434] T 068a346ecfa34d718b43ece4a0975af9 P 6c49455c651145b18ec5b8347431953a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:21:11.022626 32107 raft_consensus.cc:493] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.023222 32107 raft_consensus.cc:515] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } }
I20260709 12:21:11.024168 32102 ts_tablet_manager.cc:1434] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.004s
I20260709 12:21:11.025303 32102 tablet_bootstrap.cc:492] T 791b6bac77444aff87f47e5e173f3aa0 P 3b3951143a384f049fc5ccbc6de793a2: Bootstrap starting.
I20260709 12:21:11.025444 32101 tablet_bootstrap.cc:492] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d: No bootstrap required, opened a new log
I20260709 12:21:11.026093 32101 ts_tablet_manager.cc:1403] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:21:11.029071 32101 raft_consensus.cc:359] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.029821 32101 raft_consensus.cc:385] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.030113 32101 raft_consensus.cc:740] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55c7361a93554f5080f2cc1156764e3d, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.023552 31936 heartbeater.cc:499] Master 127.20.191.62:37857 was elected leader, sending a full tablet report...
I20260709 12:21:11.030827 32101 consensus_queue.cc:260] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.033008 32102 tablet_bootstrap.cc:654] T 791b6bac77444aff87f47e5e173f3aa0 P 3b3951143a384f049fc5ccbc6de793a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.033972 32107 leader_election.cc:290] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b3951143a384f049fc5ccbc6de793a2 (127.20.191.1:36379), 6c49455c651145b18ec5b8347431953a (127.20.191.3:41573)
I20260709 12:21:11.043836 32060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068a346ecfa34d718b43ece4a0975af9" candidate_uuid: "55c7361a93554f5080f2cc1156764e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c49455c651145b18ec5b8347431953a" is_pre_election: true
I20260709 12:21:11.044762 32060 raft_consensus.cc:2468] T 068a346ecfa34d718b43ece4a0975af9 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55c7361a93554f5080f2cc1156764e3d in term 0.
I20260709 12:21:11.046727 31949 leader_election.cc:304] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55c7361a93554f5080f2cc1156764e3d, 6c49455c651145b18ec5b8347431953a; no voters: 
I20260709 12:21:11.047806 32107 raft_consensus.cc:2804] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:11.048228 32107 raft_consensus.cc:493] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.048586 32107 raft_consensus.cc:3060] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.061267 32102 tablet_bootstrap.cc:492] T 791b6bac77444aff87f47e5e173f3aa0 P 3b3951143a384f049fc5ccbc6de793a2: No bootstrap required, opened a new log
I20260709 12:21:11.061525 32101 ts_tablet_manager.cc:1434] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d: Time spent starting tablet: real 0.035s	user 0.014s	sys 0.019s
I20260709 12:21:11.062088 32102 ts_tablet_manager.cc:1403] T 791b6bac77444aff87f47e5e173f3aa0 P 3b3951143a384f049fc5ccbc6de793a2: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.012s
I20260709 12:21:11.064877 32107 raft_consensus.cc:515] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } }
I20260709 12:21:11.066627 32102 raft_consensus.cc:359] T 791b6bac77444aff87f47e5e173f3aa0 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.067484 32102 raft_consensus.cc:385] T 791b6bac77444aff87f47e5e173f3aa0 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.067852 32102 raft_consensus.cc:740] T 791b6bac77444aff87f47e5e173f3aa0 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b3951143a384f049fc5ccbc6de793a2, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.068832 32102 consensus_queue.cc:260] T 791b6bac77444aff87f47e5e173f3aa0 P 3b3951143a384f049fc5ccbc6de793a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.069787 32107 leader_election.cc:290] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [CANDIDATE]: Term 1 election: Requested vote from peers 3b3951143a384f049fc5ccbc6de793a2 (127.20.191.1:36379), 6c49455c651145b18ec5b8347431953a (127.20.191.3:41573)
I20260709 12:21:11.070410 31911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068a346ecfa34d718b43ece4a0975af9" candidate_uuid: "55c7361a93554f5080f2cc1156764e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b3951143a384f049fc5ccbc6de793a2" is_pre_election: true
I20260709 12:21:11.071146 31911 raft_consensus.cc:2468] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55c7361a93554f5080f2cc1156764e3d in term 0.
I20260709 12:21:11.071384 32102 ts_tablet_manager.cc:1434] T 791b6bac77444aff87f47e5e173f3aa0 P 3b3951143a384f049fc5ccbc6de793a2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:21:11.072283 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068a346ecfa34d718b43ece4a0975af9" candidate_uuid: "55c7361a93554f5080f2cc1156764e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b3951143a384f049fc5ccbc6de793a2"
I20260709 12:21:11.072660 32060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068a346ecfa34d718b43ece4a0975af9" candidate_uuid: "55c7361a93554f5080f2cc1156764e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c49455c651145b18ec5b8347431953a"
I20260709 12:21:11.072929 31910 raft_consensus.cc:3060] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.073249 32060 raft_consensus.cc:3060] T 068a346ecfa34d718b43ece4a0975af9 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.080804 32060 raft_consensus.cc:2468] T 068a346ecfa34d718b43ece4a0975af9 P 6c49455c651145b18ec5b8347431953a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55c7361a93554f5080f2cc1156764e3d in term 1.
I20260709 12:21:11.080804 31910 raft_consensus.cc:2468] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55c7361a93554f5080f2cc1156764e3d in term 1.
I20260709 12:21:11.082247 31949 leader_election.cc:304] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55c7361a93554f5080f2cc1156764e3d, 6c49455c651145b18ec5b8347431953a; no voters: 
I20260709 12:21:11.082935 32107 raft_consensus.cc:2804] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:11.083328 32107 raft_consensus.cc:697] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 1 LEADER]: Becoming Leader. State: Replica: 55c7361a93554f5080f2cc1156764e3d, State: Running, Role: LEADER
I20260709 12:21:11.084071 32107 consensus_queue.cc:237] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } }
I20260709 12:21:11.091168 31809 catalog_manager.cc:5697] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 55c7361a93554f5080f2cc1156764e3d (127.20.191.2). New cstate: current_term: 1 leader_uuid: "55c7361a93554f5080f2cc1156764e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:11.341099 32105 raft_consensus.cc:493] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.341658 32105 raft_consensus.cc:515] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.343767 32105 leader_election.cc:290] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b3951143a384f049fc5ccbc6de793a2 (127.20.191.1:36379), 55c7361a93554f5080f2cc1156764e3d (127.20.191.2:44641)
I20260709 12:21:11.354777 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791b6bac77444aff87f47e5e173f3aa0" candidate_uuid: "6c49455c651145b18ec5b8347431953a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b3951143a384f049fc5ccbc6de793a2" is_pre_election: true
I20260709 12:21:11.355540 31910 raft_consensus.cc:2468] T 791b6bac77444aff87f47e5e173f3aa0 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c49455c651145b18ec5b8347431953a in term 0.
I20260709 12:21:11.355458 31986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791b6bac77444aff87f47e5e173f3aa0" candidate_uuid: "6c49455c651145b18ec5b8347431953a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55c7361a93554f5080f2cc1156764e3d" is_pre_election: true
I20260709 12:21:11.356391 31986 raft_consensus.cc:2468] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c49455c651145b18ec5b8347431953a in term 0.
I20260709 12:21:11.356792 32024 leader_election.cc:304] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b3951143a384f049fc5ccbc6de793a2, 6c49455c651145b18ec5b8347431953a; no voters: 
I20260709 12:21:11.357566 32105 raft_consensus.cc:2804] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:11.357955 32105 raft_consensus.cc:493] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.358212 32105 raft_consensus.cc:3060] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.363821 32105 raft_consensus.cc:515] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.366276 32105 leader_election.cc:290] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [CANDIDATE]: Term 1 election: Requested vote from peers 3b3951143a384f049fc5ccbc6de793a2 (127.20.191.1:36379), 55c7361a93554f5080f2cc1156764e3d (127.20.191.2:44641)
I20260709 12:21:11.367048 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791b6bac77444aff87f47e5e173f3aa0" candidate_uuid: "6c49455c651145b18ec5b8347431953a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b3951143a384f049fc5ccbc6de793a2"
I20260709 12:21:11.367792 31986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791b6bac77444aff87f47e5e173f3aa0" candidate_uuid: "6c49455c651145b18ec5b8347431953a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55c7361a93554f5080f2cc1156764e3d"
I20260709 12:21:11.368042 31910 raft_consensus.cc:3060] T 791b6bac77444aff87f47e5e173f3aa0 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.368528 31986 raft_consensus.cc:3060] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.373838 31910 raft_consensus.cc:2468] T 791b6bac77444aff87f47e5e173f3aa0 P 3b3951143a384f049fc5ccbc6de793a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c49455c651145b18ec5b8347431953a in term 1.
I20260709 12:21:11.374145 31986 raft_consensus.cc:2468] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c49455c651145b18ec5b8347431953a in term 1.
I20260709 12:21:11.375124 32024 leader_election.cc:304] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b3951143a384f049fc5ccbc6de793a2, 6c49455c651145b18ec5b8347431953a; no voters: 
I20260709 12:21:11.375950 32105 raft_consensus.cc:2804] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:11.377144 32105 raft_consensus.cc:697] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 1 LEADER]: Becoming Leader. State: Replica: 6c49455c651145b18ec5b8347431953a, State: Running, Role: LEADER
I20260709 12:21:11.377936 32105 consensus_queue.cc:237] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.385152 31809 catalog_manager.cc:5697] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c49455c651145b18ec5b8347431953a (127.20.191.3). New cstate: current_term: 1 leader_uuid: "6c49455c651145b18ec5b8347431953a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:11.389497 31857 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:11.478473 32107 consensus_queue.cc:1048] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:11.491276 32112 consensus_queue.cc:1048] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:11.525137 31808 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33874:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:21:11.527107 31808 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:21:11.550886 31901 tablet_service.cc:1511] Processing CreateTablet for tablet 7e53dcdaf0c946acb411e89b68d44b18 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ff4095031c0c436d98b2466e9e3ff5c5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:21:11.551926 31975 tablet_service.cc:1511] Processing CreateTablet for tablet 7e53dcdaf0c946acb411e89b68d44b18 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ff4095031c0c436d98b2466e9e3ff5c5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:21:11.552321 31901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e53dcdaf0c946acb411e89b68d44b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.553316 32050 tablet_service.cc:1511] Processing CreateTablet for tablet 7e53dcdaf0c946acb411e89b68d44b18 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ff4095031c0c436d98b2466e9e3ff5c5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:21:11.553285 31975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e53dcdaf0c946acb411e89b68d44b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.554647 32050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e53dcdaf0c946acb411e89b68d44b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.556443 31900 tablet_service.cc:1511] Processing CreateTablet for tablet 0aea5b7cc177493199c6dd6daa6587c6 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ff4095031c0c436d98b2466e9e3ff5c5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:21:11.557791 31900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aea5b7cc177493199c6dd6daa6587c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.559196 32049 tablet_service.cc:1511] Processing CreateTablet for tablet 0aea5b7cc177493199c6dd6daa6587c6 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ff4095031c0c436d98b2466e9e3ff5c5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:21:11.557818 31976 tablet_service.cc:1511] Processing CreateTablet for tablet 0aea5b7cc177493199c6dd6daa6587c6 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ff4095031c0c436d98b2466e9e3ff5c5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:21:11.560570 32049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aea5b7cc177493199c6dd6daa6587c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.560708 31976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aea5b7cc177493199c6dd6daa6587c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.583407 32131 tablet_bootstrap.cc:492] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2: Bootstrap starting.
I20260709 12:21:11.594934 32130 tablet_bootstrap.cc:492] T 7e53dcdaf0c946acb411e89b68d44b18 P 55c7361a93554f5080f2cc1156764e3d: Bootstrap starting.
I20260709 12:21:11.595505 32131 tablet_bootstrap.cc:654] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.599030 32132 tablet_bootstrap.cc:492] T 7e53dcdaf0c946acb411e89b68d44b18 P 6c49455c651145b18ec5b8347431953a: Bootstrap starting.
I20260709 12:21:11.601460 32130 tablet_bootstrap.cc:654] T 7e53dcdaf0c946acb411e89b68d44b18 P 55c7361a93554f5080f2cc1156764e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.604720 32131 tablet_bootstrap.cc:492] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2: No bootstrap required, opened a new log
I20260709 12:21:11.605156 32131 ts_tablet_manager.cc:1403] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.003s
I20260709 12:21:11.606876 32132 tablet_bootstrap.cc:654] T 7e53dcdaf0c946acb411e89b68d44b18 P 6c49455c651145b18ec5b8347431953a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.607643 32131 raft_consensus.cc:359] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.608414 32131 raft_consensus.cc:385] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.609004 32131 raft_consensus.cc:740] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b3951143a384f049fc5ccbc6de793a2, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.609926 32131 consensus_queue.cc:260] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.610378 32130 tablet_bootstrap.cc:492] T 7e53dcdaf0c946acb411e89b68d44b18 P 55c7361a93554f5080f2cc1156764e3d: No bootstrap required, opened a new log
I20260709 12:21:11.610980 32130 ts_tablet_manager.cc:1403] T 7e53dcdaf0c946acb411e89b68d44b18 P 55c7361a93554f5080f2cc1156764e3d: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.007s
I20260709 12:21:11.612512 32131 ts_tablet_manager.cc:1434] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:21:11.613788 32131 tablet_bootstrap.cc:492] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2: Bootstrap starting.
I20260709 12:21:11.615188 32130 raft_consensus.cc:359] T 7e53dcdaf0c946acb411e89b68d44b18 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.616029 32130 raft_consensus.cc:385] T 7e53dcdaf0c946acb411e89b68d44b18 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.616353 32130 raft_consensus.cc:740] T 7e53dcdaf0c946acb411e89b68d44b18 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55c7361a93554f5080f2cc1156764e3d, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.617255 32130 consensus_queue.cc:260] T 7e53dcdaf0c946acb411e89b68d44b18 P 55c7361a93554f5080f2cc1156764e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.621482 32131 tablet_bootstrap.cc:654] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.622059 32130 ts_tablet_manager.cc:1434] T 7e53dcdaf0c946acb411e89b68d44b18 P 55c7361a93554f5080f2cc1156764e3d: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.005s
I20260709 12:21:11.623260 32130 tablet_bootstrap.cc:492] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d: Bootstrap starting.
I20260709 12:21:11.623637 32132 tablet_bootstrap.cc:492] T 7e53dcdaf0c946acb411e89b68d44b18 P 6c49455c651145b18ec5b8347431953a: No bootstrap required, opened a new log
I20260709 12:21:11.624254 32132 ts_tablet_manager.cc:1403] T 7e53dcdaf0c946acb411e89b68d44b18 P 6c49455c651145b18ec5b8347431953a: Time spent bootstrapping tablet: real 0.026s	user 0.004s	sys 0.016s
I20260709 12:21:11.627899 32132 raft_consensus.cc:359] T 7e53dcdaf0c946acb411e89b68d44b18 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.629009 32132 raft_consensus.cc:385] T 7e53dcdaf0c946acb411e89b68d44b18 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.629400 32132 raft_consensus.cc:740] T 7e53dcdaf0c946acb411e89b68d44b18 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c49455c651145b18ec5b8347431953a, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.629962 32130 tablet_bootstrap.cc:654] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.630692 32132 consensus_queue.cc:260] T 7e53dcdaf0c946acb411e89b68d44b18 P 6c49455c651145b18ec5b8347431953a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.632158 32109 raft_consensus.cc:493] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.632682 32109 raft_consensus.cc:515] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.633970 32132 ts_tablet_manager.cc:1434] T 7e53dcdaf0c946acb411e89b68d44b18 P 6c49455c651145b18ec5b8347431953a: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.006s
I20260709 12:21:11.635205 32132 tablet_bootstrap.cc:492] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a: Bootstrap starting.
I20260709 12:21:11.636884 32109 leader_election.cc:290] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55c7361a93554f5080f2cc1156764e3d (127.20.191.2:44641), 6c49455c651145b18ec5b8347431953a (127.20.191.3:41573)
I20260709 12:21:11.642590 32132 tablet_bootstrap.cc:654] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.654405 32131 tablet_bootstrap.cc:492] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2: No bootstrap required, opened a new log
I20260709 12:21:11.654978 32131 ts_tablet_manager.cc:1403] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2: Time spent bootstrapping tablet: real 0.041s	user 0.024s	sys 0.001s
I20260709 12:21:11.657944 32131 raft_consensus.cc:359] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.658658 32131 raft_consensus.cc:385] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.658944 32131 raft_consensus.cc:740] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b3951143a384f049fc5ccbc6de793a2, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.659668 32131 consensus_queue.cc:260] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.665611 32131 ts_tablet_manager.cc:1434] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:21:11.672300 32132 tablet_bootstrap.cc:492] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a: No bootstrap required, opened a new log
I20260709 12:21:11.672962 32132 ts_tablet_manager.cc:1403] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.019s
I20260709 12:21:11.676399 32132 raft_consensus.cc:359] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.677448 32132 raft_consensus.cc:385] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.677832 32132 raft_consensus.cc:740] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c49455c651145b18ec5b8347431953a, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.678786 32132 consensus_queue.cc:260] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.681123 32132 ts_tablet_manager.cc:1434] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:21:11.681854 31986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53dcdaf0c946acb411e89b68d44b18" candidate_uuid: "3b3951143a384f049fc5ccbc6de793a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55c7361a93554f5080f2cc1156764e3d" is_pre_election: true
I20260709 12:21:11.682554 31986 raft_consensus.cc:2468] T 7e53dcdaf0c946acb411e89b68d44b18 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b3951143a384f049fc5ccbc6de793a2 in term 0.
I20260709 12:21:11.683727 32130 tablet_bootstrap.cc:492] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d: No bootstrap required, opened a new log
I20260709 12:21:11.683883 31877 leader_election.cc:304] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b3951143a384f049fc5ccbc6de793a2, 55c7361a93554f5080f2cc1156764e3d; no voters: 
I20260709 12:21:11.684386 32130 ts_tablet_manager.cc:1403] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.006s
I20260709 12:21:11.684870 32109 raft_consensus.cc:2804] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:11.685335 32109 raft_consensus.cc:493] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.685158 32060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53dcdaf0c946acb411e89b68d44b18" candidate_uuid: "3b3951143a384f049fc5ccbc6de793a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c49455c651145b18ec5b8347431953a" is_pre_election: true
I20260709 12:21:11.685801 32109 raft_consensus.cc:3060] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.686048 32060 raft_consensus.cc:2468] T 7e53dcdaf0c946acb411e89b68d44b18 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b3951143a384f049fc5ccbc6de793a2 in term 0.
I20260709 12:21:11.687774 32130 raft_consensus.cc:359] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.688573 32130 raft_consensus.cc:385] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.688874 32130 raft_consensus.cc:740] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55c7361a93554f5080f2cc1156764e3d, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.689683 32130 consensus_queue.cc:260] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.692080 32130 ts_tablet_manager.cc:1434] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:21:11.693418 32105 raft_consensus.cc:493] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.694007 32105 raft_consensus.cc:515] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.696224 32105 leader_election.cc:290] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b3951143a384f049fc5ccbc6de793a2 (127.20.191.1:36379), 55c7361a93554f5080f2cc1156764e3d (127.20.191.2:44641)
I20260709 12:21:11.696328 32109 raft_consensus.cc:515] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.696988 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aea5b7cc177493199c6dd6daa6587c6" candidate_uuid: "6c49455c651145b18ec5b8347431953a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b3951143a384f049fc5ccbc6de793a2" is_pre_election: true
I20260709 12:21:11.697650 31910 raft_consensus.cc:2468] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c49455c651145b18ec5b8347431953a in term 0.
I20260709 12:21:11.697890 31986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aea5b7cc177493199c6dd6daa6587c6" candidate_uuid: "6c49455c651145b18ec5b8347431953a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55c7361a93554f5080f2cc1156764e3d" is_pre_election: true
I20260709 12:21:11.698547 32109 leader_election.cc:290] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [CANDIDATE]: Term 1 election: Requested vote from peers 55c7361a93554f5080f2cc1156764e3d (127.20.191.2:44641), 6c49455c651145b18ec5b8347431953a (127.20.191.3:41573)
I20260709 12:21:11.698566 31986 raft_consensus.cc:2468] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c49455c651145b18ec5b8347431953a in term 0.
I20260709 12:21:11.698990 32024 leader_election.cc:304] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b3951143a384f049fc5ccbc6de793a2, 6c49455c651145b18ec5b8347431953a; no voters: 
I20260709 12:21:11.699815 32105 raft_consensus.cc:2804] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:11.700238 32105 raft_consensus.cc:493] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.700551 32105 raft_consensus.cc:3060] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.700815 31986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53dcdaf0c946acb411e89b68d44b18" candidate_uuid: "3b3951143a384f049fc5ccbc6de793a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55c7361a93554f5080f2cc1156764e3d"
I20260709 12:21:11.701408 32060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53dcdaf0c946acb411e89b68d44b18" candidate_uuid: "3b3951143a384f049fc5ccbc6de793a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c49455c651145b18ec5b8347431953a"
I20260709 12:21:11.702039 32060 raft_consensus.cc:3060] T 7e53dcdaf0c946acb411e89b68d44b18 P 6c49455c651145b18ec5b8347431953a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.701412 31986 raft_consensus.cc:3060] T 7e53dcdaf0c946acb411e89b68d44b18 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.706976 32105 raft_consensus.cc:515] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.709139 32105 leader_election.cc:290] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [CANDIDATE]: Term 1 election: Requested vote from peers 3b3951143a384f049fc5ccbc6de793a2 (127.20.191.1:36379), 55c7361a93554f5080f2cc1156764e3d (127.20.191.2:44641)
I20260709 12:21:11.709997 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aea5b7cc177493199c6dd6daa6587c6" candidate_uuid: "6c49455c651145b18ec5b8347431953a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b3951143a384f049fc5ccbc6de793a2"
I20260709 12:21:11.710309 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aea5b7cc177493199c6dd6daa6587c6" candidate_uuid: "6c49455c651145b18ec5b8347431953a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55c7361a93554f5080f2cc1156764e3d"
I20260709 12:21:11.710683 31910 raft_consensus.cc:3060] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.711036 31985 raft_consensus.cc:3060] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.711799 32060 raft_consensus.cc:2468] T 7e53dcdaf0c946acb411e89b68d44b18 P 6c49455c651145b18ec5b8347431953a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b3951143a384f049fc5ccbc6de793a2 in term 1.
I20260709 12:21:11.711810 31986 raft_consensus.cc:2468] T 7e53dcdaf0c946acb411e89b68d44b18 P 55c7361a93554f5080f2cc1156764e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b3951143a384f049fc5ccbc6de793a2 in term 1.
I20260709 12:21:11.713470 31874 leader_election.cc:304] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b3951143a384f049fc5ccbc6de793a2, 6c49455c651145b18ec5b8347431953a; no voters: 
I20260709 12:21:11.714687 32109 raft_consensus.cc:2804] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:11.716012 32109 raft_consensus.cc:697] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [term 1 LEADER]: Becoming Leader. State: Replica: 3b3951143a384f049fc5ccbc6de793a2, State: Running, Role: LEADER
I20260709 12:21:11.716903 32109 consensus_queue.cc:237] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.717334 31910 raft_consensus.cc:2468] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c49455c651145b18ec5b8347431953a in term 1.
I20260709 12:21:11.718428 32024 leader_election.cc:304] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b3951143a384f049fc5ccbc6de793a2, 6c49455c651145b18ec5b8347431953a; no voters: 
I20260709 12:21:11.719139 32105 raft_consensus.cc:2804] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:11.719600 32105 raft_consensus.cc:697] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 1 LEADER]: Becoming Leader. State: Replica: 6c49455c651145b18ec5b8347431953a, State: Running, Role: LEADER
I20260709 12:21:11.720392 32105 consensus_queue.cc:237] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:11.720970 31985 raft_consensus.cc:2468] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c49455c651145b18ec5b8347431953a in term 1.
I20260709 12:21:11.727582 31809 catalog_manager.cc:5697] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b3951143a384f049fc5ccbc6de793a2 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "3b3951143a384f049fc5ccbc6de793a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:11.731129 31807 catalog_manager.cc:5697] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c49455c651145b18ec5b8347431953a (127.20.191.3). New cstate: current_term: 1 leader_uuid: "6c49455c651145b18ec5b8347431953a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:11.768944 32105 consensus_queue.cc:1048] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [LEADER]: Connected to new peer: Peer: permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:11.775600 31986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "068a346ecfa34d718b43ece4a0975af9"
dest_uuid: "55c7361a93554f5080f2cc1156764e3d"
mode: GRACEFUL
new_leader_uuid: "3b3951143a384f049fc5ccbc6de793a2"
 from {username='slave'} at 127.0.0.1:46972
I20260709 12:21:11.776214 31986 raft_consensus.cc:606] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 1 LEADER]: Received request to transfer leadership to TS 3b3951143a384f049fc5ccbc6de793a2
I20260709 12:21:11.782384 32105 consensus_queue.cc:1048] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:11.794071 32060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "791b6bac77444aff87f47e5e173f3aa0"
dest_uuid: "6c49455c651145b18ec5b8347431953a"
mode: GRACEFUL
new_leader_uuid: "55c7361a93554f5080f2cc1156764e3d"
 from {username='slave'} at 127.0.0.1:43926
I20260709 12:21:11.794762 32060 raft_consensus.cc:606] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 1 LEADER]: Received request to transfer leadership to TS 55c7361a93554f5080f2cc1156764e3d
I20260709 12:21:11.803869 32060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0aea5b7cc177493199c6dd6daa6587c6"
dest_uuid: "6c49455c651145b18ec5b8347431953a"
mode: GRACEFUL
new_leader_uuid: "3b3951143a384f049fc5ccbc6de793a2"
 from {username='slave'} at 127.0.0.1:43926
I20260709 12:21:11.804369 32060 raft_consensus.cc:606] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 1 LEADER]: Received request to transfer leadership to TS 3b3951143a384f049fc5ccbc6de793a2
I20260709 12:21:12.107785 32149 raft_consensus.cc:993] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d: : Instructing follower 3b3951143a384f049fc5ccbc6de793a2 to start an election
I20260709 12:21:12.108203 32107 raft_consensus.cc:1081] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 1 LEADER]: Signalling peer 3b3951143a384f049fc5ccbc6de793a2 to start an election
I20260709 12:21:12.109608 31910 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "068a346ecfa34d718b43ece4a0975af9"
dest_uuid: "3b3951143a384f049fc5ccbc6de793a2"
 from {username='slave'} at 127.0.0.1:58858
I20260709 12:21:12.110108 31910 raft_consensus.cc:493] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:12.110373 31910 raft_consensus.cc:3060] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.117277 31910 raft_consensus.cc:515] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } }
I20260709 12:21:12.118963 31910 leader_election.cc:290] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [CANDIDATE]: Term 2 election: Requested vote from peers 6c49455c651145b18ec5b8347431953a (127.20.191.3:41573), 55c7361a93554f5080f2cc1156764e3d (127.20.191.2:44641)
I20260709 12:21:12.119948 32060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068a346ecfa34d718b43ece4a0975af9" candidate_uuid: "3b3951143a384f049fc5ccbc6de793a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c49455c651145b18ec5b8347431953a"
I20260709 12:21:12.120119 31986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068a346ecfa34d718b43ece4a0975af9" candidate_uuid: "3b3951143a384f049fc5ccbc6de793a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55c7361a93554f5080f2cc1156764e3d"
I20260709 12:21:12.120687 32060 raft_consensus.cc:3060] T 068a346ecfa34d718b43ece4a0975af9 P 6c49455c651145b18ec5b8347431953a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.120818 31986 raft_consensus.cc:3055] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:12.121362 31986 raft_consensus.cc:740] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55c7361a93554f5080f2cc1156764e3d, State: Running, Role: LEADER
I20260709 12:21:12.122133 31986 consensus_queue.cc:260] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } }
I20260709 12:21:12.123071 31986 raft_consensus.cc:3060] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.126296 32060 raft_consensus.cc:2468] T 068a346ecfa34d718b43ece4a0975af9 P 6c49455c651145b18ec5b8347431953a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b3951143a384f049fc5ccbc6de793a2 in term 2.
I20260709 12:21:12.127707 31874 leader_election.cc:304] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b3951143a384f049fc5ccbc6de793a2, 6c49455c651145b18ec5b8347431953a; no voters: 
I20260709 12:21:12.128559 32109 raft_consensus.cc:2804] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:12.128729 31986 raft_consensus.cc:2468] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b3951143a384f049fc5ccbc6de793a2 in term 2.
I20260709 12:21:12.128957 32109 raft_consensus.cc:697] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [term 2 LEADER]: Becoming Leader. State: Replica: 3b3951143a384f049fc5ccbc6de793a2, State: Running, Role: LEADER
I20260709 12:21:12.129995 32109 consensus_queue.cc:237] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } }
I20260709 12:21:12.136018 31807 catalog_manager.cc:5697] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 reported cstate change: term changed from 1 to 2, leader changed from 55c7361a93554f5080f2cc1156764e3d (127.20.191.2) to 3b3951143a384f049fc5ccbc6de793a2 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "3b3951143a384f049fc5ccbc6de793a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:12.212141 32105 consensus_queue.cc:1048] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [LEADER]: Connected to new peer: Peer: permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:12.223275 32117 consensus_queue.cc:1048] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:12.233251 32147 raft_consensus.cc:993] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a: : Instructing follower 3b3951143a384f049fc5ccbc6de793a2 to start an election
I20260709 12:21:12.233808 32117 raft_consensus.cc:1081] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 1 LEADER]: Signalling peer 3b3951143a384f049fc5ccbc6de793a2 to start an election
I20260709 12:21:12.236896 31910 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0aea5b7cc177493199c6dd6daa6587c6"
dest_uuid: "3b3951143a384f049fc5ccbc6de793a2"
 from {username='slave'} at 127.0.0.1:58864
I20260709 12:21:12.237650 31910 raft_consensus.cc:493] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:12.238090 31910 raft_consensus.cc:3060] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.244891 31910 raft_consensus.cc:515] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:12.247948 32060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aea5b7cc177493199c6dd6daa6587c6" candidate_uuid: "3b3951143a384f049fc5ccbc6de793a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c49455c651145b18ec5b8347431953a"
I20260709 12:21:12.248500 32060 raft_consensus.cc:3055] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:12.248790 32060 raft_consensus.cc:740] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c49455c651145b18ec5b8347431953a, State: Running, Role: LEADER
I20260709 12:21:12.249467 32060 consensus_queue.cc:260] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:12.250438 32060 raft_consensus.cc:3060] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.251176 31986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aea5b7cc177493199c6dd6daa6587c6" candidate_uuid: "3b3951143a384f049fc5ccbc6de793a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55c7361a93554f5080f2cc1156764e3d"
I20260709 12:21:12.251793 31986 raft_consensus.cc:3060] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.256471 32060 raft_consensus.cc:2468] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b3951143a384f049fc5ccbc6de793a2 in term 2.
I20260709 12:21:12.247390 31910 leader_election.cc:290] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [CANDIDATE]: Term 2 election: Requested vote from peers 55c7361a93554f5080f2cc1156764e3d (127.20.191.2:44641), 6c49455c651145b18ec5b8347431953a (127.20.191.3:41573)
I20260709 12:21:12.257874 31874 leader_election.cc:304] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b3951143a384f049fc5ccbc6de793a2, 6c49455c651145b18ec5b8347431953a; no voters: 
I20260709 12:21:12.258682 32109 raft_consensus.cc:2804] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:12.258783 31986 raft_consensus.cc:2468] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b3951143a384f049fc5ccbc6de793a2 in term 2.
I20260709 12:21:12.259207 32109 raft_consensus.cc:697] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 2 LEADER]: Becoming Leader. State: Replica: 3b3951143a384f049fc5ccbc6de793a2, State: Running, Role: LEADER
I20260709 12:21:12.260025 32109 consensus_queue.cc:237] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:12.265903 31809 catalog_manager.cc:5697] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 reported cstate change: term changed from 1 to 2, leader changed from 6c49455c651145b18ec5b8347431953a (127.20.191.3) to 3b3951143a384f049fc5ccbc6de793a2 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "3b3951143a384f049fc5ccbc6de793a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:12.301026 32109 consensus_queue.cc:1048] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:12.312224 32109 consensus_queue.cc:1048] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:12.375846 32147 raft_consensus.cc:993] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a: : Instructing follower 55c7361a93554f5080f2cc1156764e3d to start an election
I20260709 12:21:12.376286 32117 raft_consensus.cc:1081] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 1 LEADER]: Signalling peer 55c7361a93554f5080f2cc1156764e3d to start an election
I20260709 12:21:12.378010 31986 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "791b6bac77444aff87f47e5e173f3aa0"
dest_uuid: "55c7361a93554f5080f2cc1156764e3d"
 from {username='slave'} at 127.0.0.1:46954
I20260709 12:21:12.378593 31986 raft_consensus.cc:493] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:12.378898 31986 raft_consensus.cc:3060] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.384298 31986 raft_consensus.cc:515] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:12.386219 31986 leader_election.cc:290] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d [CANDIDATE]: Term 2 election: Requested vote from peers 3b3951143a384f049fc5ccbc6de793a2 (127.20.191.1:36379), 6c49455c651145b18ec5b8347431953a (127.20.191.3:41573)
I20260709 12:21:12.387125 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791b6bac77444aff87f47e5e173f3aa0" candidate_uuid: "55c7361a93554f5080f2cc1156764e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b3951143a384f049fc5ccbc6de793a2"
I20260709 12:21:12.387332 32060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791b6bac77444aff87f47e5e173f3aa0" candidate_uuid: "55c7361a93554f5080f2cc1156764e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c49455c651145b18ec5b8347431953a"
I20260709 12:21:12.387779 31910 raft_consensus.cc:3060] T 791b6bac77444aff87f47e5e173f3aa0 P 3b3951143a384f049fc5ccbc6de793a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.387895 32060 raft_consensus.cc:3055] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:12.388264 32060 raft_consensus.cc:740] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c49455c651145b18ec5b8347431953a, State: Running, Role: LEADER
I20260709 12:21:12.388913 32060 consensus_queue.cc:260] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:12.389901 32060 raft_consensus.cc:3060] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.395045 31910 raft_consensus.cc:2468] T 791b6bac77444aff87f47e5e173f3aa0 P 3b3951143a384f049fc5ccbc6de793a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55c7361a93554f5080f2cc1156764e3d in term 2.
I20260709 12:21:12.395113 32060 raft_consensus.cc:2468] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55c7361a93554f5080f2cc1156764e3d in term 2.
I20260709 12:21:12.396517 31949 leader_election.cc:304] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55c7361a93554f5080f2cc1156764e3d, 6c49455c651145b18ec5b8347431953a; no voters: 
I20260709 12:21:12.397173 32107 raft_consensus.cc:2804] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:12.397552 32107 raft_consensus.cc:697] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d [term 2 LEADER]: Becoming Leader. State: Replica: 55c7361a93554f5080f2cc1156764e3d, State: Running, Role: LEADER
I20260709 12:21:12.398343 32107 consensus_queue.cc:237] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:12.404099 31807 catalog_manager.cc:5697] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d reported cstate change: term changed from 1 to 2, leader changed from 6c49455c651145b18ec5b8347431953a (127.20.191.3) to 55c7361a93554f5080f2cc1156764e3d (127.20.191.2). New cstate: current_term: 2 leader_uuid: "55c7361a93554f5080f2cc1156764e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:12.535982 21244 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:21:12.537937 21244 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:21:12.538364 21244 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:21:12.550668 31910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0aea5b7cc177493199c6dd6daa6587c6"
dest_uuid: "3b3951143a384f049fc5ccbc6de793a2"
mode: GRACEFUL
new_leader_uuid: "6c49455c651145b18ec5b8347431953a"
 from {username='slave'} at 127.0.0.1:58868
I20260709 12:21:12.551198 31910 raft_consensus.cc:606] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 2 LEADER]: Received request to transfer leadership to TS 6c49455c651145b18ec5b8347431953a
I20260709 12:21:12.552248 21244 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:21:12.581712 31986 raft_consensus.cc:1275] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 2 FOLLOWER]: Refusing update from remote peer 3b3951143a384f049fc5ccbc6de793a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:12.582981 32109 consensus_queue.cc:1048] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:12.591650 32060 raft_consensus.cc:1275] T 068a346ecfa34d718b43ece4a0975af9 P 6c49455c651145b18ec5b8347431953a [term 2 FOLLOWER]: Refusing update from remote peer 3b3951143a384f049fc5ccbc6de793a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:12.593232 32142 consensus_queue.cc:1048] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:12.664692 31986 raft_consensus.cc:1275] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d [term 2 FOLLOWER]: Refusing update from remote peer 3b3951143a384f049fc5ccbc6de793a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:12.665982 32142 consensus_queue.cc:1048] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:12.673306 32060 raft_consensus.cc:1275] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 2 FOLLOWER]: Refusing update from remote peer 3b3951143a384f049fc5ccbc6de793a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:12.675285 32109 consensus_queue.cc:1048] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:12.682996 32153 raft_consensus.cc:993] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2: : Instructing follower 6c49455c651145b18ec5b8347431953a to start an election
I20260709 12:21:12.683511 32109 raft_consensus.cc:1081] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 2 LEADER]: Signalling peer 6c49455c651145b18ec5b8347431953a to start an election
I20260709 12:21:12.685024 32060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0aea5b7cc177493199c6dd6daa6587c6"
dest_uuid: "6c49455c651145b18ec5b8347431953a"
 from {username='slave'} at 127.0.0.1:43912
I20260709 12:21:12.685535 32060 raft_consensus.cc:493] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:12.685918 32060 raft_consensus.cc:3060] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.691690 32060 raft_consensus.cc:515] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:12.694283 32060 leader_election.cc:290] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [CANDIDATE]: Term 3 election: Requested vote from peers 3b3951143a384f049fc5ccbc6de793a2 (127.20.191.1:36379), 55c7361a93554f5080f2cc1156764e3d (127.20.191.2:44641)
I20260709 12:21:12.694308 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aea5b7cc177493199c6dd6daa6587c6" candidate_uuid: "6c49455c651145b18ec5b8347431953a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3b3951143a384f049fc5ccbc6de793a2"
I20260709 12:21:12.694525 31986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aea5b7cc177493199c6dd6daa6587c6" candidate_uuid: "6c49455c651145b18ec5b8347431953a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "55c7361a93554f5080f2cc1156764e3d"
I20260709 12:21:12.695124 31910 raft_consensus.cc:3055] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:12.695349 31986 raft_consensus.cc:3060] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.695520 31910 raft_consensus.cc:740] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3b3951143a384f049fc5ccbc6de793a2, State: Running, Role: LEADER
I20260709 12:21:12.696484 31910 consensus_queue.cc:260] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:12.697815 31910 raft_consensus.cc:3060] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.701177 31986 raft_consensus.cc:2468] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c49455c651145b18ec5b8347431953a in term 3.
I20260709 12:21:12.702524 32026 leader_election.cc:304] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55c7361a93554f5080f2cc1156764e3d, 6c49455c651145b18ec5b8347431953a; no voters: 
I20260709 12:21:12.703290 31910 raft_consensus.cc:2468] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c49455c651145b18ec5b8347431953a in term 3.
I20260709 12:21:12.703342 32117 raft_consensus.cc:2804] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:12.703929 32117 raft_consensus.cc:697] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 3 LEADER]: Becoming Leader. State: Replica: 6c49455c651145b18ec5b8347431953a, State: Running, Role: LEADER
I20260709 12:21:12.704730 32117 consensus_queue.cc:237] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } }
I20260709 12:21:12.710371 31807 catalog_manager.cc:5697] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a reported cstate change: term changed from 2 to 3, leader changed from 3b3951143a384f049fc5ccbc6de793a2 (127.20.191.1) to 6c49455c651145b18ec5b8347431953a (127.20.191.3). New cstate: current_term: 3 leader_uuid: "6c49455c651145b18ec5b8347431953a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3951143a384f049fc5ccbc6de793a2" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55c7361a93554f5080f2cc1156764e3d" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 44641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c49455c651145b18ec5b8347431953a" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 41573 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:12.766373 21244 tablet_server.cc:179] TabletServer@127.20.191.1:0 shutting down...
I20260709 12:21:12.789897 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:12.790555 21244 tablet_replica.cc:333] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2: stopping tablet replica
I20260709 12:21:12.791281 21244 raft_consensus.cc:2243] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:12.791849 21244 raft_consensus.cc:2272] T 0aea5b7cc177493199c6dd6daa6587c6 P 3b3951143a384f049fc5ccbc6de793a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:12.794337 21244 tablet_replica.cc:333] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2: stopping tablet replica
I20260709 12:21:12.794831 21244 raft_consensus.cc:2243] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:12.795584 21244 raft_consensus.cc:2272] T 7e53dcdaf0c946acb411e89b68d44b18 P 3b3951143a384f049fc5ccbc6de793a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:12.797686 21244 tablet_replica.cc:333] T 791b6bac77444aff87f47e5e173f3aa0 P 3b3951143a384f049fc5ccbc6de793a2: stopping tablet replica
I20260709 12:21:12.798210 21244 raft_consensus.cc:2243] T 791b6bac77444aff87f47e5e173f3aa0 P 3b3951143a384f049fc5ccbc6de793a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:12.798573 21244 raft_consensus.cc:2272] T 791b6bac77444aff87f47e5e173f3aa0 P 3b3951143a384f049fc5ccbc6de793a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:12.800261 21244 tablet_replica.cc:333] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2: stopping tablet replica
I20260709 12:21:12.800691 21244 raft_consensus.cc:2243] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:12.801429 21244 raft_consensus.cc:2272] T 068a346ecfa34d718b43ece4a0975af9 P 3b3951143a384f049fc5ccbc6de793a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:12.823836 21244 tablet_server.cc:196] TabletServer@127.20.191.1:0 shutdown complete.
I20260709 12:21:12.835729 21244 tablet_server.cc:179] TabletServer@127.20.191.2:0 shutting down...
I20260709 12:21:12.851794 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:12.852365 21244 tablet_replica.cc:333] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d: stopping tablet replica
I20260709 12:21:12.852887 21244 raft_consensus.cc:2243] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:12.853302 21244 raft_consensus.cc:2272] T 0aea5b7cc177493199c6dd6daa6587c6 P 55c7361a93554f5080f2cc1156764e3d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:12.855428 21244 tablet_replica.cc:333] T 7e53dcdaf0c946acb411e89b68d44b18 P 55c7361a93554f5080f2cc1156764e3d: stopping tablet replica
I20260709 12:21:12.855912 21244 raft_consensus.cc:2243] T 7e53dcdaf0c946acb411e89b68d44b18 P 55c7361a93554f5080f2cc1156764e3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:12.856266 21244 raft_consensus.cc:2272] T 7e53dcdaf0c946acb411e89b68d44b18 P 55c7361a93554f5080f2cc1156764e3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:12.858659 21244 tablet_replica.cc:333] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d: stopping tablet replica
I20260709 12:21:12.859108 21244 raft_consensus.cc:2243] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:12.859659 21244 pending_rounds.cc:70] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d: Trying to abort 1 pending ops.
I20260709 12:21:12.859819 21244 pending_rounds.cc:77] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305624258150883328 op_type: NO_OP noop_request { }
I20260709 12:21:12.860064 21244 raft_consensus.cc:2889] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:21:12.860294 21244 raft_consensus.cc:2272] T 791b6bac77444aff87f47e5e173f3aa0 P 55c7361a93554f5080f2cc1156764e3d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:12.862479 21244 tablet_replica.cc:333] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d: stopping tablet replica
I20260709 12:21:12.862921 21244 raft_consensus.cc:2243] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:12.863284 21244 raft_consensus.cc:2272] T 068a346ecfa34d718b43ece4a0975af9 P 55c7361a93554f5080f2cc1156764e3d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:12.886732 21244 tablet_server.cc:196] TabletServer@127.20.191.2:0 shutdown complete.
I20260709 12:21:12.898929 21244 tablet_server.cc:179] TabletServer@127.20.191.3:0 shutting down...
I20260709 12:21:12.918278 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:12.918937 21244 tablet_replica.cc:333] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a: stopping tablet replica
I20260709 12:21:12.919544 21244 raft_consensus.cc:2243] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:12.920205 21244 pending_rounds.cc:70] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a: Trying to abort 1 pending ops.
I20260709 12:21:12.920377 21244 pending_rounds.cc:77] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305624259405848576 op_type: NO_OP noop_request { }
I20260709 12:21:12.920647 21244 raft_consensus.cc:2889] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:21:12.920907 21244 raft_consensus.cc:2272] T 0aea5b7cc177493199c6dd6daa6587c6 P 6c49455c651145b18ec5b8347431953a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:12.923060 21244 tablet_replica.cc:333] T 068a346ecfa34d718b43ece4a0975af9 P 6c49455c651145b18ec5b8347431953a: stopping tablet replica
I20260709 12:21:12.923633 21244 raft_consensus.cc:2243] T 068a346ecfa34d718b43ece4a0975af9 P 6c49455c651145b18ec5b8347431953a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:12.924185 21244 raft_consensus.cc:2272] T 068a346ecfa34d718b43ece4a0975af9 P 6c49455c651145b18ec5b8347431953a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:12.926542 21244 tablet_replica.cc:333] T 7e53dcdaf0c946acb411e89b68d44b18 P 6c49455c651145b18ec5b8347431953a: stopping tablet replica
I20260709 12:21:12.927064 21244 raft_consensus.cc:2243] T 7e53dcdaf0c946acb411e89b68d44b18 P 6c49455c651145b18ec5b8347431953a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:12.927501 21244 raft_consensus.cc:2272] T 7e53dcdaf0c946acb411e89b68d44b18 P 6c49455c651145b18ec5b8347431953a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:12.929692 21244 tablet_replica.cc:333] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a: stopping tablet replica
I20260709 12:21:12.930275 21244 raft_consensus.cc:2243] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:12.930657 21244 raft_consensus.cc:2272] T 791b6bac77444aff87f47e5e173f3aa0 P 6c49455c651145b18ec5b8347431953a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:12.952566 21244 tablet_server.cc:196] TabletServer@127.20.191.3:0 shutdown complete.
I20260709 12:21:12.964582 21244 master.cc:562] Master@127.20.191.62:37857 shutting down...
I20260709 12:21:12.980144 21244 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:12.980707 21244 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:12.981063 21244 tablet_replica.cc:333] T 00000000000000000000000000000000 P ce55ac9f327844f39981b130cf42e1ab: stopping tablet replica
I20260709 12:21:12.999195 21244 master.cc:584] Master@127.20.191.62:37857 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2773 ms)
[----------] 6 tests from LeaderRebalancerTest (347991 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:21:13.027689 21244 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.191.62:36083
I20260709 12:21:13.028820 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:13.033736 32160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:13.033730 32159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:13.036480 21244 server_base.cc:1061] running on GCE node
W20260709 12:21:13.036859 32162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:13.037750 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:13.038079 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:13.038197 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599673038186 us; error 0 us; skew 500 ppm
I20260709 12:21:13.038686 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:13.041006 21244 webserver.cc:533] Webserver started at http://127.20.191.62:35697/ using document root <none> and password file <none>
I20260709 12:21:13.041466 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:13.041630 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:13.041880 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:13.042948 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/master-0-root/instance:
uuid: "71227152cd7d43ed98cd73431a2b8d15"
format_stamp: "Formatted at 2026-07-09 12:21:13 on dist-test-slave-7c1h"
I20260709 12:21:13.047482 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:21:13.051051 32167 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:13.051864 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:21:13.052163 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/master-0-root
uuid: "71227152cd7d43ed98cd73431a2b8d15"
format_stamp: "Formatted at 2026-07-09 12:21:13 on dist-test-slave-7c1h"
I20260709 12:21:13.052449 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:13.069330 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:13.070393 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:13.104454 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.62:36083
I20260709 12:21:13.104552 32218 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.62:36083 every 8 connection(s)
I20260709 12:21:13.108224 32219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.118914 32219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15: Bootstrap starting.
I20260709 12:21:13.123359 32219 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:13.127373 32219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15: No bootstrap required, opened a new log
I20260709 12:21:13.129508 32219 raft_consensus.cc:359] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71227152cd7d43ed98cd73431a2b8d15" member_type: VOTER }
I20260709 12:21:13.129944 32219 raft_consensus.cc:385] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:13.130183 32219 raft_consensus.cc:740] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71227152cd7d43ed98cd73431a2b8d15, State: Initialized, Role: FOLLOWER
I20260709 12:21:13.130762 32219 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71227152cd7d43ed98cd73431a2b8d15" member_type: VOTER }
I20260709 12:21:13.131227 32219 raft_consensus.cc:399] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:21:13.131443 32219 raft_consensus.cc:493] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:21:13.131697 32219 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:13.137523 32219 raft_consensus.cc:515] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71227152cd7d43ed98cd73431a2b8d15" member_type: VOTER }
I20260709 12:21:13.138146 32219 leader_election.cc:304] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71227152cd7d43ed98cd73431a2b8d15; no voters: 
I20260709 12:21:13.139312 32219 leader_election.cc:290] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:21:13.139950 32222 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:13.141208 32222 raft_consensus.cc:697] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [term 1 LEADER]: Becoming Leader. State: Replica: 71227152cd7d43ed98cd73431a2b8d15, State: Running, Role: LEADER
I20260709 12:21:13.142088 32219 sys_catalog.cc:565] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:21:13.142011 32222 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71227152cd7d43ed98cd73431a2b8d15" member_type: VOTER }
I20260709 12:21:13.145406 32223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71227152cd7d43ed98cd73431a2b8d15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71227152cd7d43ed98cd73431a2b8d15" member_type: VOTER } }
I20260709 12:21:13.145437 32224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71227152cd7d43ed98cd73431a2b8d15. Latest consensus state: current_term: 1 leader_uuid: "71227152cd7d43ed98cd73431a2b8d15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71227152cd7d43ed98cd73431a2b8d15" member_type: VOTER } }
I20260709 12:21:13.146253 32223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:13.146276 32224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:13.156302 32227 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:21:13.161733 32227 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:21:13.162976 21244 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:21:13.171095 32227 catalog_manager.cc:1383] Generated new cluster ID: 43aa051b197d42e7bddb9df3e5126728
I20260709 12:21:13.171447 32227 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:21:13.184070 32227 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:21:13.185408 32227 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:21:13.201406 32227 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15: Generated new TSK 0
I20260709 12:21:13.202080 32227 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:21:13.230198 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:13.236290 32240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:13.236931 32241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:13.240949 32243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:13.244323 21244 server_base.cc:1061] running on GCE node
I20260709 12:21:13.249214 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:13.249473 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:13.249645 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599673249630 us; error 0 us; skew 500 ppm
I20260709 12:21:13.250288 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:13.252775 21244 webserver.cc:533] Webserver started at http://127.20.191.1:40625/ using document root <none> and password file <none>
I20260709 12:21:13.253278 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:13.253448 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:13.253755 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:13.254956 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/ts-0-root/instance:
uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
format_stamp: "Formatted at 2026-07-09 12:21:13 on dist-test-slave-7c1h"
I20260709 12:21:13.259452 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:21:13.263046 32248 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:13.263857 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:21:13.264155 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/ts-0-root
uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
format_stamp: "Formatted at 2026-07-09 12:21:13 on dist-test-slave-7c1h"
I20260709 12:21:13.264423 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:13.303974 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:13.305307 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:13.306944 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:13.309471 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:13.309695 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:13.310009 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:13.310173 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:13.348853 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.1:38901
I20260709 12:21:13.348948 32310 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.1:38901 every 8 connection(s)
I20260709 12:21:13.353716 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:13.360049 32315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:13.363147 21244 server_base.cc:1061] running on GCE node
W20260709 12:21:13.363729 32316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:13.364207 32318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:13.365670 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:13.365950 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:13.366147 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599673366129 us; error 0 us; skew 500 ppm
I20260709 12:21:13.366411 32311 heartbeater.cc:344] Connected to a master server at 127.20.191.62:36083
I20260709 12:21:13.366751 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:13.366792 32311 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:13.367736 32311 heartbeater.cc:507] Master 127.20.191.62:36083 requested a full tablet report, sending...
I20260709 12:21:13.369808 32184 ts_manager.cc:194] Registered new tserver with Master: a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901)
I20260709 12:21:13.369825 21244 webserver.cc:533] Webserver started at http://127.20.191.2:46129/ using document root <none> and password file <none>
I20260709 12:21:13.370462 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:13.370656 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:13.370913 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:13.371682 32184 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60078
I20260709 12:21:13.371956 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/ts-1-root/instance:
uuid: "81bee0a37e054555ac4d58f6adeff729"
format_stamp: "Formatted at 2026-07-09 12:21:13 on dist-test-slave-7c1h"
I20260709 12:21:13.376461 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:21:13.379935 32323 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:13.380719 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:21:13.381016 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/ts-1-root
uuid: "81bee0a37e054555ac4d58f6adeff729"
format_stamp: "Formatted at 2026-07-09 12:21:13 on dist-test-slave-7c1h"
I20260709 12:21:13.381280 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:13.389741 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:13.390795 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:13.392145 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:13.394346 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:13.394524 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:13.394771 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:13.394917 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:13.433316 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.2:36783
I20260709 12:21:13.433416 32385 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.2:36783 every 8 connection(s)
I20260709 12:21:13.438499 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:13.445989 32389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:13.446101 32390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:13.450310 32386 heartbeater.cc:344] Connected to a master server at 127.20.191.62:36083
I20260709 12:21:13.450868 32386 heartbeater.cc:461] Registering TS with master...
W20260709 12:21:13.451766 32392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:13.451809 21244 server_base.cc:1061] running on GCE node
I20260709 12:21:13.451930 32386 heartbeater.cc:507] Master 127.20.191.62:36083 requested a full tablet report, sending...
I20260709 12:21:13.453136 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:13.453405 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:13.453573 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599673453557 us; error 0 us; skew 500 ppm
I20260709 12:21:13.454491 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:13.454941 32184 ts_manager.cc:194] Registered new tserver with Master: 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783)
I20260709 12:21:13.457013 32184 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60092
I20260709 12:21:13.457492 21244 webserver.cc:533] Webserver started at http://127.20.191.3:44641/ using document root <none> and password file <none>
I20260709 12:21:13.458281 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:13.458498 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:13.458803 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:13.459949 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/ts-2-root/instance:
uuid: "e03b91883c034031a866b1e6a7133759"
format_stamp: "Formatted at 2026-07-09 12:21:13 on dist-test-slave-7c1h"
I20260709 12:21:13.465206 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 12:21:13.468922 32397 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:13.469743 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:21:13.470093 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/ts-2-root
uuid: "e03b91883c034031a866b1e6a7133759"
format_stamp: "Formatted at 2026-07-09 12:21:13 on dist-test-slave-7c1h"
I20260709 12:21:13.470389 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599324869158-21244-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:13.499763 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:13.500895 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:13.502336 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:13.504884 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:13.505110 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:13.505358 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:13.505513 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:13.545899 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.3:42161
I20260709 12:21:13.546008 32459 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.3:42161 every 8 connection(s)
I20260709 12:21:13.560771 32460 heartbeater.cc:344] Connected to a master server at 127.20.191.62:36083
I20260709 12:21:13.561223 32460 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:13.562083 32460 heartbeater.cc:507] Master 127.20.191.62:36083 requested a full tablet report, sending...
I20260709 12:21:13.564219 32184 ts_manager.cc:194] Registered new tserver with Master: e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:13.565263 21244 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016079352s
I20260709 12:21:13.565858 32184 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60096
I20260709 12:21:13.591903 32184 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60104:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:21:13.594693 32184 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:21:13.663676 32276 tablet_service.cc:1511] Processing CreateTablet for tablet c4b5e728b50b4085803fe63160773c74 (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:13.662992 32275 tablet_service.cc:1511] Processing CreateTablet for tablet 0dffe4baaa524e338c4515fde30f55d1 (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:13.666700 32275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dffe4baaa524e338c4515fde30f55d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.670267 32276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b5e728b50b4085803fe63160773c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.670889 32274 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb847a8cef042b8a343a8b27bfb8bdc (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:13.672394 32274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb847a8cef042b8a343a8b27bfb8bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.676218 32273 tablet_service.cc:1511] Processing CreateTablet for tablet 50ec226d96254424be091cc09af472d3 (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:13.677721 32273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ec226d96254424be091cc09af472d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.680146 32272 tablet_service.cc:1511] Processing CreateTablet for tablet b91241c3bfe946cb887450cca2024905 (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:13.681324 32272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91241c3bfe946cb887450cca2024905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.684664 32271 tablet_service.cc:1511] Processing CreateTablet for tablet 9c0f90b7959d41c2903d5937c85300ca (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:13.686373 32271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0f90b7959d41c2903d5937c85300ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.693347 32270 tablet_service.cc:1511] Processing CreateTablet for tablet 05f8aeab48474f4d9b142f321588f2f1 (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:13.694859 32270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f8aeab48474f4d9b142f321588f2f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.698307 32351 tablet_service.cc:1511] Processing CreateTablet for tablet c4b5e728b50b4085803fe63160773c74 (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:13.699930 32351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b5e728b50b4085803fe63160773c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.703948 32349 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb847a8cef042b8a343a8b27bfb8bdc (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:13.702888 32350 tablet_service.cc:1511] Processing CreateTablet for tablet 0dffe4baaa524e338c4515fde30f55d1 (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:13.707818 32347 tablet_service.cc:1511] Processing CreateTablet for tablet b91241c3bfe946cb887450cca2024905 (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:13.708351 32268 tablet_service.cc:1511] Processing CreateTablet for tablet 588047560b544889a59f83bed49923be (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:13.709362 32350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dffe4baaa524e338c4515fde30f55d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.709869 32268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 588047560b544889a59f83bed49923be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.709986 32347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91241c3bfe946cb887450cca2024905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.705050 32348 tablet_service.cc:1511] Processing CreateTablet for tablet 50ec226d96254424be091cc09af472d3 (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:13.711680 32348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ec226d96254424be091cc09af472d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.701746 32269 tablet_service.cc:1511] Processing CreateTablet for tablet 27bda943e6a2453187d9f36ad10208f2 (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:13.714111 32269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27bda943e6a2453187d9f36ad10208f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.719985 32346 tablet_service.cc:1511] Processing CreateTablet for tablet 9c0f90b7959d41c2903d5937c85300ca (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:13.722169 32349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb847a8cef042b8a343a8b27bfb8bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.730170 32346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0f90b7959d41c2903d5937c85300ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.739637 32345 tablet_service.cc:1511] Processing CreateTablet for tablet 05f8aeab48474f4d9b142f321588f2f1 (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:13.741168 32345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f8aeab48474f4d9b142f321588f2f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.748034 32344 tablet_service.cc:1511] Processing CreateTablet for tablet 27bda943e6a2453187d9f36ad10208f2 (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:13.749534 32344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27bda943e6a2453187d9f36ad10208f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.752019 32343 tablet_service.cc:1511] Processing CreateTablet for tablet 588047560b544889a59f83bed49923be (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:13.753449 32343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 588047560b544889a59f83bed49923be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.759371 32475 tablet_bootstrap.cc:492] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Bootstrap starting.
I20260709 12:21:13.773099 32425 tablet_service.cc:1511] Processing CreateTablet for tablet c4b5e728b50b4085803fe63160773c74 (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:13.774739 32425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b5e728b50b4085803fe63160773c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.775143 32421 tablet_service.cc:1511] Processing CreateTablet for tablet b91241c3bfe946cb887450cca2024905 (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:13.776662 32421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91241c3bfe946cb887450cca2024905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.779510 32424 tablet_service.cc:1511] Processing CreateTablet for tablet 0dffe4baaa524e338c4515fde30f55d1 (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:13.781209 32424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dffe4baaa524e338c4515fde30f55d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.783114 32423 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb847a8cef042b8a343a8b27bfb8bdc (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:13.784822 32423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb847a8cef042b8a343a8b27bfb8bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.787083 32422 tablet_service.cc:1511] Processing CreateTablet for tablet 50ec226d96254424be091cc09af472d3 (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:13.788659 32422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ec226d96254424be091cc09af472d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.790987 32420 tablet_service.cc:1511] Processing CreateTablet for tablet 9c0f90b7959d41c2903d5937c85300ca (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:13.792505 32420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0f90b7959d41c2903d5937c85300ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.795078 32419 tablet_service.cc:1511] Processing CreateTablet for tablet 05f8aeab48474f4d9b142f321588f2f1 (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:13.796638 32419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f8aeab48474f4d9b142f321588f2f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.799041 32418 tablet_service.cc:1511] Processing CreateTablet for tablet 27bda943e6a2453187d9f36ad10208f2 (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:13.801417 32475 tablet_bootstrap.cc:654] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:13.802415 32417 tablet_service.cc:1511] Processing CreateTablet for tablet 588047560b544889a59f83bed49923be (DEFAULT_TABLE table=test-workload [id=836efda98da54627bad282e8a9f622e8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:13.814014 32418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27bda943e6a2453187d9f36ad10208f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.814407 32476 tablet_bootstrap.cc:492] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729: Bootstrap starting.
I20260709 12:21:13.815997 32477 tablet_bootstrap.cc:492] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759: Bootstrap starting.
I20260709 12:21:13.855001 32417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 588047560b544889a59f83bed49923be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:13.871384 32476 tablet_bootstrap.cc:654] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:13.874393 32477 tablet_bootstrap.cc:654] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:13.874881 32475 tablet_bootstrap.cc:492] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6: No bootstrap required, opened a new log
I20260709 12:21:13.875443 32475 ts_tablet_manager.cc:1403] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent bootstrapping tablet: real 0.116s	user 0.011s	sys 0.002s
I20260709 12:21:13.878459 32475 raft_consensus.cc:359] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:13.879292 32475 raft_consensus.cc:385] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:13.879655 32475 raft_consensus.cc:740] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Initialized, Role: FOLLOWER
I20260709 12:21:13.880582 32475 consensus_queue.cc:260] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:13.888116 32311 heartbeater.cc:499] Master 127.20.191.62:36083 was elected leader, sending a full tablet report...
I20260709 12:21:13.888725 32477 tablet_bootstrap.cc:492] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759: No bootstrap required, opened a new log
I20260709 12:21:13.888779 32475 ts_tablet_manager.cc:1434] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 12:21:13.889525 32477 ts_tablet_manager.cc:1403] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.009s
I20260709 12:21:13.890231 32475 tablet_bootstrap.cc:492] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Bootstrap starting.
I20260709 12:21:13.895680 32475 tablet_bootstrap.cc:654] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:13.896486 32477 raft_consensus.cc:359] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:13.897346 32477 raft_consensus.cc:385] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:13.897660 32477 raft_consensus.cc:740] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Initialized, Role: FOLLOWER
I20260709 12:21:13.898622 32477 consensus_queue.cc:260] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:13.908806 32476 tablet_bootstrap.cc:492] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729: No bootstrap required, opened a new log
I20260709 12:21:13.909755 32476 ts_tablet_manager.cc:1403] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.003s
I20260709 12:21:13.913432 32476 raft_consensus.cc:359] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:13.914723 32476 raft_consensus.cc:385] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:13.915148 32476 raft_consensus.cc:740] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Initialized, Role: FOLLOWER
I20260709 12:21:13.916136 32476 consensus_queue.cc:260] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:13.924752 32460 heartbeater.cc:499] Master 127.20.191.62:36083 was elected leader, sending a full tablet report...
I20260709 12:21:13.925590 32386 heartbeater.cc:499] Master 127.20.191.62:36083 was elected leader, sending a full tablet report...
I20260709 12:21:13.925983 32475 tablet_bootstrap.cc:492] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6: No bootstrap required, opened a new log
I20260709 12:21:13.926537 32475 ts_tablet_manager.cc:1403] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.014s
I20260709 12:21:13.926822 32476 ts_tablet_manager.cc:1434] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 12:21:13.927968 32476 tablet_bootstrap.cc:492] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729: Bootstrap starting.
I20260709 12:21:13.929579 32475 raft_consensus.cc:359] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } }
I20260709 12:21:13.930272 32477 ts_tablet_manager.cc:1434] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759: Time spent starting tablet: real 0.040s	user 0.019s	sys 0.011s
I20260709 12:21:13.930433 32475 raft_consensus.cc:385] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:13.930804 32475 raft_consensus.cc:740] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Initialized, Role: FOLLOWER
I20260709 12:21:13.931447 32477 tablet_bootstrap.cc:492] T 0dffe4baaa524e338c4515fde30f55d1 P e03b91883c034031a866b1e6a7133759: Bootstrap starting.
I20260709 12:21:13.931818 32475 consensus_queue.cc:260] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } }
I20260709 12:21:13.935194 32476 tablet_bootstrap.cc:654] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:13.937008 32475 ts_tablet_manager.cc:1434] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:21:13.938262 32475 tablet_bootstrap.cc:492] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Bootstrap starting.
I20260709 12:21:13.939752 32477 tablet_bootstrap.cc:654] T 0dffe4baaa524e338c4515fde30f55d1 P e03b91883c034031a866b1e6a7133759: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:13.946555 32475 tablet_bootstrap.cc:654] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:13.951903 32477 tablet_bootstrap.cc:492] T 0dffe4baaa524e338c4515fde30f55d1 P e03b91883c034031a866b1e6a7133759: No bootstrap required, opened a new log
I20260709 12:21:13.952571 32477 ts_tablet_manager.cc:1403] T 0dffe4baaa524e338c4515fde30f55d1 P e03b91883c034031a866b1e6a7133759: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.006s
I20260709 12:21:13.956633 32477 raft_consensus.cc:359] T 0dffe4baaa524e338c4515fde30f55d1 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:13.957582 32477 raft_consensus.cc:385] T 0dffe4baaa524e338c4515fde30f55d1 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:13.957952 32477 raft_consensus.cc:740] T 0dffe4baaa524e338c4515fde30f55d1 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Initialized, Role: FOLLOWER
I20260709 12:21:13.959311 32477 consensus_queue.cc:260] T 0dffe4baaa524e338c4515fde30f55d1 P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:13.962456 32477 ts_tablet_manager.cc:1434] T 0dffe4baaa524e338c4515fde30f55d1 P e03b91883c034031a866b1e6a7133759: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 12:21:13.963887 32477 tablet_bootstrap.cc:492] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759: Bootstrap starting.
I20260709 12:21:13.969202 32475 tablet_bootstrap.cc:492] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6: No bootstrap required, opened a new log
I20260709 12:21:13.970037 32475 ts_tablet_manager.cc:1403] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.009s
I20260709 12:21:13.972483 32477 tablet_bootstrap.cc:654] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:13.973173 32475 raft_consensus.cc:359] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:13.974040 32475 raft_consensus.cc:385] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:13.974391 32475 raft_consensus.cc:740] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Initialized, Role: FOLLOWER
I20260709 12:21:13.975455 32475 consensus_queue.cc:260] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:13.982746 32475 ts_tablet_manager.cc:1434] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:21:13.984141 32475 tablet_bootstrap.cc:492] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6: Bootstrap starting.
I20260709 12:21:13.991750 32475 tablet_bootstrap.cc:654] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:13.992825 32477 tablet_bootstrap.cc:492] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759: No bootstrap required, opened a new log
I20260709 12:21:13.993507 32477 ts_tablet_manager.cc:1403] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.016s
I20260709 12:21:13.997188 32477 raft_consensus.cc:359] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } }
I20260709 12:21:13.998206 32477 raft_consensus.cc:385] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:13.998588 32477 raft_consensus.cc:740] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Initialized, Role: FOLLOWER
I20260709 12:21:13.999742 32477 consensus_queue.cc:260] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } }
I20260709 12:21:14.003374 32477 ts_tablet_manager.cc:1434] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:21:14.004453 32477 tablet_bootstrap.cc:492] T 05f8aeab48474f4d9b142f321588f2f1 P e03b91883c034031a866b1e6a7133759: Bootstrap starting.
I20260709 12:21:14.004897 32475 tablet_bootstrap.cc:492] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6: No bootstrap required, opened a new log
I20260709 12:21:14.005138 32480 raft_consensus.cc:493] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.005517 32475 ts_tablet_manager.cc:1403] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 12:21:14.005725 32480 raft_consensus.cc:515] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.008749 32475 raft_consensus.cc:359] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.009516 32475 raft_consensus.cc:385] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.009843 32475 raft_consensus.cc:740] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.010924 32477 tablet_bootstrap.cc:654] T 05f8aeab48474f4d9b142f321588f2f1 P e03b91883c034031a866b1e6a7133759: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:14.013980 32475 consensus_queue.cc:260] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.016005 32476 tablet_bootstrap.cc:492] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729: No bootstrap required, opened a new log
I20260709 12:21:14.016661 32476 ts_tablet_manager.cc:1403] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729: Time spent bootstrapping tablet: real 0.089s	user 0.036s	sys 0.038s
I20260709 12:21:14.019742 32476 raft_consensus.cc:359] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.020181 32480 leader_election.cc:290] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.020581 32476 raft_consensus.cc:385] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.029798 32476 raft_consensus.cc:740] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.030630 32484 raft_consensus.cc:493] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.031522 32475 ts_tablet_manager.cc:1434] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.016s
I20260709 12:21:14.031219 32484 raft_consensus.cc:515] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.031106 32476 consensus_queue.cc:260] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.033046 32475 tablet_bootstrap.cc:492] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Bootstrap starting.
I20260709 12:21:14.040088 32484 leader_election.cc:290] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.044893 32477 tablet_bootstrap.cc:492] T 05f8aeab48474f4d9b142f321588f2f1 P e03b91883c034031a866b1e6a7133759: No bootstrap required, opened a new log
I20260709 12:21:14.045668 32477 ts_tablet_manager.cc:1403] T 05f8aeab48474f4d9b142f321588f2f1 P e03b91883c034031a866b1e6a7133759: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.012s
I20260709 12:21:14.049299 32475 tablet_bootstrap.cc:654] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:14.050298 32477 raft_consensus.cc:359] T 05f8aeab48474f4d9b142f321588f2f1 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.053146 32477 raft_consensus.cc:385] T 05f8aeab48474f4d9b142f321588f2f1 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.055022 32477 raft_consensus.cc:740] T 05f8aeab48474f4d9b142f321588f2f1 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.057183 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dffe4baaa524e338c4515fde30f55d1" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729" is_pre_election: true
W20260709 12:21:14.065263 32252 leader_election.cc:343] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:14.065891 32477 consensus_queue.cc:260] T 05f8aeab48474f4d9b142f321588f2f1 P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.068562 32477 ts_tablet_manager.cc:1434] T 05f8aeab48474f4d9b142f321588f2f1 P e03b91883c034031a866b1e6a7133759: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 12:21:14.069736 32476 ts_tablet_manager.cc:1434] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729: Time spent starting tablet: real 0.053s	user 0.013s	sys 0.003s
I20260709 12:21:14.070712 32477 tablet_bootstrap.cc:492] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759: Bootstrap starting.
I20260709 12:21:14.077615 32477 tablet_bootstrap.cc:654] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:14.078878 32476 tablet_bootstrap.cc:492] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729: Bootstrap starting.
I20260709 12:21:14.083308 32475 tablet_bootstrap.cc:492] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6: No bootstrap required, opened a new log
I20260709 12:21:14.083945 32475 ts_tablet_manager.cc:1403] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.010s
I20260709 12:21:14.086817 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dffe4baaa524e338c4515fde30f55d1" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:14.087671 32435 raft_consensus.cc:2468] T 0dffe4baaa524e338c4515fde30f55d1 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 0.
I20260709 12:21:14.088819 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f8aeab48474f4d9b142f321588f2f1" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" is_pre_election: true
I20260709 12:21:14.089351 32250 leader_election.cc:304] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759; no voters: 81bee0a37e054555ac4d58f6adeff729
I20260709 12:21:14.090394 32493 raft_consensus.cc:2804] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:14.090807 32493 raft_consensus.cc:493] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:14.091030 32324 leader_election.cc:343] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:14.091152 32493 raft_consensus.cc:3060] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.091776 32476 tablet_bootstrap.cc:654] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:14.092190 32475 raft_consensus.cc:359] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.093137 32475 raft_consensus.cc:385] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.093513 32475 raft_consensus.cc:740] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.094024 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f8aeab48474f4d9b142f321588f2f1" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:14.094758 32435 raft_consensus.cc:2468] T 05f8aeab48474f4d9b142f321588f2f1 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 0.
I20260709 12:21:14.094653 32475 consensus_queue.cc:260] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.096261 32325 leader_election.cc:304] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, e03b91883c034031a866b1e6a7133759; no voters: a1bcba00e3e34ed7b7a1cf5d40e29be6
I20260709 12:21:14.097271 32497 raft_consensus.cc:2804] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:14.097677 32497 raft_consensus.cc:493] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.098018 32497 raft_consensus.cc:3060] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.099591 32493 raft_consensus.cc:515] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.102773 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dffe4baaa524e338c4515fde30f55d1" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
W20260709 12:21:14.104434 32252 leader_election.cc:343] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:14.102897 32475 ts_tablet_manager.cc:1434] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:21:14.105881 32475 tablet_bootstrap.cc:492] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6: Bootstrap starting.
I20260709 12:21:14.107528 32497 raft_consensus.cc:515] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.110615 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f8aeab48474f4d9b142f321588f2f1" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
W20260709 12:21:14.112079 32324 leader_election.cc:343] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:14.112331 32475 tablet_bootstrap.cc:654] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:14.112114 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f8aeab48474f4d9b142f321588f2f1" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:14.112890 32435 raft_consensus.cc:3060] T 05f8aeab48474f4d9b142f321588f2f1 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.115031 32476 tablet_bootstrap.cc:492] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729: No bootstrap required, opened a new log
I20260709 12:21:14.115343 32480 raft_consensus.cc:493] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.115598 32476 ts_tablet_manager.cc:1403] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.010s
I20260709 12:21:14.116034 32480 raft_consensus.cc:515] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.116889 32477 tablet_bootstrap.cc:492] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759: No bootstrap required, opened a new log
I20260709 12:21:14.117457 32477 ts_tablet_manager.cc:1403] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.000s
I20260709 12:21:14.118373 32493 leader_election.cc:290] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 election: Requested vote from peers 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.119894 32476 raft_consensus.cc:359] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.120577 32434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dffe4baaa524e338c4515fde30f55d1" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:14.120704 32476 raft_consensus.cc:385] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.121296 32483 raft_consensus.cc:493] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.121510 32477 raft_consensus.cc:359] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.120774 32435 raft_consensus.cc:2468] T 05f8aeab48474f4d9b142f321588f2f1 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 1.
I20260709 12:21:14.121748 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91241c3bfe946cb887450cca2024905" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:14.130477 32434 raft_consensus.cc:3060] T 0dffe4baaa524e338c4515fde30f55d1 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.131625 32433 raft_consensus.cc:2468] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 0.
I20260709 12:21:14.132380 32325 leader_election.cc:304] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, e03b91883c034031a866b1e6a7133759; no voters: a1bcba00e3e34ed7b7a1cf5d40e29be6
I20260709 12:21:14.130650 32476 raft_consensus.cc:740] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.127223 32497 leader_election.cc:290] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 election: Requested vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.131198 32477 raft_consensus.cc:385] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.133270 32250 leader_election.cc:304] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:14.133812 32483 raft_consensus.cc:515] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } }
I20260709 12:21:14.133975 32476 consensus_queue.cc:260] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.122808 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91241c3bfe946cb887450cca2024905" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729" is_pre_election: true
I20260709 12:21:14.133833 32477 raft_consensus.cc:740] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.133664 32484 raft_consensus.cc:2804] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:21:14.136869 32252 leader_election.cc:343] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:14.134610 32493 raft_consensus.cc:2804] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:14.138484 32493 raft_consensus.cc:493] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.138902 32493 raft_consensus.cc:3060] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.118501 32480 leader_election.cc:290] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.146548 32483 leader_election.cc:290] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783)
I20260709 12:21:14.137782 32477 consensus_queue.cc:260] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.150650 32477 ts_tablet_manager.cc:1434] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.005s
I20260709 12:21:14.151898 32477 tablet_bootstrap.cc:492] T 0bb847a8cef042b8a343a8b27bfb8bdc P e03b91883c034031a866b1e6a7133759: Bootstrap starting.
W20260709 12:21:14.154744 32232 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:14.164368 32480 raft_consensus.cc:493] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.164680 32477 tablet_bootstrap.cc:654] T 0bb847a8cef042b8a343a8b27bfb8bdc P e03b91883c034031a866b1e6a7133759: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:14.165020 32480 raft_consensus.cc:515] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } }
I20260709 12:21:14.169337 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b5e728b50b4085803fe63160773c74" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:14.170413 32435 raft_consensus.cc:2468] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 0.
I20260709 12:21:14.172035 32250 leader_election.cc:304] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:14.181843 32483 raft_consensus.cc:493] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.182690 32483 raft_consensus.cc:515] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.185410 32483 leader_election.cc:290] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783)
I20260709 12:21:14.188095 32477 tablet_bootstrap.cc:492] T 0bb847a8cef042b8a343a8b27bfb8bdc P e03b91883c034031a866b1e6a7133759: No bootstrap required, opened a new log
I20260709 12:21:14.188431 32360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ec226d96254424be091cc09af472d3" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729" is_pre_election: true
W20260709 12:21:14.190493 32401 leader_election.cc:343] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:14.188757 32477 ts_tablet_manager.cc:1403] T 0bb847a8cef042b8a343a8b27bfb8bdc P e03b91883c034031a866b1e6a7133759: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.004s
I20260709 12:21:14.188465 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b5e728b50b4085803fe63160773c74" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729" is_pre_election: true
W20260709 12:21:14.192730 32401 leader_election.cc:343] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:14.194305 32477 raft_consensus.cc:359] T 0bb847a8cef042b8a343a8b27bfb8bdc P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.195291 32477 raft_consensus.cc:385] T 0bb847a8cef042b8a343a8b27bfb8bdc P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.195649 32477 raft_consensus.cc:740] T 0bb847a8cef042b8a343a8b27bfb8bdc P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.196875 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b5e728b50b4085803fe63160773c74" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729" is_pre_election: true
W20260709 12:21:14.198683 32252 leader_election.cc:343] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:14.201025 32480 leader_election.cc:290] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161), 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783)
I20260709 12:21:14.201659 32480 raft_consensus.cc:2804] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:14.202066 32480 raft_consensus.cc:493] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.202464 32480 raft_consensus.cc:3060] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.202100 32477 consensus_queue.cc:260] T 0bb847a8cef042b8a343a8b27bfb8bdc P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.209192 32477 ts_tablet_manager.cc:1434] T 0bb847a8cef042b8a343a8b27bfb8bdc P e03b91883c034031a866b1e6a7133759: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.004s
I20260709 12:21:14.210611 32477 tablet_bootstrap.cc:492] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759: Bootstrap starting.
I20260709 12:21:14.224627 32477 tablet_bootstrap.cc:654] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:14.234165 32250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:42161, user_credentials={real_user=slave}} blocked reactor thread for 62256.4us
I20260709 12:21:14.237973 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b5e728b50b4085803fe63160773c74" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" is_pre_election: true
I20260709 12:21:14.238757 32285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ec226d96254424be091cc09af472d3" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" is_pre_election: true
W20260709 12:21:14.240934 32398 leader_election.cc:343] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:14.241506 32398 leader_election.cc:304] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e03b91883c034031a866b1e6a7133759; no voters: 81bee0a37e054555ac4d58f6adeff729, a1bcba00e3e34ed7b7a1cf5d40e29be6
I20260709 12:21:14.242023 32434 raft_consensus.cc:2468] T 0dffe4baaa524e338c4515fde30f55d1 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 1.
I20260709 12:21:14.243387 32483 raft_consensus.cc:2749] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:14.243884 32250 leader_election.cc:304] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759; no voters: 81bee0a37e054555ac4d58f6adeff729
I20260709 12:21:14.245615 32506 raft_consensus.cc:2804] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:14.247089 32484 raft_consensus.cc:697] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Becoming Leader. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Running, Role: LEADER
I20260709 12:21:14.247375 32477 tablet_bootstrap.cc:492] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759: No bootstrap required, opened a new log
I20260709 12:21:14.248091 32477 ts_tablet_manager.cc:1403] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759: Time spent bootstrapping tablet: real 0.038s	user 0.005s	sys 0.007s
I20260709 12:21:14.248368 32484 consensus_queue.cc:237] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.193282 32493 raft_consensus.cc:515] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.251600 32477 raft_consensus.cc:359] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.252564 32477 raft_consensus.cc:385] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.252892 32477 raft_consensus.cc:740] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.253196 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91241c3bfe946cb887450cca2024905" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
I20260709 12:21:14.254007 32477 consensus_queue.cc:260] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
W20260709 12:21:14.255452 32252 leader_election.cc:343] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:14.256856 32493 leader_election.cc:290] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 election: Requested vote from peers 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.260152 32477 ts_tablet_manager.cc:1434] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 12:21:14.261502 32477 tablet_bootstrap.cc:492] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759: Bootstrap starting.
I20260709 12:21:14.269356 32477 tablet_bootstrap.cc:654] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:14.273983 32434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91241c3bfe946cb887450cca2024905" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:14.274839 32434 raft_consensus.cc:3060] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.276536 32506 raft_consensus.cc:697] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Becoming Leader. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Running, Role: LEADER
I20260709 12:21:14.277865 32506 consensus_queue.cc:237] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.279440 32475 tablet_bootstrap.cc:492] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6: No bootstrap required, opened a new log
I20260709 12:21:14.280097 32475 ts_tablet_manager.cc:1403] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent bootstrapping tablet: real 0.174s	user 0.071s	sys 0.050s
I20260709 12:21:14.283430 32509 raft_consensus.cc:493] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.284062 32509 raft_consensus.cc:515] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.288300 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588047560b544889a59f83bed49923be" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729" is_pre_election: true
W20260709 12:21:14.290308 32252 leader_election.cc:343] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:14.293046 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588047560b544889a59f83bed49923be" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
W20260709 12:21:14.295063 32250 leader_election.cc:343] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:14.295615 32250 leader_election.cc:304] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 81bee0a37e054555ac4d58f6adeff729, e03b91883c034031a866b1e6a7133759
I20260709 12:21:14.296684 32493 raft_consensus.cc:2749] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:14.284404 32475 raft_consensus.cc:359] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.300259 32475 raft_consensus.cc:385] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.300601 32475 raft_consensus.cc:740] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.301533 32475 consensus_queue.cc:260] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.304347 32475 ts_tablet_manager.cc:1434] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.003s
I20260709 12:21:14.305524 32475 tablet_bootstrap.cc:492] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Bootstrap starting.
I20260709 12:21:14.298993 32509 leader_election.cc:290] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.302392 32480 raft_consensus.cc:515] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } }
I20260709 12:21:14.314826 32286 raft_consensus.cc:2393] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e03b91883c034031a866b1e6a7133759 in current term 1: Already voted for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in this term.
I20260709 12:21:14.318225 32475 tablet_bootstrap.cc:654] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:14.319729 32398 leader_election.cc:304] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e03b91883c034031a866b1e6a7133759; no voters: 81bee0a37e054555ac4d58f6adeff729, a1bcba00e3e34ed7b7a1cf5d40e29be6
I20260709 12:21:14.318136 32181 catalog_manager.cc:5697] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:14.320453 32480 leader_election.cc:290] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 election: Requested vote from peers e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161), 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783)
I20260709 12:21:14.321115 32483 raft_consensus.cc:3060] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.323119 32434 raft_consensus.cc:2468] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 1.
I20260709 12:21:14.324246 32476 ts_tablet_manager.cc:1434] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729: Time spent starting tablet: real 0.208s	user 0.067s	sys 0.075s
I20260709 12:21:14.324430 32250 leader_election.cc:304] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759; no voters: 81bee0a37e054555ac4d58f6adeff729
I20260709 12:21:14.324599 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b5e728b50b4085803fe63160773c74" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
I20260709 12:21:14.326188 32476 tablet_bootstrap.cc:492] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729: Bootstrap starting.
I20260709 12:21:14.326709 32480 raft_consensus.cc:2804] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:14.327239 32480 raft_consensus.cc:697] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Becoming Leader. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Running, Role: LEADER
I20260709 12:21:14.325696 32183 catalog_manager.cc:5697] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "81bee0a37e054555ac4d58f6adeff729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:14.328059 32480 consensus_queue.cc:237] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.325047 32477 tablet_bootstrap.cc:492] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759: No bootstrap required, opened a new log
I20260709 12:21:14.330150 32477 ts_tablet_manager.cc:1403] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759: Time spent bootstrapping tablet: real 0.069s	user 0.023s	sys 0.023s
W20260709 12:21:14.330598 32252 leader_election.cc:343] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:14.322988 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b5e728b50b4085803fe63160773c74" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:14.332958 32477 raft_consensus.cc:359] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.333482 32476 tablet_bootstrap.cc:654] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:14.333659 32477 raft_consensus.cc:385] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.334036 32477 raft_consensus.cc:740] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.335134 32506 raft_consensus.cc:493] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.335923 32506 raft_consensus.cc:515] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.337146 32477 consensus_queue.cc:260] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.339349 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27bda943e6a2453187d9f36ad10208f2" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729" is_pre_election: true
I20260709 12:21:14.340446 32484 raft_consensus.cc:493] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.341012 32484 raft_consensus.cc:515] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.344326 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb847a8cef042b8a343a8b27bfb8bdc" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" is_pre_election: true
W20260709 12:21:14.344525 32252 leader_election.cc:343] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:14.343495 32484 leader_election.cc:290] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.344698 32434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb847a8cef042b8a343a8b27bfb8bdc" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:14.345327 32286 raft_consensus.cc:2468] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 0.
I20260709 12:21:14.345467 32434 raft_consensus.cc:2468] T 0bb847a8cef042b8a343a8b27bfb8bdc P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 0.
I20260709 12:21:14.346274 32483 raft_consensus.cc:2749] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:14.347036 32324 leader_election.cc:304] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 
I20260709 12:21:14.347770 32434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27bda943e6a2453187d9f36ad10208f2" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:14.348022 32484 raft_consensus.cc:2804] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:14.348510 32484 raft_consensus.cc:493] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.348869 32484 raft_consensus.cc:3060] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:14.350522 32250 leader_election.cc:343] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:14.351082 32250 leader_election.cc:304] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 81bee0a37e054555ac4d58f6adeff729, e03b91883c034031a866b1e6a7133759
I20260709 12:21:14.354031 32509 raft_consensus.cc:2749] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:14.355484 32435 raft_consensus.cc:2468] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 1.
I20260709 12:21:14.357878 32250 leader_election.cc:304] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759; no voters: 81bee0a37e054555ac4d58f6adeff729
I20260709 12:21:14.359134 32509 raft_consensus.cc:2804] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:14.359632 32509 raft_consensus.cc:697] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Becoming Leader. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Running, Role: LEADER
I20260709 12:21:14.360549 32509 consensus_queue.cc:237] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } }
I20260709 12:21:14.363804 32484 raft_consensus.cc:515] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.345676 32506 leader_election.cc:290] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.367273 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb847a8cef042b8a343a8b27bfb8bdc" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
I20260709 12:21:14.368034 32286 raft_consensus.cc:3060] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.373237 32484 leader_election.cc:290] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 election: Requested vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.380735 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb847a8cef042b8a343a8b27bfb8bdc" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:14.381383 32435 raft_consensus.cc:3060] T 0bb847a8cef042b8a343a8b27bfb8bdc P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.399509 32477 ts_tablet_manager.cc:1434] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759: Time spent starting tablet: real 0.069s	user 0.020s	sys 0.027s
I20260709 12:21:14.400689 32477 tablet_bootstrap.cc:492] T 27bda943e6a2453187d9f36ad10208f2 P e03b91883c034031a866b1e6a7133759: Bootstrap starting.
I20260709 12:21:14.398015 32286 raft_consensus.cc:2468] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 1.
I20260709 12:21:14.402837 32324 leader_election.cc:304] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 
I20260709 12:21:14.403283 32435 raft_consensus.cc:2468] T 0bb847a8cef042b8a343a8b27bfb8bdc P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 1.
I20260709 12:21:14.403792 32484 raft_consensus.cc:2804] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:14.404384 32484 raft_consensus.cc:697] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Becoming Leader. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Running, Role: LEADER
I20260709 12:21:14.405292 32476 tablet_bootstrap.cc:492] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729: No bootstrap required, opened a new log
I20260709 12:21:14.405929 32476 ts_tablet_manager.cc:1403] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.038s
I20260709 12:21:14.405313 32484 consensus_queue.cc:237] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.407015 32477 tablet_bootstrap.cc:654] T 27bda943e6a2453187d9f36ad10208f2 P e03b91883c034031a866b1e6a7133759: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:14.412395 32475 tablet_bootstrap.cc:492] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6: No bootstrap required, opened a new log
I20260709 12:21:14.413103 32475 ts_tablet_manager.cc:1403] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.009s
I20260709 12:21:14.413435 32476 raft_consensus.cc:359] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.414310 32476 raft_consensus.cc:385] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.414599 32476 raft_consensus.cc:740] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.415369 32476 consensus_queue.cc:260] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.417085 32475 raft_consensus.cc:359] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.418123 32475 raft_consensus.cc:385] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.418478 32475 raft_consensus.cc:740] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.419567 32475 consensus_queue.cc:260] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.417637 32476 ts_tablet_manager.cc:1434] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:21:14.422353 32476 tablet_bootstrap.cc:492] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729: Bootstrap starting.
I20260709 12:21:14.422689 32475 ts_tablet_manager.cc:1434] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:21:14.423979 32475 tablet_bootstrap.cc:492] T 05f8aeab48474f4d9b142f321588f2f1 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Bootstrap starting.
I20260709 12:21:14.431470 32475 tablet_bootstrap.cc:654] T 05f8aeab48474f4d9b142f321588f2f1 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:14.434298 32476 tablet_bootstrap.cc:654] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:14.436424 32477 tablet_bootstrap.cc:492] T 27bda943e6a2453187d9f36ad10208f2 P e03b91883c034031a866b1e6a7133759: No bootstrap required, opened a new log
I20260709 12:21:14.437180 32477 ts_tablet_manager.cc:1403] T 27bda943e6a2453187d9f36ad10208f2 P e03b91883c034031a866b1e6a7133759: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.006s
I20260709 12:21:14.436364 32181 catalog_manager.cc:5697] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "81bee0a37e054555ac4d58f6adeff729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:14.440727 32477 raft_consensus.cc:359] T 27bda943e6a2453187d9f36ad10208f2 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.441655 32477 raft_consensus.cc:385] T 27bda943e6a2453187d9f36ad10208f2 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.442070 32477 raft_consensus.cc:740] T 27bda943e6a2453187d9f36ad10208f2 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.443128 32477 consensus_queue.cc:260] T 27bda943e6a2453187d9f36ad10208f2 P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.454546 32475 tablet_bootstrap.cc:492] T 05f8aeab48474f4d9b142f321588f2f1 P a1bcba00e3e34ed7b7a1cf5d40e29be6: No bootstrap required, opened a new log
I20260709 12:21:14.455219 32475 ts_tablet_manager.cc:1403] T 05f8aeab48474f4d9b142f321588f2f1 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.007s
I20260709 12:21:14.455977 32476 tablet_bootstrap.cc:492] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729: No bootstrap required, opened a new log
I20260709 12:21:14.456549 32476 ts_tablet_manager.cc:1403] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.004s
I20260709 12:21:14.456478 32183 catalog_manager.cc:5697] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:14.458154 32475 raft_consensus.cc:359] T 05f8aeab48474f4d9b142f321588f2f1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.458726 32475 raft_consensus.cc:385] T 05f8aeab48474f4d9b142f321588f2f1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.459020 32475 raft_consensus.cc:740] T 05f8aeab48474f4d9b142f321588f2f1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.458576 32183 catalog_manager.cc:5697] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:14.459723 32475 consensus_queue.cc:260] T 05f8aeab48474f4d9b142f321588f2f1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.459839 32476 raft_consensus.cc:359] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } }
I20260709 12:21:14.460598 32476 raft_consensus.cc:385] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.460915 32476 raft_consensus.cc:740] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.461354 32475 ts_tablet_manager.cc:1434] T 05f8aeab48474f4d9b142f321588f2f1 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:21:14.461727 32476 consensus_queue.cc:260] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } }
I20260709 12:21:14.462384 32475 tablet_bootstrap.cc:492] T 9c0f90b7959d41c2903d5937c85300ca P a1bcba00e3e34ed7b7a1cf5d40e29be6: Bootstrap starting.
I20260709 12:21:14.462658 32477 ts_tablet_manager.cc:1434] T 27bda943e6a2453187d9f36ad10208f2 P e03b91883c034031a866b1e6a7133759: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:21:14.467154 32476 ts_tablet_manager.cc:1434] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 12:21:14.468330 32476 tablet_bootstrap.cc:492] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729: Bootstrap starting.
I20260709 12:21:14.468724 32475 tablet_bootstrap.cc:654] T 9c0f90b7959d41c2903d5937c85300ca P a1bcba00e3e34ed7b7a1cf5d40e29be6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:14.473744 32475 tablet_bootstrap.cc:492] T 9c0f90b7959d41c2903d5937c85300ca P a1bcba00e3e34ed7b7a1cf5d40e29be6: No bootstrap required, opened a new log
I20260709 12:21:14.474265 32475 ts_tablet_manager.cc:1403] T 9c0f90b7959d41c2903d5937c85300ca P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:21:14.475056 32476 tablet_bootstrap.cc:654] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:14.476732 32475 raft_consensus.cc:359] T 9c0f90b7959d41c2903d5937c85300ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.477427 32475 raft_consensus.cc:385] T 9c0f90b7959d41c2903d5937c85300ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.477686 32475 raft_consensus.cc:740] T 9c0f90b7959d41c2903d5937c85300ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.478461 32475 consensus_queue.cc:260] T 9c0f90b7959d41c2903d5937c85300ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.481550 32475 ts_tablet_manager.cc:1434] T 9c0f90b7959d41c2903d5937c85300ca P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:14.485875 32476 tablet_bootstrap.cc:492] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729: No bootstrap required, opened a new log
I20260709 12:21:14.486387 32476 ts_tablet_manager.cc:1403] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 12:21:14.488770 32476 raft_consensus.cc:359] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.489355 32476 raft_consensus.cc:385] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.489578 32476 raft_consensus.cc:740] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.490274 32476 consensus_queue.cc:260] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.492272 32476 ts_tablet_manager.cc:1434] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:21:14.493224 32476 tablet_bootstrap.cc:492] T 50ec226d96254424be091cc09af472d3 P 81bee0a37e054555ac4d58f6adeff729: Bootstrap starting.
I20260709 12:21:14.498733 32476 tablet_bootstrap.cc:654] T 50ec226d96254424be091cc09af472d3 P 81bee0a37e054555ac4d58f6adeff729: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:14.503324 32476 tablet_bootstrap.cc:492] T 50ec226d96254424be091cc09af472d3 P 81bee0a37e054555ac4d58f6adeff729: No bootstrap required, opened a new log
I20260709 12:21:14.503770 32476 ts_tablet_manager.cc:1403] T 50ec226d96254424be091cc09af472d3 P 81bee0a37e054555ac4d58f6adeff729: Time spent bootstrapping tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:21:14.505959 32476 raft_consensus.cc:359] T 50ec226d96254424be091cc09af472d3 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.506477 32476 raft_consensus.cc:385] T 50ec226d96254424be091cc09af472d3 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.506703 32476 raft_consensus.cc:740] T 50ec226d96254424be091cc09af472d3 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.507268 32476 consensus_queue.cc:260] T 50ec226d96254424be091cc09af472d3 P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.509262 32476 ts_tablet_manager.cc:1434] T 50ec226d96254424be091cc09af472d3 P 81bee0a37e054555ac4d58f6adeff729: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:21:14.510252 32476 tablet_bootstrap.cc:492] T 0dffe4baaa524e338c4515fde30f55d1 P 81bee0a37e054555ac4d58f6adeff729: Bootstrap starting.
I20260709 12:21:14.515484 32476 tablet_bootstrap.cc:654] T 0dffe4baaa524e338c4515fde30f55d1 P 81bee0a37e054555ac4d58f6adeff729: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:14.520092 32476 tablet_bootstrap.cc:492] T 0dffe4baaa524e338c4515fde30f55d1 P 81bee0a37e054555ac4d58f6adeff729: No bootstrap required, opened a new log
I20260709 12:21:14.520501 32476 ts_tablet_manager.cc:1403] T 0dffe4baaa524e338c4515fde30f55d1 P 81bee0a37e054555ac4d58f6adeff729: Time spent bootstrapping tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:21:14.522666 32476 raft_consensus.cc:359] T 0dffe4baaa524e338c4515fde30f55d1 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.523149 32476 raft_consensus.cc:385] T 0dffe4baaa524e338c4515fde30f55d1 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.523315 32476 raft_consensus.cc:740] T 0dffe4baaa524e338c4515fde30f55d1 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.523800 32476 consensus_queue.cc:260] T 0dffe4baaa524e338c4515fde30f55d1 P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.525151 32476 ts_tablet_manager.cc:1434] T 0dffe4baaa524e338c4515fde30f55d1 P 81bee0a37e054555ac4d58f6adeff729: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:21:14.525949 32476 tablet_bootstrap.cc:492] T 588047560b544889a59f83bed49923be P 81bee0a37e054555ac4d58f6adeff729: Bootstrap starting.
I20260709 12:21:14.530200 32476 tablet_bootstrap.cc:654] T 588047560b544889a59f83bed49923be P 81bee0a37e054555ac4d58f6adeff729: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:14.534781 32476 tablet_bootstrap.cc:492] T 588047560b544889a59f83bed49923be P 81bee0a37e054555ac4d58f6adeff729: No bootstrap required, opened a new log
I20260709 12:21:14.535310 32476 ts_tablet_manager.cc:1403] T 588047560b544889a59f83bed49923be P 81bee0a37e054555ac4d58f6adeff729: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:21:14.537581 32476 raft_consensus.cc:359] T 588047560b544889a59f83bed49923be P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.538092 32476 raft_consensus.cc:385] T 588047560b544889a59f83bed49923be P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:14.538275 32476 raft_consensus.cc:740] T 588047560b544889a59f83bed49923be P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Initialized, Role: FOLLOWER
I20260709 12:21:14.538735 32476 consensus_queue.cc:260] T 588047560b544889a59f83bed49923be P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.540112 32476 ts_tablet_manager.cc:1434] T 588047560b544889a59f83bed49923be P 81bee0a37e054555ac4d58f6adeff729: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:21:14.546070 32484 raft_consensus.cc:493] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.546602 32484 raft_consensus.cc:515] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.548467 32484 leader_election.cc:290] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.549175 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91241c3bfe946cb887450cca2024905" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" is_pre_election: true
I20260709 12:21:14.549508 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91241c3bfe946cb887450cca2024905" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:14.550287 32435 raft_consensus.cc:2393] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81bee0a37e054555ac4d58f6adeff729 in current term 1: Already voted for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in this term.
I20260709 12:21:14.551213 32325 leader_election.cc:304] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729; no voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759
I20260709 12:21:14.551852 32484 raft_consensus.cc:3060] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.558503 32484 raft_consensus.cc:2749] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:14.562209 32484 raft_consensus.cc:493] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.562634 32484 raft_consensus.cc:515] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.564464 32484 leader_election.cc:290] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.565255 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27bda943e6a2453187d9f36ad10208f2" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" is_pre_election: true
I20260709 12:21:14.565444 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27bda943e6a2453187d9f36ad10208f2" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:14.565919 32286 raft_consensus.cc:2468] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 0.
I20260709 12:21:14.566129 32435 raft_consensus.cc:2468] T 27bda943e6a2453187d9f36ad10208f2 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 0.
I20260709 12:21:14.566924 32324 leader_election.cc:304] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 
I20260709 12:21:14.567639 32484 raft_consensus.cc:2804] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:14.567905 32484 raft_consensus.cc:493] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.568176 32484 raft_consensus.cc:3060] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.570235 32502 raft_consensus.cc:493] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.570761 32502 raft_consensus.cc:515] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.572973 32502 leader_election.cc:290] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.573632 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f90b7959d41c2903d5937c85300ca" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" is_pre_election: true
I20260709 12:21:14.574067 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f90b7959d41c2903d5937c85300ca" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:14.574307 32286 raft_consensus.cc:2468] T 9c0f90b7959d41c2903d5937c85300ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 0.
I20260709 12:21:14.574755 32435 raft_consensus.cc:2468] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 0.
I20260709 12:21:14.574954 32484 raft_consensus.cc:515] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.575326 32324 leader_election.cc:304] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 
I20260709 12:21:14.576107 32502 raft_consensus.cc:2804] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:14.576468 32502 raft_consensus.cc:493] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.576756 32502 raft_consensus.cc:3060] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.577744 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27bda943e6a2453187d9f36ad10208f2" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
I20260709 12:21:14.577966 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27bda943e6a2453187d9f36ad10208f2" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:14.577342 32484 leader_election.cc:290] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 election: Requested vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.578361 32286 raft_consensus.cc:3060] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.578577 32435 raft_consensus.cc:3060] T 27bda943e6a2453187d9f36ad10208f2 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.584249 32286 raft_consensus.cc:2468] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 1.
I20260709 12:21:14.584530 32502 raft_consensus.cc:515] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.585423 32324 leader_election.cc:304] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 
I20260709 12:21:14.586376 32484 raft_consensus.cc:2804] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:14.586910 32435 raft_consensus.cc:2468] T 27bda943e6a2453187d9f36ad10208f2 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 1.
I20260709 12:21:14.587260 32484 raft_consensus.cc:697] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Becoming Leader. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Running, Role: LEADER
I20260709 12:21:14.588074 32502 leader_election.cc:290] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 election: Requested vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.587906 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f90b7959d41c2903d5937c85300ca" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
I20260709 12:21:14.589267 32286 raft_consensus.cc:3060] T 9c0f90b7959d41c2903d5937c85300ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.589367 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f90b7959d41c2903d5937c85300ca" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:14.589972 32435 raft_consensus.cc:3060] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.589432 32484 consensus_queue.cc:237] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.596001 32480 raft_consensus.cc:493] T 05f8aeab48474f4d9b142f321588f2f1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.596614 32480 raft_consensus.cc:515] T 05f8aeab48474f4d9b142f321588f2f1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.596553 32435 raft_consensus.cc:2468] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 1.
I20260709 12:21:14.598186 32286 raft_consensus.cc:2468] T 9c0f90b7959d41c2903d5937c85300ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 1.
I20260709 12:21:14.598850 32480 leader_election.cc:290] T 05f8aeab48474f4d9b142f321588f2f1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.600018 32324 leader_election.cc:304] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 
I20260709 12:21:14.600033 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f8aeab48474f4d9b142f321588f2f1" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:14.599694 32181 catalog_manager.cc:5697] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "81bee0a37e054555ac4d58f6adeff729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:14.601203 32435 raft_consensus.cc:2393] T 05f8aeab48474f4d9b142f321588f2f1 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in current term 1: Already voted for candidate 81bee0a37e054555ac4d58f6adeff729 in this term.
I20260709 12:21:14.601258 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f8aeab48474f4d9b142f321588f2f1" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729" is_pre_election: true
I20260709 12:21:14.601469 32484 raft_consensus.cc:2804] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:14.602658 32484 raft_consensus.cc:697] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Becoming Leader. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Running, Role: LEADER
I20260709 12:21:14.603088 32252 leader_election.cc:304] T 05f8aeab48474f4d9b142f321588f2f1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 81bee0a37e054555ac4d58f6adeff729, e03b91883c034031a866b1e6a7133759
I20260709 12:21:14.603426 32484 consensus_queue.cc:237] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.603826 32480 raft_consensus.cc:3060] T 05f8aeab48474f4d9b142f321588f2f1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.612325 32480 raft_consensus.cc:2749] T 05f8aeab48474f4d9b142f321588f2f1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:14.616384 32181 catalog_manager.cc:5697] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "81bee0a37e054555ac4d58f6adeff729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:14.665382 32484 raft_consensus.cc:493] T 0dffe4baaa524e338c4515fde30f55d1 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.666059 32484 raft_consensus.cc:515] T 0dffe4baaa524e338c4515fde30f55d1 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.668138 32484 leader_election.cc:290] T 0dffe4baaa524e338c4515fde30f55d1 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.668867 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dffe4baaa524e338c4515fde30f55d1" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" is_pre_election: true
I20260709 12:21:14.669510 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dffe4baaa524e338c4515fde30f55d1" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:14.670346 32435 raft_consensus.cc:2393] T 0dffe4baaa524e338c4515fde30f55d1 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81bee0a37e054555ac4d58f6adeff729 in current term 1: Already voted for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in this term.
I20260709 12:21:14.671290 32325 leader_election.cc:304] T 0dffe4baaa524e338c4515fde30f55d1 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729; no voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759
I20260709 12:21:14.671921 32484 raft_consensus.cc:3060] T 0dffe4baaa524e338c4515fde30f55d1 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.677371 32484 raft_consensus.cc:2749] T 0dffe4baaa524e338c4515fde30f55d1 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:14.700506 32484 consensus_queue.cc:1048] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:14.715269 32535 consensus_queue.cc:1048] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:14.719472 32480 consensus_queue.cc:1048] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:14.731918 32506 consensus_queue.cc:1048] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:14.734632 32516 raft_consensus.cc:493] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.735224 32516 raft_consensus.cc:515] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.737654 32516 leader_election.cc:290] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783)
I20260709 12:21:14.738718 32360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588047560b544889a59f83bed49923be" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729" is_pre_election: true
I20260709 12:21:14.739275 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588047560b544889a59f83bed49923be" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" is_pre_election: true
I20260709 12:21:14.739449 32360 raft_consensus.cc:2468] T 588047560b544889a59f83bed49923be P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 0.
I20260709 12:21:14.739979 32286 raft_consensus.cc:2468] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 0.
I20260709 12:21:14.740832 32401 leader_election.cc:304] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:14.741777 32516 raft_consensus.cc:2804] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:14.742130 32516 raft_consensus.cc:493] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.742517 32516 raft_consensus.cc:3060] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.748692 32516 raft_consensus.cc:515] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.750789 32516 leader_election.cc:290] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 election: Requested vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783)
I20260709 12:21:14.751205 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588047560b544889a59f83bed49923be" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
I20260709 12:21:14.751485 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588047560b544889a59f83bed49923be" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
I20260709 12:21:14.751892 32286 raft_consensus.cc:3060] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.752041 32361 raft_consensus.cc:3060] T 588047560b544889a59f83bed49923be P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.757884 32286 raft_consensus.cc:2468] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 1.
I20260709 12:21:14.757928 32361 raft_consensus.cc:2468] T 588047560b544889a59f83bed49923be P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 1.
I20260709 12:21:14.758361 32506 raft_consensus.cc:493] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.758849 32506 raft_consensus.cc:515] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.759208 32401 leader_election.cc:304] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:14.760144 32516 raft_consensus.cc:2804] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:14.760618 32516 raft_consensus.cc:697] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [term 1 LEADER]: Becoming Leader. State: Replica: e03b91883c034031a866b1e6a7133759, State: Running, Role: LEADER
I20260709 12:21:14.761070 32506 leader_election.cc:290] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.761418 32516 consensus_queue.cc:237] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.762676 32434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ec226d96254424be091cc09af472d3" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:14.763233 32434 raft_consensus.cc:2468] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 0.
I20260709 12:21:14.763200 32506 consensus_queue.cc:1048] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:14.764338 32250 leader_election.cc:304] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:14.764958 32506 raft_consensus.cc:2804] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:14.765359 32506 raft_consensus.cc:493] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.765755 32506 raft_consensus.cc:3060] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.765751 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ec226d96254424be091cc09af472d3" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729" is_pre_election: true
I20260709 12:21:14.766798 32361 raft_consensus.cc:2468] T 50ec226d96254424be091cc09af472d3 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 0.
I20260709 12:21:14.774039 32506 raft_consensus.cc:515] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.776278 32506 leader_election.cc:290] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 election: Requested vote from peers 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.778247 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ec226d96254424be091cc09af472d3" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:14.776975 32183 catalog_manager.cc:5697] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 reported cstate change: term changed from 0 to 1, leader changed from <none> to e03b91883c034031a866b1e6a7133759 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "e03b91883c034031a866b1e6a7133759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:14.778729 32360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ec226d96254424be091cc09af472d3" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
I20260709 12:21:14.779408 32360 raft_consensus.cc:3060] T 50ec226d96254424be091cc09af472d3 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.778908 32435 raft_consensus.cc:3060] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.780395 32506 consensus_queue.cc:1048] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:14.787081 32360 raft_consensus.cc:2468] T 50ec226d96254424be091cc09af472d3 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 1.
I20260709 12:21:14.788249 32252 leader_election.cc:304] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 
I20260709 12:21:14.789671 32493 raft_consensus.cc:2804] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:14.790149 32493 raft_consensus.cc:697] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Becoming Leader. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Running, Role: LEADER
I20260709 12:21:14.790984 32493 consensus_queue.cc:237] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:14.798442 32435 raft_consensus.cc:2468] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 1.
I20260709 12:21:14.800537 32184 catalog_manager.cc:5697] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:14.820461 32535 raft_consensus.cc:493] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.820938 32535 raft_consensus.cc:515] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } }
I20260709 12:21:14.822716 32535 leader_election.cc:290] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:14.823632 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b5e728b50b4085803fe63160773c74" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" is_pre_election: true
I20260709 12:21:14.823770 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b5e728b50b4085803fe63160773c74" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:14.824466 32435 raft_consensus.cc:2393] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81bee0a37e054555ac4d58f6adeff729 in current term 1: Already voted for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in this term.
I20260709 12:21:14.825317 32325 leader_election.cc:304] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729; no voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759
I20260709 12:21:14.825946 32535 raft_consensus.cc:3060] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:14.830952 32535 raft_consensus.cc:2749] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:14.848443 32506 consensus_queue.cc:1048] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:14.859074 32506 consensus_queue.cc:1048] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:14.889066 32535 consensus_queue.cc:1048] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:14.902323 32536 consensus_queue.cc:1048] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:14.973198 32361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bb847a8cef042b8a343a8b27bfb8bdc"
dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
mode: GRACEFUL
new_leader_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
 from {username='slave'} at 127.0.0.1:47934
I20260709 12:21:14.973811 32361 raft_consensus.cc:606] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Received request to transfer leadership to TS a1bcba00e3e34ed7b7a1cf5d40e29be6
I20260709 12:21:14.990878 32286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b91241c3bfe946cb887450cca2024905"
dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
mode: GRACEFUL
new_leader_uuid: "81bee0a37e054555ac4d58f6adeff729"
 from {username='slave'} at 127.0.0.1:59866
I20260709 12:21:14.991405 32286 raft_consensus.cc:606] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Received request to transfer leadership to TS 81bee0a37e054555ac4d58f6adeff729
I20260709 12:21:15.060848 32536 consensus_queue.cc:1048] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:15.075728 32535 consensus_queue.cc:1048] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:15.077064 32536 consensus_queue.cc:1048] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:15.089279 32536 consensus_queue.cc:1048] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:15.270445 32516 consensus_queue.cc:1048] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:15.282636 32516 consensus_queue.cc:1048] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:15.324772 32480 raft_consensus.cc:993] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6: : Instructing follower 81bee0a37e054555ac4d58f6adeff729 to start an election
I20260709 12:21:15.325217 32506 raft_consensus.cc:1081] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Signalling peer 81bee0a37e054555ac4d58f6adeff729 to start an election
I20260709 12:21:15.326872 32361 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b91241c3bfe946cb887450cca2024905"
dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
 from {username='slave'} at 127.0.0.1:47912
I20260709 12:21:15.327395 32361 raft_consensus.cc:493] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:15.327708 32361 raft_consensus.cc:3060] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:15.333139 32361 raft_consensus.cc:515] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:15.335011 32361 leader_election.cc:290] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 2 election: Requested vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:15.336182 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91241c3bfe946cb887450cca2024905" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:15.336108 32285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91241c3bfe946cb887450cca2024905" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
I20260709 12:21:15.336997 32435 raft_consensus.cc:3060] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:15.337071 32285 raft_consensus.cc:3055] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:15.337488 32285 raft_consensus.cc:740] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Running, Role: LEADER
I20260709 12:21:15.338376 32285 consensus_queue.cc:260] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:15.339711 32285 raft_consensus.cc:3060] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:15.344908 32435 raft_consensus.cc:2468] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 2.
I20260709 12:21:15.346475 32325 leader_election.cc:304] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:15.346994 32285 raft_consensus.cc:2468] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 2.
I20260709 12:21:15.347234 32484 raft_consensus.cc:2804] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:15.347796 32484 raft_consensus.cc:697] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [term 2 LEADER]: Becoming Leader. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Running, Role: LEADER
I20260709 12:21:15.348639 32484 consensus_queue.cc:237] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:15.355868 32183 catalog_manager.cc:5697] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 reported cstate change: term changed from 1 to 2, leader changed from a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1) to 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "81bee0a37e054555ac4d58f6adeff729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:15.358392 32506 consensus_queue.cc:1048] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:15.375752 32480 consensus_queue.cc:1048] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:15.391330 32536 raft_consensus.cc:993] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729: : Instructing follower a1bcba00e3e34ed7b7a1cf5d40e29be6 to start an election
I20260709 12:21:15.391777 32484 raft_consensus.cc:1081] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Signalling peer a1bcba00e3e34ed7b7a1cf5d40e29be6 to start an election
I20260709 12:21:15.393345 32285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bb847a8cef042b8a343a8b27bfb8bdc"
dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
 from {username='slave'} at 127.0.0.1:59856
I20260709 12:21:15.393821 32285 raft_consensus.cc:493] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:15.394079 32285 raft_consensus.cc:3060] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:15.399101 32285 raft_consensus.cc:515] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:15.400713 32285 leader_election.cc:290] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 2 election: Requested vote from peers 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:15.401623 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb847a8cef042b8a343a8b27bfb8bdc" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
I20260709 12:21:15.401842 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb847a8cef042b8a343a8b27bfb8bdc" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:15.402379 32361 raft_consensus.cc:3055] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:15.402413 32435 raft_consensus.cc:3060] T 0bb847a8cef042b8a343a8b27bfb8bdc P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:15.402907 32361 raft_consensus.cc:740] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Running, Role: LEADER
I20260709 12:21:15.403774 32361 consensus_queue.cc:260] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:15.405004 32361 raft_consensus.cc:3060] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:15.410075 32435 raft_consensus.cc:2468] T 0bb847a8cef042b8a343a8b27bfb8bdc P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 2.
I20260709 12:21:15.411584 32250 leader_election.cc:304] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:15.411880 32361 raft_consensus.cc:2468] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 2.
I20260709 12:21:15.412304 32480 raft_consensus.cc:2804] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:15.412751 32480 raft_consensus.cc:697] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 LEADER]: Becoming Leader. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Running, Role: LEADER
I20260709 12:21:15.413472 32480 consensus_queue.cc:237] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:15.420012 32183 catalog_manager.cc:5697] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 reported cstate change: term changed from 1 to 2, leader changed from 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2) to a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:15.762949 32285 raft_consensus.cc:1275] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Refusing update from remote peer 81bee0a37e054555ac4d58f6adeff729: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:15.764205 32536 consensus_queue.cc:1048] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:15.771941 32435 raft_consensus.cc:1275] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Refusing update from remote peer 81bee0a37e054555ac4d58f6adeff729: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:15.773576 32535 consensus_queue.cc:1048] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:16.028434 32361 raft_consensus.cc:1275] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Refusing update from remote peer a1bcba00e3e34ed7b7a1cf5d40e29be6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:16.028460 32435 raft_consensus.cc:1275] T 0bb847a8cef042b8a343a8b27bfb8bdc P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Refusing update from remote peer a1bcba00e3e34ed7b7a1cf5d40e29be6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:16.029853 32509 consensus_queue.cc:1048] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:16.030622 32480 consensus_queue.cc:1048] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:18.034116 32181 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60116:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:21:18.036875 32181 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:21:18.094122 32271 tablet_service.cc:1511] Processing CreateTablet for tablet 025032ae81ca449e8469df7b0db080d0 (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:18.096140 32271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 025032ae81ca449e8469df7b0db080d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.096225 32343 tablet_service.cc:1511] Processing CreateTablet for tablet 025032ae81ca449e8469df7b0db080d0 (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:18.098080 32418 tablet_service.cc:1511] Processing CreateTablet for tablet 025032ae81ca449e8469df7b0db080d0 (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:18.098100 32343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 025032ae81ca449e8469df7b0db080d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.099988 32418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 025032ae81ca449e8469df7b0db080d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.103142 32270 tablet_service.cc:1511] Processing CreateTablet for tablet 7b3990238fdb4b3f9c60704cff0a5007 (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:18.103747 32273 tablet_service.cc:1511] Processing CreateTablet for tablet 83ea334d6850454995ed5e7266aff57c (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:18.104839 32270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b3990238fdb4b3f9c60704cff0a5007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.105542 32273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ea334d6850454995ed5e7266aff57c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.110678 32274 tablet_service.cc:1511] Processing CreateTablet for tablet fb85fe03506e4cb5913be0824ebb9d9b (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:18.112357 32274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb85fe03506e4cb5913be0824ebb9d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.114362 32417 tablet_service.cc:1511] Processing CreateTablet for tablet 7b3990238fdb4b3f9c60704cff0a5007 (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:18.116096 32417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b3990238fdb4b3f9c60704cff0a5007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.119308 32420 tablet_service.cc:1511] Processing CreateTablet for tablet 83ea334d6850454995ed5e7266aff57c (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:18.120980 32420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ea334d6850454995ed5e7266aff57c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.123172 32423 tablet_service.cc:1511] Processing CreateTablet for tablet fb85fe03506e4cb5913be0824ebb9d9b (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:18.124785 32423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb85fe03506e4cb5913be0824ebb9d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.131958 32350 tablet_service.cc:1511] Processing CreateTablet for tablet 7b3990238fdb4b3f9c60704cff0a5007 (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:18.133913 32350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b3990238fdb4b3f9c60704cff0a5007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.135630 32344 tablet_service.cc:1511] Processing CreateTablet for tablet fb85fe03506e4cb5913be0824ebb9d9b (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:18.143049 32344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb85fe03506e4cb5913be0824ebb9d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.137737 32348 tablet_service.cc:1511] Processing CreateTablet for tablet 83ea334d6850454995ed5e7266aff57c (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:18.146080 32348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ea334d6850454995ed5e7266aff57c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.152616 32272 tablet_service.cc:1511] Processing CreateTablet for tablet c9636a2fcffb44328184e08625d74513 (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:18.154551 32272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9636a2fcffb44328184e08625d74513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.157083 32351 tablet_service.cc:1511] Processing CreateTablet for tablet c9636a2fcffb44328184e08625d74513 (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:18.158720 32351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9636a2fcffb44328184e08625d74513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.175419 32422 tablet_service.cc:1511] Processing CreateTablet for tablet c9636a2fcffb44328184e08625d74513 (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:18.177031 32422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9636a2fcffb44328184e08625d74513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.179111 32582 tablet_bootstrap.cc:492] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6: Bootstrap starting.
I20260709 12:21:18.192503 32274 tablet_service.cc:1511] Processing CreateTablet for tablet 576732b19cb041c187a86d548f1b8c48 (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:18.193974 32274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 576732b19cb041c187a86d548f1b8c48. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:18.199467 32232 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:18.216744 32347 tablet_service.cc:1511] Processing CreateTablet for tablet 576732b19cb041c187a86d548f1b8c48 (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:18.218359 32347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 576732b19cb041c187a86d548f1b8c48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.219311 32581 tablet_bootstrap.cc:492] T 025032ae81ca449e8469df7b0db080d0 P 81bee0a37e054555ac4d58f6adeff729: Bootstrap starting.
I20260709 12:21:18.222283 32582 tablet_bootstrap.cc:654] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.227228 32420 tablet_service.cc:1511] Processing CreateTablet for tablet 576732b19cb041c187a86d548f1b8c48 (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:18.233160 32271 tablet_service.cc:1511] Processing CreateTablet for tablet 1b41c7bd1cb54f27b7699b8c27edab05 (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:18.233695 32420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 576732b19cb041c187a86d548f1b8c48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.230741 32343 tablet_service.cc:1511] Processing CreateTablet for tablet 82197fa1e8084b78823d76fd7e35a096 (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:18.232218 32425 tablet_service.cc:1511] Processing CreateTablet for tablet 82197fa1e8084b78823d76fd7e35a096 (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:18.239043 32584 tablet_bootstrap.cc:492] T 025032ae81ca449e8469df7b0db080d0 P e03b91883c034031a866b1e6a7133759: Bootstrap starting.
I20260709 12:21:18.240406 32343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82197fa1e8084b78823d76fd7e35a096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.230741 32273 tablet_service.cc:1511] Processing CreateTablet for tablet 82197fa1e8084b78823d76fd7e35a096 (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:18.234651 32271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b41c7bd1cb54f27b7699b8c27edab05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.244928 32345 tablet_service.cc:1511] Processing CreateTablet for tablet 1b41c7bd1cb54f27b7699b8c27edab05 (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:18.246899 32345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b41c7bd1cb54f27b7699b8c27edab05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.247284 32273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82197fa1e8084b78823d76fd7e35a096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.249992 32425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82197fa1e8084b78823d76fd7e35a096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.266776 32351 tablet_service.cc:1511] Processing CreateTablet for tablet 422814cbe50747fb91b9be40bf8212ca (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:18.268338 32351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 422814cbe50747fb91b9be40bf8212ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.273290 32272 tablet_service.cc:1511] Processing CreateTablet for tablet 422814cbe50747fb91b9be40bf8212ca (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:18.270342 32418 tablet_service.cc:1511] Processing CreateTablet for tablet 1b41c7bd1cb54f27b7699b8c27edab05 (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:18.274696 32272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 422814cbe50747fb91b9be40bf8212ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.275676 32584 tablet_bootstrap.cc:654] T 025032ae81ca449e8469df7b0db080d0 P e03b91883c034031a866b1e6a7133759: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.276043 32418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b41c7bd1cb54f27b7699b8c27edab05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.280814 32581 tablet_bootstrap.cc:654] T 025032ae81ca449e8469df7b0db080d0 P 81bee0a37e054555ac4d58f6adeff729: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.283694 32582 tablet_bootstrap.cc:492] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6: No bootstrap required, opened a new log
I20260709 12:21:18.289709 32582 ts_tablet_manager.cc:1403] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent bootstrapping tablet: real 0.111s	user 0.010s	sys 0.004s
I20260709 12:21:18.293576 32423 tablet_service.cc:1511] Processing CreateTablet for tablet 422814cbe50747fb91b9be40bf8212ca (DEFAULT_TABLE table=soft_deleted_table [id=d4af025862be435fb4db094dabacf226]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:18.293484 32582 raft_consensus.cc:359] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.294870 32582 raft_consensus.cc:385] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.295311 32582 raft_consensus.cc:740] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.296237 32582 consensus_queue.cc:260] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.299432 32423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 422814cbe50747fb91b9be40bf8212ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.301234 32581 tablet_bootstrap.cc:492] T 025032ae81ca449e8469df7b0db080d0 P 81bee0a37e054555ac4d58f6adeff729: No bootstrap required, opened a new log
I20260709 12:21:18.301810 32581 ts_tablet_manager.cc:1403] T 025032ae81ca449e8469df7b0db080d0 P 81bee0a37e054555ac4d58f6adeff729: Time spent bootstrapping tablet: real 0.083s	user 0.007s	sys 0.007s
I20260709 12:21:18.305239 32581 raft_consensus.cc:359] T 025032ae81ca449e8469df7b0db080d0 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.314221 32581 raft_consensus.cc:385] T 025032ae81ca449e8469df7b0db080d0 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.314625 32581 raft_consensus.cc:740] T 025032ae81ca449e8469df7b0db080d0 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.315507 32581 consensus_queue.cc:260] T 025032ae81ca449e8469df7b0db080d0 P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.308297 32582 ts_tablet_manager.cc:1434] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent starting tablet: real 0.018s	user 0.000s	sys 0.009s
I20260709 12:21:18.324599 32582 tablet_bootstrap.cc:492] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Bootstrap starting.
I20260709 12:21:18.328164 32581 ts_tablet_manager.cc:1434] T 025032ae81ca449e8469df7b0db080d0 P 81bee0a37e054555ac4d58f6adeff729: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:21:18.328780 32584 tablet_bootstrap.cc:492] T 025032ae81ca449e8469df7b0db080d0 P e03b91883c034031a866b1e6a7133759: No bootstrap required, opened a new log
I20260709 12:21:18.329345 32581 tablet_bootstrap.cc:492] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729: Bootstrap starting.
I20260709 12:21:18.336229 32581 tablet_bootstrap.cc:654] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.336309 32584 ts_tablet_manager.cc:1403] T 025032ae81ca449e8469df7b0db080d0 P e03b91883c034031a866b1e6a7133759: Time spent bootstrapping tablet: real 0.098s	user 0.004s	sys 0.023s
I20260709 12:21:18.339776 32584 raft_consensus.cc:359] T 025032ae81ca449e8469df7b0db080d0 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.341315 32584 raft_consensus.cc:385] T 025032ae81ca449e8469df7b0db080d0 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.341653 32584 raft_consensus.cc:740] T 025032ae81ca449e8469df7b0db080d0 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.342489 32584 consensus_queue.cc:260] T 025032ae81ca449e8469df7b0db080d0 P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.345703 32584 ts_tablet_manager.cc:1434] T 025032ae81ca449e8469df7b0db080d0 P e03b91883c034031a866b1e6a7133759: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:21:18.347064 32584 tablet_bootstrap.cc:492] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759: Bootstrap starting.
I20260709 12:21:18.347895 32582 tablet_bootstrap.cc:654] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.354894 32584 tablet_bootstrap.cc:654] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.360132 32582 tablet_bootstrap.cc:492] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6: No bootstrap required, opened a new log
I20260709 12:21:18.360697 32582 ts_tablet_manager.cc:1403] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent bootstrapping tablet: real 0.036s	user 0.005s	sys 0.012s
I20260709 12:21:18.363970 32582 raft_consensus.cc:359] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.364823 32582 raft_consensus.cc:385] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.366417 32582 raft_consensus.cc:740] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.367316 32584 tablet_bootstrap.cc:492] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759: No bootstrap required, opened a new log
I20260709 12:21:18.368104 32584 ts_tablet_manager.cc:1403] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.007s
I20260709 12:21:18.367447 32582 consensus_queue.cc:260] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.371731 32584 raft_consensus.cc:359] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.372561 32584 raft_consensus.cc:385] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.372903 32584 raft_consensus.cc:740] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.374007 32584 consensus_queue.cc:260] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.375517 32582 ts_tablet_manager.cc:1434] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.007s
I20260709 12:21:18.376647 32582 tablet_bootstrap.cc:492] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6: Bootstrap starting.
I20260709 12:21:18.407071 32584 ts_tablet_manager.cc:1434] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.015s
I20260709 12:21:18.409060 32582 tablet_bootstrap.cc:654] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.412012 32584 tablet_bootstrap.cc:492] T 7b3990238fdb4b3f9c60704cff0a5007 P e03b91883c034031a866b1e6a7133759: Bootstrap starting.
I20260709 12:21:18.414194 32581 tablet_bootstrap.cc:492] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729: No bootstrap required, opened a new log
I20260709 12:21:18.415683 32581 ts_tablet_manager.cc:1403] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729: Time spent bootstrapping tablet: real 0.087s	user 0.038s	sys 0.015s
I20260709 12:21:18.419497 32581 raft_consensus.cc:359] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.420325 32584 tablet_bootstrap.cc:654] T 7b3990238fdb4b3f9c60704cff0a5007 P e03b91883c034031a866b1e6a7133759: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.420447 32581 raft_consensus.cc:385] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.421015 32581 raft_consensus.cc:740] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.422030 32581 consensus_queue.cc:260] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.424417 32581 ts_tablet_manager.cc:1434] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:18.425485 32581 tablet_bootstrap.cc:492] T 7b3990238fdb4b3f9c60704cff0a5007 P 81bee0a37e054555ac4d58f6adeff729: Bootstrap starting.
I20260709 12:21:18.432794 32581 tablet_bootstrap.cc:654] T 7b3990238fdb4b3f9c60704cff0a5007 P 81bee0a37e054555ac4d58f6adeff729: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.434653 32582 tablet_bootstrap.cc:492] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6: No bootstrap required, opened a new log
I20260709 12:21:18.435302 32582 ts_tablet_manager.cc:1403] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.023s
I20260709 12:21:18.439824 32582 raft_consensus.cc:359] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.440765 32582 raft_consensus.cc:385] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.441097 32582 raft_consensus.cc:740] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.442132 32582 consensus_queue.cc:260] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.445365 32582 ts_tablet_manager.cc:1434] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 12:21:18.446579 32582 tablet_bootstrap.cc:492] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Bootstrap starting.
I20260709 12:21:18.449234 32581 tablet_bootstrap.cc:492] T 7b3990238fdb4b3f9c60704cff0a5007 P 81bee0a37e054555ac4d58f6adeff729: No bootstrap required, opened a new log
I20260709 12:21:18.450037 32581 ts_tablet_manager.cc:1403] T 7b3990238fdb4b3f9c60704cff0a5007 P 81bee0a37e054555ac4d58f6adeff729: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.000s
I20260709 12:21:18.453848 32584 tablet_bootstrap.cc:492] T 7b3990238fdb4b3f9c60704cff0a5007 P e03b91883c034031a866b1e6a7133759: No bootstrap required, opened a new log
I20260709 12:21:18.454084 32582 tablet_bootstrap.cc:654] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.453835 32581 raft_consensus.cc:359] T 7b3990238fdb4b3f9c60704cff0a5007 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.455047 32584 ts_tablet_manager.cc:1403] T 7b3990238fdb4b3f9c60704cff0a5007 P e03b91883c034031a866b1e6a7133759: Time spent bootstrapping tablet: real 0.043s	user 0.022s	sys 0.019s
I20260709 12:21:18.455096 32581 raft_consensus.cc:385] T 7b3990238fdb4b3f9c60704cff0a5007 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.455590 32581 raft_consensus.cc:740] T 7b3990238fdb4b3f9c60704cff0a5007 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.456425 32581 consensus_queue.cc:260] T 7b3990238fdb4b3f9c60704cff0a5007 P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.459316 32581 ts_tablet_manager.cc:1434] T 7b3990238fdb4b3f9c60704cff0a5007 P 81bee0a37e054555ac4d58f6adeff729: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:21:18.458904 32584 raft_consensus.cc:359] T 7b3990238fdb4b3f9c60704cff0a5007 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.460428 32584 raft_consensus.cc:385] T 7b3990238fdb4b3f9c60704cff0a5007 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.460587 32581 tablet_bootstrap.cc:492] T fb85fe03506e4cb5913be0824ebb9d9b P 81bee0a37e054555ac4d58f6adeff729: Bootstrap starting.
I20260709 12:21:18.460781 32584 raft_consensus.cc:740] T 7b3990238fdb4b3f9c60704cff0a5007 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.461685 32584 consensus_queue.cc:260] T 7b3990238fdb4b3f9c60704cff0a5007 P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.464098 32584 ts_tablet_manager.cc:1434] T 7b3990238fdb4b3f9c60704cff0a5007 P e03b91883c034031a866b1e6a7133759: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 12:21:18.465121 32584 tablet_bootstrap.cc:492] T fb85fe03506e4cb5913be0824ebb9d9b P e03b91883c034031a866b1e6a7133759: Bootstrap starting.
I20260709 12:21:18.472553 32584 tablet_bootstrap.cc:654] T fb85fe03506e4cb5913be0824ebb9d9b P e03b91883c034031a866b1e6a7133759: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.473197 32581 tablet_bootstrap.cc:654] T fb85fe03506e4cb5913be0824ebb9d9b P 81bee0a37e054555ac4d58f6adeff729: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.480388 32582 tablet_bootstrap.cc:492] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6: No bootstrap required, opened a new log
I20260709 12:21:18.481041 32582 ts_tablet_manager.cc:1403] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.008s
I20260709 12:21:18.484818 32582 raft_consensus.cc:359] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.485728 32582 raft_consensus.cc:385] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.486097 32582 raft_consensus.cc:740] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.486934 32582 consensus_queue.cc:260] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.489934 32582 ts_tablet_manager.cc:1434] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.005s
I20260709 12:21:18.494501 32582 tablet_bootstrap.cc:492] T c9636a2fcffb44328184e08625d74513 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Bootstrap starting.
I20260709 12:21:18.496515 32584 tablet_bootstrap.cc:492] T fb85fe03506e4cb5913be0824ebb9d9b P e03b91883c034031a866b1e6a7133759: No bootstrap required, opened a new log
I20260709 12:21:18.497198 32584 ts_tablet_manager.cc:1403] T fb85fe03506e4cb5913be0824ebb9d9b P e03b91883c034031a866b1e6a7133759: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.012s
I20260709 12:21:18.500895 32584 raft_consensus.cc:359] T fb85fe03506e4cb5913be0824ebb9d9b P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.501677 32584 raft_consensus.cc:385] T fb85fe03506e4cb5913be0824ebb9d9b P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.502015 32584 raft_consensus.cc:740] T fb85fe03506e4cb5913be0824ebb9d9b P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.502992 32584 consensus_queue.cc:260] T fb85fe03506e4cb5913be0824ebb9d9b P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.504931 32582 tablet_bootstrap.cc:654] T c9636a2fcffb44328184e08625d74513 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.505357 32584 ts_tablet_manager.cc:1434] T fb85fe03506e4cb5913be0824ebb9d9b P e03b91883c034031a866b1e6a7133759: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:21:18.506559 32584 tablet_bootstrap.cc:492] T c9636a2fcffb44328184e08625d74513 P e03b91883c034031a866b1e6a7133759: Bootstrap starting.
I20260709 12:21:18.508595 32581 tablet_bootstrap.cc:492] T fb85fe03506e4cb5913be0824ebb9d9b P 81bee0a37e054555ac4d58f6adeff729: No bootstrap required, opened a new log
I20260709 12:21:18.509174 32581 ts_tablet_manager.cc:1403] T fb85fe03506e4cb5913be0824ebb9d9b P 81bee0a37e054555ac4d58f6adeff729: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.014s
I20260709 12:21:18.512531 32581 raft_consensus.cc:359] T fb85fe03506e4cb5913be0824ebb9d9b P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.514117 32584 tablet_bootstrap.cc:654] T c9636a2fcffb44328184e08625d74513 P e03b91883c034031a866b1e6a7133759: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.513343 32581 raft_consensus.cc:385] T fb85fe03506e4cb5913be0824ebb9d9b P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.514806 32581 raft_consensus.cc:740] T fb85fe03506e4cb5913be0824ebb9d9b P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.515815 32581 consensus_queue.cc:260] T fb85fe03506e4cb5913be0824ebb9d9b P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.519917 32583 raft_consensus.cc:493] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.520692 32583 raft_consensus.cc:515] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.529570 32581 ts_tablet_manager.cc:1434] T fb85fe03506e4cb5913be0824ebb9d9b P 81bee0a37e054555ac4d58f6adeff729: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 12:21:18.526664 32583 leader_election.cc:290] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:18.531144 32581 tablet_bootstrap.cc:492] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729: Bootstrap starting.
I20260709 12:21:18.531873 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3990238fdb4b3f9c60704cff0a5007" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729" is_pre_election: true
I20260709 12:21:18.530831 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3990238fdb4b3f9c60704cff0a5007" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:18.532522 32584 tablet_bootstrap.cc:492] T c9636a2fcffb44328184e08625d74513 P e03b91883c034031a866b1e6a7133759: No bootstrap required, opened a new log
I20260709 12:21:18.533257 32584 ts_tablet_manager.cc:1403] T c9636a2fcffb44328184e08625d74513 P e03b91883c034031a866b1e6a7133759: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.008s
I20260709 12:21:18.532596 32361 raft_consensus.cc:2468] T 7b3990238fdb4b3f9c60704cff0a5007 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 0.
I20260709 12:21:18.536244 32252 leader_election.cc:304] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 
I20260709 12:21:18.537117 32584 raft_consensus.cc:359] T c9636a2fcffb44328184e08625d74513 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.537161 32583 raft_consensus.cc:2804] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:18.538635 32583 raft_consensus.cc:493] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.539006 32583 raft_consensus.cc:3060] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.542289 32435 raft_consensus.cc:2468] T 7b3990238fdb4b3f9c60704cff0a5007 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 0.
I20260709 12:21:18.538192 32584 raft_consensus.cc:385] T c9636a2fcffb44328184e08625d74513 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.544991 32584 raft_consensus.cc:740] T c9636a2fcffb44328184e08625d74513 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.545977 32584 consensus_queue.cc:260] T c9636a2fcffb44328184e08625d74513 P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.550679 32581 tablet_bootstrap.cc:654] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.551970 32584 ts_tablet_manager.cc:1434] T c9636a2fcffb44328184e08625d74513 P e03b91883c034031a866b1e6a7133759: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:21:18.552860 32582 tablet_bootstrap.cc:492] T c9636a2fcffb44328184e08625d74513 P a1bcba00e3e34ed7b7a1cf5d40e29be6: No bootstrap required, opened a new log
I20260709 12:21:18.553268 32584 tablet_bootstrap.cc:492] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759: Bootstrap starting.
I20260709 12:21:18.553550 32582 ts_tablet_manager.cc:1403] T c9636a2fcffb44328184e08625d74513 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent bootstrapping tablet: real 0.059s	user 0.023s	sys 0.029s
I20260709 12:21:18.556331 32583 raft_consensus.cc:515] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.557356 32582 raft_consensus.cc:359] T c9636a2fcffb44328184e08625d74513 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.558264 32582 raft_consensus.cc:385] T c9636a2fcffb44328184e08625d74513 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.558579 32582 raft_consensus.cc:740] T c9636a2fcffb44328184e08625d74513 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.559449 32582 consensus_queue.cc:260] T c9636a2fcffb44328184e08625d74513 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.560097 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3990238fdb4b3f9c60704cff0a5007" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
I20260709 12:21:18.560983 32361 raft_consensus.cc:3060] T 7b3990238fdb4b3f9c60704cff0a5007 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.562057 32582 ts_tablet_manager.cc:1434] T c9636a2fcffb44328184e08625d74513 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:21:18.563290 32582 tablet_bootstrap.cc:492] T 576732b19cb041c187a86d548f1b8c48 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Bootstrap starting.
I20260709 12:21:18.565780 32581 tablet_bootstrap.cc:492] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729: No bootstrap required, opened a new log
I20260709 12:21:18.566457 32581 ts_tablet_manager.cc:1403] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.008s
I20260709 12:21:18.569201 32584 tablet_bootstrap.cc:654] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.570106 32581 raft_consensus.cc:359] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.570573 32582 tablet_bootstrap.cc:654] T 576732b19cb041c187a86d548f1b8c48 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.570935 32581 raft_consensus.cc:385] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.571267 32581 raft_consensus.cc:740] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.572307 32581 consensus_queue.cc:260] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.579460 32581 ts_tablet_manager.cc:1434] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:21:18.580834 32581 tablet_bootstrap.cc:492] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729: Bootstrap starting.
I20260709 12:21:18.592046 32581 tablet_bootstrap.cc:654] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.594947 32582 tablet_bootstrap.cc:492] T 576732b19cb041c187a86d548f1b8c48 P a1bcba00e3e34ed7b7a1cf5d40e29be6: No bootstrap required, opened a new log
I20260709 12:21:18.595640 32582 ts_tablet_manager.cc:1403] T 576732b19cb041c187a86d548f1b8c48 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.007s
I20260709 12:21:18.599336 32582 raft_consensus.cc:359] T 576732b19cb041c187a86d548f1b8c48 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.600239 32582 raft_consensus.cc:385] T 576732b19cb041c187a86d548f1b8c48 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.600543 32582 raft_consensus.cc:740] T 576732b19cb041c187a86d548f1b8c48 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.601370 32582 consensus_queue.cc:260] T 576732b19cb041c187a86d548f1b8c48 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.601658 32568 raft_consensus.cc:493] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.603966 32582 ts_tablet_manager.cc:1434] T 576732b19cb041c187a86d548f1b8c48 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:21:18.603746 32568 raft_consensus.cc:515] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.605217 32582 tablet_bootstrap.cc:492] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Bootstrap starting.
I20260709 12:21:18.607648 32581 tablet_bootstrap.cc:492] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729: No bootstrap required, opened a new log
I20260709 12:21:18.607777 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ea334d6850454995ed5e7266aff57c" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:18.608412 32581 ts_tablet_manager.cc:1403] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.007s
I20260709 12:21:18.608542 32435 raft_consensus.cc:2468] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 0.
I20260709 12:21:18.610322 32325 leader_election.cc:304] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:18.611917 32581 raft_consensus.cc:359] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.612469 32568 leader_election.cc:290] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:18.612762 32581 raft_consensus.cc:385] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.620818 32581 raft_consensus.cc:740] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.622207 32583 leader_election.cc:290] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 election: Requested vote from peers 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:18.614671 32582 tablet_bootstrap.cc:654] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.623160 32581 consensus_queue.cc:260] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.623598 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3990238fdb4b3f9c60704cff0a5007" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:18.624321 32435 raft_consensus.cc:3060] T 7b3990238fdb4b3f9c60704cff0a5007 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.626001 32581 ts_tablet_manager.cc:1434] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:21:18.627174 32581 tablet_bootstrap.cc:492] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729: Bootstrap starting.
I20260709 12:21:18.629442 32361 raft_consensus.cc:2468] T 7b3990238fdb4b3f9c60704cff0a5007 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 1.
I20260709 12:21:18.631640 32252 leader_election.cc:304] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 
I20260709 12:21:18.632889 32583 raft_consensus.cc:2804] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:18.634460 32583 raft_consensus.cc:697] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Becoming Leader. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Running, Role: LEADER
I20260709 12:21:18.635562 32583 consensus_queue.cc:237] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.648555 32604 raft_consensus.cc:493] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.649232 32604 raft_consensus.cc:515] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.640654 32435 raft_consensus.cc:2468] T 7b3990238fdb4b3f9c60704cff0a5007 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 1.
I20260709 12:21:18.640861 32569 raft_consensus.cc:493] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.651940 32569 raft_consensus.cc:515] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
W20260709 12:21:18.653226 32324 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:38901, user_credentials={real_user=slave}} blocked reactor thread for 50321.9us
I20260709 12:21:18.655176 32569 leader_election.cc:290] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:18.655539 32285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ea334d6850454995ed5e7266aff57c" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" is_pre_election: true
I20260709 12:21:18.656736 32285 raft_consensus.cc:2468] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 0.
I20260709 12:21:18.658421 32434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b41c7bd1cb54f27b7699b8c27edab05" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:18.661089 32434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "025032ae81ca449e8469df7b0db080d0" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:18.643371 32603 raft_consensus.cc:2804] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:18.661923 32434 raft_consensus.cc:2468] T 025032ae81ca449e8469df7b0db080d0 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 0.
I20260709 12:21:18.662227 32603 raft_consensus.cc:493] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.662910 32603 raft_consensus.cc:3060] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:18.666263 32325 leader_election.cc:343] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:18.669514 32285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b41c7bd1cb54f27b7699b8c27edab05" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" is_pre_election: true
I20260709 12:21:18.669605 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "025032ae81ca449e8469df7b0db080d0" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729" is_pre_election: true
I20260709 12:21:18.671196 32361 raft_consensus.cc:2468] T 025032ae81ca449e8469df7b0db080d0 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 0.
I20260709 12:21:18.671938 32250 leader_election.cc:304] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:18.672896 32569 raft_consensus.cc:2804] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:18.673265 32569 raft_consensus.cc:493] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.673599 32569 raft_consensus.cc:3060] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:18.678143 32324 leader_election.cc:343] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:18.682938 32324 leader_election.cc:304] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729; no voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759
I20260709 12:21:18.683823 32183 catalog_manager.cc:5697] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:18.688256 32606 raft_consensus.cc:2749] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:18.679484 32604 leader_election.cc:290] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:18.699034 32603 raft_consensus.cc:515] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.703169 32582 tablet_bootstrap.cc:492] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6: No bootstrap required, opened a new log
I20260709 12:21:18.703763 32582 ts_tablet_manager.cc:1403] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent bootstrapping tablet: real 0.099s	user 0.028s	sys 0.036s
I20260709 12:21:18.703974 32285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ea334d6850454995ed5e7266aff57c" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
I20260709 12:21:18.705097 32285 raft_consensus.cc:3060] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.705952 32603 leader_election.cc:290] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 election: Requested vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:18.693199 32569 raft_consensus.cc:515] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.706954 32584 tablet_bootstrap.cc:492] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759: No bootstrap required, opened a new log
I20260709 12:21:18.707530 32584 ts_tablet_manager.cc:1403] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759: Time spent bootstrapping tablet: real 0.155s	user 0.048s	sys 0.055s
I20260709 12:21:18.708838 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ea334d6850454995ed5e7266aff57c" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:18.709120 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "025032ae81ca449e8469df7b0db080d0" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
I20260709 12:21:18.709856 32361 raft_consensus.cc:3060] T 025032ae81ca449e8469df7b0db080d0 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.710913 32584 raft_consensus.cc:359] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.711746 32584 raft_consensus.cc:385] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.712075 32584 raft_consensus.cc:740] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.713996 32435 raft_consensus.cc:3060] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.714133 32609 raft_consensus.cc:493] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.715827 32609 raft_consensus.cc:515] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.715866 32582 raft_consensus.cc:359] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.718200 32582 raft_consensus.cc:385] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.718554 32582 raft_consensus.cc:740] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.719758 32609 leader_election.cc:290] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:18.719501 32582 consensus_queue.cc:260] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.716697 32581 tablet_bootstrap.cc:654] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.722398 32435 raft_consensus.cc:2468] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 1.
I20260709 12:21:18.723026 32434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb85fe03506e4cb5913be0824ebb9d9b" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:18.723141 32360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb85fe03506e4cb5913be0824ebb9d9b" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729" is_pre_election: true
I20260709 12:21:18.723663 32325 leader_election.cc:304] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:18.723891 32360 raft_consensus.cc:2468] T fb85fe03506e4cb5913be0824ebb9d9b P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 0.
I20260709 12:21:18.724624 32603 raft_consensus.cc:2804] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:18.725811 32603 raft_consensus.cc:697] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Becoming Leader. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Running, Role: LEADER
I20260709 12:21:18.726514 32252 leader_election.cc:304] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 
I20260709 12:21:18.731149 32361 raft_consensus.cc:2468] T 025032ae81ca449e8469df7b0db080d0 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 1.
I20260709 12:21:18.726788 32603 consensus_queue.cc:237] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.731560 32606 raft_consensus.cc:493] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.732100 32606 raft_consensus.cc:515] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.732429 32252 leader_election.cc:304] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 
I20260709 12:21:18.730995 32609 raft_consensus.cc:2804] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:18.733719 32583 raft_consensus.cc:2804] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:18.723878 32434 raft_consensus.cc:2468] T fb85fe03506e4cb5913be0824ebb9d9b P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 0.
I20260709 12:21:18.739868 32583 raft_consensus.cc:697] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Becoming Leader. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Running, Role: LEADER
I20260709 12:21:18.740971 32583 consensus_queue.cc:237] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.743711 32285 raft_consensus.cc:2468] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 1.
I20260709 12:21:18.735041 32606 leader_election.cc:290] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:18.733341 32584 consensus_queue.cc:260] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.737146 32435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9636a2fcffb44328184e08625d74513" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:18.746290 32435 raft_consensus.cc:2468] T c9636a2fcffb44328184e08625d74513 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 0.
I20260709 12:21:18.737562 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "025032ae81ca449e8469df7b0db080d0" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:18.738071 32609 raft_consensus.cc:493] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.734373 32569 leader_election.cc:290] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 election: Requested vote from peers 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:18.744102 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9636a2fcffb44328184e08625d74513" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" is_pre_election: true
I20260709 12:21:18.750309 32433 raft_consensus.cc:3060] T 025032ae81ca449e8469df7b0db080d0 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.751915 32584 ts_tablet_manager.cc:1434] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.001s
I20260709 12:21:18.753031 32584 tablet_bootstrap.cc:492] T 576732b19cb041c187a86d548f1b8c48 P e03b91883c034031a866b1e6a7133759: Bootstrap starting.
I20260709 12:21:18.753890 32609 raft_consensus.cc:3060] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.758689 32325 leader_election.cc:304] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:18.760293 32603 raft_consensus.cc:2804] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:18.760667 32603 raft_consensus.cc:493] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.760995 32603 raft_consensus.cc:3060] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.754942 32286 raft_consensus.cc:2468] T c9636a2fcffb44328184e08625d74513 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 0.
I20260709 12:21:18.768586 32433 raft_consensus.cc:2468] T 025032ae81ca449e8469df7b0db080d0 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 1.
I20260709 12:21:18.776194 32609 raft_consensus.cc:515] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.778470 32182 catalog_manager.cc:5697] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "81bee0a37e054555ac4d58f6adeff729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:18.784451 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb85fe03506e4cb5913be0824ebb9d9b" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
I20260709 12:21:18.785197 32361 raft_consensus.cc:3060] T fb85fe03506e4cb5913be0824ebb9d9b P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.785573 32609 leader_election.cc:290] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 election: Requested vote from peers 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:18.785881 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb85fe03506e4cb5913be0824ebb9d9b" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:18.786624 32433 raft_consensus.cc:3060] T fb85fe03506e4cb5913be0824ebb9d9b P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.789844 32581 tablet_bootstrap.cc:492] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729: No bootstrap required, opened a new log
I20260709 12:21:18.790494 32581 ts_tablet_manager.cc:1403] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729: Time spent bootstrapping tablet: real 0.164s	user 0.014s	sys 0.017s
I20260709 12:21:18.793820 32581 raft_consensus.cc:359] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.794606 32581 raft_consensus.cc:385] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.794914 32581 raft_consensus.cc:740] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.794979 32433 raft_consensus.cc:2468] T fb85fe03506e4cb5913be0824ebb9d9b P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 1.
I20260709 12:21:18.795897 32183 catalog_manager.cc:5697] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:18.796475 32250 leader_election.cc:304] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:18.797628 32582 ts_tablet_manager.cc:1434] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent starting tablet: real 0.094s	user 0.005s	sys 0.018s
I20260709 12:21:18.779922 32584 tablet_bootstrap.cc:654] T 576732b19cb041c187a86d548f1b8c48 P e03b91883c034031a866b1e6a7133759: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.797868 32616 raft_consensus.cc:2804] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:18.798588 32616 raft_consensus.cc:697] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Becoming Leader. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Running, Role: LEADER
I20260709 12:21:18.798803 32582 tablet_bootstrap.cc:492] T 422814cbe50747fb91b9be40bf8212ca P a1bcba00e3e34ed7b7a1cf5d40e29be6: Bootstrap starting.
I20260709 12:21:18.799575 32616 consensus_queue.cc:237] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.804100 32603 raft_consensus.cc:515] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.806789 32603 leader_election.cc:290] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 election: Requested vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:18.795749 32581 consensus_queue.cc:260] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.807441 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9636a2fcffb44328184e08625d74513" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
I20260709 12:21:18.808089 32286 raft_consensus.cc:3060] T c9636a2fcffb44328184e08625d74513 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.809051 32581 ts_tablet_manager.cc:1434] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:21:18.807523 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9636a2fcffb44328184e08625d74513" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:18.810103 32581 tablet_bootstrap.cc:492] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729: Bootstrap starting.
I20260709 12:21:18.814023 32433 raft_consensus.cc:3060] T c9636a2fcffb44328184e08625d74513 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.817632 32581 tablet_bootstrap.cc:654] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.828611 32433 raft_consensus.cc:2468] T c9636a2fcffb44328184e08625d74513 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 1.
I20260709 12:21:18.795825 32361 raft_consensus.cc:2468] T fb85fe03506e4cb5913be0824ebb9d9b P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 1.
I20260709 12:21:18.830062 32581 tablet_bootstrap.cc:492] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729: No bootstrap required, opened a new log
I20260709 12:21:18.830168 32325 leader_election.cc:304] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:18.830886 32581 ts_tablet_manager.cc:1403] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.006s
I20260709 12:21:18.831171 32603 raft_consensus.cc:2804] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:18.831702 32603 raft_consensus.cc:697] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Becoming Leader. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Running, Role: LEADER
I20260709 12:21:18.832551 32603 consensus_queue.cc:237] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.825528 32286 raft_consensus.cc:2468] T c9636a2fcffb44328184e08625d74513 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 1.
I20260709 12:21:18.833902 32581 raft_consensus.cc:359] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.834638 32581 raft_consensus.cc:385] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.834900 32581 raft_consensus.cc:740] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.835632 32581 consensus_queue.cc:260] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.837946 32581 ts_tablet_manager.cc:1434] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:21:18.838940 32581 tablet_bootstrap.cc:492] T 422814cbe50747fb91b9be40bf8212ca P 81bee0a37e054555ac4d58f6adeff729: Bootstrap starting.
I20260709 12:21:18.846604 32581 tablet_bootstrap.cc:654] T 422814cbe50747fb91b9be40bf8212ca P 81bee0a37e054555ac4d58f6adeff729: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.847625 32584 tablet_bootstrap.cc:492] T 576732b19cb041c187a86d548f1b8c48 P e03b91883c034031a866b1e6a7133759: No bootstrap required, opened a new log
I20260709 12:21:18.848342 32584 ts_tablet_manager.cc:1403] T 576732b19cb041c187a86d548f1b8c48 P e03b91883c034031a866b1e6a7133759: Time spent bootstrapping tablet: real 0.096s	user 0.027s	sys 0.018s
I20260709 12:21:18.849861 32582 tablet_bootstrap.cc:654] T 422814cbe50747fb91b9be40bf8212ca P a1bcba00e3e34ed7b7a1cf5d40e29be6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.857106 32183 catalog_manager.cc:5697] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "81bee0a37e054555ac4d58f6adeff729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:18.858464 32581 tablet_bootstrap.cc:492] T 422814cbe50747fb91b9be40bf8212ca P 81bee0a37e054555ac4d58f6adeff729: No bootstrap required, opened a new log
I20260709 12:21:18.858701 32584 raft_consensus.cc:359] T 576732b19cb041c187a86d548f1b8c48 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.859740 32584 raft_consensus.cc:385] T 576732b19cb041c187a86d548f1b8c48 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.859876 32581 ts_tablet_manager.cc:1403] T 422814cbe50747fb91b9be40bf8212ca P 81bee0a37e054555ac4d58f6adeff729: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:21:18.860059 32584 raft_consensus.cc:740] T 576732b19cb041c187a86d548f1b8c48 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.860896 32584 consensus_queue.cc:260] T 576732b19cb041c187a86d548f1b8c48 P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.863294 32582 tablet_bootstrap.cc:492] T 422814cbe50747fb91b9be40bf8212ca P a1bcba00e3e34ed7b7a1cf5d40e29be6: No bootstrap required, opened a new log
I20260709 12:21:18.863801 32582 ts_tablet_manager.cc:1403] T 422814cbe50747fb91b9be40bf8212ca P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.008s
I20260709 12:21:18.864992 32182 catalog_manager.cc:5697] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:18.866575 32582 raft_consensus.cc:359] T 422814cbe50747fb91b9be40bf8212ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.867324 32582 raft_consensus.cc:385] T 422814cbe50747fb91b9be40bf8212ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.867580 32582 raft_consensus.cc:740] T 422814cbe50747fb91b9be40bf8212ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.868309 32581 raft_consensus.cc:359] T 422814cbe50747fb91b9be40bf8212ca P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.868989 32581 raft_consensus.cc:385] T 422814cbe50747fb91b9be40bf8212ca P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.869297 32581 raft_consensus.cc:740] T 422814cbe50747fb91b9be40bf8212ca P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.869928 32581 consensus_queue.cc:260] T 422814cbe50747fb91b9be40bf8212ca P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.871852 32581 ts_tablet_manager.cc:1434] T 422814cbe50747fb91b9be40bf8212ca P 81bee0a37e054555ac4d58f6adeff729: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:21:18.868597 32582 consensus_queue.cc:260] T 422814cbe50747fb91b9be40bf8212ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.874042 32582 ts_tablet_manager.cc:1434] T 422814cbe50747fb91b9be40bf8212ca P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:21:18.874768 32582 tablet_bootstrap.cc:492] T 82197fa1e8084b78823d76fd7e35a096 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Bootstrap starting.
I20260709 12:21:18.876953 32584 ts_tablet_manager.cc:1434] T 576732b19cb041c187a86d548f1b8c48 P e03b91883c034031a866b1e6a7133759: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:21:18.880523 32582 tablet_bootstrap.cc:654] T 82197fa1e8084b78823d76fd7e35a096 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.882607 32584 tablet_bootstrap.cc:492] T 82197fa1e8084b78823d76fd7e35a096 P e03b91883c034031a866b1e6a7133759: Bootstrap starting.
I20260709 12:21:18.888212 32582 tablet_bootstrap.cc:492] T 82197fa1e8084b78823d76fd7e35a096 P a1bcba00e3e34ed7b7a1cf5d40e29be6: No bootstrap required, opened a new log
I20260709 12:21:18.888784 32582 ts_tablet_manager.cc:1403] T 82197fa1e8084b78823d76fd7e35a096 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 12:21:18.889889 32584 tablet_bootstrap.cc:654] T 82197fa1e8084b78823d76fd7e35a096 P e03b91883c034031a866b1e6a7133759: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.891510 32582 raft_consensus.cc:359] T 82197fa1e8084b78823d76fd7e35a096 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.892217 32582 raft_consensus.cc:385] T 82197fa1e8084b78823d76fd7e35a096 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.892506 32582 raft_consensus.cc:740] T 82197fa1e8084b78823d76fd7e35a096 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.893174 32582 consensus_queue.cc:260] T 82197fa1e8084b78823d76fd7e35a096 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.894618 32584 tablet_bootstrap.cc:492] T 82197fa1e8084b78823d76fd7e35a096 P e03b91883c034031a866b1e6a7133759: No bootstrap required, opened a new log
I20260709 12:21:18.895124 32584 ts_tablet_manager.cc:1403] T 82197fa1e8084b78823d76fd7e35a096 P e03b91883c034031a866b1e6a7133759: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 12:21:18.895397 32582 ts_tablet_manager.cc:1434] T 82197fa1e8084b78823d76fd7e35a096 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:21:18.897341 32584 raft_consensus.cc:359] T 82197fa1e8084b78823d76fd7e35a096 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.897897 32584 raft_consensus.cc:385] T 82197fa1e8084b78823d76fd7e35a096 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.898097 32584 raft_consensus.cc:740] T 82197fa1e8084b78823d76fd7e35a096 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.898672 32584 consensus_queue.cc:260] T 82197fa1e8084b78823d76fd7e35a096 P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.900041 32584 ts_tablet_manager.cc:1434] T 82197fa1e8084b78823d76fd7e35a096 P e03b91883c034031a866b1e6a7133759: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:21:18.900949 32584 tablet_bootstrap.cc:492] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759: Bootstrap starting.
I20260709 12:21:18.901314 32603 raft_consensus.cc:493] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.901860 32603 raft_consensus.cc:515] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.903981 32603 leader_election.cc:290] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:18.904742 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576732b19cb041c187a86d548f1b8c48" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" is_pre_election: true
I20260709 12:21:18.905503 32286 raft_consensus.cc:2468] T 576732b19cb041c187a86d548f1b8c48 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 0.
I20260709 12:21:18.907002 32584 tablet_bootstrap.cc:654] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.907835 32324 leader_election.cc:304] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 
I20260709 12:21:18.908740 32603 raft_consensus.cc:2804] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:18.909112 32603 raft_consensus.cc:493] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.909449 32603 raft_consensus.cc:3060] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.912715 32584 tablet_bootstrap.cc:492] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759: No bootstrap required, opened a new log
I20260709 12:21:18.913267 32584 ts_tablet_manager.cc:1403] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.006s
I20260709 12:21:18.906942 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576732b19cb041c187a86d548f1b8c48" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:18.914366 32433 raft_consensus.cc:2468] T 576732b19cb041c187a86d548f1b8c48 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 0.
I20260709 12:21:18.915993 32584 raft_consensus.cc:359] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.916703 32584 raft_consensus.cc:385] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.916961 32584 raft_consensus.cc:740] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.917611 32584 consensus_queue.cc:260] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.919399 32603 raft_consensus.cc:515] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.919979 32584 ts_tablet_manager.cc:1434] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:21:18.921684 32603 leader_election.cc:290] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 election: Requested vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:18.922626 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576732b19cb041c187a86d548f1b8c48" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
I20260709 12:21:18.923396 32286 raft_consensus.cc:3060] T 576732b19cb041c187a86d548f1b8c48 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.922784 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576732b19cb041c187a86d548f1b8c48" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:18.927358 32433 raft_consensus.cc:3060] T 576732b19cb041c187a86d548f1b8c48 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.929967 32286 raft_consensus.cc:2468] T 576732b19cb041c187a86d548f1b8c48 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 1.
I20260709 12:21:18.931349 32324 leader_election.cc:304] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 
I20260709 12:21:18.932346 32603 raft_consensus.cc:2804] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:18.932739 32603 raft_consensus.cc:697] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Becoming Leader. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Running, Role: LEADER
I20260709 12:21:18.933514 32603 consensus_queue.cc:237] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.933990 32516 raft_consensus.cc:493] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.934536 32433 raft_consensus.cc:2468] T 576732b19cb041c187a86d548f1b8c48 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 1.
I20260709 12:21:18.934551 32516 raft_consensus.cc:515] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.937724 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b41c7bd1cb54f27b7699b8c27edab05" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" is_pre_election: true
I20260709 12:21:18.938123 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b41c7bd1cb54f27b7699b8c27edab05" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729" is_pre_election: true
I20260709 12:21:18.938390 32286 raft_consensus.cc:2468] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 0.
I20260709 12:21:18.938830 32361 raft_consensus.cc:2468] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 0.
I20260709 12:21:18.939853 32398 leader_election.cc:304] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:18.941006 32516 leader_election.cc:290] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783)
I20260709 12:21:18.941465 32516 raft_consensus.cc:2804] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:18.941812 32516 raft_consensus.cc:493] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.942130 32516 raft_consensus.cc:3060] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.944046 32183 catalog_manager.cc:5697] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "81bee0a37e054555ac4d58f6adeff729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:18.949162 32516 raft_consensus.cc:515] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.950991 32516 leader_election.cc:290] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 election: Requested vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783)
I20260709 12:21:18.952203 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b41c7bd1cb54f27b7699b8c27edab05" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
I20260709 12:21:18.952453 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b41c7bd1cb54f27b7699b8c27edab05" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
I20260709 12:21:18.952903 32361 raft_consensus.cc:3060] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.953140 32286 raft_consensus.cc:3060] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.959233 32361 raft_consensus.cc:2468] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 1.
I20260709 12:21:18.959233 32286 raft_consensus.cc:2468] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 1.
I20260709 12:21:18.960418 32401 leader_election.cc:304] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:18.961154 32516 raft_consensus.cc:2804] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:18.961596 32516 raft_consensus.cc:697] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 1 LEADER]: Becoming Leader. State: Replica: e03b91883c034031a866b1e6a7133759, State: Running, Role: LEADER
I20260709 12:21:18.962320 32516 consensus_queue.cc:237] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.970155 32183 catalog_manager.cc:5697] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 reported cstate change: term changed from 0 to 1, leader changed from <none> to e03b91883c034031a866b1e6a7133759 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "e03b91883c034031a866b1e6a7133759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:18.991555 32606 raft_consensus.cc:493] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.992060 32606 raft_consensus.cc:515] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:18.993862 32606 leader_election.cc:290] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:18.994843 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82197fa1e8084b78823d76fd7e35a096" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" is_pre_election: true
I20260709 12:21:18.995013 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82197fa1e8084b78823d76fd7e35a096" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759" is_pre_election: true
I20260709 12:21:18.995483 32286 raft_consensus.cc:2468] T 82197fa1e8084b78823d76fd7e35a096 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 0.
I20260709 12:21:18.995604 32433 raft_consensus.cc:2468] T 82197fa1e8084b78823d76fd7e35a096 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 0.
I20260709 12:21:18.996477 32324 leader_election.cc:304] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 
I20260709 12:21:18.997179 32606 raft_consensus.cc:2804] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:18.997512 32606 raft_consensus.cc:493] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.997735 32606 raft_consensus.cc:3060] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.003618 32606 raft_consensus.cc:515] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:19.005550 32606 leader_election.cc:290] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 election: Requested vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:19.006215 32285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82197fa1e8084b78823d76fd7e35a096" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
I20260709 12:21:19.006778 32285 raft_consensus.cc:3060] T 82197fa1e8084b78823d76fd7e35a096 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.007350 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82197fa1e8084b78823d76fd7e35a096" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:19.008028 32433 raft_consensus.cc:3060] T 82197fa1e8084b78823d76fd7e35a096 P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.011986 32285 raft_consensus.cc:2468] T 82197fa1e8084b78823d76fd7e35a096 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 1.
I20260709 12:21:19.012985 32433 raft_consensus.cc:2468] T 82197fa1e8084b78823d76fd7e35a096 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 1.
I20260709 12:21:19.013051 32324 leader_election.cc:304] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 
I20260709 12:21:19.013942 32606 raft_consensus.cc:2804] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:19.014307 32516 raft_consensus.cc:493] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.014462 32606 raft_consensus.cc:697] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Becoming Leader. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Running, Role: LEADER
I20260709 12:21:19.014786 32516 raft_consensus.cc:515] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:19.015344 32606 consensus_queue.cc:237] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:19.017249 32516 leader_election.cc:290] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783)
I20260709 12:21:19.018743 32285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422814cbe50747fb91b9be40bf8212ca" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" is_pre_election: true
I20260709 12:21:19.018798 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422814cbe50747fb91b9be40bf8212ca" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729" is_pre_election: true
I20260709 12:21:19.019610 32285 raft_consensus.cc:2468] T 422814cbe50747fb91b9be40bf8212ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 0.
I20260709 12:21:19.019742 32361 raft_consensus.cc:2468] T 422814cbe50747fb91b9be40bf8212ca P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 0.
I20260709 12:21:19.023511 32401 leader_election.cc:304] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:19.024371 32516 raft_consensus.cc:2804] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:19.024767 32516 raft_consensus.cc:493] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.025116 32516 raft_consensus.cc:3060] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.026187 32183 catalog_manager.cc:5697] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2). New cstate: current_term: 1 leader_uuid: "81bee0a37e054555ac4d58f6adeff729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:19.031494 32516 raft_consensus.cc:515] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:19.033347 32516 leader_election.cc:290] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 election: Requested vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783)
I20260709 12:21:19.034571 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422814cbe50747fb91b9be40bf8212ca" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
I20260709 12:21:19.034473 32285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422814cbe50747fb91b9be40bf8212ca" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
I20260709 12:21:19.035331 32361 raft_consensus.cc:3060] T 422814cbe50747fb91b9be40bf8212ca P 81bee0a37e054555ac4d58f6adeff729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.035369 32285 raft_consensus.cc:3060] T 422814cbe50747fb91b9be40bf8212ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.043000 32361 raft_consensus.cc:2468] T 422814cbe50747fb91b9be40bf8212ca P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 1.
I20260709 12:21:19.043000 32285 raft_consensus.cc:2468] T 422814cbe50747fb91b9be40bf8212ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 1.
I20260709 12:21:19.044275 32401 leader_election.cc:304] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:19.045071 32516 raft_consensus.cc:2804] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:19.045483 32516 raft_consensus.cc:697] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [term 1 LEADER]: Becoming Leader. State: Replica: e03b91883c034031a866b1e6a7133759, State: Running, Role: LEADER
I20260709 12:21:19.046257 32516 consensus_queue.cc:237] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:19.054759 32183 catalog_manager.cc:5697] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 reported cstate change: term changed from 0 to 1, leader changed from <none> to e03b91883c034031a866b1e6a7133759 (127.20.191.3). New cstate: current_term: 1 leader_uuid: "e03b91883c034031a866b1e6a7133759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:19.084460 32583 consensus_queue.cc:1048] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:19.097898 32569 consensus_queue.cc:1048] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:19.120893 32603 consensus_queue.cc:1048] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:19.132063 32604 consensus_queue.cc:1048] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:19.199568 32609 consensus_queue.cc:1048] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:19.201918 32609 consensus_queue.cc:1048] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:19.212216 32569 consensus_queue.cc:1048] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:19.230290 32616 consensus_queue.cc:1048] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:19.230499 32604 consensus_queue.cc:1048] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:19.252525 32606 consensus_queue.cc:1048] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:19.272776 32360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83ea334d6850454995ed5e7266aff57c"
dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
mode: GRACEFUL
new_leader_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
 from {username='slave'} at 127.0.0.1:47934
I20260709 12:21:19.273556 32360 raft_consensus.cc:606] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Received request to transfer leadership to TS a1bcba00e3e34ed7b7a1cf5d40e29be6
I20260709 12:21:19.302100 32434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b41c7bd1cb54f27b7699b8c27edab05"
dest_uuid: "e03b91883c034031a866b1e6a7133759"
mode: GRACEFUL
new_leader_uuid: "81bee0a37e054555ac4d58f6adeff729"
 from {username='slave'} at 127.0.0.1:60034
I20260709 12:21:19.302624 32434 raft_consensus.cc:606] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 1 LEADER]: Received request to transfer leadership to TS 81bee0a37e054555ac4d58f6adeff729
I20260709 12:21:19.361634 32606 consensus_queue.cc:1048] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:19.373795 32606 consensus_queue.cc:1048] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:19.425633 32606 consensus_queue.cc:1048] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:19.437084 32604 consensus_queue.cc:1048] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:19.446861 32516 consensus_queue.cc:1048] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:19.459308 32628 consensus_queue.cc:1048] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:19.464260 32652 consensus_queue.cc:1048] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:19.484647 32516 consensus_queue.cc:1048] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:19.494831 32516 raft_consensus.cc:993] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759: : Instructing follower 81bee0a37e054555ac4d58f6adeff729 to start an election
I20260709 12:21:19.495368 32652 raft_consensus.cc:1081] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 1 LEADER]: Signalling peer 81bee0a37e054555ac4d58f6adeff729 to start an election
I20260709 12:21:19.496905 32360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b41c7bd1cb54f27b7699b8c27edab05"
dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
 from {username='slave'} at 127.0.0.1:47926
I20260709 12:21:19.497426 32360 raft_consensus.cc:493] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:19.497720 32360 raft_consensus.cc:3060] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:19.503425 32360 raft_consensus.cc:515] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:19.505110 32360 leader_election.cc:290] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 2 election: Requested vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:19.506042 32286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b41c7bd1cb54f27b7699b8c27edab05" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
I20260709 12:21:19.506256 32434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b41c7bd1cb54f27b7699b8c27edab05" candidate_uuid: "81bee0a37e054555ac4d58f6adeff729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:19.506681 32286 raft_consensus.cc:3060] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:19.506783 32434 raft_consensus.cc:3055] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:19.507151 32434 raft_consensus.cc:740] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e03b91883c034031a866b1e6a7133759, State: Running, Role: LEADER
I20260709 12:21:19.507788 32434 consensus_queue.cc:260] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:19.508793 32434 raft_consensus.cc:3060] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:19.512202 32286 raft_consensus.cc:2468] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 2.
I20260709 12:21:19.513360 32324 leader_election.cc:304] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, a1bcba00e3e34ed7b7a1cf5d40e29be6; no voters: 
I20260709 12:21:19.514165 32606 raft_consensus.cc:2804] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:19.514446 32434 raft_consensus.cc:2468] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81bee0a37e054555ac4d58f6adeff729 in term 2.
I20260709 12:21:19.514708 32606 raft_consensus.cc:697] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 2 LEADER]: Becoming Leader. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Running, Role: LEADER
I20260709 12:21:19.515599 32606 consensus_queue.cc:237] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:19.522439 32183 catalog_manager.cc:5697] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 reported cstate change: term changed from 1 to 2, leader changed from e03b91883c034031a866b1e6a7133759 (127.20.191.3) to 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2). New cstate: current_term: 2 leader_uuid: "81bee0a37e054555ac4d58f6adeff729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:19.735942 32604 raft_consensus.cc:993] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729: : Instructing follower a1bcba00e3e34ed7b7a1cf5d40e29be6 to start an election
I20260709 12:21:19.736373 32606 raft_consensus.cc:1081] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Signalling peer a1bcba00e3e34ed7b7a1cf5d40e29be6 to start an election
I20260709 12:21:19.737900 32286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83ea334d6850454995ed5e7266aff57c"
dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
 from {username='slave'} at 127.0.0.1:59856
I20260709 12:21:19.738471 32286 raft_consensus.cc:493] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:19.738831 32286 raft_consensus.cc:3060] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:19.744341 32286 raft_consensus.cc:515] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:19.746032 32286 leader_election.cc:290] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 2 election: Requested vote from peers 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783), e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161)
I20260709 12:21:19.746840 32360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ea334d6850454995ed5e7266aff57c" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
I20260709 12:21:19.747068 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ea334d6850454995ed5e7266aff57c" candidate_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e03b91883c034031a866b1e6a7133759"
I20260709 12:21:19.747545 32360 raft_consensus.cc:3055] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:19.747583 32433 raft_consensus.cc:3060] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:19.748018 32360 raft_consensus.cc:740] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Running, Role: LEADER
I20260709 12:21:19.748879 32360 consensus_queue.cc:260] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:19.750159 32360 raft_consensus.cc:3060] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:19.755241 32433 raft_consensus.cc:2468] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 2.
I20260709 12:21:19.756716 32250 leader_election.cc:304] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:19.757020 32360 raft_consensus.cc:2468] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1bcba00e3e34ed7b7a1cf5d40e29be6 in term 2.
I20260709 12:21:19.757424 32608 raft_consensus.cc:2804] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:19.757964 32608 raft_consensus.cc:697] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 LEADER]: Becoming Leader. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Running, Role: LEADER
I20260709 12:21:19.758744 32608 consensus_queue.cc:237] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:19.765200 32183 catalog_manager.cc:5697] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 reported cstate change: term changed from 1 to 2, leader changed from 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2) to a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:19.918519 32433 raft_consensus.cc:1275] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Refusing update from remote peer 81bee0a37e054555ac4d58f6adeff729: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:19.919764 32606 consensus_queue.cc:1048] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:19.927623 32286 raft_consensus.cc:1275] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Refusing update from remote peer 81bee0a37e054555ac4d58f6adeff729: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:19.930439 32606 consensus_queue.cc:1048] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:20.187284 32361 raft_consensus.cc:1275] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Refusing update from remote peer a1bcba00e3e34ed7b7a1cf5d40e29be6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:20.188500 32609 consensus_queue.cc:1048] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:20.207885 32433 raft_consensus.cc:1275] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Refusing update from remote peer a1bcba00e3e34ed7b7a1cf5d40e29be6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:20.210337 32661 consensus_queue.cc:1048] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:22.308970 32181 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60116:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:21:22.328228 32181 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60116:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:21:22.368072 21244 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:22.468454 32707 tablet.cc:1724] T 7b3990238fdb4b3f9c60704cff0a5007 P 81bee0a37e054555ac4d58f6adeff729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:21:22.481518 32324 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:38901, user_credentials={real_user=slave}} blocked reactor thread for 89328.6us
I20260709 12:21:22.495893 32710 tablet.cc:1724] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.471421 32706 tablet.cc:1724] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.478083 32709 tablet.cc:1724] T 7b3990238fdb4b3f9c60704cff0a5007 P e03b91883c034031a866b1e6a7133759: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:21:22.478623 32325 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.3:42161, user_credentials={real_user=slave}} blocked reactor thread for 81430us
W20260709 12:21:22.509574 32312 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:025032ae81ca449e8469df7b0db080d0)
W20260709 12:21:22.519207 32312 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:025032ae81ca449e8469df7b0db080d0)
W20260709 12:21:22.522456 32312 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:025032ae81ca449e8469df7b0db080d0)
I20260709 12:21:22.540822 32717 tablet.cc:1724] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.543305 32713 tablet.cc:1724] T 025032ae81ca449e8469df7b0db080d0 P 81bee0a37e054555ac4d58f6adeff729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.635707 32727 tablet.cc:1724] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.636310 32707 tablet.cc:1724] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.638312 32709 tablet.cc:1724] T fb85fe03506e4cb5913be0824ebb9d9b P e03b91883c034031a866b1e6a7133759: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.592099 32723 tablet.cc:1724] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.648907 32357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b41c7bd1cb54f27b7699b8c27edab05"
dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
mode: GRACEFUL
new_leader_uuid: "e03b91883c034031a866b1e6a7133759"
 from {username='slave'} at 127.0.0.1:34446
I20260709 12:21:22.649839 32357 raft_consensus.cc:606] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 2 LEADER]: Received request to transfer leadership to TS e03b91883c034031a866b1e6a7133759
W20260709 12:21:22.653052 32720 log.cc:927] Time spent T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759: Append to log took a long time: real 0.101s	user 0.000s	sys 0.003s
I20260709 12:21:22.655206 32706 tablet.cc:1724] T 422814cbe50747fb91b9be40bf8212ca P a1bcba00e3e34ed7b7a1cf5d40e29be6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:21:22.635576 32712 log.cc:927] Time spent T c9636a2fcffb44328184e08625d74513 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Append to log took a long time: real 0.124s	user 0.004s	sys 0.000s
I20260709 12:21:22.656179 32710 tablet.cc:1724] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.698973 32726 tablet.cc:1724] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.680809 32727 tablet.cc:1724] T 422814cbe50747fb91b9be40bf8212ca P 81bee0a37e054555ac4d58f6adeff729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.620775 32724 tablet.cc:1724] T 025032ae81ca449e8469df7b0db080d0 P e03b91883c034031a866b1e6a7133759: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.699731 32692 raft_consensus.cc:993] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729: : Instructing follower e03b91883c034031a866b1e6a7133759 to start an election
I20260709 12:21:22.684932 32717 tablet.cc:1724] T c9636a2fcffb44328184e08625d74513 P e03b91883c034031a866b1e6a7133759: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.722028 32707 tablet.cc:1724] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.721990 32728 raft_consensus.cc:1081] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 2 LEADER]: Signalling peer e03b91883c034031a866b1e6a7133759 to start an election
I20260709 12:21:22.736321 32430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b41c7bd1cb54f27b7699b8c27edab05"
dest_uuid: "e03b91883c034031a866b1e6a7133759"
 from {username='slave'} at 127.0.0.1:60026
I20260709 12:21:22.737026 32430 raft_consensus.cc:493] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:22.737406 32430 raft_consensus.cc:3060] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:22.721525 32713 tablet.cc:1724] T fb85fe03506e4cb5913be0824ebb9d9b P 81bee0a37e054555ac4d58f6adeff729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.760728 32726 tablet.cc:1724] T 576732b19cb041c187a86d548f1b8c48 P e03b91883c034031a866b1e6a7133759: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.740913 32706 tablet.cc:1724] T 576732b19cb041c187a86d548f1b8c48 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.770731 32734 tablet.cc:1724] T c9636a2fcffb44328184e08625d74513 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.775096 32709 tablet.cc:1724] T 82197fa1e8084b78823d76fd7e35a096 P e03b91883c034031a866b1e6a7133759: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.781068 32723 tablet.cc:1724] T 82197fa1e8084b78823d76fd7e35a096 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.793056 32707 tablet.cc:1724] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.776691 32713 tablet.cc:1724] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.803949 32710 tablet.cc:1724] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:22.818843 32284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83ea334d6850454995ed5e7266aff57c"
dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
mode: GRACEFUL
new_leader_uuid: "e03b91883c034031a866b1e6a7133759"
 from {username='slave'} at 127.0.0.1:55596
I20260709 12:21:22.820464 32284 raft_consensus.cc:606] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 LEADER]: Received request to transfer leadership to TS e03b91883c034031a866b1e6a7133759
I20260709 12:21:22.823472 21244 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:21:22.824164 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:22.765653 32430 raft_consensus.cc:515] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:22.826288 32433 raft_consensus.cc:1240] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 3 FOLLOWER]: Rejecting Update request from peer 81bee0a37e054555ac4d58f6adeff729 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:22.828241 32284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b41c7bd1cb54f27b7699b8c27edab05" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
I20260709 12:21:22.829665 32284 raft_consensus.cc:3060] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:22.829816 32721 consensus_queue.cc:1059] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:22.830870 32603 raft_consensus.cc:3055] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:22.831192 32603 raft_consensus.cc:740] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Running, Role: LEADER
I20260709 12:21:22.831911 32603 consensus_queue.cc:260] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:22.832908 32603 raft_consensus.cc:3060] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:22.834558 32430 leader_election.cc:290] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 3 election: Requested vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783)
I20260709 12:21:22.837145 32284 raft_consensus.cc:2468] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 3.
I20260709 12:21:22.837270 32359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b41c7bd1cb54f27b7699b8c27edab05" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
I20260709 12:21:22.838852 32398 leader_election.cc:304] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:22.839727 32658 raft_consensus.cc:2804] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:22.840183 32658 raft_consensus.cc:697] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 3 LEADER]: Becoming Leader. State: Replica: e03b91883c034031a866b1e6a7133759, State: Running, Role: LEADER
I20260709 12:21:22.840962 32658 consensus_queue.cc:237] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:22.844570 32357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c0f90b7959d41c2903d5937c85300ca"
dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
mode: GRACEFUL
new_leader_uuid: "e03b91883c034031a866b1e6a7133759"
 from {username='slave'} at 127.0.0.1:34446
I20260709 12:21:22.845290 32357 raft_consensus.cc:606] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Received request to transfer leadership to TS e03b91883c034031a866b1e6a7133759
I20260709 12:21:22.850046 32284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4b5e728b50b4085803fe63160773c74"
dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
mode: GRACEFUL
new_leader_uuid: "e03b91883c034031a866b1e6a7133759"
 from {username='slave'} at 127.0.0.1:55596
I20260709 12:21:22.850615 32284 raft_consensus.cc:606] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Received request to transfer leadership to TS e03b91883c034031a866b1e6a7133759
I20260709 12:21:22.851831 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:21:22.852144 32359 raft_consensus.cc:2468] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 3.
I20260709 12:21:22.852476 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:22.852658 32183 catalog_manager.cc:5697] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 reported cstate change: term changed from 2 to 3, leader changed from 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2) to e03b91883c034031a866b1e6a7133759 (127.20.191.3). New cstate: current_term: 3 leader_uuid: "e03b91883c034031a866b1e6a7133759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.854135 32183 catalog_manager.cc:5789] TS e03b91883c034031a866b1e6a7133759 (127.20.191.3:42161) does not have the latest schema for tablet 1b41c7bd1cb54f27b7699b8c27edab05 (table soft_deleted_table [id=d4af025862be435fb4db094dabacf226]). Expected version 1 got 0
I20260709 12:21:22.873822 32182 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15: soft_deleted_table [id=d4af025862be435fb4db094dabacf226] alter complete (version 1)
I20260709 12:21:22.999588 32708 raft_consensus.cc:993] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6: : Instructing follower e03b91883c034031a866b1e6a7133759 to start an election
I20260709 12:21:23.000023 32661 raft_consensus.cc:1081] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Signalling peer e03b91883c034031a866b1e6a7133759 to start an election
I20260709 12:21:23.001556 32430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4b5e728b50b4085803fe63160773c74"
dest_uuid: "e03b91883c034031a866b1e6a7133759"
 from {username='slave'} at 127.0.0.1:60024
I20260709 12:21:23.002085 32430 raft_consensus.cc:493] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:23.002384 32430 raft_consensus.cc:3060] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:23.007687 32430 raft_consensus.cc:515] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } }
I20260709 12:21:23.010221 32430 leader_election.cc:290] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 2 election: Requested vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783)
I20260709 12:21:23.010795 32359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b5e728b50b4085803fe63160773c74" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
I20260709 12:21:23.011420 32359 raft_consensus.cc:3060] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:23.012769 32284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b5e728b50b4085803fe63160773c74" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
I20260709 12:21:23.013384 32284 raft_consensus.cc:3055] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:23.013706 32284 raft_consensus.cc:740] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Running, Role: LEADER
I20260709 12:21:23.014606 32284 consensus_queue.cc:260] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } }
I20260709 12:21:23.015667 32284 raft_consensus.cc:3060] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:23.017727 32359 raft_consensus.cc:2468] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 2.
I20260709 12:21:23.019135 32401 leader_election.cc:304] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81bee0a37e054555ac4d58f6adeff729, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:23.019948 32658 raft_consensus.cc:2804] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:23.020299 32658 raft_consensus.cc:697] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [term 2 LEADER]: Becoming Leader. State: Replica: e03b91883c034031a866b1e6a7133759, State: Running, Role: LEADER
I20260709 12:21:23.021111 32658 consensus_queue.cc:237] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } }
I20260709 12:21:23.022359 32284 raft_consensus.cc:2468] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 2.
I20260709 12:21:23.028561 32181 catalog_manager.cc:5697] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 reported cstate change: term changed from 1 to 2, leader changed from a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1) to e03b91883c034031a866b1e6a7133759 (127.20.191.3). New cstate: current_term: 2 leader_uuid: "e03b91883c034031a866b1e6a7133759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:23.170982 32721 raft_consensus.cc:993] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729: : Instructing follower e03b91883c034031a866b1e6a7133759 to start an election
I20260709 12:21:23.171509 32603 raft_consensus.cc:1081] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Signalling peer e03b91883c034031a866b1e6a7133759 to start an election
I20260709 12:21:23.173187 32430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c0f90b7959d41c2903d5937c85300ca"
dest_uuid: "e03b91883c034031a866b1e6a7133759"
 from {username='slave'} at 127.0.0.1:60026
I20260709 12:21:23.173802 32430 raft_consensus.cc:493] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:23.174176 32430 raft_consensus.cc:3060] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:23.181701 32430 raft_consensus.cc:515] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:23.183717 32430 leader_election.cc:290] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 2 election: Requested vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783)
I20260709 12:21:23.184562 32284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f90b7959d41c2903d5937c85300ca" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
I20260709 12:21:23.185011 32359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f90b7959d41c2903d5937c85300ca" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
I20260709 12:21:23.185254 32284 raft_consensus.cc:3060] T 9c0f90b7959d41c2903d5937c85300ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:23.185663 32359 raft_consensus.cc:3055] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:23.186103 32359 raft_consensus.cc:740] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81bee0a37e054555ac4d58f6adeff729, State: Running, Role: LEADER
I20260709 12:21:23.186925 32359 consensus_queue.cc:260] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:23.188246 32359 raft_consensus.cc:3060] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:23.191301 32284 raft_consensus.cc:2468] T 9c0f90b7959d41c2903d5937c85300ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 2.
I20260709 12:21:23.192515 32398 leader_election.cc:304] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:23.193255 32658 raft_consensus.cc:2804] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:23.193606 32658 raft_consensus.cc:697] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [term 2 LEADER]: Becoming Leader. State: Replica: e03b91883c034031a866b1e6a7133759, State: Running, Role: LEADER
I20260709 12:21:23.194767 32658 consensus_queue.cc:237] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:23.195716 32359 raft_consensus.cc:2468] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 2.
I20260709 12:21:23.203682 32181 catalog_manager.cc:5697] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 reported cstate change: term changed from 1 to 2, leader changed from 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2) to e03b91883c034031a866b1e6a7133759 (127.20.191.3). New cstate: current_term: 2 leader_uuid: "e03b91883c034031a866b1e6a7133759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:23.241238 32359 raft_consensus.cc:1275] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 3 FOLLOWER]: Refusing update from remote peer e03b91883c034031a866b1e6a7133759: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:21:23.242703 32658 consensus_queue.cc:1048] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:23.242905 32661 raft_consensus.cc:993] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6: : Instructing follower e03b91883c034031a866b1e6a7133759 to start an election
I20260709 12:21:23.243506 32661 raft_consensus.cc:1081] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 LEADER]: Signalling peer e03b91883c034031a866b1e6a7133759 to start an election
I20260709 12:21:23.245039 32430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83ea334d6850454995ed5e7266aff57c"
dest_uuid: "e03b91883c034031a866b1e6a7133759"
 from {username='slave'} at 127.0.0.1:60024
I20260709 12:21:23.245591 32430 raft_consensus.cc:493] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:23.246078 32430 raft_consensus.cc:3060] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:23.249058 32717 tablet.cc:1724] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:23.258584 32284 raft_consensus.cc:1275] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 3 FOLLOWER]: Refusing update from remote peer e03b91883c034031a866b1e6a7133759: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:21:23.255292 32430 raft_consensus.cc:515] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:23.260073 32658 consensus_queue.cc:1048] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:23.261973 32430 leader_election.cc:290] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 3 election: Requested vote from peers a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901), 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783)
I20260709 12:21:23.262929 32285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ea334d6850454995ed5e7266aff57c" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6"
I20260709 12:21:23.263645 32285 raft_consensus.cc:3055] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:23.263979 32285 raft_consensus.cc:740] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1bcba00e3e34ed7b7a1cf5d40e29be6, State: Running, Role: LEADER
I20260709 12:21:23.264765 32285 consensus_queue.cc:260] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:23.266228 32358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ea334d6850454995ed5e7266aff57c" candidate_uuid: "e03b91883c034031a866b1e6a7133759" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "81bee0a37e054555ac4d58f6adeff729"
I20260709 12:21:23.266845 32358 raft_consensus.cc:3060] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:23.271168 32285 raft_consensus.cc:3060] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:23.279839 32285 raft_consensus.cc:2468] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 3.
I20260709 12:21:23.282801 32398 leader_election.cc:304] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1bcba00e3e34ed7b7a1cf5d40e29be6, e03b91883c034031a866b1e6a7133759; no voters: 
I20260709 12:21:23.283795 32658 raft_consensus.cc:2804] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:23.284302 32658 raft_consensus.cc:697] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [term 3 LEADER]: Becoming Leader. State: Replica: e03b91883c034031a866b1e6a7133759, State: Running, Role: LEADER
I20260709 12:21:23.285125 32658 consensus_queue.cc:237] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } }
I20260709 12:21:23.286952 32358 raft_consensus.cc:2468] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e03b91883c034031a866b1e6a7133759 in term 3.
I20260709 12:21:23.294046 32713 tablet.cc:1719] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729: Skipping requested alter to schema version 1, tablet already version 1
I20260709 12:21:23.300112 32717 tablet.cc:1719] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759: Skipping requested alter to schema version 1, tablet already version 1
I20260709 12:21:23.303668 32710 tablet.cc:1719] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6: Skipping requested alter to schema version 1, tablet already version 1
I20260709 12:21:23.305567 32181 catalog_manager.cc:5697] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 reported cstate change: term changed from 2 to 3, leader changed from a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1) to e03b91883c034031a866b1e6a7133759 (127.20.191.3). New cstate: current_term: 3 leader_uuid: "e03b91883c034031a866b1e6a7133759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e03b91883c034031a866b1e6a7133759" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 42161 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:23.429730 32284 raft_consensus.cc:1275] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Refusing update from remote peer e03b91883c034031a866b1e6a7133759: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:23.431125 32743 consensus_queue.cc:1048] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:23.440307 32359 raft_consensus.cc:1275] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Refusing update from remote peer e03b91883c034031a866b1e6a7133759: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:23.443327 32711 consensus_queue.cc:1048] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:23.674305 32358 raft_consensus.cc:1275] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 3 FOLLOWER]: Refusing update from remote peer e03b91883c034031a866b1e6a7133759: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:21:23.675474 32744 consensus_queue.cc:1048] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:23.683776 32284 raft_consensus.cc:1275] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 3 FOLLOWER]: Refusing update from remote peer e03b91883c034031a866b1e6a7133759: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:21:23.686501 32658 consensus_queue.cc:1048] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:23.775473 32358 raft_consensus.cc:1275] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Refusing update from remote peer e03b91883c034031a866b1e6a7133759: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:23.776901 32658 consensus_queue.cc:1048] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81bee0a37e054555ac4d58f6adeff729" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 36783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:23.783143 32284 raft_consensus.cc:1275] T 9c0f90b7959d41c2903d5937c85300ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Refusing update from remote peer e03b91883c034031a866b1e6a7133759: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:23.785856 32744 consensus_queue.cc:1048] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bcba00e3e34ed7b7a1cf5d40e29be6" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 38901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:23.854164 21244 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:23.859647 21244 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:21:23.860175 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:23.864861 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:23.865298 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:24.866492 21244 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:24.872067 21244 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:21:24.872588 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:24.877566 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:24.878080 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:25.879088 21244 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:25.884315 21244 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:21:25.884743 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:25.889932 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:25.890403 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:26.891463 21244 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:26.896781 21244 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:21:26.897316 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:26.903486 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:26.903920 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:27.905211 21244 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:27.910898 21244 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:21:27.911346 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:27.916142 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:27.916616 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:28.917836 21244 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:28.922758 21244 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:21:28.923206 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:28.928601 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:28.929055 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:30.646874 21244 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:30.652031 21244 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:21:30.652474 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:30.658212 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:30.658792 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:21:30.915818 32307 debug-util.cc:398] Leaking SignalData structure 0x7b080019f6c0 after lost signal to thread 21247
W20260709 12:21:30.916920 32307 debug-util.cc:398] Leaking SignalData structure 0x7b08001a9220 after lost signal to thread 32218
W20260709 12:21:30.918041 32307 debug-util.cc:398] Leaking SignalData structure 0x7b08000c32a0 after lost signal to thread 32310
W20260709 12:21:30.918970 32307 debug-util.cc:398] Leaking SignalData structure 0x7b08001c9340 after lost signal to thread 32385
W20260709 12:21:30.919888 32307 debug-util.cc:398] Leaking SignalData structure 0x7b0800389140 after lost signal to thread 32459
I20260709 12:21:31.659722 21244 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:31.665042 21244 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:21:31.665506 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:31.670336 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:31.670825 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:32.671923 21244 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:32.677217 21244 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:21:32.677714 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:32.682593 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:32.683008 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:33.743135 21244 tablet_server.cc:179] TabletServer@127.20.191.1:0 shutting down...
W20260709 12:21:33.747920 32398 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 12:21:33.757836 32398 consensus_peers.cc:597] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 -> Peer a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901): Couldn't send request to peer a1bcba00e3e34ed7b7a1cf5d40e29be6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:33.780669 32324 consensus_peers.cc:597] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 -> Peer a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901): Couldn't send request to peer a1bcba00e3e34ed7b7a1cf5d40e29be6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:33.781824 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:33.783142 21244 tablet_replica.cc:333] T 82197fa1e8084b78823d76fd7e35a096 P a1bcba00e3e34ed7b7a1cf5d40e29be6: stopping tablet replica
I20260709 12:21:33.784749 21244 raft_consensus.cc:2243] T 82197fa1e8084b78823d76fd7e35a096 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:33.785238 32324 consensus_peers.cc:597] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 -> Peer a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901): Couldn't send request to peer a1bcba00e3e34ed7b7a1cf5d40e29be6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:33.785959 21244 raft_consensus.cc:2272] T 82197fa1e8084b78823d76fd7e35a096 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.789496 21244 tablet_replica.cc:333] T 576732b19cb041c187a86d548f1b8c48 P a1bcba00e3e34ed7b7a1cf5d40e29be6: stopping tablet replica
I20260709 12:21:33.790426 21244 raft_consensus.cc:2243] T 576732b19cb041c187a86d548f1b8c48 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:33.791206 21244 raft_consensus.cc:2272] T 576732b19cb041c187a86d548f1b8c48 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.793920 21244 tablet_replica.cc:333] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6: stopping tablet replica
I20260709 12:21:33.794545 21244 raft_consensus.cc:2243] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:33.795459 21244 raft_consensus.cc:2272] T 7b3990238fdb4b3f9c60704cff0a5007 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.797694 21244 tablet_replica.cc:333] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6: stopping tablet replica
I20260709 12:21:33.798312 21244 raft_consensus.cc:2243] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:33.798774 21244 raft_consensus.cc:2272] T 83ea334d6850454995ed5e7266aff57c P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.801156 21244 tablet_replica.cc:333] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6: stopping tablet replica
I20260709 12:21:33.801790 21244 raft_consensus.cc:2243] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:33.802680 21244 raft_consensus.cc:2272] T fb85fe03506e4cb5913be0824ebb9d9b P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.805197 21244 tablet_replica.cc:333] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6: stopping tablet replica
I20260709 12:21:33.805862 21244 raft_consensus.cc:2243] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:33.806771 21244 raft_consensus.cc:2272] T 50ec226d96254424be091cc09af472d3 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.809181 21244 tablet_replica.cc:333] T 422814cbe50747fb91b9be40bf8212ca P a1bcba00e3e34ed7b7a1cf5d40e29be6: stopping tablet replica
I20260709 12:21:33.809733 21244 raft_consensus.cc:2243] T 422814cbe50747fb91b9be40bf8212ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:33.810361 21244 raft_consensus.cc:2272] T 422814cbe50747fb91b9be40bf8212ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.812712 21244 tablet_replica.cc:333] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6: stopping tablet replica
I20260709 12:21:33.813337 21244 raft_consensus.cc:2243] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:33.813848 21244 raft_consensus.cc:2272] T b91241c3bfe946cb887450cca2024905 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.816150 21244 tablet_replica.cc:333] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6: stopping tablet replica
I20260709 12:21:33.816749 21244 raft_consensus.cc:2243] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:33.817642 21244 raft_consensus.cc:2272] T 025032ae81ca449e8469df7b0db080d0 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.820187 21244 tablet_replica.cc:333] T c9636a2fcffb44328184e08625d74513 P a1bcba00e3e34ed7b7a1cf5d40e29be6: stopping tablet replica
I20260709 12:21:33.820749 21244 raft_consensus.cc:2243] T c9636a2fcffb44328184e08625d74513 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:33.821360 21244 raft_consensus.cc:2272] T c9636a2fcffb44328184e08625d74513 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.824139 21244 tablet_replica.cc:333] T 9c0f90b7959d41c2903d5937c85300ca P a1bcba00e3e34ed7b7a1cf5d40e29be6: stopping tablet replica
I20260709 12:21:33.824695 21244 raft_consensus.cc:2243] T 9c0f90b7959d41c2903d5937c85300ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:33.825207 21244 raft_consensus.cc:2272] T 9c0f90b7959d41c2903d5937c85300ca P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.827544 21244 tablet_replica.cc:333] T 05f8aeab48474f4d9b142f321588f2f1 P a1bcba00e3e34ed7b7a1cf5d40e29be6: stopping tablet replica
I20260709 12:21:33.828110 21244 raft_consensus.cc:2243] T 05f8aeab48474f4d9b142f321588f2f1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:33.828547 21244 raft_consensus.cc:2272] T 05f8aeab48474f4d9b142f321588f2f1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.830878 21244 tablet_replica.cc:333] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6: stopping tablet replica
I20260709 12:21:33.831439 21244 raft_consensus.cc:2243] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:33.831983 21244 raft_consensus.cc:2272] T 1b41c7bd1cb54f27b7699b8c27edab05 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.834147 21244 tablet_replica.cc:333] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6: stopping tablet replica
I20260709 12:21:33.834697 21244 raft_consensus.cc:2243] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:33.835556 21244 raft_consensus.cc:2272] T 0bb847a8cef042b8a343a8b27bfb8bdc P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.837952 21244 tablet_replica.cc:333] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6: stopping tablet replica
I20260709 12:21:33.838801 21244 raft_consensus.cc:2243] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:33.839375 21244 raft_consensus.cc:2272] T 27bda943e6a2453187d9f36ad10208f2 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:33.840409 32398 consensus_peers.cc:597] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 -> Peer a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901): Couldn't send request to peer a1bcba00e3e34ed7b7a1cf5d40e29be6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:33.842175 21244 tablet_replica.cc:333] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6: stopping tablet replica
I20260709 12:21:33.842806 21244 raft_consensus.cc:2243] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:33.843302 21244 raft_consensus.cc:2272] T 588047560b544889a59f83bed49923be P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.845661 21244 tablet_replica.cc:333] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6: stopping tablet replica
I20260709 12:21:33.846289 21244 raft_consensus.cc:2243] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:33.846781 21244 raft_consensus.cc:2272] T c4b5e728b50b4085803fe63160773c74 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.849071 21244 tablet_replica.cc:333] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6: stopping tablet replica
I20260709 12:21:33.849516 21244 raft_consensus.cc:2243] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:33.850786 21244 raft_consensus.cc:2272] T 0dffe4baaa524e338c4515fde30f55d1 P a1bcba00e3e34ed7b7a1cf5d40e29be6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:33.880066 32398 consensus_peers.cc:597] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 -> Peer a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901): Couldn't send request to peer a1bcba00e3e34ed7b7a1cf5d40e29be6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:33.910419 32324 consensus_peers.cc:597] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 -> Peer a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901): Couldn't send request to peer a1bcba00e3e34ed7b7a1cf5d40e29be6. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:38901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:33.917896 21244 tablet_server.cc:196] TabletServer@127.20.191.1:0 shutdown complete.
W20260709 12:21:33.937651 32398 consensus_peers.cc:597] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 -> Peer a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901): Couldn't send request to peer a1bcba00e3e34ed7b7a1cf5d40e29be6. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:38901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:33.969172 21244 tablet_server.cc:179] TabletServer@127.20.191.2:0 shutting down...
I20260709 12:21:33.998778 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:33.999574 21244 tablet_replica.cc:333] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729: stopping tablet replica
I20260709 12:21:34.000583 21244 raft_consensus.cc:2243] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.001700 21244 raft_consensus.cc:2272] T 576732b19cb041c187a86d548f1b8c48 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.003957 21244 tablet_replica.cc:333] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729: stopping tablet replica
I20260709 12:21:34.004518 21244 raft_consensus.cc:2243] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.005383 21244 raft_consensus.cc:2272] T 82197fa1e8084b78823d76fd7e35a096 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.007748 21244 tablet_replica.cc:333] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729: stopping tablet replica
I20260709 12:21:34.008330 21244 raft_consensus.cc:2243] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.008858 21244 raft_consensus.cc:2272] T 83ea334d6850454995ed5e7266aff57c P 81bee0a37e054555ac4d58f6adeff729 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.011595 21244 tablet_replica.cc:333] T fb85fe03506e4cb5913be0824ebb9d9b P 81bee0a37e054555ac4d58f6adeff729: stopping tablet replica
I20260709 12:21:34.012436 21244 raft_consensus.cc:2243] T fb85fe03506e4cb5913be0824ebb9d9b P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.013136 21244 raft_consensus.cc:2272] T fb85fe03506e4cb5913be0824ebb9d9b P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.015512 21244 tablet_replica.cc:333] T 7b3990238fdb4b3f9c60704cff0a5007 P 81bee0a37e054555ac4d58f6adeff729: stopping tablet replica
I20260709 12:21:34.016067 21244 raft_consensus.cc:2243] T 7b3990238fdb4b3f9c60704cff0a5007 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.016556 21244 raft_consensus.cc:2272] T 7b3990238fdb4b3f9c60704cff0a5007 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.018790 21244 tablet_replica.cc:333] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729: stopping tablet replica
I20260709 12:21:34.019335 21244 raft_consensus.cc:2243] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.019784 21244 raft_consensus.cc:2272] T c4b5e728b50b4085803fe63160773c74 P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.021880 21244 tablet_replica.cc:333] T 588047560b544889a59f83bed49923be P 81bee0a37e054555ac4d58f6adeff729: stopping tablet replica
I20260709 12:21:34.022406 21244 raft_consensus.cc:2243] T 588047560b544889a59f83bed49923be P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.022819 21244 raft_consensus.cc:2272] T 588047560b544889a59f83bed49923be P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.025082 21244 tablet_replica.cc:333] T 0dffe4baaa524e338c4515fde30f55d1 P 81bee0a37e054555ac4d58f6adeff729: stopping tablet replica
I20260709 12:21:34.025583 21244 raft_consensus.cc:2243] T 0dffe4baaa524e338c4515fde30f55d1 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.026023 21244 raft_consensus.cc:2272] T 0dffe4baaa524e338c4515fde30f55d1 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.028012 21244 tablet_replica.cc:333] T 50ec226d96254424be091cc09af472d3 P 81bee0a37e054555ac4d58f6adeff729: stopping tablet replica
I20260709 12:21:34.028532 21244 raft_consensus.cc:2243] T 50ec226d96254424be091cc09af472d3 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.028949 21244 raft_consensus.cc:2272] T 50ec226d96254424be091cc09af472d3 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.031008 21244 tablet_replica.cc:333] T 422814cbe50747fb91b9be40bf8212ca P 81bee0a37e054555ac4d58f6adeff729: stopping tablet replica
I20260709 12:21:34.031479 21244 raft_consensus.cc:2243] T 422814cbe50747fb91b9be40bf8212ca P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.031931 21244 raft_consensus.cc:2272] T 422814cbe50747fb91b9be40bf8212ca P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.034029 21244 tablet_replica.cc:333] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729: stopping tablet replica
I20260709 12:21:34.034534 21244 raft_consensus.cc:2243] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.035360 21244 raft_consensus.cc:2272] T b91241c3bfe946cb887450cca2024905 P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.037309 21244 tablet_replica.cc:333] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729: stopping tablet replica
I20260709 12:21:34.037839 21244 raft_consensus.cc:2243] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.038305 21244 raft_consensus.cc:2272] T 9c0f90b7959d41c2903d5937c85300ca P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.040341 21244 tablet_replica.cc:333] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729: stopping tablet replica
I20260709 12:21:34.040851 21244 raft_consensus.cc:2243] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.041652 21244 raft_consensus.cc:2272] T c9636a2fcffb44328184e08625d74513 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.044095 21244 tablet_replica.cc:333] T 025032ae81ca449e8469df7b0db080d0 P 81bee0a37e054555ac4d58f6adeff729: stopping tablet replica
I20260709 12:21:34.044675 21244 raft_consensus.cc:2243] T 025032ae81ca449e8469df7b0db080d0 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.045178 21244 raft_consensus.cc:2272] T 025032ae81ca449e8469df7b0db080d0 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.047415 21244 tablet_replica.cc:333] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729: stopping tablet replica
I20260709 12:21:34.047926 21244 raft_consensus.cc:2243] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.048751 21244 raft_consensus.cc:2272] T 27bda943e6a2453187d9f36ad10208f2 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.050983 21244 tablet_replica.cc:333] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729: stopping tablet replica
I20260709 12:21:34.051479 21244 raft_consensus.cc:2243] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.052084 21244 raft_consensus.cc:2272] T 1b41c7bd1cb54f27b7699b8c27edab05 P 81bee0a37e054555ac4d58f6adeff729 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.054216 21244 tablet_replica.cc:333] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729: stopping tablet replica
I20260709 12:21:34.054703 21244 raft_consensus.cc:2243] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.055137 21244 raft_consensus.cc:2272] T 0bb847a8cef042b8a343a8b27bfb8bdc P 81bee0a37e054555ac4d58f6adeff729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.057243 21244 tablet_replica.cc:333] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729: stopping tablet replica
I20260709 12:21:34.057662 21244 raft_consensus.cc:2243] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.058491 21244 raft_consensus.cc:2272] T 05f8aeab48474f4d9b142f321588f2f1 P 81bee0a37e054555ac4d58f6adeff729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.100700 21244 tablet_server.cc:196] TabletServer@127.20.191.2:0 shutdown complete.
W20260709 12:21:34.134610 32401 consensus_peers.cc:597] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 -> Peer 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783): Couldn't send request to peer 81bee0a37e054555ac4d58f6adeff729. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:36783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:34.136286 32398 consensus_peers.cc:597] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 -> Peer a1bcba00e3e34ed7b7a1cf5d40e29be6 (127.20.191.1:38901): Couldn't send request to peer a1bcba00e3e34ed7b7a1cf5d40e29be6. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:38901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:34.142529 21244 tablet_server.cc:179] TabletServer@127.20.191.3:0 shutting down...
I20260709 12:21:34.169708 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:34.170506 21244 tablet_replica.cc:333] T 82197fa1e8084b78823d76fd7e35a096 P e03b91883c034031a866b1e6a7133759: stopping tablet replica
I20260709 12:21:34.171160 21244 raft_consensus.cc:2243] T 82197fa1e8084b78823d76fd7e35a096 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.171777 21244 raft_consensus.cc:2272] T 82197fa1e8084b78823d76fd7e35a096 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.174109 21244 tablet_replica.cc:333] T 576732b19cb041c187a86d548f1b8c48 P e03b91883c034031a866b1e6a7133759: stopping tablet replica
I20260709 12:21:34.174738 21244 raft_consensus.cc:2243] T 576732b19cb041c187a86d548f1b8c48 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.175209 21244 raft_consensus.cc:2272] T 576732b19cb041c187a86d548f1b8c48 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.177389 21244 tablet_replica.cc:333] T fb85fe03506e4cb5913be0824ebb9d9b P e03b91883c034031a866b1e6a7133759: stopping tablet replica
I20260709 12:21:34.178046 21244 raft_consensus.cc:2243] T fb85fe03506e4cb5913be0824ebb9d9b P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.178527 21244 raft_consensus.cc:2272] T fb85fe03506e4cb5913be0824ebb9d9b P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.180734 21244 tablet_replica.cc:333] T 7b3990238fdb4b3f9c60704cff0a5007 P e03b91883c034031a866b1e6a7133759: stopping tablet replica
I20260709 12:21:34.181258 21244 raft_consensus.cc:2243] T 7b3990238fdb4b3f9c60704cff0a5007 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.181757 21244 raft_consensus.cc:2272] T 7b3990238fdb4b3f9c60704cff0a5007 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.183784 21244 tablet_replica.cc:333] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759: stopping tablet replica
I20260709 12:21:34.184300 21244 raft_consensus.cc:2243] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.185132 21244 raft_consensus.cc:2272] T 588047560b544889a59f83bed49923be P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.187559 21244 tablet_replica.cc:333] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759: stopping tablet replica
I20260709 12:21:34.188141 21244 raft_consensus.cc:2243] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.189234 21244 raft_consensus.cc:2272] T c4b5e728b50b4085803fe63160773c74 P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:34.191792 32401 consensus_peers.cc:597] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 -> Peer 81bee0a37e054555ac4d58f6adeff729 (127.20.191.2:36783): Couldn't send request to peer 81bee0a37e054555ac4d58f6adeff729. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:36783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:34.192305 21244 tablet_replica.cc:333] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759: stopping tablet replica
I20260709 12:21:34.192968 21244 raft_consensus.cc:2243] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.193456 21244 raft_consensus.cc:2272] T 50ec226d96254424be091cc09af472d3 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.195734 21244 tablet_replica.cc:333] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759: stopping tablet replica
I20260709 12:21:34.196748 21244 raft_consensus.cc:2243] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.197795 21244 raft_consensus.cc:2272] T 83ea334d6850454995ed5e7266aff57c P e03b91883c034031a866b1e6a7133759 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.201133 21244 tablet_replica.cc:333] T 025032ae81ca449e8469df7b0db080d0 P e03b91883c034031a866b1e6a7133759: stopping tablet replica
I20260709 12:21:34.202014 21244 raft_consensus.cc:2243] T 025032ae81ca449e8469df7b0db080d0 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.202585 21244 raft_consensus.cc:2272] T 025032ae81ca449e8469df7b0db080d0 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.206511 21244 tablet_replica.cc:333] T 27bda943e6a2453187d9f36ad10208f2 P e03b91883c034031a866b1e6a7133759: stopping tablet replica
I20260709 12:21:34.207226 21244 raft_consensus.cc:2243] T 27bda943e6a2453187d9f36ad10208f2 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.207762 21244 raft_consensus.cc:2272] T 27bda943e6a2453187d9f36ad10208f2 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.210273 21244 tablet_replica.cc:333] T c9636a2fcffb44328184e08625d74513 P e03b91883c034031a866b1e6a7133759: stopping tablet replica
I20260709 12:21:34.210826 21244 raft_consensus.cc:2243] T c9636a2fcffb44328184e08625d74513 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.211308 21244 raft_consensus.cc:2272] T c9636a2fcffb44328184e08625d74513 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.213515 21244 tablet_replica.cc:333] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759: stopping tablet replica
I20260709 12:21:34.214121 21244 raft_consensus.cc:2243] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.214979 21244 raft_consensus.cc:2272] T 9c0f90b7959d41c2903d5937c85300ca P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.217077 21244 tablet_replica.cc:333] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759: stopping tablet replica
I20260709 12:21:34.217628 21244 raft_consensus.cc:2243] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.218493 21244 raft_consensus.cc:2272] T 1b41c7bd1cb54f27b7699b8c27edab05 P e03b91883c034031a866b1e6a7133759 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.220695 21244 tablet_replica.cc:333] T 0bb847a8cef042b8a343a8b27bfb8bdc P e03b91883c034031a866b1e6a7133759: stopping tablet replica
I20260709 12:21:34.221261 21244 raft_consensus.cc:2243] T 0bb847a8cef042b8a343a8b27bfb8bdc P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.221704 21244 raft_consensus.cc:2272] T 0bb847a8cef042b8a343a8b27bfb8bdc P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.223767 21244 tablet_replica.cc:333] T 05f8aeab48474f4d9b142f321588f2f1 P e03b91883c034031a866b1e6a7133759: stopping tablet replica
I20260709 12:21:34.224278 21244 raft_consensus.cc:2243] T 05f8aeab48474f4d9b142f321588f2f1 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.224717 21244 raft_consensus.cc:2272] T 05f8aeab48474f4d9b142f321588f2f1 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.226894 21244 tablet_replica.cc:333] T 0dffe4baaa524e338c4515fde30f55d1 P e03b91883c034031a866b1e6a7133759: stopping tablet replica
I20260709 12:21:34.227397 21244 raft_consensus.cc:2243] T 0dffe4baaa524e338c4515fde30f55d1 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.227828 21244 raft_consensus.cc:2272] T 0dffe4baaa524e338c4515fde30f55d1 P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.229875 21244 tablet_replica.cc:333] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759: stopping tablet replica
I20260709 12:21:34.230363 21244 raft_consensus.cc:2243] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.231201 21244 raft_consensus.cc:2272] T 422814cbe50747fb91b9be40bf8212ca P e03b91883c034031a866b1e6a7133759 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.233573 21244 tablet_replica.cc:333] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759: stopping tablet replica
I20260709 12:21:34.234118 21244 raft_consensus.cc:2243] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.234541 21244 raft_consensus.cc:2272] T b91241c3bfe946cb887450cca2024905 P e03b91883c034031a866b1e6a7133759 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.275377 21244 tablet_server.cc:196] TabletServer@127.20.191.3:0 shutdown complete.
I20260709 12:21:34.310171 21244 master.cc:562] Master@127.20.191.62:36083 shutting down...
I20260709 12:21:34.331591 21244 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.332150 21244 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.332430 21244 tablet_replica.cc:333] T 00000000000000000000000000000000 P 71227152cd7d43ed98cd73431a2b8d15: stopping tablet replica
I20260709 12:21:34.352700 21244 master.cc:584] Master@127.20.191.62:36083 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21375 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:21:34.402964 21244 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.191.62:33483
I20260709 12:21:34.404044 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:34.409452   317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:34.409478   318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:34.410699   320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:34.417542 21244 server_base.cc:1061] running on GCE node
I20260709 12:21:34.418591 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:34.418789 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:34.418953 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599694418926 us; error 0 us; skew 500 ppm
I20260709 12:21:34.419497 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:34.421977 21244 webserver.cc:533] Webserver started at http://127.20.191.62:40759/ using document root <none> and password file <none>
I20260709 12:21:34.422480 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:34.422645 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:34.422914 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:34.424045 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/master-0-root/instance:
uuid: "3188b17973f34f288ab39a21af7da74b"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-7c1h"
I20260709 12:21:34.428675 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:21:34.432524   325 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.433456 21244 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:21:34.433812 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/master-0-root
uuid: "3188b17973f34f288ab39a21af7da74b"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-7c1h"
I20260709 12:21:34.434084 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:34.443917 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:34.445194 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:34.484086 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.62:33483
I20260709 12:21:34.484187   376 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.62:33483 every 8 connection(s)
I20260709 12:21:34.488161   377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:34.500394   377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b: Bootstrap starting.
I20260709 12:21:34.505357   377 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.509606   377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b: No bootstrap required, opened a new log
I20260709 12:21:34.511926   377 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3188b17973f34f288ab39a21af7da74b" member_type: VOTER }
I20260709 12:21:34.512378   377 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.512550   377 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3188b17973f34f288ab39a21af7da74b, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.513059   377 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3188b17973f34f288ab39a21af7da74b" member_type: VOTER }
I20260709 12:21:34.513513   377 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:21:34.513705   377 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:21:34.513958   377 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.518842   377 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3188b17973f34f288ab39a21af7da74b" member_type: VOTER }
I20260709 12:21:34.519346   377 leader_election.cc:304] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3188b17973f34f288ab39a21af7da74b; no voters: 
I20260709 12:21:34.520442   377 leader_election.cc:290] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:21:34.520854   380 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:34.522217   380 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [term 1 LEADER]: Becoming Leader. State: Replica: 3188b17973f34f288ab39a21af7da74b, State: Running, Role: LEADER
I20260709 12:21:34.522962   380 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3188b17973f34f288ab39a21af7da74b" member_type: VOTER }
I20260709 12:21:34.523531   377 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:21:34.527977   382 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3188b17973f34f288ab39a21af7da74b. Latest consensus state: current_term: 1 leader_uuid: "3188b17973f34f288ab39a21af7da74b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3188b17973f34f288ab39a21af7da74b" member_type: VOTER } }
I20260709 12:21:34.528755   382 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:34.529336   381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3188b17973f34f288ab39a21af7da74b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3188b17973f34f288ab39a21af7da74b" member_type: VOTER } }
I20260709 12:21:34.529834   381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:34.530818   387 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:21:34.535831   387 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:21:34.540148 21244 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:21:34.545919   387 catalog_manager.cc:1383] Generated new cluster ID: 4e58bf2b01fe49beb1a3afac09517432
I20260709 12:21:34.546243   387 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:21:34.570528   387 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:21:34.571899   387 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:21:34.584815   387 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b: Generated new TSK 0
I20260709 12:21:34.585453   387 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:21:34.606915 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:34.613044   398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:34.613971   399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:34.616707   401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:34.616767 21244 server_base.cc:1061] running on GCE node
I20260709 12:21:34.618085 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:34.618315 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:34.618465 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599694618448 us; error 0 us; skew 500 ppm
I20260709 12:21:34.618968 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:34.621281 21244 webserver.cc:533] Webserver started at http://127.20.191.1:42709/ using document root <none> and password file <none>
I20260709 12:21:34.621737 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:34.621953 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:34.622238 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:34.623314 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/ts-0-root/instance:
uuid: "017c9ead48d24bd0bb44234d9a4d0722"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-7c1h"
I20260709 12:21:34.627933 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:21:34.631294   406 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.632009 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:21:34.632310 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/ts-0-root
uuid: "017c9ead48d24bd0bb44234d9a4d0722"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-7c1h"
I20260709 12:21:34.632582 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:34.647169 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:34.648355 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:34.649714 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:34.652001 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:34.652210 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.652431 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:34.652601 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.691900 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.1:42101
I20260709 12:21:34.692008   468 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.1:42101 every 8 connection(s)
I20260709 12:21:34.696808 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:34.704185   473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:34.706727   474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:34.707401 21244 server_base.cc:1061] running on GCE node
W20260709 12:21:34.708271   476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:34.709502 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:34.709745 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:34.709957 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599694709937 us; error 0 us; skew 500 ppm
I20260709 12:21:34.710490 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:34.710603   469 heartbeater.cc:344] Connected to a master server at 127.20.191.62:33483
I20260709 12:21:34.711062   469 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:34.711997   469 heartbeater.cc:507] Master 127.20.191.62:33483 requested a full tablet report, sending...
I20260709 12:21:34.713233 21244 webserver.cc:533] Webserver started at http://127.20.191.2:39263/ using document root <none> and password file <none>
I20260709 12:21:34.713851 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:34.714080 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:34.714418 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:34.714614   342 ts_manager.cc:194] Registered new tserver with Master: 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101)
I20260709 12:21:34.716078 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/ts-1-root/instance:
uuid: "8502a45e5e924eb2b44da52c43bc936f"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-7c1h"
I20260709 12:21:34.717234   342 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42576
I20260709 12:21:34.721913 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:21:34.725636   481 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.726506 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:21:34.726814 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/ts-1-root
uuid: "8502a45e5e924eb2b44da52c43bc936f"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-7c1h"
I20260709 12:21:34.727078 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:34.745206 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:34.746502 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:34.747979 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:34.750284 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:34.750505 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.750737 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:34.750895 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.792608 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.2:38727
I20260709 12:21:34.792723   543 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.2:38727 every 8 connection(s)
I20260709 12:21:34.797606 21244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:34.804867   547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:34.806871   548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:34.810000 21244 server_base.cc:1061] running on GCE node
W20260709 12:21:34.810122   550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:34.810645   544 heartbeater.cc:344] Connected to a master server at 127.20.191.62:33483
I20260709 12:21:34.811094   544 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:34.811348 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:34.811620 21244 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:34.811827 21244 hybrid_clock.cc:648] HybridClock initialized: now 1783599694811809 us; error 0 us; skew 500 ppm
I20260709 12:21:34.811976   544 heartbeater.cc:507] Master 127.20.191.62:33483 requested a full tablet report, sending...
I20260709 12:21:34.812572 21244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:34.814213   342 ts_manager.cc:194] Registered new tserver with Master: 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:34.815447 21244 webserver.cc:533] Webserver started at http://127.20.191.3:41139/ using document root <none> and password file <none>
I20260709 12:21:34.815706   342 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42592
I20260709 12:21:34.816016 21244 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:34.816298 21244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:34.816555 21244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:34.817836 21244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/ts-2-root/instance:
uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-7c1h"
I20260709 12:21:34.822376 21244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:21:34.825928   555 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.826707 21244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:21:34.826992 21244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/ts-2-root
uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-7c1h"
I20260709 12:21:34.827243 21244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskh1og22/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599324869158-21244-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:34.850294 21244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:34.851549 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:34.852962 21244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:34.855298 21244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:34.855521 21244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.855753 21244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:34.855921 21244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.894980 21244 rpc_server.cc:307] RPC server started. Bound to: 127.20.191.3:46421
I20260709 12:21:34.895077   617 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.191.3:46421 every 8 connection(s)
I20260709 12:21:34.908561   618 heartbeater.cc:344] Connected to a master server at 127.20.191.62:33483
I20260709 12:21:34.908994   618 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:34.909734   618 heartbeater.cc:507] Master 127.20.191.62:33483 requested a full tablet report, sending...
I20260709 12:21:34.911774   342 ts_manager.cc:194] Registered new tserver with Master: 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:34.912873 21244 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014766146s
I20260709 12:21:34.913470   342 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42594
I20260709 12:21:34.938576   342 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42604:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:21:34.941195   342 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:21:35.030839   434 tablet_service.cc:1511] Processing CreateTablet for tablet 085b00a79a914b93a414b8a4bad3575c (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:35.031807   433 tablet_service.cc:1511] Processing CreateTablet for tablet f4c8653139784a98bd178fb7ff97c8c1 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:35.032382   434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085b00a79a914b93a414b8a4bad3575c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.033286   433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4c8653139784a98bd178fb7ff97c8c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.033950   431 tablet_service.cc:1511] Processing CreateTablet for tablet 055394fe3a5e4910875669f67e8d8858 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:35.035288   431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 055394fe3a5e4910875669f67e8d8858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.035737   506 tablet_service.cc:1511] Processing CreateTablet for tablet 055394fe3a5e4910875669f67e8d8858 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:35.037106   506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 055394fe3a5e4910875669f67e8d8858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.039002   507 tablet_service.cc:1511] Processing CreateTablet for tablet 7b786653ccc44d8dabf8d79978ed4399 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:35.040407   507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b786653ccc44d8dabf8d79978ed4399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.043524   509 tablet_service.cc:1511] Processing CreateTablet for tablet 085b00a79a914b93a414b8a4bad3575c (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:35.044886   509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085b00a79a914b93a414b8a4bad3575c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.046984   508 tablet_service.cc:1511] Processing CreateTablet for tablet f4c8653139784a98bd178fb7ff97c8c1 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:35.048393   508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4c8653139784a98bd178fb7ff97c8c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.032596   432 tablet_service.cc:1511] Processing CreateTablet for tablet 7b786653ccc44d8dabf8d79978ed4399 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:35.051257   432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b786653ccc44d8dabf8d79978ed4399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.060647   633 tablet_bootstrap.cc:492] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722: Bootstrap starting.
I20260709 12:21:35.067811   634 tablet_bootstrap.cc:492] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f: Bootstrap starting.
I20260709 12:21:35.075435   633 tablet_bootstrap.cc:654] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.075455   634 tablet_bootstrap.cc:654] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.085927   432 tablet_service.cc:1511] Processing CreateTablet for tablet 3c79b33073604287949695b0b8fbb1e9 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:35.087520   432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c79b33073604287949695b0b8fbb1e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.094113   507 tablet_service.cc:1511] Processing CreateTablet for tablet 3c79b33073604287949695b0b8fbb1e9 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:35.094419   433 tablet_service.cc:1511] Processing CreateTablet for tablet a243589bc22d4e0092f4ab9d355c2710 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:35.096097   433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a243589bc22d4e0092f4ab9d355c2710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.095866   507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c79b33073604287949695b0b8fbb1e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.114435   633 tablet_bootstrap.cc:492] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722: No bootstrap required, opened a new log
I20260709 12:21:35.115190   633 ts_tablet_manager.cc:1403] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent bootstrapping tablet: real 0.055s	user 0.026s	sys 0.004s
I20260709 12:21:35.119045   633 raft_consensus.cc:359] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.120548   633 raft_consensus.cc:385] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.120949   633 raft_consensus.cc:740] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.121978   633 consensus_queue.cc:260] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.122108   505 tablet_service.cc:1511] Processing CreateTablet for tablet a243589bc22d4e0092f4ab9d355c2710 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:35.123625   505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a243589bc22d4e0092f4ab9d355c2710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.136193   581 tablet_service.cc:1511] Processing CreateTablet for tablet 7b786653ccc44d8dabf8d79978ed4399 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:35.138963   582 tablet_service.cc:1511] Processing CreateTablet for tablet f4c8653139784a98bd178fb7ff97c8c1 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:35.140080   583 tablet_service.cc:1511] Processing CreateTablet for tablet 085b00a79a914b93a414b8a4bad3575c (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:35.137688   581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b786653ccc44d8dabf8d79978ed4399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.142370   580 tablet_service.cc:1511] Processing CreateTablet for tablet 055394fe3a5e4910875669f67e8d8858 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:35.143823   580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 055394fe3a5e4910875669f67e8d8858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.146212   583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085b00a79a914b93a414b8a4bad3575c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.148229   582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4c8653139784a98bd178fb7ff97c8c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.149884   634 tablet_bootstrap.cc:492] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f: No bootstrap required, opened a new log
I20260709 12:21:35.150591   634 ts_tablet_manager.cc:1403] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.010s
I20260709 12:21:35.156613   577 tablet_service.cc:1511] Processing CreateTablet for tablet dffa183e76384d118cb4e27fd83e1934 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:35.158059   508 tablet_service.cc:1511] Processing CreateTablet for tablet dffa183e76384d118cb4e27fd83e1934 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:35.159452   508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dffa183e76384d118cb4e27fd83e1934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.159642   579 tablet_service.cc:1511] Processing CreateTablet for tablet 3c79b33073604287949695b0b8fbb1e9 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:35.160946   579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c79b33073604287949695b0b8fbb1e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.162775   431 tablet_service.cc:1511] Processing CreateTablet for tablet e587d48344e3425aaef56b90052b5f58 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:35.164114   431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e587d48344e3425aaef56b90052b5f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.165920   432 tablet_service.cc:1511] Processing CreateTablet for tablet dffa183e76384d118cb4e27fd83e1934 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:35.167295   432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dffa183e76384d118cb4e27fd83e1934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.166951   504 tablet_service.cc:1511] Processing CreateTablet for tablet e587d48344e3425aaef56b90052b5f58 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:35.168286   504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e587d48344e3425aaef56b90052b5f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.168668   430 tablet_service.cc:1511] Processing CreateTablet for tablet 535662e2eba6427ea18a3975a6d4afc8 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:35.170938   503 tablet_service.cc:1511] Processing CreateTablet for tablet 535662e2eba6427ea18a3975a6d4afc8 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:35.172291   503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535662e2eba6427ea18a3975a6d4afc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.175019   578 tablet_service.cc:1511] Processing CreateTablet for tablet a243589bc22d4e0092f4ab9d355c2710 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:35.176590   578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a243589bc22d4e0092f4ab9d355c2710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.177412   634 raft_consensus.cc:359] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.178387   634 raft_consensus.cc:385] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.178689   634 raft_consensus.cc:740] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.179463   576 tablet_service.cc:1511] Processing CreateTablet for tablet e587d48344e3425aaef56b90052b5f58 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:35.180866   576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e587d48344e3425aaef56b90052b5f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.183596   575 tablet_service.cc:1511] Processing CreateTablet for tablet 535662e2eba6427ea18a3975a6d4afc8 (DEFAULT_TABLE table=test-workload [id=08293663c4da41c1bbc5196315822791]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:35.185070   575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535662e2eba6427ea18a3975a6d4afc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.186427   577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dffa183e76384d118cb4e27fd83e1934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.187597   430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535662e2eba6427ea18a3975a6d4afc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.215335   469 heartbeater.cc:499] Master 127.20.191.62:33483 was elected leader, sending a full tablet report...
I20260709 12:21:35.217340   633 ts_tablet_manager.cc:1434] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent starting tablet: real 0.102s	user 0.032s	sys 0.032s
I20260709 12:21:35.218665   633 tablet_bootstrap.cc:492] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722: Bootstrap starting.
I20260709 12:21:35.215322   637 raft_consensus.cc:493] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.223172   637 raft_consensus.cc:515] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.227839   637 leader_election.cc:290] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.241705   633 tablet_bootstrap.cc:654] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.183600   634 consensus_queue.cc:260] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.250519   639 tablet_bootstrap.cc:492] T 055394fe3a5e4910875669f67e8d8858 P 762bba1a64cd462d95c59db0cb9e0dfa: Bootstrap starting.
I20260709 12:21:35.321969   643 raft_consensus.cc:493] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.322551   643 raft_consensus.cc:515] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.323081   634 ts_tablet_manager.cc:1434] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f: Time spent starting tablet: real 0.172s	user 0.014s	sys 0.012s
I20260709 12:21:35.330330   544 heartbeater.cc:499] Master 127.20.191.62:33483 was elected leader, sending a full tablet report...
I20260709 12:21:35.334169   593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055394fe3a5e4910875669f67e8d8858" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" is_pre_election: true
I20260709 12:21:35.335023   519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055394fe3a5e4910875669f67e8d8858" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
I20260709 12:21:35.336486   634 tablet_bootstrap.cc:492] T f4c8653139784a98bd178fb7ff97c8c1 P 8502a45e5e924eb2b44da52c43bc936f: Bootstrap starting.
W20260709 12:21:35.336669   409 leader_election.cc:343] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:35.337852   410 leader_election.cc:343] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:35.338312   410 leader_election.cc:304] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722; no voters: 762bba1a64cd462d95c59db0cb9e0dfa, 8502a45e5e924eb2b44da52c43bc936f
I20260709 12:21:35.339560   638 raft_consensus.cc:2749] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:35.342785   639 tablet_bootstrap.cc:654] T 055394fe3a5e4910875669f67e8d8858 P 762bba1a64cd462d95c59db0cb9e0dfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.343484   634 tablet_bootstrap.cc:654] T f4c8653139784a98bd178fb7ff97c8c1 P 8502a45e5e924eb2b44da52c43bc936f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.358772   633 tablet_bootstrap.cc:492] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722: No bootstrap required, opened a new log
I20260709 12:21:35.359333   633 ts_tablet_manager.cc:1403] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent bootstrapping tablet: real 0.141s	user 0.015s	sys 0.009s
I20260709 12:21:35.362423   643 leader_election.cc:290] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.372663   633 raft_consensus.cc:359] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.378185   633 raft_consensus.cc:385] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.381649   633 raft_consensus.cc:740] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.382900   633 consensus_queue.cc:260] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.389550   633 ts_tablet_manager.cc:1434] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 12:21:35.390679   633 tablet_bootstrap.cc:492] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722: Bootstrap starting.
I20260709 12:21:35.396906   634 tablet_bootstrap.cc:492] T f4c8653139784a98bd178fb7ff97c8c1 P 8502a45e5e924eb2b44da52c43bc936f: No bootstrap required, opened a new log
I20260709 12:21:35.397431   634 ts_tablet_manager.cc:1403] T f4c8653139784a98bd178fb7ff97c8c1 P 8502a45e5e924eb2b44da52c43bc936f: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.030s
I20260709 12:21:35.397953   633 tablet_bootstrap.cc:654] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.398118   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b786653ccc44d8dabf8d79978ed4399" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722" is_pre_election: true
W20260709 12:21:35.401170   484 leader_election.cc:343] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:35.400529   634 raft_consensus.cc:359] T f4c8653139784a98bd178fb7ff97c8c1 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.402442   634 raft_consensus.cc:385] T f4c8653139784a98bd178fb7ff97c8c1 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.402763   634 raft_consensus.cc:740] T f4c8653139784a98bd178fb7ff97c8c1 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.403566   634 consensus_queue.cc:260] T f4c8653139784a98bd178fb7ff97c8c1 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.404515   639 tablet_bootstrap.cc:492] T 055394fe3a5e4910875669f67e8d8858 P 762bba1a64cd462d95c59db0cb9e0dfa: No bootstrap required, opened a new log
I20260709 12:21:35.405082   639 ts_tablet_manager.cc:1403] T 055394fe3a5e4910875669f67e8d8858 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent bootstrapping tablet: real 0.156s	user 0.011s	sys 0.000s
I20260709 12:21:35.405711   634 ts_tablet_manager.cc:1434] T f4c8653139784a98bd178fb7ff97c8c1 P 8502a45e5e924eb2b44da52c43bc936f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:21:35.406884   634 tablet_bootstrap.cc:492] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f: Bootstrap starting.
I20260709 12:21:35.408179   639 raft_consensus.cc:359] T 055394fe3a5e4910875669f67e8d8858 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.408995   639 raft_consensus.cc:385] T 055394fe3a5e4910875669f67e8d8858 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.409319   639 raft_consensus.cc:740] T 055394fe3a5e4910875669f67e8d8858 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.410226   639 consensus_queue.cc:260] T 055394fe3a5e4910875669f67e8d8858 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.413203   634 tablet_bootstrap.cc:654] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.419752   593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b786653ccc44d8dabf8d79978ed4399" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" is_pre_election: true
W20260709 12:21:35.422080   485 leader_election.cc:343] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:35.422716   485 leader_election.cc:304] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8502a45e5e924eb2b44da52c43bc936f; no voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa
I20260709 12:21:35.424086   643 raft_consensus.cc:2749] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:35.424865   639 ts_tablet_manager.cc:1434] T 055394fe3a5e4910875669f67e8d8858 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.014s
I20260709 12:21:35.425783   618 heartbeater.cc:499] Master 127.20.191.62:33483 was elected leader, sending a full tablet report...
I20260709 12:21:35.427757   634 tablet_bootstrap.cc:492] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f: No bootstrap required, opened a new log
I20260709 12:21:35.428287   634 ts_tablet_manager.cc:1403] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 12:21:35.425936   633 tablet_bootstrap.cc:492] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722: No bootstrap required, opened a new log
I20260709 12:21:35.429870   633 ts_tablet_manager.cc:1403] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.009s
I20260709 12:21:35.430550   639 tablet_bootstrap.cc:492] T 7b786653ccc44d8dabf8d79978ed4399 P 762bba1a64cd462d95c59db0cb9e0dfa: Bootstrap starting.
I20260709 12:21:35.431383   634 raft_consensus.cc:359] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.432143   634 raft_consensus.cc:385] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.432446   634 raft_consensus.cc:740] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.433202   634 consensus_queue.cc:260] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.433367   633 raft_consensus.cc:359] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.434355   633 raft_consensus.cc:385] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.434680   633 raft_consensus.cc:740] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.435523   633 consensus_queue.cc:260] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.439139   639 tablet_bootstrap.cc:654] T 7b786653ccc44d8dabf8d79978ed4399 P 762bba1a64cd462d95c59db0cb9e0dfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.440594   634 ts_tablet_manager.cc:1434] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:21:35.442838   634 tablet_bootstrap.cc:492] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f: Bootstrap starting.
I20260709 12:21:35.443740   633 ts_tablet_manager.cc:1434] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:21:35.444927   633 tablet_bootstrap.cc:492] T 3c79b33073604287949695b0b8fbb1e9 P 017c9ead48d24bd0bb44234d9a4d0722: Bootstrap starting.
W20260709 12:21:35.446403   470 tablet.cc:2406] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:21:35.451923   634 tablet_bootstrap.cc:654] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.451923   633 tablet_bootstrap.cc:654] T 3c79b33073604287949695b0b8fbb1e9 P 017c9ead48d24bd0bb44234d9a4d0722: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.453117   639 tablet_bootstrap.cc:492] T 7b786653ccc44d8dabf8d79978ed4399 P 762bba1a64cd462d95c59db0cb9e0dfa: No bootstrap required, opened a new log
I20260709 12:21:35.453830   639 ts_tablet_manager.cc:1403] T 7b786653ccc44d8dabf8d79978ed4399 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 12:21:35.457105   639 raft_consensus.cc:359] T 7b786653ccc44d8dabf8d79978ed4399 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.458014   639 raft_consensus.cc:385] T 7b786653ccc44d8dabf8d79978ed4399 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.458369   639 raft_consensus.cc:740] T 7b786653ccc44d8dabf8d79978ed4399 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.459421   639 consensus_queue.cc:260] T 7b786653ccc44d8dabf8d79978ed4399 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.462087   639 ts_tablet_manager.cc:1434] T 7b786653ccc44d8dabf8d79978ed4399 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:35.463207   639 tablet_bootstrap.cc:492] T f4c8653139784a98bd178fb7ff97c8c1 P 762bba1a64cd462d95c59db0cb9e0dfa: Bootstrap starting.
I20260709 12:21:35.467226   634 tablet_bootstrap.cc:492] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f: No bootstrap required, opened a new log
I20260709 12:21:35.467850   634 ts_tablet_manager.cc:1403] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.008s
I20260709 12:21:35.468309   633 tablet_bootstrap.cc:492] T 3c79b33073604287949695b0b8fbb1e9 P 017c9ead48d24bd0bb44234d9a4d0722: No bootstrap required, opened a new log
I20260709 12:21:35.468896   633 ts_tablet_manager.cc:1403] T 3c79b33073604287949695b0b8fbb1e9 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 12:21:35.470778   639 tablet_bootstrap.cc:654] T f4c8653139784a98bd178fb7ff97c8c1 P 762bba1a64cd462d95c59db0cb9e0dfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.471081   634 raft_consensus.cc:359] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.471872   634 raft_consensus.cc:385] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.472246   634 raft_consensus.cc:740] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.472645   638 raft_consensus.cc:493] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.471946   633 raft_consensus.cc:359] T 3c79b33073604287949695b0b8fbb1e9 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.473145   638 raft_consensus.cc:515] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.473618   633 raft_consensus.cc:385] T 3c79b33073604287949695b0b8fbb1e9 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.473965   633 raft_consensus.cc:740] T 3c79b33073604287949695b0b8fbb1e9 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.474889   633 consensus_queue.cc:260] T 3c79b33073604287949695b0b8fbb1e9 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.475533   638 leader_election.cc:290] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.473134   634 consensus_queue.cc:260] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.477177   633 ts_tablet_manager.cc:1434] T 3c79b33073604287949695b0b8fbb1e9 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:35.478283   633 tablet_bootstrap.cc:492] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722: Bootstrap starting.
I20260709 12:21:35.478763   634 ts_tablet_manager.cc:1434] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:21:35.479246   593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b786653ccc44d8dabf8d79978ed4399" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" is_pre_election: true
I20260709 12:21:35.479772   634 tablet_bootstrap.cc:492] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f: Bootstrap starting.
I20260709 12:21:35.480372   519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b786653ccc44d8dabf8d79978ed4399" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
I20260709 12:21:35.480988   519 raft_consensus.cc:2468] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 0.
I20260709 12:21:35.484126   409 leader_election.cc:304] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:35.485028   637 raft_consensus.cc:2804] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:35.485491   637 raft_consensus.cc:493] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.485025   633 tablet_bootstrap.cc:654] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.485893   637 raft_consensus.cc:3060] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.486584   634 tablet_bootstrap.cc:654] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.479889   593 raft_consensus.cc:2468] T 7b786653ccc44d8dabf8d79978ed4399 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 0.
I20260709 12:21:35.497809   633 tablet_bootstrap.cc:492] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722: No bootstrap required, opened a new log
I20260709 12:21:35.498003   634 tablet_bootstrap.cc:492] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f: No bootstrap required, opened a new log
I20260709 12:21:35.498560   634 ts_tablet_manager.cc:1403] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 12:21:35.501066   637 raft_consensus.cc:515] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.498560   633 ts_tablet_manager.cc:1403] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 12:21:35.501639   634 raft_consensus.cc:359] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.502470   634 raft_consensus.cc:385] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.502790   634 raft_consensus.cc:740] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.502936   639 tablet_bootstrap.cc:492] T f4c8653139784a98bd178fb7ff97c8c1 P 762bba1a64cd462d95c59db0cb9e0dfa: No bootstrap required, opened a new log
I20260709 12:21:35.504005   639 ts_tablet_manager.cc:1403] T f4c8653139784a98bd178fb7ff97c8c1 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.003s
I20260709 12:21:35.503676   634 consensus_queue.cc:260] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.504981   643 raft_consensus.cc:493] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.505044   633 raft_consensus.cc:359] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.505493   643 raft_consensus.cc:515] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.505899   633 raft_consensus.cc:385] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.505234   519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b786653ccc44d8dabf8d79978ed4399" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:35.506448   633 raft_consensus.cc:740] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.505831   593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b786653ccc44d8dabf8d79978ed4399" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:35.507082   593 raft_consensus.cc:3060] T 7b786653ccc44d8dabf8d79978ed4399 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.507251   639 raft_consensus.cc:359] T f4c8653139784a98bd178fb7ff97c8c1 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.507325   633 consensus_queue.cc:260] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.507757   643 leader_election.cc:290] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.508374   639 raft_consensus.cc:385] T f4c8653139784a98bd178fb7ff97c8c1 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.508687   639 raft_consensus.cc:740] T f4c8653139784a98bd178fb7ff97c8c1 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.509802   633 ts_tablet_manager.cc:1434] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:35.510094   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243589bc22d4e0092f4ab9d355c2710" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722" is_pre_election: true
I20260709 12:21:35.510538   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243589bc22d4e0092f4ab9d355c2710" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" is_pre_election: true
I20260709 12:21:35.511109   633 tablet_bootstrap.cc:492] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722: Bootstrap starting.
I20260709 12:21:35.511446   639 consensus_queue.cc:260] T f4c8653139784a98bd178fb7ff97c8c1 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
W20260709 12:21:35.511991   485 leader_election.cc:343] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:35.512639   484 leader_election.cc:343] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:35.513068   484 leader_election.cc:304] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8502a45e5e924eb2b44da52c43bc936f; no voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa
I20260709 12:21:35.514313   643 raft_consensus.cc:2749] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:35.516700   634 ts_tablet_manager.cc:1434] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:21:35.518123   634 tablet_bootstrap.cc:492] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f: Bootstrap starting.
I20260709 12:21:35.519413   633 tablet_bootstrap.cc:654] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.524058   519 raft_consensus.cc:3060] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.524766   634 tablet_bootstrap.cc:654] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.530257   639 ts_tablet_manager.cc:1434] T f4c8653139784a98bd178fb7ff97c8c1 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 12:21:35.531581   639 tablet_bootstrap.cc:492] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa: Bootstrap starting.
I20260709 12:21:35.503436   637 leader_election.cc:290] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 election: Requested vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.532569   637 raft_consensus.cc:493] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.533006   637 raft_consensus.cc:515] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
W20260709 12:21:35.535197   390 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:35.538134   593 raft_consensus.cc:2468] T 7b786653ccc44d8dabf8d79978ed4399 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 1.
I20260709 12:21:35.533092   633 tablet_bootstrap.cc:492] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722: No bootstrap required, opened a new log
I20260709 12:21:35.540477   633 ts_tablet_manager.cc:1403] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.008s
I20260709 12:21:35.541019   637 leader_election.cc:290] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.541703   410 leader_election.cc:304] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 
I20260709 12:21:35.543921   633 raft_consensus.cc:359] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.544870   633 raft_consensus.cc:385] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.543709   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c8653139784a98bd178fb7ff97c8c1" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" is_pre_election: true
I20260709 12:21:35.542884   518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c8653139784a98bd178fb7ff97c8c1" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
I20260709 12:21:35.545512   633 raft_consensus.cc:740] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.546164   518 raft_consensus.cc:2468] T f4c8653139784a98bd178fb7ff97c8c1 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 0.
I20260709 12:21:35.546695   633 consensus_queue.cc:260] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.547626   409 leader_election.cc:304] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:35.547958   638 raft_consensus.cc:2804] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:35.548409   592 raft_consensus.cc:2468] T f4c8653139784a98bd178fb7ff97c8c1 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 0.
I20260709 12:21:35.553726   519 raft_consensus.cc:2468] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 1.
I20260709 12:21:35.555460   639 tablet_bootstrap.cc:654] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.555883   633 ts_tablet_manager.cc:1434] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:21:35.559993   661 raft_consensus.cc:2804] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:35.560426   661 raft_consensus.cc:493] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.560751   661 raft_consensus.cc:3060] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.562722   633 tablet_bootstrap.cc:492] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722: Bootstrap starting.
I20260709 12:21:35.564499   639 tablet_bootstrap.cc:492] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa: No bootstrap required, opened a new log
I20260709 12:21:35.565182   639 ts_tablet_manager.cc:1403] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.000s
I20260709 12:21:35.568395   639 raft_consensus.cc:359] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.570070   639 raft_consensus.cc:385] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.570425   639 raft_consensus.cc:740] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.568962   661 raft_consensus.cc:515] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.570618   638 raft_consensus.cc:697] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Becoming Leader. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:35.571009   634 tablet_bootstrap.cc:492] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f: No bootstrap required, opened a new log
I20260709 12:21:35.571659   634 ts_tablet_manager.cc:1403] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.014s
I20260709 12:21:35.571666   638 consensus_queue.cc:237] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.573701   633 tablet_bootstrap.cc:654] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.573418   639 consensus_queue.cc:260] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.576152   639 ts_tablet_manager.cc:1434] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:21:35.574577   593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c8653139784a98bd178fb7ff97c8c1" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:35.577333   593 raft_consensus.cc:3060] T f4c8653139784a98bd178fb7ff97c8c1 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.578673   519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c8653139784a98bd178fb7ff97c8c1" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:35.579330   519 raft_consensus.cc:3060] T f4c8653139784a98bd178fb7ff97c8c1 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.575827   634 raft_consensus.cc:359] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.584965   634 raft_consensus.cc:385] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.585376   634 raft_consensus.cc:740] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.582480   639 tablet_bootstrap.cc:492] T e587d48344e3425aaef56b90052b5f58 P 762bba1a64cd462d95c59db0cb9e0dfa: Bootstrap starting.
I20260709 12:21:35.586264   634 consensus_queue.cc:260] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.588948   634 ts_tablet_manager.cc:1434] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:21:35.590163   634 tablet_bootstrap.cc:492] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f: Bootstrap starting.
I20260709 12:21:35.595510   639 tablet_bootstrap.cc:654] T e587d48344e3425aaef56b90052b5f58 P 762bba1a64cd462d95c59db0cb9e0dfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.596930   634 tablet_bootstrap.cc:654] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.582896   661 leader_election.cc:290] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 election: Requested vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.600601   593 raft_consensus.cc:2468] T f4c8653139784a98bd178fb7ff97c8c1 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 1.
I20260709 12:21:35.603947   519 raft_consensus.cc:2468] T f4c8653139784a98bd178fb7ff97c8c1 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 1.
I20260709 12:21:35.604357   639 tablet_bootstrap.cc:492] T e587d48344e3425aaef56b90052b5f58 P 762bba1a64cd462d95c59db0cb9e0dfa: No bootstrap required, opened a new log
I20260709 12:21:35.604641   410 leader_election.cc:304] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 
I20260709 12:21:35.604833   633 tablet_bootstrap.cc:492] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722: No bootstrap required, opened a new log
I20260709 12:21:35.604931   639 ts_tablet_manager.cc:1403] T e587d48344e3425aaef56b90052b5f58 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 12:21:35.605556   633 ts_tablet_manager.cc:1403] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.016s
I20260709 12:21:35.608218   639 raft_consensus.cc:359] T e587d48344e3425aaef56b90052b5f58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.609340   633 raft_consensus.cc:359] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.611116   633 raft_consensus.cc:385] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.611480   633 raft_consensus.cc:740] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.606002   638 raft_consensus.cc:2804] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:35.612087   638 raft_consensus.cc:697] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Becoming Leader. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:35.612460   639 raft_consensus.cc:385] T e587d48344e3425aaef56b90052b5f58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.612262   633 consensus_queue.cc:260] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.612895   639 raft_consensus.cc:740] T e587d48344e3425aaef56b90052b5f58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.614372   634 tablet_bootstrap.cc:492] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f: No bootstrap required, opened a new log
I20260709 12:21:35.612959   638 consensus_queue.cc:237] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.614687   633 ts_tablet_manager.cc:1434] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:35.614280   639 consensus_queue.cc:260] T e587d48344e3425aaef56b90052b5f58 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.614948   634 ts_tablet_manager.cc:1403] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.001s
I20260709 12:21:35.615773   633 tablet_bootstrap.cc:492] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722: Bootstrap starting.
I20260709 12:21:35.609349   341 catalog_manager.cc:5697] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:35.618276   634 raft_consensus.cc:359] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.619002   634 raft_consensus.cc:385] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.619278   634 raft_consensus.cc:740] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.621351   634 consensus_queue.cc:260] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.622786   633 tablet_bootstrap.cc:654] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.623811   634 ts_tablet_manager.cc:1434] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:35.624910   634 tablet_bootstrap.cc:492] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f: Bootstrap starting.
I20260709 12:21:35.625327   639 ts_tablet_manager.cc:1434] T e587d48344e3425aaef56b90052b5f58 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.003s
I20260709 12:21:35.631515   634 tablet_bootstrap.cc:654] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.634222   639 tablet_bootstrap.cc:492] T dffa183e76384d118cb4e27fd83e1934 P 762bba1a64cd462d95c59db0cb9e0dfa: Bootstrap starting.
I20260709 12:21:35.638289   633 tablet_bootstrap.cc:492] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722: No bootstrap required, opened a new log
I20260709 12:21:35.638916   633 ts_tablet_manager.cc:1403] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.006s
I20260709 12:21:35.641690   633 raft_consensus.cc:359] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.642474   633 raft_consensus.cc:385] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.642743   633 raft_consensus.cc:740] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.645334   639 tablet_bootstrap.cc:654] T dffa183e76384d118cb4e27fd83e1934 P 762bba1a64cd462d95c59db0cb9e0dfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.645946   633 consensus_queue.cc:260] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.648082   633 ts_tablet_manager.cc:1434] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:21:35.649056   633 tablet_bootstrap.cc:492] T 535662e2eba6427ea18a3975a6d4afc8 P 017c9ead48d24bd0bb44234d9a4d0722: Bootstrap starting.
I20260709 12:21:35.645437   634 tablet_bootstrap.cc:492] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f: No bootstrap required, opened a new log
I20260709 12:21:35.650986   634 ts_tablet_manager.cc:1403] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.005s
I20260709 12:21:35.653798   634 raft_consensus.cc:359] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.654534   634 raft_consensus.cc:385] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.654829   633 tablet_bootstrap.cc:654] T 535662e2eba6427ea18a3975a6d4afc8 P 017c9ead48d24bd0bb44234d9a4d0722: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.654829   634 raft_consensus.cc:740] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.655853   634 consensus_queue.cc:260] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.657545   639 tablet_bootstrap.cc:492] T dffa183e76384d118cb4e27fd83e1934 P 762bba1a64cd462d95c59db0cb9e0dfa: No bootstrap required, opened a new log
I20260709 12:21:35.658061   634 ts_tablet_manager.cc:1434] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:21:35.658206   639 ts_tablet_manager.cc:1403] T dffa183e76384d118cb4e27fd83e1934 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.007s
I20260709 12:21:35.659255   634 tablet_bootstrap.cc:492] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f: Bootstrap starting.
I20260709 12:21:35.659798   638 raft_consensus.cc:493] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.660323   638 raft_consensus.cc:515] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.663443   519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffa183e76384d118cb4e27fd83e1934" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
I20260709 12:21:35.663237   639 raft_consensus.cc:359] T dffa183e76384d118cb4e27fd83e1934 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.664242   519 raft_consensus.cc:2468] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 0.
I20260709 12:21:35.664332   639 raft_consensus.cc:385] T dffa183e76384d118cb4e27fd83e1934 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.664934   639 raft_consensus.cc:740] T dffa183e76384d118cb4e27fd83e1934 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.665938   409 leader_election.cc:304] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:35.665818   639 consensus_queue.cc:260] T dffa183e76384d118cb4e27fd83e1934 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.666641   634 tablet_bootstrap.cc:654] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.666853   661 raft_consensus.cc:2804] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:35.667286   661 raft_consensus.cc:493] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.667611   661 raft_consensus.cc:3060] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.672389   639 ts_tablet_manager.cc:1434] T dffa183e76384d118cb4e27fd83e1934 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 12:21:35.673681   639 tablet_bootstrap.cc:492] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa: Bootstrap starting.
I20260709 12:21:35.675988   593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffa183e76384d118cb4e27fd83e1934" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" is_pre_election: true
I20260709 12:21:35.674499   638 leader_election.cc:290] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.676837   593 raft_consensus.cc:2468] T dffa183e76384d118cb4e27fd83e1934 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 0.
I20260709 12:21:35.676395   661 raft_consensus.cc:515] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.679637   519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffa183e76384d118cb4e27fd83e1934" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:35.680249   519 raft_consensus.cc:3060] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.681625   633 tablet_bootstrap.cc:492] T 535662e2eba6427ea18a3975a6d4afc8 P 017c9ead48d24bd0bb44234d9a4d0722: No bootstrap required, opened a new log
I20260709 12:21:35.682107   643 raft_consensus.cc:493] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.682269   633 ts_tablet_manager.cc:1403] T 535662e2eba6427ea18a3975a6d4afc8 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.018s
I20260709 12:21:35.682791   639 tablet_bootstrap.cc:654] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.682626   643 raft_consensus.cc:515] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.685832   633 raft_consensus.cc:359] T 535662e2eba6427ea18a3975a6d4afc8 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.686226   593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c79b33073604287949695b0b8fbb1e9" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" is_pre_election: true
I20260709 12:21:35.686684   633 raft_consensus.cc:385] T 535662e2eba6427ea18a3975a6d4afc8 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.687057   633 raft_consensus.cc:740] T 535662e2eba6427ea18a3975a6d4afc8 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.687412   643 leader_election.cc:290] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.688005   633 consensus_queue.cc:260] T 535662e2eba6427ea18a3975a6d4afc8 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
W20260709 12:21:35.689248   485 leader_election.cc:343] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:35.691056   633 ts_tablet_manager.cc:1434] T 535662e2eba6427ea18a3975a6d4afc8 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:21:35.690937   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c79b33073604287949695b0b8fbb1e9" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722" is_pre_election: true
I20260709 12:21:35.691963   444 raft_consensus.cc:2468] T 3c79b33073604287949695b0b8fbb1e9 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 0.
I20260709 12:21:35.693679   484 leader_election.cc:304] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 762bba1a64cd462d95c59db0cb9e0dfa
I20260709 12:21:35.698024   643 raft_consensus.cc:2804] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:35.698505   643 raft_consensus.cc:493] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.698856   643 raft_consensus.cc:3060] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.699653   661 leader_election.cc:290] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 election: Requested vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.699879   593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffa183e76384d118cb4e27fd83e1934" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:35.700573   593 raft_consensus.cc:3060] T dffa183e76384d118cb4e27fd83e1934 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.706120   650 raft_consensus.cc:493] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.706732   650 raft_consensus.cc:515] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.709460   650 leader_election.cc:290] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:35.713054   634 tablet_bootstrap.cc:492] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f: No bootstrap required, opened a new log
I20260709 12:21:35.713593   634 ts_tablet_manager.cc:1403] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f: Time spent bootstrapping tablet: real 0.055s	user 0.028s	sys 0.024s
I20260709 12:21:35.716522   634 raft_consensus.cc:359] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.717221   634 raft_consensus.cc:385] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.717433   639 tablet_bootstrap.cc:492] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa: No bootstrap required, opened a new log
I20260709 12:21:35.718024   639 ts_tablet_manager.cc:1403] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.010s
I20260709 12:21:35.721028   661 raft_consensus.cc:493] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.721616   661 raft_consensus.cc:515] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.724213   661 leader_election.cc:290] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.717495   634 raft_consensus.cc:740] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.725003   518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243589bc22d4e0092f4ab9d355c2710" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
I20260709 12:21:35.721004   639 raft_consensus.cc:359] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.726269   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243589bc22d4e0092f4ab9d355c2710" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" is_pre_election: true
I20260709 12:21:35.726588   639 raft_consensus.cc:385] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.725710   518 raft_consensus.cc:2468] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 0.
I20260709 12:21:35.725605   634 consensus_queue.cc:260] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.728874   409 leader_election.cc:304] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:35.729210   634 ts_tablet_manager.cc:1434] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:21:35.726930   639 raft_consensus.cc:740] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.726963   592 raft_consensus.cc:2468] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 0.
I20260709 12:21:35.730887   639 consensus_queue.cc:260] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.729970   661 raft_consensus.cc:2804] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:35.732128   661 raft_consensus.cc:493] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.732445   661 raft_consensus.cc:3060] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.732823   519 raft_consensus.cc:2468] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 1.
I20260709 12:21:35.733381   639 ts_tablet_manager.cc:1434] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:21:35.734210   409 leader_election.cc:304] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:35.734576   639 tablet_bootstrap.cc:492] T 3c79b33073604287949695b0b8fbb1e9 P 762bba1a64cd462d95c59db0cb9e0dfa: Bootstrap starting.
I20260709 12:21:35.735847   638 raft_consensus.cc:2804] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:35.736318   638 raft_consensus.cc:697] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Becoming Leader. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:35.708557   593 raft_consensus.cc:2468] T dffa183e76384d118cb4e27fd83e1934 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 1.
I20260709 12:21:35.737140   638 consensus_queue.cc:237] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.740314   643 raft_consensus.cc:515] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.741557   639 tablet_bootstrap.cc:654] T 3c79b33073604287949695b0b8fbb1e9 P 762bba1a64cd462d95c59db0cb9e0dfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.721604   342 catalog_manager.cc:5697] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:35.746562   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c79b33073604287949695b0b8fbb1e9" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:35.747211   444 raft_consensus.cc:3060] T 3c79b33073604287949695b0b8fbb1e9 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.747350   639 tablet_bootstrap.cc:492] T 3c79b33073604287949695b0b8fbb1e9 P 762bba1a64cd462d95c59db0cb9e0dfa: No bootstrap required, opened a new log
I20260709 12:21:35.748133   639 ts_tablet_manager.cc:1403] T 3c79b33073604287949695b0b8fbb1e9 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:21:35.751222   639 raft_consensus.cc:359] T 3c79b33073604287949695b0b8fbb1e9 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.751986   639 raft_consensus.cc:385] T 3c79b33073604287949695b0b8fbb1e9 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.752271   639 raft_consensus.cc:740] T 3c79b33073604287949695b0b8fbb1e9 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.752971   639 consensus_queue.cc:260] T 3c79b33073604287949695b0b8fbb1e9 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.755524   639 ts_tablet_manager.cc:1434] T 3c79b33073604287949695b0b8fbb1e9 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:35.755729   444 raft_consensus.cc:2468] T 3c79b33073604287949695b0b8fbb1e9 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 1.
I20260709 12:21:35.756633   639 tablet_bootstrap.cc:492] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa: Bootstrap starting.
I20260709 12:21:35.747236   643 leader_election.cc:290] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.758132   484 leader_election.cc:304] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:35.759932   643 raft_consensus.cc:2804] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:35.760739   643 raft_consensus.cc:697] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [term 1 LEADER]: Becoming Leader. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Running, Role: LEADER
I20260709 12:21:35.761636   643 consensus_queue.cc:237] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.763671   639 tablet_bootstrap.cc:654] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.766453   642 raft_consensus.cc:493] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.767099   642 raft_consensus.cc:515] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.770852   642 leader_election.cc:290] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.771026   638 raft_consensus.cc:493] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.771715   638 raft_consensus.cc:515] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.772158   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535662e2eba6427ea18a3975a6d4afc8" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722" is_pre_election: true
I20260709 12:21:35.772850   444 raft_consensus.cc:2468] T 535662e2eba6427ea18a3975a6d4afc8 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 0.
I20260709 12:21:35.773885   642 raft_consensus.cc:493] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.774443   642 raft_consensus.cc:515] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.775421   593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e587d48344e3425aaef56b90052b5f58" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" is_pre_election: true
I20260709 12:21:35.775998   639 tablet_bootstrap.cc:492] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa: No bootstrap required, opened a new log
I20260709 12:21:35.776106   593 raft_consensus.cc:2468] T e587d48344e3425aaef56b90052b5f58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 0.
I20260709 12:21:35.776656   639 ts_tablet_manager.cc:1403] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:21:35.777707   410 leader_election.cc:304] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 
I20260709 12:21:35.778801   660 raft_consensus.cc:2804] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:35.779175   660 raft_consensus.cc:493] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.779498   660 raft_consensus.cc:3060] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.779704   484 leader_election.cc:304] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:35.779747   639 raft_consensus.cc:359] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.780732   639 raft_consensus.cc:385] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.781039   639 raft_consensus.cc:740] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.782042   639 consensus_queue.cc:260] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.782328   519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e587d48344e3425aaef56b90052b5f58" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
I20260709 12:21:35.782990   519 raft_consensus.cc:2468] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 0.
I20260709 12:21:35.784412   639 ts_tablet_manager.cc:1434] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:21:35.785995   638 leader_election.cc:290] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.785075   340 catalog_manager.cc:5697] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:35.788676   660 raft_consensus.cc:515] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.791616   661 raft_consensus.cc:515] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.792182   593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e587d48344e3425aaef56b90052b5f58" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:35.792714   660 leader_election.cc:290] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 election: Requested vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.794358   683 raft_consensus.cc:2804] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:35.795077   591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535662e2eba6427ea18a3975a6d4afc8" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" is_pre_election: true
I20260709 12:21:35.795485   683 raft_consensus.cc:493] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.795104   593 raft_consensus.cc:3060] T e587d48344e3425aaef56b90052b5f58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.795943   683 raft_consensus.cc:3060] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.796311   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c79b33073604287949695b0b8fbb1e9" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:35.796916   661 leader_election.cc:290] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 election: Requested vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.797688   591 raft_consensus.cc:2468] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 0.
I20260709 12:21:35.798234   590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243589bc22d4e0092f4ab9d355c2710" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:35.798890   590 raft_consensus.cc:3060] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.796942   592 raft_consensus.cc:3060] T 3c79b33073604287949695b0b8fbb1e9 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.801657   519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243589bc22d4e0092f4ab9d355c2710" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
I20260709 12:21:35.802402   519 raft_consensus.cc:2468] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 0.
I20260709 12:21:35.806707   590 raft_consensus.cc:2468] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 1.
I20260709 12:21:35.807835   683 raft_consensus.cc:515] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.808044   410 leader_election.cc:304] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 
I20260709 12:21:35.808853   558 leader_election.cc:304] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762bba1a64cd462d95c59db0cb9e0dfa, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:35.809088   661 raft_consensus.cc:2804] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:35.809830   650 raft_consensus.cc:2764] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:21:35.809945   661 raft_consensus.cc:697] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Becoming Leader. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:35.808036   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243589bc22d4e0092f4ab9d355c2710" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722" is_pre_election: true
I20260709 12:21:35.810559   683 leader_election.cc:290] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.810848   661 consensus_queue.cc:237] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.811478   590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535662e2eba6427ea18a3975a6d4afc8" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:35.811744   593 raft_consensus.cc:2468] T e587d48344e3425aaef56b90052b5f58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 1.
I20260709 12:21:35.812134   590 raft_consensus.cc:3060] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.817348   410 leader_election.cc:304] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 
I20260709 12:21:35.818240   660 raft_consensus.cc:2804] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:35.818562   519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e587d48344e3425aaef56b90052b5f58" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:35.818750   660 raft_consensus.cc:697] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Becoming Leader. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:35.819247   519 raft_consensus.cc:3060] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.819859   660 consensus_queue.cc:237] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.820470   590 raft_consensus.cc:2468] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 1.
I20260709 12:21:35.821686   340 catalog_manager.cc:5697] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2). New cstate: current_term: 1 leader_uuid: "8502a45e5e924eb2b44da52c43bc936f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:35.826673   592 raft_consensus.cc:2468] T 3c79b33073604287949695b0b8fbb1e9 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 1.
I20260709 12:21:35.827327   519 raft_consensus.cc:2468] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 1.
I20260709 12:21:35.827980   518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243589bc22d4e0092f4ab9d355c2710" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:35.828629   518 raft_consensus.cc:3060] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.831487   642 leader_election.cc:290] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.832602   485 leader_election.cc:304] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762bba1a64cd462d95c59db0cb9e0dfa, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:35.833725   642 raft_consensus.cc:2804] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:35.834674   642 raft_consensus.cc:697] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 1 LEADER]: Becoming Leader. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Running, Role: LEADER
I20260709 12:21:35.835175   443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535662e2eba6427ea18a3975a6d4afc8" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:35.835567   642 consensus_queue.cc:237] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.836526   443 raft_consensus.cc:3060] T 535662e2eba6427ea18a3975a6d4afc8 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.837450   590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055394fe3a5e4910875669f67e8d8858" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" is_pre_election: true
I20260709 12:21:35.837481   518 raft_consensus.cc:2468] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 1.
I20260709 12:21:35.838270   590 raft_consensus.cc:2468] T 055394fe3a5e4910875669f67e8d8858 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 0.
I20260709 12:21:35.839418   485 leader_election.cc:304] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762bba1a64cd462d95c59db0cb9e0dfa, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:35.840447   683 raft_consensus.cc:2804] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:35.840828   683 raft_consensus.cc:493] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.839290   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055394fe3a5e4910875669f67e8d8858" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722" is_pre_election: true
I20260709 12:21:35.841244   683 raft_consensus.cc:3060] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.841578   444 raft_consensus.cc:2468] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 0.
I20260709 12:21:35.848877   683 raft_consensus.cc:515] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.850647   341 catalog_manager.cc:5697] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:35.852057   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055394fe3a5e4910875669f67e8d8858" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:35.852734   444 raft_consensus.cc:3060] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.852711   443 raft_consensus.cc:2468] T 535662e2eba6427ea18a3975a6d4afc8 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 1.
I20260709 12:21:35.852588   341 catalog_manager.cc:5697] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:35.855747   683 leader_election.cc:290] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.856971   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055394fe3a5e4910875669f67e8d8858" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:35.857622   592 raft_consensus.cc:3060] T 055394fe3a5e4910875669f67e8d8858 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.860610   444 raft_consensus.cc:2468] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 1.
I20260709 12:21:35.862649   484 leader_election.cc:304] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:35.863611   683 raft_consensus.cc:2804] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:35.864104   683 raft_consensus.cc:697] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 1 LEADER]: Becoming Leader. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Running, Role: LEADER
I20260709 12:21:35.865183   592 raft_consensus.cc:2468] T 055394fe3a5e4910875669f67e8d8858 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 1.
I20260709 12:21:35.864916   683 consensus_queue.cc:237] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.873248   341 catalog_manager.cc:5697] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2). New cstate: current_term: 1 leader_uuid: "8502a45e5e924eb2b44da52c43bc936f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:35.874627   341 catalog_manager.cc:5697] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2). New cstate: current_term: 1 leader_uuid: "8502a45e5e924eb2b44da52c43bc936f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:35.960433   683 raft_consensus.cc:493] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.960981   683 raft_consensus.cc:515] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.962744   683 leader_election.cc:290] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.963773   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085b00a79a914b93a414b8a4bad3575c" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722" is_pre_election: true
I20260709 12:21:35.963773   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085b00a79a914b93a414b8a4bad3575c" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" is_pre_election: true
I20260709 12:21:35.964421   444 raft_consensus.cc:2468] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 0.
I20260709 12:21:35.964519   592 raft_consensus.cc:2468] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 0.
I20260709 12:21:35.965476   484 leader_election.cc:304] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:35.966240   683 raft_consensus.cc:2804] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:35.966573   683 raft_consensus.cc:493] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.966802   683 raft_consensus.cc:3060] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.971937   683 raft_consensus.cc:515] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.973664   683 leader_election.cc:290] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:35.974551   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085b00a79a914b93a414b8a4bad3575c" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:35.974797   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085b00a79a914b93a414b8a4bad3575c" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:35.975106   444 raft_consensus.cc:3060] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.975409   592 raft_consensus.cc:3060] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.980314   444 raft_consensus.cc:2468] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 1.
I20260709 12:21:35.980386   592 raft_consensus.cc:2468] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 1.
I20260709 12:21:35.981539   484 leader_election.cc:304] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:35.982236   683 raft_consensus.cc:2804] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:35.982698   683 raft_consensus.cc:697] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 1 LEADER]: Becoming Leader. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Running, Role: LEADER
I20260709 12:21:35.983397   683 consensus_queue.cc:237] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:35.990250   341 catalog_manager.cc:5697] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2). New cstate: current_term: 1 leader_uuid: "8502a45e5e924eb2b44da52c43bc936f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:36.017441   661 consensus_queue.cc:1048] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:36.030133   661 consensus_queue.cc:1048] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:36.061638   660 consensus_queue.cc:1048] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:36.072580   660 consensus_queue.cc:1048] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:36.154265   518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "085b00a79a914b93a414b8a4bad3575c"
dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
mode: GRACEFUL
new_leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
 from {username='slave'} at 127.0.0.1:39872
I20260709 12:21:36.154896   518 raft_consensus.cc:606] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 1 LEADER]: Received request to transfer leadership to TS 017c9ead48d24bd0bb44234d9a4d0722
I20260709 12:21:36.166577   518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "055394fe3a5e4910875669f67e8d8858"
dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
mode: GRACEFUL
new_leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
 from {username='slave'} at 127.0.0.1:39872
I20260709 12:21:36.167230   518 raft_consensus.cc:606] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 1 LEADER]: Received request to transfer leadership to TS 017c9ead48d24bd0bb44234d9a4d0722
I20260709 12:21:36.182483   444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a243589bc22d4e0092f4ab9d355c2710"
dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
mode: GRACEFUL
new_leader_uuid: "8502a45e5e924eb2b44da52c43bc936f"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:21:36.182978   444 raft_consensus.cc:606] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Received request to transfer leadership to TS 8502a45e5e924eb2b44da52c43bc936f
I20260709 12:21:36.188310   444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dffa183e76384d118cb4e27fd83e1934"
dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
mode: GRACEFUL
new_leader_uuid: "8502a45e5e924eb2b44da52c43bc936f"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:21:36.188912   444 raft_consensus.cc:606] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Received request to transfer leadership to TS 8502a45e5e924eb2b44da52c43bc936f
I20260709 12:21:36.194087   444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e587d48344e3425aaef56b90052b5f58"
dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
mode: GRACEFUL
new_leader_uuid: "8502a45e5e924eb2b44da52c43bc936f"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:21:36.194576   444 raft_consensus.cc:606] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Received request to transfer leadership to TS 8502a45e5e924eb2b44da52c43bc936f
I20260709 12:21:36.200507   660 consensus_queue.cc:1048] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:36.209556   519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "535662e2eba6427ea18a3975a6d4afc8"
dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
mode: GRACEFUL
new_leader_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
 from {username='slave'} at 127.0.0.1:39872
I20260709 12:21:36.210214   519 raft_consensus.cc:606] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 1 LEADER]: Received request to transfer leadership to TS 762bba1a64cd462d95c59db0cb9e0dfa
I20260709 12:21:36.211632   683 consensus_queue.cc:1048] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:36.213666   660 consensus_queue.cc:1048] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:36.225526   661 raft_consensus.cc:993] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722: : Instructing follower 8502a45e5e924eb2b44da52c43bc936f to start an election
I20260709 12:21:36.226045   661 raft_consensus.cc:1081] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Signalling peer 8502a45e5e924eb2b44da52c43bc936f to start an election
I20260709 12:21:36.228436   518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dffa183e76384d118cb4e27fd83e1934"
dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
 from {username='slave'} at 127.0.0.1:39856
I20260709 12:21:36.229068   518 raft_consensus.cc:493] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:36.229380   518 raft_consensus.cc:3060] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.231298   642 consensus_queue.cc:1048] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:36.233188   661 consensus_queue.cc:1048] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:36.237061   518 raft_consensus.cc:515] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:36.238155   519 raft_consensus.cc:1240] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Rejecting Update request from peer 017c9ead48d24bd0bb44234d9a4d0722 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:36.253304   695 consensus_queue.cc:1059] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:36.253499   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffa183e76384d118cb4e27fd83e1934" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:36.254257   444 raft_consensus.cc:3055] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:36.254602   444 raft_consensus.cc:740] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:36.253876   660 consensus_queue.cc:1048] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:36.256162   518 leader_election.cc:290] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 2 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:36.256969   590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffa183e76384d118cb4e27fd83e1934" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:36.257325   444 consensus_queue.cc:260] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:36.262612   444 raft_consensus.cc:3060] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:36.263136   660 consensus_queue.cc:1175] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:21:36.269232   660 raft_consensus.cc:993] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722: : Instructing follower 8502a45e5e924eb2b44da52c43bc936f to start an election
I20260709 12:21:36.269729   660 raft_consensus.cc:1081] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Signalling peer 8502a45e5e924eb2b44da52c43bc936f to start an election
I20260709 12:21:36.269695   444 raft_consensus.cc:2468] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 2.
W20260709 12:21:36.271667   695 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:21:36.272011   484 leader_election.cc:304] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 762bba1a64cd462d95c59db0cb9e0dfa
I20260709 12:21:36.272953   642 raft_consensus.cc:2804] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:36.273449   642 raft_consensus.cc:697] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [term 2 LEADER]: Becoming Leader. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Running, Role: LEADER
I20260709 12:21:36.273716   518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e587d48344e3425aaef56b90052b5f58"
dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
 from {username='slave'} at 127.0.0.1:39856
I20260709 12:21:36.274434   518 raft_consensus.cc:493] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:36.274945   518 raft_consensus.cc:3060] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.277429   683 consensus_queue.cc:1048] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:36.274343   642 consensus_queue.cc:237] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:36.282575   518 raft_consensus.cc:515] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:36.284271   695 consensus_queue.cc:1048] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:36.286008   518 leader_election.cc:290] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 2 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:36.287556   683 raft_consensus.cc:993] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f: : Instructing follower 762bba1a64cd462d95c59db0cb9e0dfa to start an election
I20260709 12:21:36.287364   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e587d48344e3425aaef56b90052b5f58" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:36.288105   643 raft_consensus.cc:1081] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 1 LEADER]: Signalling peer 762bba1a64cd462d95c59db0cb9e0dfa to start an election
I20260709 12:21:36.288245   444 raft_consensus.cc:3055] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:36.288712   444 raft_consensus.cc:740] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:36.290061   592 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "535662e2eba6427ea18a3975a6d4afc8"
dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
 from {username='slave'} at 127.0.0.1:58032
I20260709 12:21:36.290695   592 raft_consensus.cc:493] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:36.291086   592 raft_consensus.cc:3060] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.291586   444 consensus_queue.cc:260] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:36.292063   593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e587d48344e3425aaef56b90052b5f58" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:36.292680   593 raft_consensus.cc:3060] T e587d48344e3425aaef56b90052b5f58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.292999   444 raft_consensus.cc:3060] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.294287   643 consensus_queue.cc:1048] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:36.298702   592 raft_consensus.cc:515] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:36.300918   592 leader_election.cc:290] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 2 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:36.301546   442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535662e2eba6427ea18a3975a6d4afc8" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:36.305461   695 consensus_queue.cc:1048] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:21:36.304567   341 catalog_manager.cc:5697] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f reported cstate change: term changed from 1 to 2, leader changed from 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1) to 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2). New cstate: current_term: 2 leader_uuid: "8502a45e5e924eb2b44da52c43bc936f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:36.315079   519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535662e2eba6427ea18a3975a6d4afc8" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:36.324488   519 raft_consensus.cc:3055] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:36.324841   519 raft_consensus.cc:740] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Running, Role: LEADER
I20260709 12:21:36.325676   519 consensus_queue.cc:260] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:36.326815   519 raft_consensus.cc:3060] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.300359   593 raft_consensus.cc:2468] T e587d48344e3425aaef56b90052b5f58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 2.
I20260709 12:21:36.330607   485 leader_election.cc:304] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762bba1a64cd462d95c59db0cb9e0dfa, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:36.301595   444 raft_consensus.cc:2468] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 2.
I20260709 12:21:36.331429   642 raft_consensus.cc:2804] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:36.331992   642 raft_consensus.cc:697] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [term 2 LEADER]: Becoming Leader. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Running, Role: LEADER
I20260709 12:21:36.332842   642 consensus_queue.cc:237] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:36.337548   519 raft_consensus.cc:2468] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 2.
I20260709 12:21:36.338765   643 consensus_queue.cc:1048] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:36.341813   558 leader_election.cc:304] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762bba1a64cd462d95c59db0cb9e0dfa, 8502a45e5e924eb2b44da52c43bc936f; no voters: 017c9ead48d24bd0bb44234d9a4d0722
I20260709 12:21:36.342662   650 raft_consensus.cc:2804] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:36.343159   650 raft_consensus.cc:697] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 LEADER]: Becoming Leader. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Running, Role: LEADER
I20260709 12:21:36.343967   650 consensus_queue.cc:237] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:36.344833   660 raft_consensus.cc:993] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722: : Instructing follower 8502a45e5e924eb2b44da52c43bc936f to start an election
I20260709 12:21:36.345422   660 raft_consensus.cc:1081] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Signalling peer 8502a45e5e924eb2b44da52c43bc936f to start an election
I20260709 12:21:36.352238   518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a243589bc22d4e0092f4ab9d355c2710"
dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
 from {username='slave'} at 127.0.0.1:39856
I20260709 12:21:36.352838   341 catalog_manager.cc:5697] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f reported cstate change: term changed from 1 to 2, leader changed from 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1) to 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2). New cstate: current_term: 2 leader_uuid: "8502a45e5e924eb2b44da52c43bc936f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:36.352882   518 raft_consensus.cc:493] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:36.356189   518 raft_consensus.cc:3060] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.365224   518 raft_consensus.cc:515] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:36.367136   683 consensus_queue.cc:1048] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:36.367800   518 leader_election.cc:290] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 2 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:36.368589   593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243589bc22d4e0092f4ab9d355c2710" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:36.369223   593 raft_consensus.cc:3060] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.371706   443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243589bc22d4e0092f4ab9d355c2710" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:36.372439   443 raft_consensus.cc:3055] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:36.372781   443 raft_consensus.cc:740] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:36.373926   443 consensus_queue.cc:260] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:36.375464   443 raft_consensus.cc:3060] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.379410   593 raft_consensus.cc:2468] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 2.
I20260709 12:21:36.380853   485 leader_election.cc:304] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762bba1a64cd462d95c59db0cb9e0dfa, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:36.381855   683 raft_consensus.cc:2804] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:36.382351   683 raft_consensus.cc:697] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 2 LEADER]: Becoming Leader. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Running, Role: LEADER
I20260709 12:21:36.383174   683 consensus_queue.cc:237] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:36.383358   340 catalog_manager.cc:5697] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa reported cstate change: term changed from 1 to 2, leader changed from 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2) to 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3). New cstate: current_term: 2 leader_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:36.391243   443 raft_consensus.cc:2468] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 2.
I20260709 12:21:36.391954   683 raft_consensus.cc:993] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f: : Instructing follower 017c9ead48d24bd0bb44234d9a4d0722 to start an election
I20260709 12:21:36.392459   683 raft_consensus.cc:1081] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 1 LEADER]: Signalling peer 017c9ead48d24bd0bb44234d9a4d0722 to start an election
I20260709 12:21:36.394196   443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "055394fe3a5e4910875669f67e8d8858"
dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
 from {username='slave'} at 127.0.0.1:50584
I20260709 12:21:36.394800   443 raft_consensus.cc:493] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:36.394304   342 catalog_manager.cc:5697] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f reported cstate change: term changed from 1 to 2, leader changed from 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1) to 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2). New cstate: current_term: 2 leader_uuid: "8502a45e5e924eb2b44da52c43bc936f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:36.395192   443 raft_consensus.cc:3060] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.403095   443 raft_consensus.cc:515] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:36.405318   443 leader_election.cc:290] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 2 election: Requested vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:36.406522   518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055394fe3a5e4910875669f67e8d8858" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:36.407148   518 raft_consensus.cc:3055] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:36.407420   518 raft_consensus.cc:740] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Running, Role: LEADER
I20260709 12:21:36.408044   518 consensus_queue.cc:260] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:36.409214   518 raft_consensus.cc:3060] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.409565   593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055394fe3a5e4910875669f67e8d8858" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:36.410259   593 raft_consensus.cc:3060] T 055394fe3a5e4910875669f67e8d8858 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.416096   518 raft_consensus.cc:2468] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 2.
I20260709 12:21:36.416153   593 raft_consensus.cc:2468] T 055394fe3a5e4910875669f67e8d8858 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 2.
I20260709 12:21:36.416939   643 consensus_queue.cc:1048] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:36.417506   409 leader_election.cc:304] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:36.418454   695 raft_consensus.cc:2804] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:36.418915   695 raft_consensus.cc:697] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 LEADER]: Becoming Leader. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:36.419668   695 consensus_queue.cc:237] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:36.430267   643 consensus_queue.cc:1048] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:36.431361   340 catalog_manager.cc:5697] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 reported cstate change: term changed from 1 to 2, leader changed from 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2) to 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:36.439129   643 raft_consensus.cc:993] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f: : Instructing follower 017c9ead48d24bd0bb44234d9a4d0722 to start an election
I20260709 12:21:36.439592   683 raft_consensus.cc:1081] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 1 LEADER]: Signalling peer 017c9ead48d24bd0bb44234d9a4d0722 to start an election
I20260709 12:21:36.441354   443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "085b00a79a914b93a414b8a4bad3575c"
dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
 from {username='slave'} at 127.0.0.1:50584
I20260709 12:21:36.442018   443 raft_consensus.cc:493] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:36.442370   443 raft_consensus.cc:3060] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.448364   443 raft_consensus.cc:515] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:36.450139   443 leader_election.cc:290] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 2 election: Requested vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:36.451283   518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085b00a79a914b93a414b8a4bad3575c" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:36.451283   593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085b00a79a914b93a414b8a4bad3575c" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:36.452133   518 raft_consensus.cc:3055] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:36.452153   593 raft_consensus.cc:3060] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.452664   518 raft_consensus.cc:740] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Running, Role: LEADER
I20260709 12:21:36.453568   518 consensus_queue.cc:260] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:36.454921   518 raft_consensus.cc:3060] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.460181   593 raft_consensus.cc:2468] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 2.
I20260709 12:21:36.461541   410 leader_election.cc:304] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 
I20260709 12:21:36.462481   695 raft_consensus.cc:2804] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:36.462738   518 raft_consensus.cc:2468] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 2.
I20260709 12:21:36.463187   695 raft_consensus.cc:697] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 LEADER]: Becoming Leader. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:36.464159   695 consensus_queue.cc:237] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:36.471449   340 catalog_manager.cc:5697] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 reported cstate change: term changed from 1 to 2, leader changed from 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2) to 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:36.725004   593 raft_consensus.cc:1275] T e587d48344e3425aaef56b90052b5f58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Refusing update from remote peer 8502a45e5e924eb2b44da52c43bc936f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:36.726305   683 consensus_queue.cc:1048] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:36.733263   443 raft_consensus.cc:3060] T 535662e2eba6427ea18a3975a6d4afc8 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.735059   444 raft_consensus.cc:1275] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Refusing update from remote peer 8502a45e5e924eb2b44da52c43bc936f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:36.736943   643 consensus_queue.cc:1048] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:36.741518   443 raft_consensus.cc:1275] T 535662e2eba6427ea18a3975a6d4afc8 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Refusing update from remote peer 762bba1a64cd462d95c59db0cb9e0dfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:36.743666   709 consensus_queue.cc:1048] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:36.747757   593 raft_consensus.cc:3060] T dffa183e76384d118cb4e27fd83e1934 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.748296   443 raft_consensus.cc:1275] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Refusing update from remote peer 8502a45e5e924eb2b44da52c43bc936f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:36.749912   643 consensus_queue.cc:1048] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:36.756208   593 raft_consensus.cc:1275] T dffa183e76384d118cb4e27fd83e1934 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Refusing update from remote peer 8502a45e5e924eb2b44da52c43bc936f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:36.758600   518 raft_consensus.cc:1275] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Refusing update from remote peer 762bba1a64cd462d95c59db0cb9e0dfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:36.758913   643 consensus_queue.cc:1048] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:36.766829   713 consensus_queue.cc:1048] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:36.862041   518 raft_consensus.cc:1275] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Refusing update from remote peer 017c9ead48d24bd0bb44234d9a4d0722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:36.863503   695 consensus_queue.cc:1048] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:36.872404   593 raft_consensus.cc:1275] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Refusing update from remote peer 017c9ead48d24bd0bb44234d9a4d0722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:36.874120   660 consensus_queue.cc:1048] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:36.906338   443 raft_consensus.cc:1275] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Refusing update from remote peer 8502a45e5e924eb2b44da52c43bc936f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:36.907662   642 consensus_queue.cc:1048] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:36.917076   593 raft_consensus.cc:1275] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Refusing update from remote peer 8502a45e5e924eb2b44da52c43bc936f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:36.917719   518 raft_consensus.cc:1275] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Refusing update from remote peer 017c9ead48d24bd0bb44234d9a4d0722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:36.918620   683 consensus_queue.cc:1048] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:36.919523   695 consensus_queue.cc:1048] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:36.930490   593 raft_consensus.cc:1275] T 055394fe3a5e4910875669f67e8d8858 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Refusing update from remote peer 017c9ead48d24bd0bb44234d9a4d0722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:36.934597   695 consensus_queue.cc:1048] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:39.256500   341 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42608:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:21:39.259407   341 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:21:39.314389   430 tablet_service.cc:1511] Processing CreateTablet for tablet 079f8a0314d1405c9b9baf09afbe5d71 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:39.316375   430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079f8a0314d1405c9b9baf09afbe5d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.316720   504 tablet_service.cc:1511] Processing CreateTablet for tablet 079f8a0314d1405c9b9baf09afbe5d71 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:39.317941   575 tablet_service.cc:1511] Processing CreateTablet for tablet 079f8a0314d1405c9b9baf09afbe5d71 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:39.319796   575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079f8a0314d1405c9b9baf09afbe5d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.320636   433 tablet_service.cc:1511] Processing CreateTablet for tablet c115e7328403473a922fbc56401ba287 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:39.322175   433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c115e7328403473a922fbc56401ba287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.326397   583 tablet_service.cc:1511] Processing CreateTablet for tablet c115e7328403473a922fbc56401ba287 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:39.327294   503 tablet_service.cc:1511] Processing CreateTablet for tablet c115e7328403473a922fbc56401ba287 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:39.327955   583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c115e7328403473a922fbc56401ba287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.329759   508 tablet_service.cc:1511] Processing CreateTablet for tablet b1a8ac187f184e98a21e0ac41628ca58 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:39.335870   431 tablet_service.cc:1511] Processing CreateTablet for tablet b1a8ac187f184e98a21e0ac41628ca58 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:39.337226   579 tablet_service.cc:1511] Processing CreateTablet for tablet b1a8ac187f184e98a21e0ac41628ca58 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:39.339255   579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a8ac187f184e98a21e0ac41628ca58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.340827   505 tablet_service.cc:1511] Processing CreateTablet for tablet 12ac6d65a2cc486dab9d55cf339c9dd7 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:39.341842   507 tablet_service.cc:1511] Processing CreateTablet for tablet aa7f78b9a838497983700855b943c465 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:39.343466   504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079f8a0314d1405c9b9baf09afbe5d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.344409   505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ac6d65a2cc486dab9d55cf339c9dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.345103   503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c115e7328403473a922fbc56401ba287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.352097   432 tablet_service.cc:1511] Processing CreateTablet for tablet aa7f78b9a838497983700855b943c465 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:39.353945   507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7f78b9a838497983700855b943c465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.354790   429 tablet_service.cc:1511] Processing CreateTablet for tablet 06a50317ffb6474ea8c0342284306b5b (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:39.355808   577 tablet_service.cc:1511] Processing CreateTablet for tablet aa7f78b9a838497983700855b943c465 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:39.357196   428 tablet_service.cc:1511] Processing CreateTablet for tablet 580c7b8182f9471190387d62d32dea37 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:39.351995   434 tablet_service.cc:1511] Processing CreateTablet for tablet 12ac6d65a2cc486dab9d55cf339c9dd7 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:39.359774   427 tablet_service.cc:1511] Processing CreateTablet for tablet 3b77bfee2d5141a49a6ed739339d8be3 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:39.360766   508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a8ac187f184e98a21e0ac41628ca58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.362108   426 tablet_service.cc:1511] Processing CreateTablet for tablet a4bf29215fdc4cf8928a8522e11d4168 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:39.357215   577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7f78b9a838497983700855b943c465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.337581   431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a8ac187f184e98a21e0ac41628ca58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.366582   432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7f78b9a838497983700855b943c465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.367447   426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4bf29215fdc4cf8928a8522e11d4168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.369371   434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ac6d65a2cc486dab9d55cf339c9dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.370092   427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b77bfee2d5141a49a6ed739339d8be3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.374140   429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06a50317ffb6474ea8c0342284306b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.376036   509 tablet_service.cc:1511] Processing CreateTablet for tablet 06a50317ffb6474ea8c0342284306b5b (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:39.377611   509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06a50317ffb6474ea8c0342284306b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.377338   506 tablet_service.cc:1511] Processing CreateTablet for tablet 580c7b8182f9471190387d62d32dea37 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:39.378119   428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580c7b8182f9471190387d62d32dea37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.378882   506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580c7b8182f9471190387d62d32dea37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.376675   502 tablet_service.cc:1511] Processing CreateTablet for tablet 3b77bfee2d5141a49a6ed739339d8be3 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:39.383203   502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b77bfee2d5141a49a6ed739339d8be3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.387475   501 tablet_service.cc:1511] Processing CreateTablet for tablet a4bf29215fdc4cf8928a8522e11d4168 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:39.389014   501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4bf29215fdc4cf8928a8522e11d4168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.396946   582 tablet_service.cc:1511] Processing CreateTablet for tablet 12ac6d65a2cc486dab9d55cf339c9dd7 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:39.398901   582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ac6d65a2cc486dab9d55cf339c9dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.433135   576 tablet_service.cc:1511] Processing CreateTablet for tablet 06a50317ffb6474ea8c0342284306b5b (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:39.434728   576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06a50317ffb6474ea8c0342284306b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.436690   728 tablet_bootstrap.cc:492] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa: Bootstrap starting.
I20260709 12:21:39.439060   580 tablet_service.cc:1511] Processing CreateTablet for tablet 3b77bfee2d5141a49a6ed739339d8be3 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:39.440541   580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b77bfee2d5141a49a6ed739339d8be3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.443027   581 tablet_service.cc:1511] Processing CreateTablet for tablet a4bf29215fdc4cf8928a8522e11d4168 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:39.444466   581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4bf29215fdc4cf8928a8522e11d4168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.447120   578 tablet_service.cc:1511] Processing CreateTablet for tablet 580c7b8182f9471190387d62d32dea37 (DEFAULT_TABLE table=soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:39.448578   578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580c7b8182f9471190387d62d32dea37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.491863   728 tablet_bootstrap.cc:654] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.552057   729 tablet_bootstrap.cc:492] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f: Bootstrap starting.
I20260709 12:21:39.552057   730 tablet_bootstrap.cc:492] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722: Bootstrap starting.
I20260709 12:21:39.560812   729 tablet_bootstrap.cc:654] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.565303   730 tablet_bootstrap.cc:654] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.566515   728 tablet_bootstrap.cc:492] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa: No bootstrap required, opened a new log
I20260709 12:21:39.567111   728 ts_tablet_manager.cc:1403] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent bootstrapping tablet: real 0.131s	user 0.012s	sys 0.006s
I20260709 12:21:39.568972   729 tablet_bootstrap.cc:492] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f: No bootstrap required, opened a new log
I20260709 12:21:39.569726   729 ts_tablet_manager.cc:1403] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 12:21:39.572269   730 tablet_bootstrap.cc:492] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722: No bootstrap required, opened a new log
I20260709 12:21:39.572067   728 raft_consensus.cc:359] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.573002   730 ts_tablet_manager.cc:1403] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.010s
I20260709 12:21:39.573239   728 raft_consensus.cc:385] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.573228   729 raft_consensus.cc:359] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.574046   728 raft_consensus.cc:740] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.574280   729 raft_consensus.cc:385] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.574633   729 raft_consensus.cc:740] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.574991   728 consensus_queue.cc:260] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.575353   729 consensus_queue.cc:260] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.576337   730 raft_consensus.cc:359] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.577116   730 raft_consensus.cc:385] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.577416   730 raft_consensus.cc:740] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.577907   729 ts_tablet_manager.cc:1434] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
W20260709 12:21:39.578117   390 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:39.578389   730 consensus_queue.cc:260] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.580158   728 ts_tablet_manager.cc:1434] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 12:21:39.581262   730 ts_tablet_manager.cc:1434] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:39.581284   728 tablet_bootstrap.cc:492] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa: Bootstrap starting.
I20260709 12:21:39.581465   729 tablet_bootstrap.cc:492] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f: Bootstrap starting.
I20260709 12:21:39.589319   728 tablet_bootstrap.cc:654] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.589480   729 tablet_bootstrap.cc:654] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.591959   731 raft_consensus.cc:493] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.594831   731 raft_consensus.cc:515] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.594058   730 tablet_bootstrap.cc:492] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722: Bootstrap starting.
I20260709 12:21:39.592089   715 raft_consensus.cc:493] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.598392   443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7f78b9a838497983700855b943c465" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722" is_pre_election: true
W20260709 12:21:39.600680   484 leader_election.cc:343] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.598489   715 raft_consensus.cc:515] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.604596   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079f8a0314d1405c9b9baf09afbe5d71" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" is_pre_election: true
W20260709 12:21:39.606527   410 leader_election.cc:343] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.608338   518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079f8a0314d1405c9b9baf09afbe5d71" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
I20260709 12:21:39.609825   730 tablet_bootstrap.cc:654] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:39.610445   409 leader_election.cc:343] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.610945   409 leader_election.cc:304] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722; no voters: 762bba1a64cd462d95c59db0cb9e0dfa, 8502a45e5e924eb2b44da52c43bc936f
I20260709 12:21:39.611742   715 leader_election.cc:290] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:39.613991   729 tablet_bootstrap.cc:492] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f: No bootstrap required, opened a new log
I20260709 12:21:39.614725   717 raft_consensus.cc:2749] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:39.617030   730 tablet_bootstrap.cc:492] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722: No bootstrap required, opened a new log
I20260709 12:21:39.616331   728 tablet_bootstrap.cc:492] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa: No bootstrap required, opened a new log
I20260709 12:21:39.617026   729 ts_tablet_manager.cc:1403] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.012s
I20260709 12:21:39.616562   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7f78b9a838497983700855b943c465" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" is_pre_election: true
I20260709 12:21:39.617830   730 ts_tablet_manager.cc:1403] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.003s
I20260709 12:21:39.618001   728 ts_tablet_manager.cc:1403] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent bootstrapping tablet: real 0.037s	user 0.004s	sys 0.014s
I20260709 12:21:39.615491   731 leader_election.cc:290] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
W20260709 12:21:39.621114   485 leader_election.cc:343] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.621217   730 raft_consensus.cc:359] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.621649   485 leader_election.cc:304] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8502a45e5e924eb2b44da52c43bc936f; no voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa
I20260709 12:21:39.622087   730 raft_consensus.cc:385] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.622433   730 raft_consensus.cc:740] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.622870   731 raft_consensus.cc:2749] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:39.622504   729 raft_consensus.cc:359] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.622587   728 raft_consensus.cc:359] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.623219   730 consensus_queue.cc:260] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.623648   729 raft_consensus.cc:385] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.623740   728 raft_consensus.cc:385] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.624080   729 raft_consensus.cc:740] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.624185   728 raft_consensus.cc:740] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.625021   729 consensus_queue.cc:260] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.625265   728 consensus_queue.cc:260] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.627578   728 ts_tablet_manager.cc:1434] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:21:39.628300   729 ts_tablet_manager.cc:1434] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:21:39.629297   729 tablet_bootstrap.cc:492] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f: Bootstrap starting.
I20260709 12:21:39.629740   728 tablet_bootstrap.cc:492] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa: Bootstrap starting.
I20260709 12:21:39.626057   730 ts_tablet_manager.cc:1434] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:39.636003   730 tablet_bootstrap.cc:492] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722: Bootstrap starting.
I20260709 12:21:39.636229   728 tablet_bootstrap.cc:654] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.636238   729 tablet_bootstrap.cc:654] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.645427   730 tablet_bootstrap.cc:654] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.656038   728 tablet_bootstrap.cc:492] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa: No bootstrap required, opened a new log
I20260709 12:21:39.656682   728 ts_tablet_manager.cc:1403] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.000s
I20260709 12:21:39.659662   728 raft_consensus.cc:359] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.660395   728 raft_consensus.cc:385] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.660692   728 raft_consensus.cc:740] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.660904   730 tablet_bootstrap.cc:492] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722: No bootstrap required, opened a new log
I20260709 12:21:39.661610   730 ts_tablet_manager.cc:1403] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.004s
I20260709 12:21:39.661531   728 consensus_queue.cc:260] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.663161   729 tablet_bootstrap.cc:492] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f: No bootstrap required, opened a new log
I20260709 12:21:39.663733   729 ts_tablet_manager.cc:1403] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.008s
I20260709 12:21:39.664188   728 ts_tablet_manager.cc:1434] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:21:39.665014   730 raft_consensus.cc:359] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.665477   728 tablet_bootstrap.cc:492] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa: Bootstrap starting.
I20260709 12:21:39.665813   730 raft_consensus.cc:385] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.666136   730 raft_consensus.cc:740] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.666851   729 raft_consensus.cc:359] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.666990   730 consensus_queue.cc:260] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.667681   729 raft_consensus.cc:385] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.668033   729 raft_consensus.cc:740] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.668762   729 consensus_queue.cc:260] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.671537   729 ts_tablet_manager.cc:1434] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:21:39.672552   729 tablet_bootstrap.cc:492] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f: Bootstrap starting.
I20260709 12:21:39.674032   728 tablet_bootstrap.cc:654] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.676934   730 ts_tablet_manager.cc:1434] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:21:39.680469   730 tablet_bootstrap.cc:492] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722: Bootstrap starting.
I20260709 12:21:39.688333   730 tablet_bootstrap.cc:654] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.691991   709 raft_consensus.cc:493] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.692703   709 raft_consensus.cc:515] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.695024   709 leader_election.cc:290] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:39.696884   518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079f8a0314d1405c9b9baf09afbe5d71" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
I20260709 12:21:39.698870   443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079f8a0314d1405c9b9baf09afbe5d71" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722" is_pre_election: true
I20260709 12:21:39.699549   443 raft_consensus.cc:2468] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 0.
I20260709 12:21:39.702939   728 tablet_bootstrap.cc:492] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa: No bootstrap required, opened a new log
I20260709 12:21:39.703650   728 ts_tablet_manager.cc:1403] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.020s
I20260709 12:21:39.704303   558 leader_election.cc:304] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 
W20260709 12:21:39.706161   558 leader_election.cc:343] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.707764   729 tablet_bootstrap.cc:654] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.709880   709 raft_consensus.cc:2804] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.710421   709 raft_consensus.cc:493] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.710780   709 raft_consensus.cc:3060] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.711843   728 raft_consensus.cc:359] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.712466   728 raft_consensus.cc:385] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.712986   728 raft_consensus.cc:740] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.714028   728 consensus_queue.cc:260] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.721405   709 raft_consensus.cc:515] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.723647   709 leader_election.cc:290] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:39.725306   443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079f8a0314d1405c9b9baf09afbe5d71" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:39.725343   518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079f8a0314d1405c9b9baf09afbe5d71" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:39.726413   443 raft_consensus.cc:3060] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:39.727411   558 leader_election.cc:343] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.730085   730 tablet_bootstrap.cc:492] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722: No bootstrap required, opened a new log
I20260709 12:21:39.730191   728 ts_tablet_manager.cc:1434] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.012s
I20260709 12:21:39.730803   730 ts_tablet_manager.cc:1403] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.027s
I20260709 12:21:39.731707   728 tablet_bootstrap.cc:492] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa: Bootstrap starting.
I20260709 12:21:39.734079   730 raft_consensus.cc:359] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.734860   730 raft_consensus.cc:385] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.735162   730 raft_consensus.cc:740] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.735417   443 raft_consensus.cc:2468] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 1.
I20260709 12:21:39.736043   730 consensus_queue.cc:260] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.739542   730 ts_tablet_manager.cc:1434] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:21:39.740680   730 tablet_bootstrap.cc:492] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722: Bootstrap starting.
I20260709 12:21:39.741360   728 tablet_bootstrap.cc:654] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.744545   558 leader_election.cc:304] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 8502a45e5e924eb2b44da52c43bc936f
I20260709 12:21:39.745507   709 raft_consensus.cc:2804] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.746025   709 raft_consensus.cc:697] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Becoming Leader. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Running, Role: LEADER
I20260709 12:21:39.746914   709 consensus_queue.cc:237] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.748296   730 tablet_bootstrap.cc:654] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.770718   729 tablet_bootstrap.cc:492] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f: No bootstrap required, opened a new log
I20260709 12:21:39.771420   729 ts_tablet_manager.cc:1403] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.005s
I20260709 12:21:39.772027   744 raft_consensus.cc:493] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.772990   744 raft_consensus.cc:515] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.774734   728 tablet_bootstrap.cc:492] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa: No bootstrap required, opened a new log
I20260709 12:21:39.775337   728 ts_tablet_manager.cc:1403] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.021s
I20260709 12:21:39.775363   744 leader_election.cc:290] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:39.775888   729 raft_consensus.cc:359] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.775775   342 catalog_manager.cc:5697] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3). New cstate: current_term: 1 leader_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:39.776660   729 raft_consensus.cc:385] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.777001   729 raft_consensus.cc:740] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.777743   729 consensus_queue.cc:260] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.777870   728 raft_consensus.cc:359] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.778795   728 raft_consensus.cc:385] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.779109   728 raft_consensus.cc:740] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.780218   729 ts_tablet_manager.cc:1434] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.006s
I20260709 12:21:39.779853   728 consensus_queue.cc:260] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.781018   518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c115e7328403473a922fbc56401ba287" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
I20260709 12:21:39.781445   729 tablet_bootstrap.cc:492] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f: Bootstrap starting.
I20260709 12:21:39.781723   518 raft_consensus.cc:2468] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 0.
I20260709 12:21:39.783385   558 leader_election.cc:304] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762bba1a64cd462d95c59db0cb9e0dfa, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:39.784788   744 raft_consensus.cc:2804] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.785156   744 raft_consensus.cc:493] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.785482   744 raft_consensus.cc:3060] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.791069   746 raft_consensus.cc:493] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.791677   746 raft_consensus.cc:515] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.793604   744 raft_consensus.cc:515] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.794531   746 leader_election.cc:290] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:39.795718   744 leader_election.cc:290] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:39.796280   518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7f78b9a838497983700855b943c465" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
I20260709 12:21:39.796523   730 tablet_bootstrap.cc:492] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722: No bootstrap required, opened a new log
I20260709 12:21:39.797000   518 raft_consensus.cc:2468] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 0.
I20260709 12:21:39.797165   730 ts_tablet_manager.cc:1403] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.004s
I20260709 12:21:39.797456   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7f78b9a838497983700855b943c465" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722" is_pre_election: true
I20260709 12:21:39.798152   444 raft_consensus.cc:2468] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 0.
I20260709 12:21:39.798626   443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c115e7328403473a922fbc56401ba287" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722" is_pre_election: true
I20260709 12:21:39.797475   728 ts_tablet_manager.cc:1434] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:21:39.800284   728 tablet_bootstrap.cc:492] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa: Bootstrap starting.
I20260709 12:21:39.800550   730 raft_consensus.cc:359] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.801330   730 raft_consensus.cc:385] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.801620   730 raft_consensus.cc:740] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.802734   558 leader_election.cc:304] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 
I20260709 12:21:39.802556   730 consensus_queue.cc:260] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.803953   519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c115e7328403473a922fbc56401ba287" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:39.804217   744 raft_consensus.cc:2804] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.804639   519 raft_consensus.cc:3060] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.805222   730 ts_tablet_manager.cc:1434] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:39.805467   729 tablet_bootstrap.cc:654] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.806345   730 tablet_bootstrap.cc:492] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722: Bootstrap starting.
W20260709 12:21:39.803835   558 leader_election.cc:343] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.804658   744 raft_consensus.cc:493] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.810221   744 raft_consensus.cc:3060] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.812870   728 tablet_bootstrap.cc:654] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.812992   730 tablet_bootstrap.cc:654] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.814241   443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c115e7328403473a922fbc56401ba287" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
W20260709 12:21:39.815919   558 leader_election.cc:343] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.821472   729 tablet_bootstrap.cc:492] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f: No bootstrap required, opened a new log
I20260709 12:21:39.822172   729 ts_tablet_manager.cc:1403] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.000s
I20260709 12:21:39.830049   729 raft_consensus.cc:359] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.830956   729 raft_consensus.cc:385] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.831274   729 raft_consensus.cc:740] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.831794   746 raft_consensus.cc:493] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.832470   746 raft_consensus.cc:515] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.828080   744 raft_consensus.cc:515] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.835009   730 tablet_bootstrap.cc:492] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722: No bootstrap required, opened a new log
I20260709 12:21:39.835836   730 ts_tablet_manager.cc:1403] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.013s
I20260709 12:21:39.835078   744 leader_election.cc:290] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:39.835161   746 leader_election.cc:290] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:39.835371   729 consensus_queue.cc:260] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.837226   443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06a50317ffb6474ea8c0342284306b5b" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722" is_pre_election: true
I20260709 12:21:39.838054   443 raft_consensus.cc:2468] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 0.
I20260709 12:21:39.839093   730 raft_consensus.cc:359] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.839941   730 raft_consensus.cc:385] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.840250   730 raft_consensus.cc:740] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.840376   729 ts_tablet_manager.cc:1434] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:21:39.840782   443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7f78b9a838497983700855b943c465" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:39.841127   730 consensus_queue.cc:260] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.841506   443 raft_consensus.cc:3060] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.841516   729 tablet_bootstrap.cc:492] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f: Bootstrap starting.
I20260709 12:21:39.844434   518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7f78b9a838497983700855b943c465" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:39.852074   443 raft_consensus.cc:2468] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 1.
I20260709 12:21:39.847057   519 raft_consensus.cc:2468] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 1.
I20260709 12:21:39.843557   730 ts_tablet_manager.cc:1434] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:21:39.859656   730 tablet_bootstrap.cc:492] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722: Bootstrap starting.
I20260709 12:21:39.844995   517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06a50317ffb6474ea8c0342284306b5b" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
I20260709 12:21:39.858062   518 raft_consensus.cc:3060] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.862066   517 raft_consensus.cc:2468] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 0.
I20260709 12:21:39.848526   728 tablet_bootstrap.cc:492] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa: No bootstrap required, opened a new log
I20260709 12:21:39.866161   729 tablet_bootstrap.cc:654] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.866497   728 ts_tablet_manager.cc:1403] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent bootstrapping tablet: real 0.066s	user 0.028s	sys 0.010s
I20260709 12:21:39.843027   558 leader_election.cc:304] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 
I20260709 12:21:39.868734   746 raft_consensus.cc:2804] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.869114   746 raft_consensus.cc:493] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.869437   746 raft_consensus.cc:3060] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.870139   728 raft_consensus.cc:359] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.870927   728 raft_consensus.cc:385] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.871245   728 raft_consensus.cc:740] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.872066   728 consensus_queue.cc:260] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.874557   728 ts_tablet_manager.cc:1434] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:21:39.875653   728 tablet_bootstrap.cc:492] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa: Bootstrap starting.
I20260709 12:21:39.877344   518 raft_consensus.cc:2468] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 1.
I20260709 12:21:39.882393   728 tablet_bootstrap.cc:654] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.877628   746 raft_consensus.cc:515] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.887504   558 leader_election.cc:304] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762bba1a64cd462d95c59db0cb9e0dfa, 8502a45e5e924eb2b44da52c43bc936f; no voters: 017c9ead48d24bd0bb44234d9a4d0722
I20260709 12:21:39.888680   744 raft_consensus.cc:2804] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.889225   744 raft_consensus.cc:697] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Becoming Leader. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Running, Role: LEADER
I20260709 12:21:39.889823   558 leader_election.cc:304] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 
I20260709 12:21:39.890115   744 consensus_queue.cc:237] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.890836   709 raft_consensus.cc:2804] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.892089   746 leader_election.cc:290] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:39.894245   443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06a50317ffb6474ea8c0342284306b5b" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:39.895017   443 raft_consensus.cc:3060] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.898118   717 raft_consensus.cc:493] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.898763   717 raft_consensus.cc:515] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.901139   717 leader_election.cc:290] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:39.901463   730 tablet_bootstrap.cc:654] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.898164   517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06a50317ffb6474ea8c0342284306b5b" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:39.903184   517 raft_consensus.cc:3060] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.904790   443 raft_consensus.cc:2468] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 1.
I20260709 12:21:39.906313   709 raft_consensus.cc:697] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Becoming Leader. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Running, Role: LEADER
I20260709 12:21:39.906608   558 leader_election.cc:304] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 
I20260709 12:21:39.907416   709 consensus_queue.cc:237] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.909076   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a8ac187f184e98a21e0ac41628ca58" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" is_pre_election: true
W20260709 12:21:39.910987   410 leader_election.cc:343] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.912668   519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a8ac187f184e98a21e0ac41628ca58" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
I20260709 12:21:39.912698   754 raft_consensus.cc:2804] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:21:39.914687   409 leader_election.cc:343] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.917444   409 leader_election.cc:304] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722; no voters: 762bba1a64cd462d95c59db0cb9e0dfa, 8502a45e5e924eb2b44da52c43bc936f
I20260709 12:21:39.919335   717 raft_consensus.cc:2749] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:39.920461   754 raft_consensus.cc:697] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Becoming Leader. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Running, Role: LEADER
I20260709 12:21:39.916745   728 tablet_bootstrap.cc:492] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa: No bootstrap required, opened a new log
I20260709 12:21:39.921569   517 raft_consensus.cc:2468] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 1.
I20260709 12:21:39.923316   728 ts_tablet_manager.cc:1403] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.008s
I20260709 12:21:39.921540   754 consensus_queue.cc:237] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.928239   730 tablet_bootstrap.cc:492] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722: No bootstrap required, opened a new log
I20260709 12:21:39.929913   730 ts_tablet_manager.cc:1403] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent bootstrapping tablet: real 0.071s	user 0.021s	sys 0.008s
I20260709 12:21:39.931916   728 raft_consensus.cc:359] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.932793   728 raft_consensus.cc:385] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.933089   728 raft_consensus.cc:740] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.933019   730 raft_consensus.cc:359] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.933951   730 raft_consensus.cc:385] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.933413   340 catalog_manager.cc:5697] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3). New cstate: current_term: 1 leader_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:39.934221   728 consensus_queue.cc:260] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.935339   340 catalog_manager.cc:5697] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3). New cstate: current_term: 1 leader_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:39.936997   728 ts_tablet_manager.cc:1434] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:21:39.934268   730 raft_consensus.cc:740] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.938527   717 raft_consensus.cc:493] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.938397   730 consensus_queue.cc:260] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.939047   729 tablet_bootstrap.cc:492] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f: No bootstrap required, opened a new log
I20260709 12:21:39.939054   717 raft_consensus.cc:515] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.939817   729 ts_tablet_manager.cc:1403] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f: Time spent bootstrapping tablet: real 0.099s	user 0.022s	sys 0.026s
I20260709 12:21:39.943167   729 raft_consensus.cc:359] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.943498   517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bf29215fdc4cf8928a8522e11d4168" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
I20260709 12:21:39.944125   729 raft_consensus.cc:385] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.944360   517 raft_consensus.cc:2468] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 0.
I20260709 12:21:39.944571   729 raft_consensus.cc:740] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.943841   730 ts_tablet_manager.cc:1434] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:21:39.945519   729 consensus_queue.cc:260] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.946419   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bf29215fdc4cf8928a8522e11d4168" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" is_pre_election: true
I20260709 12:21:39.948343   729 ts_tablet_manager.cc:1434] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260709 12:21:39.948969   410 leader_election.cc:343] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.949919   409 leader_election.cc:304] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 762bba1a64cd462d95c59db0cb9e0dfa
I20260709 12:21:39.950762   715 raft_consensus.cc:2804] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.950852   729 tablet_bootstrap.cc:492] T 079f8a0314d1405c9b9baf09afbe5d71 P 8502a45e5e924eb2b44da52c43bc936f: Bootstrap starting.
I20260709 12:21:39.951097   717 leader_election.cc:290] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:39.939085   728 tablet_bootstrap.cc:492] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa: Bootstrap starting.
I20260709 12:21:39.954244   715 raft_consensus.cc:493] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.954707   715 raft_consensus.cc:3060] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.959091   728 tablet_bootstrap.cc:654] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.959091   729 tablet_bootstrap.cc:654] T 079f8a0314d1405c9b9baf09afbe5d71 P 8502a45e5e924eb2b44da52c43bc936f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.965440   715 raft_consensus.cc:515] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.969373   517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bf29215fdc4cf8928a8522e11d4168" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:39.970185   517 raft_consensus.cc:3060] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.974503   730 tablet_bootstrap.cc:492] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722: Bootstrap starting.
I20260709 12:21:39.977305   728 tablet_bootstrap.cc:492] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa: No bootstrap required, opened a new log
I20260709 12:21:39.981856   728 ts_tablet_manager.cc:1403] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.008s
I20260709 12:21:39.984277   517 raft_consensus.cc:2468] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 1.
I20260709 12:21:39.978933   729 tablet_bootstrap.cc:492] T 079f8a0314d1405c9b9baf09afbe5d71 P 8502a45e5e924eb2b44da52c43bc936f: No bootstrap required, opened a new log
I20260709 12:21:39.984798   728 raft_consensus.cc:359] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.985491   729 ts_tablet_manager.cc:1403] T 079f8a0314d1405c9b9baf09afbe5d71 P 8502a45e5e924eb2b44da52c43bc936f: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.008s
I20260709 12:21:39.985554   728 raft_consensus.cc:385] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.990046   728 raft_consensus.cc:740] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.990844   728 consensus_queue.cc:260] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.993186   730 tablet_bootstrap.cc:654] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.993929   717 raft_consensus.cc:493] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.984813   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bf29215fdc4cf8928a8522e11d4168" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:39.981014   715 leader_election.cc:290] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 election: Requested vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:39.994118   728 ts_tablet_manager.cc:1434] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:21:39.995940   717 raft_consensus.cc:515] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.994107   729 raft_consensus.cc:359] T 079f8a0314d1405c9b9baf09afbe5d71 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:39.988737   409 leader_election.cc:304] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:39.996802   729 raft_consensus.cc:385] T 079f8a0314d1405c9b9baf09afbe5d71 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.995208   592 raft_consensus.cc:3060] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.996438   728 tablet_bootstrap.cc:492] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa: Bootstrap starting.
I20260709 12:21:39.999778   593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580c7b8182f9471190387d62d32dea37" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" is_pre_election: true
I20260709 12:21:40.002408   517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580c7b8182f9471190387d62d32dea37" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
I20260709 12:21:40.003240   517 raft_consensus.cc:2468] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 0.
I20260709 12:21:40.004335   728 tablet_bootstrap.cc:654] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:40.004767   410 leader_election.cc:343] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.005990   715 raft_consensus.cc:2804] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.006428   717 leader_election.cc:290] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:40.006141   409 leader_election.cc:304] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 762bba1a64cd462d95c59db0cb9e0dfa
I20260709 12:21:40.008751   717 raft_consensus.cc:2804] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:40.009163   717 raft_consensus.cc:493] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.009539   717 raft_consensus.cc:3060] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.010785   730 tablet_bootstrap.cc:492] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722: No bootstrap required, opened a new log
I20260709 12:21:40.011348   730 ts_tablet_manager.cc:1403] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.019s
I20260709 12:21:39.997139   729 raft_consensus.cc:740] T 079f8a0314d1405c9b9baf09afbe5d71 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.993873   340 catalog_manager.cc:5697] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3). New cstate: current_term: 1 leader_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:40.007154   592 raft_consensus.cc:2468] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 1.
I20260709 12:21:40.028993   729 consensus_queue.cc:260] T 079f8a0314d1405c9b9baf09afbe5d71 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.040216   717 raft_consensus.cc:515] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.049854   517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580c7b8182f9471190387d62d32dea37" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:40.050544   517 raft_consensus.cc:3060] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.057749   754 raft_consensus.cc:493] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.058563   754 raft_consensus.cc:515] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.059423   517 raft_consensus.cc:2468] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 1.
I20260709 12:21:40.063102   730 raft_consensus.cc:359] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.063979   730 raft_consensus.cc:385] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.064297   730 raft_consensus.cc:740] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.064693   409 leader_election.cc:304] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:40.065380   729 ts_tablet_manager.cc:1434] T 079f8a0314d1405c9b9baf09afbe5d71 P 8502a45e5e924eb2b44da52c43bc936f: Time spent starting tablet: real 0.075s	user 0.012s	sys 0.000s
I20260709 12:21:40.065037   730 consensus_queue.cc:260] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.066545   729 tablet_bootstrap.cc:492] T b1a8ac187f184e98a21e0ac41628ca58 P 8502a45e5e924eb2b44da52c43bc936f: Bootstrap starting.
I20260709 12:21:40.069341   754 leader_election.cc:290] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:40.070530   709 raft_consensus.cc:493] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.071033   709 raft_consensus.cc:515] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.075978   709 leader_election.cc:290] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:40.061797   715 raft_consensus.cc:697] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Becoming Leader. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:40.077450   715 consensus_queue.cc:237] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.080273   717 leader_election.cc:290] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 election: Requested vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:40.081024   762 raft_consensus.cc:2804] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.081574   762 raft_consensus.cc:697] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Becoming Leader. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:40.082442   762 consensus_queue.cc:237] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.083539   518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b77bfee2d5141a49a6ed739339d8be3" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
W20260709 12:21:40.085527   558 leader_election.cc:343] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.091289   517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac6d65a2cc486dab9d55cf339c9dd7" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
W20260709 12:21:40.074528   410 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.191.3:46421, user_credentials={real_user=slave}} blocked reactor thread for 52250us
I20260709 12:21:40.098158   443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac6d65a2cc486dab9d55cf339c9dd7" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722" is_pre_election: true
I20260709 12:21:40.098922   443 raft_consensus.cc:2468] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 0.
I20260709 12:21:40.099920   593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580c7b8182f9471190387d62d32dea37" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:40.102005   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b77bfee2d5141a49a6ed739339d8be3" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722" is_pre_election: true
I20260709 12:21:40.103617   558 leader_election.cc:304] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 
I20260709 12:21:40.104624   709 raft_consensus.cc:2804] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:40.105034   709 raft_consensus.cc:493] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.105394   709 raft_consensus.cc:3060] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.108549   728 tablet_bootstrap.cc:492] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa: No bootstrap required, opened a new log
I20260709 12:21:40.109221   728 ts_tablet_manager.cc:1403] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent bootstrapping tablet: real 0.113s	user 0.041s	sys 0.033s
I20260709 12:21:40.112206   728 raft_consensus.cc:359] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.112982   728 raft_consensus.cc:385] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.113286   728 raft_consensus.cc:740] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Initialized, Role: FOLLOWER
W20260709 12:21:40.114706   558 leader_election.cc:343] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.115376   558 leader_election.cc:304] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f
I20260709 12:21:40.116237   754 raft_consensus.cc:2749] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.092883   517 raft_consensus.cc:2468] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 0.
I20260709 12:21:40.119830   728 consensus_queue.cc:260] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
W20260709 12:21:40.123512   410 leader_election.cc:343] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.133102   728 ts_tablet_manager.cc:1434] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:21:40.138052   730 ts_tablet_manager.cc:1434] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent starting tablet: real 0.126s	user 0.030s	sys 0.020s
I20260709 12:21:40.139192   730 tablet_bootstrap.cc:492] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722: Bootstrap starting.
I20260709 12:21:40.140276   729 tablet_bootstrap.cc:654] T b1a8ac187f184e98a21e0ac41628ca58 P 8502a45e5e924eb2b44da52c43bc936f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.148804   730 tablet_bootstrap.cc:654] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.133350   709 raft_consensus.cc:515] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.152367   709 leader_election.cc:290] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:40.154232   342 catalog_manager.cc:5697] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.155026   517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac6d65a2cc486dab9d55cf339c9dd7" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:40.155642   517 raft_consensus.cc:3060] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.158177   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac6d65a2cc486dab9d55cf339c9dd7" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:40.158849   444 raft_consensus.cc:3060] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.166486   709 consensus_queue.cc:1048] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:40.170461   444 raft_consensus.cc:2468] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 1.
I20260709 12:21:40.171023   517 raft_consensus.cc:2468] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 1.
I20260709 12:21:40.172382   558 leader_election.cc:304] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762bba1a64cd462d95c59db0cb9e0dfa, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:40.173084   709 raft_consensus.cc:2804] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.173595   709 raft_consensus.cc:697] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Becoming Leader. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Running, Role: LEADER
I20260709 12:21:40.174154   730 tablet_bootstrap.cc:492] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722: No bootstrap required, opened a new log
I20260709 12:21:40.174798   730 ts_tablet_manager.cc:1403] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.004s
I20260709 12:21:40.178120   730 raft_consensus.cc:359] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.178908   730 raft_consensus.cc:385] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.179185   730 raft_consensus.cc:740] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.179124   342 catalog_manager.cc:5697] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.180337   730 consensus_queue.cc:260] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.174562   709 consensus_queue.cc:237] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.182747   730 ts_tablet_manager.cc:1434] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
W20260709 12:21:40.197788   484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:42101, user_credentials={real_user=slave}} blocked reactor thread for 45581.1us
I20260709 12:21:40.198428   729 tablet_bootstrap.cc:492] T b1a8ac187f184e98a21e0ac41628ca58 P 8502a45e5e924eb2b44da52c43bc936f: No bootstrap required, opened a new log
I20260709 12:21:40.198969   729 ts_tablet_manager.cc:1403] T b1a8ac187f184e98a21e0ac41628ca58 P 8502a45e5e924eb2b44da52c43bc936f: Time spent bootstrapping tablet: real 0.133s	user 0.017s	sys 0.030s
I20260709 12:21:40.201871   729 raft_consensus.cc:359] T b1a8ac187f184e98a21e0ac41628ca58 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.203614   729 raft_consensus.cc:385] T b1a8ac187f184e98a21e0ac41628ca58 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.203949   729 raft_consensus.cc:740] T b1a8ac187f184e98a21e0ac41628ca58 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.204830   729 consensus_queue.cc:260] T b1a8ac187f184e98a21e0ac41628ca58 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.207050   729 ts_tablet_manager.cc:1434] T b1a8ac187f184e98a21e0ac41628ca58 P 8502a45e5e924eb2b44da52c43bc936f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:21:40.206223   342 catalog_manager.cc:5697] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3). New cstate: current_term: 1 leader_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:40.212167   729 tablet_bootstrap.cc:492] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f: Bootstrap starting.
I20260709 12:21:40.217306   517 raft_consensus.cc:3060] T 079f8a0314d1405c9b9baf09afbe5d71 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.217921   709 raft_consensus.cc:493] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.219659   709 raft_consensus.cc:515] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.220160   729 tablet_bootstrap.cc:654] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.237877   709 leader_election.cc:290] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:40.238925   518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580c7b8182f9471190387d62d32dea37" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
I20260709 12:21:40.239146   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580c7b8182f9471190387d62d32dea37" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722" is_pre_election: true
I20260709 12:21:40.239867   518 raft_consensus.cc:2393] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 762bba1a64cd462d95c59db0cb9e0dfa in current term 1: Already voted for candidate 017c9ead48d24bd0bb44234d9a4d0722 in this term.
I20260709 12:21:40.241298   558 leader_election.cc:304] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f
I20260709 12:21:40.242053   709 raft_consensus.cc:3060] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.242743   754 consensus_queue.cc:1048] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.243306   729 tablet_bootstrap.cc:492] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f: No bootstrap required, opened a new log
I20260709 12:21:40.243769   729 ts_tablet_manager.cc:1403] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.016s
I20260709 12:21:40.246645   729 raft_consensus.cc:359] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.247345   729 raft_consensus.cc:385] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.247617   729 raft_consensus.cc:740] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.248457   729 consensus_queue.cc:260] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.250522   729 ts_tablet_manager.cc:1434] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:21:40.250808   709 raft_consensus.cc:2749] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.289146   709 raft_consensus.cc:493] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.289625   709 raft_consensus.cc:515] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.291378   709 leader_election.cc:290] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:40.292145   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a8ac187f184e98a21e0ac41628ca58" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722" is_pre_election: true
I20260709 12:21:40.292340   517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a8ac187f184e98a21e0ac41628ca58" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
I20260709 12:21:40.292763   444 raft_consensus.cc:2468] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 0.
I20260709 12:21:40.292959   517 raft_consensus.cc:2468] T b1a8ac187f184e98a21e0ac41628ca58 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 0.
I20260709 12:21:40.293728   558 leader_election.cc:304] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 
I20260709 12:21:40.294505   709 raft_consensus.cc:2804] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:40.294778   709 raft_consensus.cc:493] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.295053   709 raft_consensus.cc:3060] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.300469   709 raft_consensus.cc:515] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.302205   709 leader_election.cc:290] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:40.303059   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a8ac187f184e98a21e0ac41628ca58" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:40.303360   517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a8ac187f184e98a21e0ac41628ca58" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:40.303646   444 raft_consensus.cc:3060] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.304083   517 raft_consensus.cc:3060] T b1a8ac187f184e98a21e0ac41628ca58 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.309113   444 raft_consensus.cc:2468] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 1.
I20260709 12:21:40.309298   517 raft_consensus.cc:2468] T b1a8ac187f184e98a21e0ac41628ca58 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 1.
I20260709 12:21:40.310675   558 leader_election.cc:304] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 
I20260709 12:21:40.311379   709 raft_consensus.cc:2804] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.311803   709 raft_consensus.cc:697] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Becoming Leader. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Running, Role: LEADER
I20260709 12:21:40.312620   709 consensus_queue.cc:237] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.313735   754 consensus_queue.cc:1048] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:40.322233   444 raft_consensus.cc:3060] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.321964   340 catalog_manager.cc:5697] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3). New cstate: current_term: 1 leader_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:40.334468   746 consensus_queue.cc:1048] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.452574   769 raft_consensus.cc:493] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.453006   769 raft_consensus.cc:515] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.454721   769 leader_election.cc:290] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:40.455497   517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b77bfee2d5141a49a6ed739339d8be3" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f" is_pre_election: true
I20260709 12:21:40.455667   593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b77bfee2d5141a49a6ed739339d8be3" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" is_pre_election: true
I20260709 12:21:40.456135   517 raft_consensus.cc:2468] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 0.
I20260709 12:21:40.456264   593 raft_consensus.cc:2468] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 0.
I20260709 12:21:40.457142   409 leader_election.cc:304] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:40.457918   769 raft_consensus.cc:2804] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:40.458200   769 raft_consensus.cc:493] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.458453   769 raft_consensus.cc:3060] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.463686   769 raft_consensus.cc:515] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.465250   769 leader_election.cc:290] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 election: Requested vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:40.466099   517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b77bfee2d5141a49a6ed739339d8be3" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:40.466286   593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b77bfee2d5141a49a6ed739339d8be3" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:40.466658   517 raft_consensus.cc:3060] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.466847   593 raft_consensus.cc:3060] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.472221   746 consensus_queue.cc:1048] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:40.474665   517 raft_consensus.cc:2468] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 1.
I20260709 12:21:40.476123   409 leader_election.cc:304] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:40.476840   769 raft_consensus.cc:2804] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.477381   769 raft_consensus.cc:697] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Becoming Leader. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:40.478220   593 raft_consensus.cc:2468] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 1.
I20260709 12:21:40.478286   769 consensus_queue.cc:237] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.489214   715 consensus_queue.cc:1048] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.495618   341 catalog_manager.cc:5697] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1). New cstate: current_term: 1 leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.497586   754 consensus_queue.cc:1048] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.499261   754 consensus_queue.cc:1048] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.521860   717 consensus_queue.cc:1048] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.532184   744 consensus_queue.cc:1048] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.648770   744 consensus_queue.cc:1048] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.653940   717 consensus_queue.cc:1048] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.670261   593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "079f8a0314d1405c9b9baf09afbe5d71"
dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
mode: GRACEFUL
new_leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
 from {username='slave'} at 127.0.0.1:59694
I20260709 12:21:40.670955   593 raft_consensus.cc:606] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Received request to transfer leadership to TS 017c9ead48d24bd0bb44234d9a4d0722
I20260709 12:21:40.673413   744 consensus_queue.cc:1048] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.678337   769 consensus_queue.cc:1048] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.681591   593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c115e7328403473a922fbc56401ba287"
dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
mode: GRACEFUL
new_leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
 from {username='slave'} at 127.0.0.1:59694
I20260709 12:21:40.682380   593 raft_consensus.cc:606] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Received request to transfer leadership to TS 017c9ead48d24bd0bb44234d9a4d0722
I20260709 12:21:40.693332   592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1a8ac187f184e98a21e0ac41628ca58"
dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
mode: GRACEFUL
new_leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
 from {username='slave'} at 127.0.0.1:59694
I20260709 12:21:40.694010   592 raft_consensus.cc:606] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Received request to transfer leadership to TS 017c9ead48d24bd0bb44234d9a4d0722
I20260709 12:21:40.700083   744 raft_consensus.cc:993] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa: : Instructing follower 017c9ead48d24bd0bb44234d9a4d0722 to start an election
I20260709 12:21:40.700533   746 raft_consensus.cc:1081] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Signalling peer 017c9ead48d24bd0bb44234d9a4d0722 to start an election
I20260709 12:21:40.701350   592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa7f78b9a838497983700855b943c465"
dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
mode: GRACEFUL
new_leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
 from {username='slave'} at 127.0.0.1:59694
I20260709 12:21:40.701952   592 raft_consensus.cc:606] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Received request to transfer leadership to TS 017c9ead48d24bd0bb44234d9a4d0722
I20260709 12:21:40.703436   444 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "079f8a0314d1405c9b9baf09afbe5d71"
dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
 from {username='slave'} at 127.0.0.1:50594
I20260709 12:21:40.704035   444 raft_consensus.cc:493] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:40.704351   444 raft_consensus.cc:3060] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:40.708060   592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12ac6d65a2cc486dab9d55cf339c9dd7"
dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
mode: GRACEFUL
new_leader_uuid: "8502a45e5e924eb2b44da52c43bc936f"
 from {username='slave'} at 127.0.0.1:59694
I20260709 12:21:40.708665   592 raft_consensus.cc:606] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Received request to transfer leadership to TS 8502a45e5e924eb2b44da52c43bc936f
I20260709 12:21:40.711062   444 raft_consensus.cc:515] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.713867   517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079f8a0314d1405c9b9baf09afbe5d71" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:40.714480   517 raft_consensus.cc:3060] T 079f8a0314d1405c9b9baf09afbe5d71 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:40.714455   444 leader_election.cc:290] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 2 election: Requested vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:40.714991   593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06a50317ffb6474ea8c0342284306b5b"
dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
mode: GRACEFUL
new_leader_uuid: "8502a45e5e924eb2b44da52c43bc936f"
 from {username='slave'} at 127.0.0.1:59694
I20260709 12:21:40.715022   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079f8a0314d1405c9b9baf09afbe5d71" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:40.715920   593 raft_consensus.cc:606] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Received request to transfer leadership to TS 8502a45e5e924eb2b44da52c43bc936f
I20260709 12:21:40.716002   592 raft_consensus.cc:3055] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:40.716506   592 raft_consensus.cc:740] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Running, Role: LEADER
I20260709 12:21:40.717370   592 consensus_queue.cc:260] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.718699   592 raft_consensus.cc:3060] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:40.721231   517 raft_consensus.cc:2468] T 079f8a0314d1405c9b9baf09afbe5d71 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 2.
I20260709 12:21:40.722116   444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "580c7b8182f9471190387d62d32dea37"
dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
mode: GRACEFUL
new_leader_uuid: "8502a45e5e924eb2b44da52c43bc936f"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:21:40.722465   409 leader_election.cc:304] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:40.722878   444 raft_consensus.cc:606] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Received request to transfer leadership to TS 8502a45e5e924eb2b44da52c43bc936f
I20260709 12:21:40.723135   769 raft_consensus.cc:2804] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:40.723654   769 raft_consensus.cc:697] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 LEADER]: Becoming Leader. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:40.724586   769 consensus_queue.cc:237] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.727792   592 raft_consensus.cc:2468] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 2.
I20260709 12:21:40.732551   342 catalog_manager.cc:5697] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 reported cstate change: term changed from 1 to 2, leader changed from 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3) to 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.732949   444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b77bfee2d5141a49a6ed739339d8be3"
dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
mode: GRACEFUL
new_leader_uuid: "8502a45e5e924eb2b44da52c43bc936f"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:21:40.733705   444 raft_consensus.cc:606] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Received request to transfer leadership to TS 8502a45e5e924eb2b44da52c43bc936f
I20260709 12:21:40.734907   746 consensus_queue.cc:1048] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.742028   443 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4bf29215fdc4cf8928a8522e11d4168"
dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
mode: GRACEFUL
new_leader_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:21:40.742766   443 raft_consensus.cc:606] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Received request to transfer leadership to TS 762bba1a64cd462d95c59db0cb9e0dfa
I20260709 12:21:40.748447   709 raft_consensus.cc:993] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa: : Instructing follower 017c9ead48d24bd0bb44234d9a4d0722 to start an election
I20260709 12:21:40.748946   709 raft_consensus.cc:1081] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Signalling peer 017c9ead48d24bd0bb44234d9a4d0722 to start an election
I20260709 12:21:40.751757   443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1a8ac187f184e98a21e0ac41628ca58"
dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
 from {username='slave'} at 127.0.0.1:50594
I20260709 12:21:40.752369   443 raft_consensus.cc:493] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:40.752717   443 raft_consensus.cc:3060] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:40.757557   709 consensus_queue.cc:1048] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:40.758589   443 raft_consensus.cc:515] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.759649   444 raft_consensus.cc:1240] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Rejecting Update request from peer 762bba1a64cd462d95c59db0cb9e0dfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:40.761463   519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a8ac187f184e98a21e0ac41628ca58" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:40.761560   443 leader_election.cc:290] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 2 election: Requested vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:40.761878   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a8ac187f184e98a21e0ac41628ca58" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:40.761725   709 consensus_queue.cc:1059] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:40.763114   592 raft_consensus.cc:3055] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:40.763494   592 raft_consensus.cc:740] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Running, Role: LEADER
I20260709 12:21:40.764213   592 consensus_queue.cc:260] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.765321   592 raft_consensus.cc:3060] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:40.771471   592 raft_consensus.cc:2468] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 2.
W20260709 12:21:40.772007   754 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:21:40.772526   410 leader_election.cc:304] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 8502a45e5e924eb2b44da52c43bc936f
I20260709 12:21:40.773396   769 raft_consensus.cc:2804] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:40.773926   769 raft_consensus.cc:697] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 LEADER]: Becoming Leader. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:40.774783   769 consensus_queue.cc:237] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.783946   342 catalog_manager.cc:5697] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 reported cstate change: term changed from 1 to 2, leader changed from 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3) to 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.878881   754 raft_consensus.cc:993] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa: : Instructing follower 017c9ead48d24bd0bb44234d9a4d0722 to start an election
I20260709 12:21:40.879385   746 raft_consensus.cc:1081] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Signalling peer 017c9ead48d24bd0bb44234d9a4d0722 to start an election
I20260709 12:21:40.880776   444 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c115e7328403473a922fbc56401ba287"
dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
 from {username='slave'} at 127.0.0.1:50594
I20260709 12:21:40.881349   444 raft_consensus.cc:493] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:40.881722   444 raft_consensus.cc:3060] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:40.887554   444 raft_consensus.cc:515] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.889001   444 leader_election.cc:290] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 2 election: Requested vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:40.890162   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c115e7328403473a922fbc56401ba287" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:40.890178   517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c115e7328403473a922fbc56401ba287" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:40.890834   592 raft_consensus.cc:3055] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:40.890977   517 raft_consensus.cc:3060] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:40.891137   592 raft_consensus.cc:740] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Running, Role: LEADER
I20260709 12:21:40.892118   592 consensus_queue.cc:260] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.893355   592 raft_consensus.cc:3060] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:40.898744   517 raft_consensus.cc:2468] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 2.
I20260709 12:21:40.900200   409 leader_election.cc:304] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:40.900542   592 raft_consensus.cc:2468] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 2.
I20260709 12:21:40.900981   769 raft_consensus.cc:2804] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:40.901521   769 raft_consensus.cc:697] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 LEADER]: Becoming Leader. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:40.902356   769 consensus_queue.cc:237] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.909019   342 catalog_manager.cc:5697] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722 reported cstate change: term changed from 1 to 2, leader changed from 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3) to 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.917061   764 raft_consensus.cc:993] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722: : Instructing follower 8502a45e5e924eb2b44da52c43bc936f to start an election
I20260709 12:21:40.917501   764 raft_consensus.cc:1081] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Signalling peer 8502a45e5e924eb2b44da52c43bc936f to start an election
I20260709 12:21:40.919126   517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "580c7b8182f9471190387d62d32dea37"
dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
 from {username='slave'} at 127.0.0.1:39856
I20260709 12:21:40.919606   517 raft_consensus.cc:493] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:40.919896   517 raft_consensus.cc:3060] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:40.926385   517 raft_consensus.cc:515] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.927987   517 leader_election.cc:290] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 2 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:40.928815   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580c7b8182f9471190387d62d32dea37" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:40.929107   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580c7b8182f9471190387d62d32dea37" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:40.929564   444 raft_consensus.cc:3055] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:40.929651   592 raft_consensus.cc:3060] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:40.929958   444 raft_consensus.cc:740] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:40.930770   444 consensus_queue.cc:260] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.931933   444 raft_consensus.cc:3060] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:40.936789   592 raft_consensus.cc:2468] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 2.
I20260709 12:21:40.938151   485 leader_election.cc:304] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762bba1a64cd462d95c59db0cb9e0dfa, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:40.938400   444 raft_consensus.cc:2468] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 2.
I20260709 12:21:40.938879   779 raft_consensus.cc:2804] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:40.939965   779 raft_consensus.cc:697] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [term 2 LEADER]: Becoming Leader. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Running, Role: LEADER
I20260709 12:21:40.940727   779 consensus_queue.cc:237] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:40.947551   342 catalog_manager.cc:5697] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f reported cstate change: term changed from 1 to 2, leader changed from 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1) to 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2). New cstate: current_term: 2 leader_uuid: "8502a45e5e924eb2b44da52c43bc936f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.978645   764 consensus_queue.cc:1048] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.988682   769 consensus_queue.cc:1048] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.998162   764 raft_consensus.cc:993] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722: : Instructing follower 8502a45e5e924eb2b44da52c43bc936f to start an election
I20260709 12:21:40.998695   769 raft_consensus.cc:1081] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Signalling peer 8502a45e5e924eb2b44da52c43bc936f to start an election
I20260709 12:21:41.000733   517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b77bfee2d5141a49a6ed739339d8be3"
dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
 from {username='slave'} at 127.0.0.1:39856
I20260709 12:21:41.001235   517 raft_consensus.cc:493] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:41.001511   517 raft_consensus.cc:3060] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:41.008364   517 raft_consensus.cc:515] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:41.010751   517 leader_election.cc:290] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 2 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:41.010932   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b77bfee2d5141a49a6ed739339d8be3" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:41.011360   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b77bfee2d5141a49a6ed739339d8be3" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:41.011713   444 raft_consensus.cc:3055] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:41.012017   592 raft_consensus.cc:3060] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:41.012029   444 raft_consensus.cc:740] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:41.013010   444 consensus_queue.cc:260] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:41.014271   444 raft_consensus.cc:3060] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:41.019217   592 raft_consensus.cc:2468] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 2.
I20260709 12:21:41.020397   485 leader_election.cc:304] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762bba1a64cd462d95c59db0cb9e0dfa, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:41.020637   444 raft_consensus.cc:2468] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 2.
I20260709 12:21:41.021095   779 raft_consensus.cc:2804] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:41.021552   779 raft_consensus.cc:697] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [term 2 LEADER]: Becoming Leader. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Running, Role: LEADER
I20260709 12:21:41.022245   779 consensus_queue.cc:237] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:41.029181   340 catalog_manager.cc:5697] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f reported cstate change: term changed from 1 to 2, leader changed from 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1) to 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2). New cstate: current_term: 2 leader_uuid: "8502a45e5e924eb2b44da52c43bc936f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.038365   754 raft_consensus.cc:993] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa: : Instructing follower 017c9ead48d24bd0bb44234d9a4d0722 to start an election
I20260709 12:21:41.038921   746 raft_consensus.cc:1081] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Signalling peer 017c9ead48d24bd0bb44234d9a4d0722 to start an election
I20260709 12:21:41.040737   444 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa7f78b9a838497983700855b943c465"
dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
 from {username='slave'} at 127.0.0.1:50594
I20260709 12:21:41.041208   444 raft_consensus.cc:493] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:41.041504   444 raft_consensus.cc:3060] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:41.046185   444 raft_consensus.cc:515] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:41.047605   444 leader_election.cc:290] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 2 election: Requested vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:41.048684   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7f78b9a838497983700855b943c465" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:41.048583   517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7f78b9a838497983700855b943c465" candidate_uuid: "017c9ead48d24bd0bb44234d9a4d0722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:41.049431   592 raft_consensus.cc:3055] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:41.049510   517 raft_consensus.cc:3060] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:41.049705   592 raft_consensus.cc:740] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Running, Role: LEADER
I20260709 12:21:41.050464   592 consensus_queue.cc:260] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:41.051338   592 raft_consensus.cc:3060] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:41.055119   517 raft_consensus.cc:2468] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 2.
I20260709 12:21:41.055990   592 raft_consensus.cc:2468] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017c9ead48d24bd0bb44234d9a4d0722 in term 2.
I20260709 12:21:41.056211   409 leader_election.cc:304] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:41.056970   769 raft_consensus.cc:2804] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:41.057456   769 raft_consensus.cc:697] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 LEADER]: Becoming Leader. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:41.058231   769 consensus_queue.cc:237] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:41.064479   342 catalog_manager.cc:5697] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 reported cstate change: term changed from 1 to 2, leader changed from 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3) to 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1). New cstate: current_term: 2 leader_uuid: "017c9ead48d24bd0bb44234d9a4d0722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.094883   754 raft_consensus.cc:993] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa: : Instructing follower 8502a45e5e924eb2b44da52c43bc936f to start an election
I20260709 12:21:41.095362   746 raft_consensus.cc:1081] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Signalling peer 8502a45e5e924eb2b44da52c43bc936f to start an election
I20260709 12:21:41.096858   517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06a50317ffb6474ea8c0342284306b5b"
dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
 from {username='slave'} at 127.0.0.1:39862
I20260709 12:21:41.097355   517 raft_consensus.cc:493] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:41.097656   517 raft_consensus.cc:3060] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:41.102485   517 raft_consensus.cc:515] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:41.103942   517 leader_election.cc:290] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 2 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:41.104683   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06a50317ffb6474ea8c0342284306b5b" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:41.104844   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06a50317ffb6474ea8c0342284306b5b" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:41.105324   444 raft_consensus.cc:3060] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:41.105398   592 raft_consensus.cc:3055] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:41.105794   592 raft_consensus.cc:740] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Running, Role: LEADER
I20260709 12:21:41.106400   592 consensus_queue.cc:260] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:41.107240   592 raft_consensus.cc:3060] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:41.109987   444 raft_consensus.cc:2468] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 2.
I20260709 12:21:41.111060   484 leader_election.cc:304] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:41.111521   592 raft_consensus.cc:2468] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 2.
I20260709 12:21:41.111706   779 raft_consensus.cc:2804] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:41.112192   779 raft_consensus.cc:697] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [term 2 LEADER]: Becoming Leader. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Running, Role: LEADER
I20260709 12:21:41.112920   779 consensus_queue.cc:237] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:41.119647   342 catalog_manager.cc:5697] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f reported cstate change: term changed from 1 to 2, leader changed from 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3) to 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2). New cstate: current_term: 2 leader_uuid: "8502a45e5e924eb2b44da52c43bc936f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.155486   517 raft_consensus.cc:3060] T b1a8ac187f184e98a21e0ac41628ca58 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:41.161188   517 raft_consensus.cc:1275] T b1a8ac187f184e98a21e0ac41628ca58 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Refusing update from remote peer 017c9ead48d24bd0bb44234d9a4d0722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.162393   769 consensus_queue.cc:1048] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:41.170055   592 raft_consensus.cc:1275] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Refusing update from remote peer 017c9ead48d24bd0bb44234d9a4d0722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.172163   762 consensus_queue.cc:1048] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:41.206879   754 raft_consensus.cc:993] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa: : Instructing follower 8502a45e5e924eb2b44da52c43bc936f to start an election
I20260709 12:21:41.207370   746 raft_consensus.cc:1081] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Signalling peer 8502a45e5e924eb2b44da52c43bc936f to start an election
I20260709 12:21:41.208879   517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12ac6d65a2cc486dab9d55cf339c9dd7"
dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
 from {username='slave'} at 127.0.0.1:39862
I20260709 12:21:41.209331   517 raft_consensus.cc:493] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:41.209607   517 raft_consensus.cc:3060] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:41.214336   517 raft_consensus.cc:515] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:41.215955   517 leader_election.cc:290] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 2 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3:46421)
I20260709 12:21:41.216746   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac6d65a2cc486dab9d55cf339c9dd7" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:41.216933   592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac6d65a2cc486dab9d55cf339c9dd7" candidate_uuid: "8502a45e5e924eb2b44da52c43bc936f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
I20260709 12:21:41.217304   444 raft_consensus.cc:3060] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:41.217516   592 raft_consensus.cc:3055] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:41.217859   592 raft_consensus.cc:740] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Running, Role: LEADER
I20260709 12:21:41.218506   592 consensus_queue.cc:260] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:41.219461   592 raft_consensus.cc:3060] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:41.222694   444 raft_consensus.cc:2468] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 2.
I20260709 12:21:41.223948   484 leader_election.cc:304] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:41.224772   779 raft_consensus.cc:2804] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:41.225023   592 raft_consensus.cc:2468] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8502a45e5e924eb2b44da52c43bc936f in term 2.
I20260709 12:21:41.225330   779 raft_consensus.cc:697] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [term 2 LEADER]: Becoming Leader. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Running, Role: LEADER
I20260709 12:21:41.226634   779 consensus_queue.cc:237] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:41.230991   762 raft_consensus.cc:993] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722: : Instructing follower 762bba1a64cd462d95c59db0cb9e0dfa to start an election
I20260709 12:21:41.231621   762 raft_consensus.cc:1081] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Signalling peer 762bba1a64cd462d95c59db0cb9e0dfa to start an election
I20260709 12:21:41.233390   592 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4bf29215fdc4cf8928a8522e11d4168"
dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
 from {username='slave'} at 127.0.0.1:58024
I20260709 12:21:41.233958   592 raft_consensus.cc:493] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:41.234318   592 raft_consensus.cc:3060] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:41.235874   342 catalog_manager.cc:5697] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f reported cstate change: term changed from 1 to 2, leader changed from 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3) to 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2). New cstate: current_term: 2 leader_uuid: "8502a45e5e924eb2b44da52c43bc936f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.239807   517 raft_consensus.cc:1275] T 079f8a0314d1405c9b9baf09afbe5d71 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Refusing update from remote peer 017c9ead48d24bd0bb44234d9a4d0722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.241078   769 consensus_queue.cc:1048] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:41.242457   592 raft_consensus.cc:515] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:41.246150   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bf29215fdc4cf8928a8522e11d4168" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:41.246740   444 raft_consensus.cc:3055] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:41.247017   444 raft_consensus.cc:740] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:41.247757   444 consensus_queue.cc:260] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:41.248819   444 raft_consensus.cc:3060] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:41.250785   593 raft_consensus.cc:1275] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Refusing update from remote peer 017c9ead48d24bd0bb44234d9a4d0722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.252025   592 leader_election.cc:290] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 2 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:41.252476   764 consensus_queue.cc:1048] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:41.253175   517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bf29215fdc4cf8928a8522e11d4168" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:41.253744   517 raft_consensus.cc:3060] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:41.260313   517 raft_consensus.cc:2468] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 2.
I20260709 12:21:41.261200   558 leader_election.cc:304] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762bba1a64cd462d95c59db0cb9e0dfa, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:41.261988   746 raft_consensus.cc:2804] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:41.262459   746 raft_consensus.cc:697] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 LEADER]: Becoming Leader. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Running, Role: LEADER
I20260709 12:21:41.263254   746 consensus_queue.cc:237] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:41.265722   444 raft_consensus.cc:2468] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 2.
I20260709 12:21:41.273170   339 catalog_manager.cc:5697] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa reported cstate change: term changed from 1 to 2, leader changed from 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1) to 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3). New cstate: current_term: 2 leader_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:41.324177   592 raft_consensus.cc:1275] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Refusing update from remote peer 8502a45e5e924eb2b44da52c43bc936f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.325279   779 consensus_queue.cc:1048] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:41.332602   517 raft_consensus.cc:1275] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Refusing update from remote peer 017c9ead48d24bd0bb44234d9a4d0722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.334484   717 consensus_queue.cc:1048] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:41.335556   444 raft_consensus.cc:1275] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Refusing update from remote peer 8502a45e5e924eb2b44da52c43bc936f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.337950   592 raft_consensus.cc:1275] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Refusing update from remote peer 017c9ead48d24bd0bb44234d9a4d0722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.338747   803 consensus_queue.cc:1048] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:41.339406   717 consensus_queue.cc:1048] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:41.424268   592 raft_consensus.cc:1275] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Refusing update from remote peer 8502a45e5e924eb2b44da52c43bc936f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.425438   803 consensus_queue.cc:1048] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:41.432883   444 raft_consensus.cc:1275] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Refusing update from remote peer 8502a45e5e924eb2b44da52c43bc936f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.435326   779 consensus_queue.cc:1048] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:41.486653   593 raft_consensus.cc:1275] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Refusing update from remote peer 017c9ead48d24bd0bb44234d9a4d0722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.487876   764 consensus_queue.cc:1048] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:41.499248   517 raft_consensus.cc:1275] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Refusing update from remote peer 017c9ead48d24bd0bb44234d9a4d0722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.500855   764 consensus_queue.cc:1048] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:41.596568   593 raft_consensus.cc:1275] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Refusing update from remote peer 8502a45e5e924eb2b44da52c43bc936f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.597967   779 consensus_queue.cc:1048] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:41.610126   444 raft_consensus.cc:1275] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Refusing update from remote peer 8502a45e5e924eb2b44da52c43bc936f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.612553   779 consensus_queue.cc:1048] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:41.698873   517 raft_consensus.cc:1275] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Refusing update from remote peer 762bba1a64cd462d95c59db0cb9e0dfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.700016   746 consensus_queue.cc:1048] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:41.708676   444 raft_consensus.cc:1275] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Refusing update from remote peer 762bba1a64cd462d95c59db0cb9e0dfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.710893   746 consensus_queue.cc:1048] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:41.759550   444 raft_consensus.cc:1275] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Refusing update from remote peer 8502a45e5e924eb2b44da52c43bc936f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.761121   799 consensus_queue.cc:1048] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:41.762283   593 raft_consensus.cc:1275] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Refusing update from remote peer 8502a45e5e924eb2b44da52c43bc936f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.763653   799 consensus_queue.cc:1048] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [LEADER]: Connected to new peer: Peer: permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:43.746519   339 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42608:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:21:43.765128   339 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42608:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:21:43.786500 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:43.878141   440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "085b00a79a914b93a414b8a4bad3575c"
dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
mode: GRACEFUL
new_leader_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
 from {username='slave'} at 127.0.0.1:58000
I20260709 12:21:43.878897   440 raft_consensus.cc:606] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 LEADER]: Received request to transfer leadership to TS 762bba1a64cd462d95c59db0cb9e0dfa
I20260709 12:21:43.894861   857 raft_consensus.cc:993] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722: : Instructing follower 762bba1a64cd462d95c59db0cb9e0dfa to start an election
I20260709 12:21:43.896848   818 raft_consensus.cc:1081] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 LEADER]: Signalling peer 762bba1a64cd462d95c59db0cb9e0dfa to start an election
I20260709 12:21:43.921093   589 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "085b00a79a914b93a414b8a4bad3575c"
dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
 from {username='slave'} at 127.0.0.1:58024
I20260709 12:21:43.921788   589 raft_consensus.cc:493] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:43.922171   589 raft_consensus.cc:3060] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:43.932600   589 raft_consensus.cc:515] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
W20260709 12:21:43.933883   843 log.cc:927] Time spent T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:21:43.945390   869 tablet.cc:1724] T 079f8a0314d1405c9b9baf09afbe5d71 P 8502a45e5e924eb2b44da52c43bc936f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:21:43.965790   853 log.cc:927] Time spent T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f: Append to log took a long time: real 0.087s	user 0.002s	sys 0.000s
I20260709 12:21:43.979180   874 tablet.cc:1724] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:21:43.982393   484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.1:42101, user_credentials={real_user=slave}} blocked reactor thread for 56951.6us
I20260709 12:21:43.990320   877 tablet.cc:1724] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:21:43.999641   858 log.cc:927] Time spent T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:21:43.994223   589 leader_election.cc:290] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 3 election: Requested vote from peers 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727), 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101)
W20260709 12:21:43.995256   846 log.cc:927] Time spent T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:21:44.004992   876 tablet.cc:1724] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.013268   517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085b00a79a914b93a414b8a4bad3575c" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
W20260709 12:21:44.013957   409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:38727, user_credentials={real_user=slave}} blocked reactor thread for 58971.2us
I20260709 12:21:44.019451   877 tablet.cc:1724] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.017542   441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085b00a79a914b93a414b8a4bad3575c" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:44.033079   517 raft_consensus.cc:3060] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:44.044755   879 tablet.cc:1724] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.033190   441 raft_consensus.cc:3055] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:44.048424   441 raft_consensus.cc:740] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 017c9ead48d24bd0bb44234d9a4d0722, State: Running, Role: LEADER
I20260709 12:21:44.050797   441 consensus_queue.cc:260] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:44.052274   441 raft_consensus.cc:3060] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:44.060112   516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a243589bc22d4e0092f4ab9d355c2710"
dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
mode: GRACEFUL
new_leader_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
 from {username='slave'} at 127.0.0.1:59580
I20260709 12:21:44.060922   516 raft_consensus.cc:606] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 2 LEADER]: Received request to transfer leadership to TS 762bba1a64cd462d95c59db0cb9e0dfa
I20260709 12:21:44.062134   517 raft_consensus.cc:2468] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 3.
I20260709 12:21:44.062397 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:21:44.063032 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:44.064577   558 leader_election.cc:304] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762bba1a64cd462d95c59db0cb9e0dfa, 8502a45e5e924eb2b44da52c43bc936f; no voters: 
I20260709 12:21:44.052423   869 tablet.cc:1724] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.094908   882 tablet.cc:1724] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.126590   887 tablet.cc:1724] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.133642   877 tablet.cc:1724] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.142261   885 tablet.cc:1724] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.138803   869 tablet.cc:1724] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.151801   883 tablet.cc:1724] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:21:44.164353   558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.191.2:38727, user_credentials={real_user=slave}} blocked reactor thread for 50394.3us
I20260709 12:21:44.134794   441 raft_consensus.cc:2468] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 3.
I20260709 12:21:44.141810   886 tablet.cc:1724] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.168392   881 tablet.cc:1724] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.169919   880 raft_consensus.cc:2804] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:44.170663   880 raft_consensus.cc:697] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [term 3 LEADER]: Becoming Leader. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Running, Role: LEADER
I20260709 12:21:44.171653   880 consensus_queue.cc:237] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:44.172616   887 tablet.cc:1724] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.175134   876 tablet.cc:1724] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.193567   879 tablet.cc:1724] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.198263   883 tablet.cc:1724] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.213485   876 tablet.cc:1724] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.225958   886 tablet.cc:1724] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.226112   874 tablet.cc:1724] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.243340   877 tablet.cc:1724] T b1a8ac187f184e98a21e0ac41628ca58 P 8502a45e5e924eb2b44da52c43bc936f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.246693   885 tablet.cc:1724] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.255504   881 tablet.cc:1724] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.257464   342 catalog_manager.cc:5697] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa reported cstate change: term changed from 2 to 3, leader changed from 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1) to 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3). New cstate: current_term: 3 leader_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:44.240666   879 tablet.cc:1724] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.282847   887 tablet.cc:1724] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:44.286031   864 raft_consensus.cc:993] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f: : Instructing follower 762bba1a64cd462d95c59db0cb9e0dfa to start an election
I20260709 12:21:44.287122   864 raft_consensus.cc:1081] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 2 LEADER]: Signalling peer 762bba1a64cd462d95c59db0cb9e0dfa to start an election
I20260709 12:21:44.289901   591 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a243589bc22d4e0092f4ab9d355c2710"
dest_uuid: "762bba1a64cd462d95c59db0cb9e0dfa"
 from {username='slave'} at 127.0.0.1:58032
I20260709 12:21:44.290499   591 raft_consensus.cc:493] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:44.290879   591 raft_consensus.cc:3060] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:44.292870   339 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b: soft_deleted_table [id=55d17925f4f44ef097ff625adf4bb77f] alter complete (version 1)
I20260709 12:21:44.297649   591 raft_consensus.cc:515] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:44.300819   591 leader_election.cc:290] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 3 election: Requested vote from peers 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101), 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727)
I20260709 12:21:44.301354   444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243589bc22d4e0092f4ab9d355c2710" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "017c9ead48d24bd0bb44234d9a4d0722"
I20260709 12:21:44.302049   444 raft_consensus.cc:3060] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:44.302186   519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243589bc22d4e0092f4ab9d355c2710" candidate_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8502a45e5e924eb2b44da52c43bc936f"
I20260709 12:21:44.302855   519 raft_consensus.cc:3055] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:44.303172   519 raft_consensus.cc:740] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8502a45e5e924eb2b44da52c43bc936f, State: Running, Role: LEADER
I20260709 12:21:44.304004   519 consensus_queue.cc:260] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:44.305294   519 raft_consensus.cc:3060] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:44.307631   444 raft_consensus.cc:2468] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 3.
I20260709 12:21:44.309046   558 leader_election.cc:304] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017c9ead48d24bd0bb44234d9a4d0722, 762bba1a64cd462d95c59db0cb9e0dfa; no voters: 
I20260709 12:21:44.309895   880 raft_consensus.cc:2804] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:44.310292   880 raft_consensus.cc:697] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 3 LEADER]: Becoming Leader. State: Replica: 762bba1a64cd462d95c59db0cb9e0dfa, State: Running, Role: LEADER
I20260709 12:21:44.311065   880 consensus_queue.cc:237] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } }
I20260709 12:21:44.312582   519 raft_consensus.cc:2468] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762bba1a64cd462d95c59db0cb9e0dfa in term 3.
I20260709 12:21:44.319392   342 catalog_manager.cc:5697] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa reported cstate change: term changed from 2 to 3, leader changed from 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2) to 762bba1a64cd462d95c59db0cb9e0dfa (127.20.191.3). New cstate: current_term: 3 leader_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762bba1a64cd462d95c59db0cb9e0dfa" member_type: VOTER last_known_addr { host: "127.20.191.3" port: 46421 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:44.738642   519 raft_consensus.cc:1275] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 3 FOLLOWER]: Refusing update from remote peer 762bba1a64cd462d95c59db0cb9e0dfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:44.739748   880 consensus_queue.cc:1048] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:44.745786   444 raft_consensus.cc:1275] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 3 FOLLOWER]: Refusing update from remote peer 762bba1a64cd462d95c59db0cb9e0dfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:44.747691   880 consensus_queue.cc:1048] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:44.752272   444 raft_consensus.cc:1275] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 3 FOLLOWER]: Refusing update from remote peer 762bba1a64cd462d95c59db0cb9e0dfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:44.756489   880 consensus_queue.cc:1048] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "017c9ead48d24bd0bb44234d9a4d0722" member_type: VOTER last_known_addr { host: "127.20.191.1" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:44.766780   519 raft_consensus.cc:1275] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 3 FOLLOWER]: Refusing update from remote peer 762bba1a64cd462d95c59db0cb9e0dfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:44.769160   892 consensus_queue.cc:1048] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8502a45e5e924eb2b44da52c43bc936f" member_type: VOTER last_known_addr { host: "127.20.191.2" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:45.064145 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:45.068992 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:45.069401 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:46.070303 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:46.075171 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:46.075594 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:47.076539 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:47.082365 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:47.082773 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:48.083952 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:48.089447 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:48.089962 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:49.091140 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:49.096149 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:49.096601 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:50.097620 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:50.102510 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:50.102954 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:51.104008 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:51.109321 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:51.109823 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:52.110808 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:52.115820 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:52.116325 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:53.117350 21244 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:53.122452 21244 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:53.122974 21244 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:54.185257 21244 tablet_server.cc:179] TabletServer@127.20.191.1:0 shutting down...
I20260709 12:21:54.230273 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:54.231081 21244 tablet_replica.cc:333] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722: stopping tablet replica
I20260709 12:21:54.231902 21244 raft_consensus.cc:2243] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.232604 21244 raft_consensus.cc:2272] T 3b77bfee2d5141a49a6ed739339d8be3 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.235944 21244 tablet_replica.cc:333] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722: stopping tablet replica
I20260709 12:21:54.237265 21244 raft_consensus.cc:2243] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:21:54.237851   484 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
I20260709 12:21:54.238679 21244 raft_consensus.cc:2272] T c115e7328403473a922fbc56401ba287 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.243326 21244 tablet_replica.cc:333] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722: stopping tablet replica
I20260709 12:21:54.244400 21244 raft_consensus.cc:2243] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.245175 21244 raft_consensus.cc:2272] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:54.246173   484 consensus_peers.cc:597] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f -> Peer 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101): Couldn't send request to peer 017c9ead48d24bd0bb44234d9a4d0722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:54.248067 21244 tablet_replica.cc:333] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722: stopping tablet replica
I20260709 12:21:54.248718 21244 raft_consensus.cc:2243] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.249300 21244 raft_consensus.cc:2272] T 580c7b8182f9471190387d62d32dea37 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.251670 21244 tablet_replica.cc:333] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722: stopping tablet replica
I20260709 12:21:54.252290 21244 raft_consensus.cc:2243] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:54.253356 21244 raft_consensus.cc:2272] T b1a8ac187f184e98a21e0ac41628ca58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.256518 21244 tablet_replica.cc:333] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722: stopping tablet replica
I20260709 12:21:54.257184 21244 raft_consensus.cc:2243] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.257789 21244 raft_consensus.cc:2272] T 06a50317ffb6474ea8c0342284306b5b P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.260421 21244 tablet_replica.cc:333] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722: stopping tablet replica
I20260709 12:21:54.261019 21244 raft_consensus.cc:2243] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.261587 21244 raft_consensus.cc:2272] T a4bf29215fdc4cf8928a8522e11d4168 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.264076 21244 tablet_replica.cc:333] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722: stopping tablet replica
I20260709 12:21:54.264681 21244 raft_consensus.cc:2243] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.265204 21244 raft_consensus.cc:2272] T e587d48344e3425aaef56b90052b5f58 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.267937 21244 tablet_replica.cc:333] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722: stopping tablet replica
I20260709 12:21:54.268565 21244 raft_consensus.cc:2243] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.269161 21244 raft_consensus.cc:2272] T dffa183e76384d118cb4e27fd83e1934 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.271908 21244 tablet_replica.cc:333] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722: stopping tablet replica
I20260709 12:21:54.272495 21244 raft_consensus.cc:2243] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:54.273362 21244 raft_consensus.cc:2272] T aa7f78b9a838497983700855b943c465 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.275897 21244 tablet_replica.cc:333] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722: stopping tablet replica
I20260709 12:21:54.276443 21244 raft_consensus.cc:2243] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:54.277347 21244 raft_consensus.cc:2272] T f4c8653139784a98bd178fb7ff97c8c1 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.279765 21244 tablet_replica.cc:333] T 535662e2eba6427ea18a3975a6d4afc8 P 017c9ead48d24bd0bb44234d9a4d0722: stopping tablet replica
I20260709 12:21:54.280309 21244 raft_consensus.cc:2243] T 535662e2eba6427ea18a3975a6d4afc8 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.280807 21244 raft_consensus.cc:2272] T 535662e2eba6427ea18a3975a6d4afc8 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.283141 21244 tablet_replica.cc:333] T 3c79b33073604287949695b0b8fbb1e9 P 017c9ead48d24bd0bb44234d9a4d0722: stopping tablet replica
I20260709 12:21:54.283803 21244 raft_consensus.cc:2243] T 3c79b33073604287949695b0b8fbb1e9 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.284401 21244 raft_consensus.cc:2272] T 3c79b33073604287949695b0b8fbb1e9 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.287319 21244 tablet_replica.cc:333] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722: stopping tablet replica
W20260709 12:21:54.287358   484 consensus_peers.cc:597] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f -> Peer 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101): Couldn't send request to peer 017c9ead48d24bd0bb44234d9a4d0722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:54.288024 21244 raft_consensus.cc:2243] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:54.289042 21244 raft_consensus.cc:2272] T 079f8a0314d1405c9b9baf09afbe5d71 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.291585 21244 tablet_replica.cc:333] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722: stopping tablet replica
I20260709 12:21:54.292346 21244 raft_consensus.cc:2243] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.293020 21244 raft_consensus.cc:2272] T 085b00a79a914b93a414b8a4bad3575c P 017c9ead48d24bd0bb44234d9a4d0722 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.296819 21244 tablet_replica.cc:333] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722: stopping tablet replica
I20260709 12:21:54.297730 21244 raft_consensus.cc:2243] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:21:54.298400   484 consensus_peers.cc:597] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f -> Peer 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101): Couldn't send request to peer 017c9ead48d24bd0bb44234d9a4d0722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:54.299237 21244 raft_consensus.cc:2272] T 7b786653ccc44d8dabf8d79978ed4399 P 017c9ead48d24bd0bb44234d9a4d0722 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:54.300812   558 consensus_peers.cc:597] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa -> Peer 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101): Couldn't send request to peer 017c9ead48d24bd0bb44234d9a4d0722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:54.302935   558 consensus_peers.cc:597] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa -> Peer 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101): Couldn't send request to peer 017c9ead48d24bd0bb44234d9a4d0722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:54.303467 21244 tablet_replica.cc:333] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722: stopping tablet replica
I20260709 12:21:54.304181 21244 raft_consensus.cc:2243] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.304725 21244 raft_consensus.cc:2272] T a243589bc22d4e0092f4ab9d355c2710 P 017c9ead48d24bd0bb44234d9a4d0722 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.307269 21244 tablet_replica.cc:333] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722: stopping tablet replica
I20260709 12:21:54.307977 21244 raft_consensus.cc:2243] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:54.308990 21244 raft_consensus.cc:2272] T 055394fe3a5e4910875669f67e8d8858 P 017c9ead48d24bd0bb44234d9a4d0722 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:54.322573   484 consensus_peers.cc:597] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f -> Peer 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101): Couldn't send request to peer 017c9ead48d24bd0bb44234d9a4d0722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:54.356308 21244 tablet_server.cc:196] TabletServer@127.20.191.1:0 shutdown complete.
W20260709 12:21:54.398635   484 consensus_peers.cc:597] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f -> Peer 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101): Couldn't send request to peer 017c9ead48d24bd0bb44234d9a4d0722. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42101: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:54.403239 21244 tablet_server.cc:179] TabletServer@127.20.191.2:0 shutting down...
I20260709 12:21:54.428804 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:54.429741 21244 tablet_replica.cc:333] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f: stopping tablet replica
I20260709 12:21:54.430722 21244 raft_consensus.cc:2243] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:54.431677 21244 raft_consensus.cc:2272] T 3b77bfee2d5141a49a6ed739339d8be3 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.434175 21244 tablet_replica.cc:333] T b1a8ac187f184e98a21e0ac41628ca58 P 8502a45e5e924eb2b44da52c43bc936f: stopping tablet replica
I20260709 12:21:54.434803 21244 raft_consensus.cc:2243] T b1a8ac187f184e98a21e0ac41628ca58 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.435420 21244 raft_consensus.cc:2272] T b1a8ac187f184e98a21e0ac41628ca58 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.437693 21244 tablet_replica.cc:333] T 079f8a0314d1405c9b9baf09afbe5d71 P 8502a45e5e924eb2b44da52c43bc936f: stopping tablet replica
I20260709 12:21:54.438295 21244 raft_consensus.cc:2243] T 079f8a0314d1405c9b9baf09afbe5d71 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.438762 21244 raft_consensus.cc:2272] T 079f8a0314d1405c9b9baf09afbe5d71 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.440934 21244 tablet_replica.cc:333] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f: stopping tablet replica
I20260709 12:21:54.441447 21244 raft_consensus.cc:2243] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:54.442306 21244 raft_consensus.cc:2272] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.444443 21244 tablet_replica.cc:333] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f: stopping tablet replica
I20260709 12:21:54.444952 21244 raft_consensus.cc:2243] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:54.445828 21244 raft_consensus.cc:2272] T 580c7b8182f9471190387d62d32dea37 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.447937 21244 tablet_replica.cc:333] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f: stopping tablet replica
I20260709 12:21:54.448515 21244 raft_consensus.cc:2243] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.448949 21244 raft_consensus.cc:2272] T a4bf29215fdc4cf8928a8522e11d4168 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.451102 21244 tablet_replica.cc:333] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f: stopping tablet replica
I20260709 12:21:54.451627 21244 raft_consensus.cc:2243] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:54.452415 21244 raft_consensus.cc:2272] T 06a50317ffb6474ea8c0342284306b5b P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.454536 21244 tablet_replica.cc:333] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f: stopping tablet replica
I20260709 12:21:54.455036 21244 raft_consensus.cc:2243] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:54.455840 21244 raft_consensus.cc:2272] T e587d48344e3425aaef56b90052b5f58 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.458760 21244 tablet_replica.cc:333] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f: stopping tablet replica
I20260709 12:21:54.459556 21244 raft_consensus.cc:2243] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:21:54.460427   558 consensus_peers.cc:597] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa -> Peer 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727): Couldn't send request to peer 8502a45e5e924eb2b44da52c43bc936f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:54.460717 21244 raft_consensus.cc:2272] T dffa183e76384d118cb4e27fd83e1934 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.463109 21244 tablet_replica.cc:333] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f: stopping tablet replica
I20260709 12:21:54.463693 21244 raft_consensus.cc:2243] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.464195 21244 raft_consensus.cc:2272] T c115e7328403473a922fbc56401ba287 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.466372 21244 tablet_replica.cc:333] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f: stopping tablet replica
I20260709 12:21:54.466950 21244 raft_consensus.cc:2243] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.467446 21244 raft_consensus.cc:2272] T aa7f78b9a838497983700855b943c465 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.469547 21244 tablet_replica.cc:333] T f4c8653139784a98bd178fb7ff97c8c1 P 8502a45e5e924eb2b44da52c43bc936f: stopping tablet replica
I20260709 12:21:54.470103 21244 raft_consensus.cc:2243] T f4c8653139784a98bd178fb7ff97c8c1 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.470557 21244 raft_consensus.cc:2272] T f4c8653139784a98bd178fb7ff97c8c1 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.473336 21244 tablet_replica.cc:333] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f: stopping tablet replica
I20260709 12:21:54.473944 21244 raft_consensus.cc:2243] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.474475 21244 raft_consensus.cc:2272] T 535662e2eba6427ea18a3975a6d4afc8 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:54.476605   558 consensus_peers.cc:597] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa -> Peer 017c9ead48d24bd0bb44234d9a4d0722 (127.20.191.1:42101): Couldn't send request to peer 017c9ead48d24bd0bb44234d9a4d0722. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.1:42101: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:54.477085 21244 tablet_replica.cc:333] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f: stopping tablet replica
I20260709 12:21:54.477661 21244 raft_consensus.cc:2243] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:54.478497 21244 raft_consensus.cc:2272] T 3c79b33073604287949695b0b8fbb1e9 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.480710 21244 tablet_replica.cc:333] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f: stopping tablet replica
I20260709 12:21:54.481228 21244 raft_consensus.cc:2243] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.481671 21244 raft_consensus.cc:2272] T 7b786653ccc44d8dabf8d79978ed4399 P 8502a45e5e924eb2b44da52c43bc936f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.483954 21244 tablet_replica.cc:333] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f: stopping tablet replica
I20260709 12:21:54.484468 21244 raft_consensus.cc:2243] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.484952 21244 raft_consensus.cc:2272] T 085b00a79a914b93a414b8a4bad3575c P 8502a45e5e924eb2b44da52c43bc936f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.487846 21244 tablet_replica.cc:333] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f: stopping tablet replica
I20260709 12:21:54.488452 21244 raft_consensus.cc:2243] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.489075 21244 raft_consensus.cc:2272] T a243589bc22d4e0092f4ab9d355c2710 P 8502a45e5e924eb2b44da52c43bc936f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:54.489101   558 consensus_peers.cc:597] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa -> Peer 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727): Couldn't send request to peer 8502a45e5e924eb2b44da52c43bc936f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:54.491259 21244 tablet_replica.cc:333] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f: stopping tablet replica
I20260709 12:21:54.491775 21244 raft_consensus.cc:2243] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.492235 21244 raft_consensus.cc:2272] T 055394fe3a5e4910875669f67e8d8858 P 8502a45e5e924eb2b44da52c43bc936f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.533492 21244 tablet_server.cc:196] TabletServer@127.20.191.2:0 shutdown complete.
W20260709 12:21:54.542541   558 consensus_peers.cc:597] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa -> Peer 8502a45e5e924eb2b44da52c43bc936f (127.20.191.2:38727): Couldn't send request to peer 8502a45e5e924eb2b44da52c43bc936f. Status: Network error: Client connection negotiation failed: client connection to 127.20.191.2:38727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:54.574486 21244 tablet_server.cc:179] TabletServer@127.20.191.3:0 shutting down...
I20260709 12:21:54.598112 21244 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:54.598863 21244 tablet_replica.cc:333] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa: stopping tablet replica
I20260709 12:21:54.599680 21244 raft_consensus.cc:2243] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.600271 21244 raft_consensus.cc:2272] T 580c7b8182f9471190387d62d32dea37 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.602648 21244 tablet_replica.cc:333] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa: stopping tablet replica
I20260709 12:21:54.603235 21244 raft_consensus.cc:2243] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:54.604081 21244 raft_consensus.cc:2272] T a4bf29215fdc4cf8928a8522e11d4168 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.606149 21244 tablet_replica.cc:333] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa: stopping tablet replica
I20260709 12:21:54.606698 21244 raft_consensus.cc:2243] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.607158 21244 raft_consensus.cc:2272] T b1a8ac187f184e98a21e0ac41628ca58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.609283 21244 tablet_replica.cc:333] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa: stopping tablet replica
I20260709 12:21:54.610030 21244 raft_consensus.cc:2243] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.610630 21244 raft_consensus.cc:2272] T 3b77bfee2d5141a49a6ed739339d8be3 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.612751 21244 tablet_replica.cc:333] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa: stopping tablet replica
I20260709 12:21:54.613372 21244 raft_consensus.cc:2243] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.613907 21244 raft_consensus.cc:2272] T 06a50317ffb6474ea8c0342284306b5b P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.616210 21244 tablet_replica.cc:333] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa: stopping tablet replica
I20260709 12:21:54.616802 21244 raft_consensus.cc:2243] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.617304 21244 raft_consensus.cc:2272] T 12ac6d65a2cc486dab9d55cf339c9dd7 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.619508 21244 tablet_replica.cc:333] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa: stopping tablet replica
I20260709 12:21:54.620055 21244 raft_consensus.cc:2243] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.620543 21244 raft_consensus.cc:2272] T aa7f78b9a838497983700855b943c465 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.622705 21244 tablet_replica.cc:333] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa: stopping tablet replica
I20260709 12:21:54.623294 21244 raft_consensus.cc:2243] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.623816 21244 raft_consensus.cc:2272] T c115e7328403473a922fbc56401ba287 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.626168 21244 tablet_replica.cc:333] T f4c8653139784a98bd178fb7ff97c8c1 P 762bba1a64cd462d95c59db0cb9e0dfa: stopping tablet replica
I20260709 12:21:54.626734 21244 raft_consensus.cc:2243] T f4c8653139784a98bd178fb7ff97c8c1 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.627173 21244 raft_consensus.cc:2272] T f4c8653139784a98bd178fb7ff97c8c1 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.629396 21244 tablet_replica.cc:333] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa: stopping tablet replica
I20260709 12:21:54.629997 21244 raft_consensus.cc:2243] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:54.630892 21244 raft_consensus.cc:2272] T 535662e2eba6427ea18a3975a6d4afc8 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.633137 21244 tablet_replica.cc:333] T 3c79b33073604287949695b0b8fbb1e9 P 762bba1a64cd462d95c59db0cb9e0dfa: stopping tablet replica
I20260709 12:21:54.633739 21244 raft_consensus.cc:2243] T 3c79b33073604287949695b0b8fbb1e9 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.634227 21244 raft_consensus.cc:2272] T 3c79b33073604287949695b0b8fbb1e9 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.636603 21244 tablet_replica.cc:333] T dffa183e76384d118cb4e27fd83e1934 P 762bba1a64cd462d95c59db0cb9e0dfa: stopping tablet replica
I20260709 12:21:54.637197 21244 raft_consensus.cc:2243] T dffa183e76384d118cb4e27fd83e1934 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.637668 21244 raft_consensus.cc:2272] T dffa183e76384d118cb4e27fd83e1934 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.639895 21244 tablet_replica.cc:333] T e587d48344e3425aaef56b90052b5f58 P 762bba1a64cd462d95c59db0cb9e0dfa: stopping tablet replica
I20260709 12:21:54.640465 21244 raft_consensus.cc:2243] T e587d48344e3425aaef56b90052b5f58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.640973 21244 raft_consensus.cc:2272] T e587d48344e3425aaef56b90052b5f58 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.643200 21244 tablet_replica.cc:333] T 055394fe3a5e4910875669f67e8d8858 P 762bba1a64cd462d95c59db0cb9e0dfa: stopping tablet replica
I20260709 12:21:54.643728 21244 raft_consensus.cc:2243] T 055394fe3a5e4910875669f67e8d8858 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.644186 21244 raft_consensus.cc:2272] T 055394fe3a5e4910875669f67e8d8858 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.646361 21244 tablet_replica.cc:333] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa: stopping tablet replica
I20260709 12:21:54.646876 21244 raft_consensus.cc:2243] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:54.647712 21244 raft_consensus.cc:2272] T a243589bc22d4e0092f4ab9d355c2710 P 762bba1a64cd462d95c59db0cb9e0dfa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.649912 21244 tablet_replica.cc:333] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa: stopping tablet replica
I20260709 12:21:54.650450 21244 raft_consensus.cc:2243] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.650950 21244 raft_consensus.cc:2272] T 079f8a0314d1405c9b9baf09afbe5d71 P 762bba1a64cd462d95c59db0cb9e0dfa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.653040 21244 tablet_replica.cc:333] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa: stopping tablet replica
I20260709 12:21:54.653506 21244 raft_consensus.cc:2243] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:54.654438 21244 raft_consensus.cc:2272] T 085b00a79a914b93a414b8a4bad3575c P 762bba1a64cd462d95c59db0cb9e0dfa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.656553 21244 tablet_replica.cc:333] T 7b786653ccc44d8dabf8d79978ed4399 P 762bba1a64cd462d95c59db0cb9e0dfa: stopping tablet replica
I20260709 12:21:54.657048 21244 raft_consensus.cc:2243] T 7b786653ccc44d8dabf8d79978ed4399 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:54.657470 21244 raft_consensus.cc:2272] T 7b786653ccc44d8dabf8d79978ed4399 P 762bba1a64cd462d95c59db0cb9e0dfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.699561 21244 tablet_server.cc:196] TabletServer@127.20.191.3:0 shutdown complete.
I20260709 12:21:54.735992 21244 master.cc:562] Master@127.20.191.62:33483 shutting down...
I20260709 12:21:54.755753 21244 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:54.756359 21244 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:54.756678 21244 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3188b17973f34f288ab39a21af7da74b: stopping tablet replica
I20260709 12:21:54.776750 21244 master.cc:584] Master@127.20.191.62:33483 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20425 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (41801 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (389793 ms total)
[  PASSED  ] 8 tests.
I20260709 12:21:54.831498 21244 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2278 messages since previous log ~32 seconds ago
I20260709 12:21:54.831698 21244 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2278 messages since previous log ~32 seconds ago
I20260709 12:21:54.831840 21244 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2273 messages since previous log ~32 seconds ago
I20260709 12:21:54.832039 21244 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~50 seconds ago
I20260709 12:21:54.832190 21244 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~50 seconds ago
I20260709 12:21:54.832356 21244 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~213 seconds ago
I20260709 12:21:54.832508 21244 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 7 messages since previous log ~298 seconds ago
I20260709 12:21:54.832651 21244 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 4 messages since previous log ~297 seconds ago
I20260709 12:21:54.832829 21244 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 12:21:54.833086 21244 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~19 seconds ago
